2024-09-19T05:47:31.695 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T05:47:31.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:47:31.822 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/fsx}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911705' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwzi2h6ZwyVz3Xoz996NZjQrARS/QQ0LvGpOidzKSV+cWkuaW02cllIrFrTbp6KTPjaW5AjVdJZqU1KXIuiaLw= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNdWxQceV9KfQK10QoZGqXrK0Qq+9ADqPkZ/igJu0fg5pjJIN4g6oKTkJ7pnRk8sPMOJjH7srvCWCXhx6/uaOI= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMHmU2wAXgKmoT0FvTs7wH9wXJWuyCKZ73v6UZbuDSD26yMrTpT4sMT6TfIXGunwUt2+B8U9tfqKa69uj7oBFU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T05:47:31.822 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T05:47:31.823 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T05:47:31.823 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T05:47:31.825 INFO:teuthology.task.internal:Checking packages... 2024-09-19T05:47:31.851 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T05:47:31.851 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T05:47:31.851 INFO:teuthology.packaging:ref: None 2024-09-19T05:47:31.851 INFO:teuthology.packaging:tag: None 2024-09-19T05:47:31.851 INFO:teuthology.packaging:branch: squid 2024-09-19T05:47:31.851 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:47:31.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T05:47:32.069 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T05:47:32.071 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T05:47:32.077 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T05:47:32.077 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T05:47:32.105 INFO:teuthology.task.internal:Saving configuration 2024-09-19T05:47:32.128 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T05:47:32.133 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T05:47:32.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:42:09.300511', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwzi2h6ZwyVz3Xoz996NZjQrARS/QQ0LvGpOidzKSV+cWkuaW02cllIrFrTbp6KTPjaW5AjVdJZqU1KXIuiaLw='} 2024-09-19T05:47:32.178 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:42:09.303935', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNdWxQceV9KfQK10QoZGqXrK0Qq+9ADqPkZ/igJu0fg5pjJIN4g6oKTkJ7pnRk8sPMOJjH7srvCWCXhx6/uaOI='} 2024-09-19T05:47:32.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:42:09.302443', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMHmU2wAXgKmoT0FvTs7wH9wXJWuyCKZ73v6UZbuDSD26yMrTpT4sMT6TfIXGunwUt2+B8U9tfqKa69uj7oBFU='} 2024-09-19T05:47:32.199 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T05:47:32.204 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T05:47:32.205 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T05:47:32.205 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T05:47:32.205 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T05:47:32.295 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f670b75f520>, signals=[15]) 2024-09-19T05:47:32.295 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T05:47:32.301 INFO:teuthology.task.internal:Opening connections... 2024-09-19T05:47:32.301 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:47:32.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:47:32.384 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T05:47:32.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:47:32.459 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:47:32.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:47:32.540 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T05:47:32.547 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-19T05:47:32.566 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-19T05:47:32.566 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-19T05:47:32.625 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-09-19T05:47:32.625 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-09-19T05:47:32.625 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-09-19T05:47:32.625 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:47:32.625 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-09-19T05:47:32.626 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:47:32.626 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:47:32.626 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-09-19T05:47:32.626 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:47:32.626 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:47:32.626 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:47:32.626 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:47:32.626 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:47:32.626 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:47:32.627 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-19T05:47:32.651 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-09-19T05:47:32.670 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-09-19T05:47:32.670 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-09-19T05:47:32.728 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-09-19T05:47:32.728 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-09-19T05:47:32.728 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-09-19T05:47:32.728 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:47:32.728 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-09-19T05:47:32.729 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:47:32.729 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:47:32.729 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-09-19T05:47:32.729 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:47:32.729 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:47:32.729 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:47:32.729 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:47:32.729 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:47:32.729 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:47:32.729 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-09-19T05:47:32.747 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-09-19T05:47:32.765 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-09-19T05:47:32.766 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-09-19T05:47:32.824 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-09-19T05:47:32.824 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-09-19T05:47:32.824 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-09-19T05:47:32.824 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:47:32.824 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-09-19T05:47:32.825 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:47:32.825 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:47:32.825 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-09-19T05:47:32.825 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:47:32.825 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:47:32.825 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:47:32.825 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:47:32.825 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:47:32.825 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:47:32.825 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-09-19T05:47:32.847 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T05:47:32.861 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T05:47:32.866 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T05:47:32.866 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:47:32.869 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:47:32.871 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:47:32.888 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T05:47:32.894 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T05:47:32.894 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:47:32.927 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:47:32.929 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:47:33.032 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T05:47:33.102 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T05:47:33.116 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T05:47:33.116 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T05:47:33.116 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:47:33.117 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:47:33.117 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:47:33.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:47:33.135 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-09-19T05:47:33.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:47:33.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:47:33.137 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-09-19T05:47:33.137 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-19T05:47:33.193 INFO:teuthology.orchestra.run.smithi169.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:47:33.193 INFO:teuthology.task.kernel:Running kernel on smithi169: 5.14.0-503.el9.x86_64 2024-09-19T05:47:33.193 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum install -y kernel 2024-09-19T05:47:33.194 INFO:teuthology.orchestra.run.smithi174.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:47:33.194 INFO:teuthology.task.kernel:Running kernel on smithi174: 5.14.0-503.el9.x86_64 2024-09-19T05:47:33.194 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum install -y kernel 2024-09-19T05:47:33.195 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:47:33.196 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-503.el9.x86_64 2024-09-19T05:47:33.196 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-09-19T05:47:35.363 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-19T05:47:36.656 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.3 MB 00:01 2024-09-19T05:47:36.728 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.3 MB 00:01 2024-09-19T05:47:37.539 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-19T05:47:38.429 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-19T05:47:41.839 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T05:47:43.540 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-19T05:47:43.929 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-19T05:47:44.727 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-19T05:47:45.023 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-19T05:47:45.464 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-19T05:47:46.359 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-19T05:47:49.349 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-19T05:47:50.166 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T05:47:50.825 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-19T05:47:51.731 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-19T05:47:51.996 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T05:47:52.081 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:47:52.081 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:47:52.178 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-09-19T05:47:52.189 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-09-19T05:47:52.189 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-09-19T05:47:52.189 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-09-19T05:47:52.189 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-09-19T05:47:52.189 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:47:52.189 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-09-19T05:47:52.190 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:47:52.190 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:47:52.190 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:47:52.190 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:47:52.190 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-09-19T05:47:52.190 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-09-19T05:47:52.190 INFO:teuthology.orchestra.run.smithi174.stdout:Install 4 Packages 2024-09-19T05:47:52.190 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:47:52.191 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 79 M 2024-09-19T05:47:52.191 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 126 M 2024-09-19T05:47:52.191 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-09-19T05:47:52.609 INFO:teuthology.orchestra.run.smithi174.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 125 kB/s | 36 kB 00:00 2024-09-19T05:47:53.588 INFO:teuthology.orchestra.run.smithi169.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:47:53.588 INFO:teuthology.orchestra.run.smithi169.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:47:53.678 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-19T05:47:53.683 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-09-19T05:47:53.683 INFO:teuthology.orchestra.run.smithi169.stdout: Package Architecture Version Repository Size 2024-09-19T05:47:53.683 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-09-19T05:47:53.683 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-09-19T05:47:53.683 INFO:teuthology.orchestra.run.smithi169.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:47:53.683 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-09-19T05:47:53.683 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:47:53.683 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:47:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:47:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:47:53.684 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-09-19T05:47:53.684 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-09-19T05:47:53.684 INFO:teuthology.orchestra.run.smithi169.stdout:Install 4 Packages 2024-09-19T05:47:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:47:53.684 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 79 M 2024-09-19T05:47:53.685 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 126 M 2024-09-19T05:47:53.685 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-09-19T05:47:53.916 INFO:teuthology.orchestra.run.smithi169.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 310 kB/s | 36 kB 00:00 2024-09-19T05:47:56.700 INFO:teuthology.orchestra.run.smithi169.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.4 MB/s | 16 MB 00:02 2024-09-19T05:47:57.368 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T05:47:59.283 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:47:59.283 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:47:59.333 INFO:teuthology.orchestra.run.smithi169.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.3 MB/s | 29 MB 00:05 2024-09-19T05:47:59.365 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-19T05:47:59.377 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-19T05:47:59.378 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-19T05:47:59.379 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-09-19T05:47:59.379 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:47:59.379 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 79 M 2024-09-19T05:47:59.379 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 126 M 2024-09-19T05:47:59.379 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-19T05:47:59.878 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 208 kB/s | 36 kB 00:00 2024-09-19T05:48:01.008 INFO:teuthology.orchestra.run.smithi169.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 4.8 MB/s | 35 MB 00:07 2024-09-19T05:48:01.008 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:48:01.008 INFO:teuthology.orchestra.run.smithi169.stdout:Total 11 MB/s | 79 MB 00:07 2024-09-19T05:48:01.688 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-09-19T05:48:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-09-19T05:48:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-09-19T05:48:02.078 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-19T05:48:02.678 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.3 MB/s | 16 MB 00:02 2024-09-19T05:48:03.060 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-09-19T05:48:03.060 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-09-19T05:48:03.162 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 8.7 MB/s | 29 MB 00:03 2024-09-19T05:48:03.162 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:48:03.163 INFO:teuthology.orchestra.run.smithi103.stdout:Total 21 MB/s | 79 MB 00:03 2024-09-19T05:48:03.283 INFO:teuthology.orchestra.run.smithi174.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 1.4 MB/s | 16 MB 00:10 2024-09-19T05:48:03.848 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-19T05:48:04.227 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-19T05:48:04.228 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-19T05:48:05.170 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-19T05:48:05.171 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-19T05:48:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-09-19T05:48:06.208 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:48:06.294 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:48:07.613 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-19T05:48:08.257 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:48:08.340 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:48:08.416 INFO:teuthology.orchestra.run.smithi174.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-19T05:48:09.064 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:48:09.189 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:48:11.108 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:48:11.242 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:48:14.039 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:48:14.140 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:16.091 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:48:16.209 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:18.965 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:21.056 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:23.790 INFO:teuthology.orchestra.run.smithi174.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 939 kB/s | 29 MB 00:31 2024-09-19T05:48:23.790 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:48:23.790 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.5 MB/s | 79 MB 00:31 2024-09-19T05:48:24.482 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-09-19T05:48:24.830 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-09-19T05:48:24.830 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-09-19T05:48:25.789 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-09-19T05:48:25.789 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-09-19T05:48:28.217 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-09-19T05:48:29.076 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:48:29.166 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:48:31.916 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:48:32.053 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:48:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:48:36.966 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:41.808 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:57.325 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:57.738 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:57.738 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:48:57.739 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:48:57.739 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:48:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:48:58.626 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-09-19T05:48:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:48:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:48:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:48:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:48:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:48:58.626 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-19T05:48:58.997 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:48:59.081 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:48:59.083 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:48:59.083 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:48:59.083 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:48:59.083 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:48:59.083 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T05:48:59.083 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:48:59.083 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:48:59.144 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:48:59.144 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:48:59.144 DEBUG:teuthology.orchestra.run.smithi169:> sudo rpm -qi grub2-tools 2024-09-19T05:48:59.182 INFO:teuthology.orchestra.run.smithi169.stdout:Name : grub2-tools 2024-09-19T05:48:59.182 INFO:teuthology.orchestra.run.smithi169.stdout:Epoch : 1 2024-09-19T05:48:59.182 INFO:teuthology.orchestra.run.smithi169.stdout:Version : 2.06 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Release : 82.el9 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: x86_64 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Group : Unspecified 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Size : 8274670 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:License : GPLv3+ 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Packager : builder@centos.org 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:Vendor : CentOS 2024-09-19T05:48:59.183 INFO:teuthology.orchestra.run.smithi169.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:48:59.184 INFO:teuthology.orchestra.run.smithi169.stdout:Summary : Support tools for GRUB. 2024-09-19T05:48:59.184 INFO:teuthology.orchestra.run.smithi169.stdout:Description : 2024-09-19T05:48:59.184 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:48:59.184 INFO:teuthology.orchestra.run.smithi169.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:48:59.184 INFO:teuthology.orchestra.run.smithi169.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:48:59.184 INFO:teuthology.orchestra.run.smithi169.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:48:59.184 INFO:teuthology.orchestra.run.smithi169.stdout:hardware devices. 2024-09-19T05:48:59.184 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:48:59.184 INFO:teuthology.orchestra.run.smithi169.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:48:59.185 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:48:59.185 INFO:teuthology.task.kernel:Updating grub on smithi169 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:48:59.185 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:48:59.525 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:59.565 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:59.835 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2024-09-19T05:48:59.917 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:48:59.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:48:59.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:48:59.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:49:00.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:49:00.782 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:49:00.782 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-19T05:49:00.782 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:49:00.782 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:49:00.782 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:49:00.782 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:49:00.782 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:49:00.782 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-19T05:49:01.102 INFO:teuthology.orchestra.run.smithi169.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:49:01.115 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:49:01.126 INFO:teuthology.orchestra.run.smithi169.stderr:done 2024-09-19T05:49:01.128 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-09-19T05:49:01.144 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.lmGcutGOaj 2024-09-19T05:49:01.144 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lmGcutGOaj 2024-09-19T05:49:01.211 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.lmGcutGOaj 2024-09-19T05:49:01.252 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:49:01.253 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:49:01.253 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:49:01.253 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:49:01.253 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:49:01.254 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T05:49:01.254 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:49:01.254 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:49:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:49:01.313 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:49:01.314 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-09-19T05:49:01.352 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-09-19T05:49:01.352 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-09-19T05:49:01.352 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-09-19T05:49:01.352 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 82.el9 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8274670 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-09-19T05:49:01.353 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:49:01.354 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-09-19T05:49:01.354 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-09-19T05:49:01.354 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:49:01.354 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:49:01.354 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:49:01.354 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:49:01.354 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-09-19T05:49:01.354 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:49:01.354 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:49:01.355 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:49:01.355 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:49:01.355 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:49:01.357 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.lmGcutGOaj is 6KB 2024-09-19T05:49:01.405 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.lmGcutGOaj 2024-09-19T05:49:01.420 DEBUG:teuthology.orchestra.run.smithi169:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:49:01.490 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:49:01.490 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:49:01.490 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:49:01.490 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:49:01.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:49:01.642 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2024-09-19T05:49:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-19T05:49:03.275 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:49:03.310 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-19T05:49:03.312 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-19T05:49:03.327 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.8dBrrTNKBu 2024-09-19T05:49:03.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8dBrrTNKBu 2024-09-19T05:49:03.395 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.8dBrrTNKBu 2024-09-19T05:49:03.531 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.8dBrrTNKBu is 6KB 2024-09-19T05:49:03.579 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.8dBrrTNKBu 2024-09-19T05:49:03.594 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:49:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:49:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:49:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:49:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:49:03.659 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:49:03.802 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-09-19T05:49:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:49:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:49:20.429 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:49:20.429 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:49:20.429 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:49:20.429 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:49:21.274 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:49:21.274 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:49:21.274 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-09-19T05:49:21.274 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:49:21.274 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:49:21.275 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:49:21.275 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:49:21.275 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:49:21.275 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-09-19T05:49:21.637 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:49:21.728 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:49:21.728 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:49:21.728 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:49:21.729 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:49:21.729 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:49:21.729 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-19T05:49:21.729 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:49:21.729 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:49:21.787 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:49:21.788 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:49:21.789 DEBUG:teuthology.orchestra.run.smithi174:> sudo rpm -qi grub2-tools 2024-09-19T05:49:21.820 INFO:teuthology.orchestra.run.smithi174.stdout:Name : grub2-tools 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:Epoch : 1 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:Version : 2.06 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:Release : 82.el9 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: x86_64 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:Group : Unspecified 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:Size : 8274670 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:License : GPLv3+ 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:49:21.821 INFO:teuthology.orchestra.run.smithi174.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:Packager : builder@centos.org 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:Vendor : CentOS 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:Summary : Support tools for GRUB. 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:Description : 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:hardware devices. 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:49:21.822 INFO:teuthology.orchestra.run.smithi174.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:49:21.823 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:49:21.823 INFO:teuthology.task.kernel:Updating grub on smithi174 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:49:21.824 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:49:22.476 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2024-09-19T05:49:23.786 INFO:teuthology.orchestra.run.smithi174.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:49:23.814 INFO:teuthology.orchestra.run.smithi174.stderr:done 2024-09-19T05:49:23.817 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-09-19T05:49:23.832 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.857RNXs0Vt 2024-09-19T05:49:23.832 DEBUG:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.857RNXs0Vt 2024-09-19T05:49:23.904 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.857RNXs0Vt 2024-09-19T05:49:24.045 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.857RNXs0Vt is 6KB 2024-09-19T05:49:24.093 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.857RNXs0Vt 2024-09-19T05:49:24.108 DEBUG:teuthology.orchestra.run.smithi174:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:49:24.175 INFO:teuthology.orchestra.run.smithi174.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:49:24.175 INFO:teuthology.orchestra.run.smithi174.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:49:24.175 INFO:teuthology.orchestra.run.smithi174.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:49:24.176 INFO:teuthology.orchestra.run.smithi174.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:49:24.177 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:49:24.339 DEBUG:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2024-09-19T05:49:31.649 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T05:49:31.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-19T05:49:31.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:49:33.807 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T05:49:33.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:49:33.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:49:52.317 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-19T05:49:54.344 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-19T05:49:54.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:49:54.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:50:01.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:50:01.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:50:04.385 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-19T05:50:06.145 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-09-19T05:50:12.797 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-09-19T05:50:15.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-19T05:50:15.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:50:16.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:50:16.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:50:19.457 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-19T05:50:21.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:50:21.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:50:24.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-09-19T05:50:34.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:50:34.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:50:36.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:50:36.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:50:47.101 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-19T05:50:47.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-19T05:50:47.422 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:50:47.422 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-09-19T05:50:47.437 INFO:teuthology.orchestra.run.smithi169.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:50:47.437 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:50:47.437 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:50:47.437 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:50:48.438 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T05:50:48.438 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:50:48.557 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-09-19T05:50:48.594 DEBUG:teuthology.parallel:result is None 2024-09-19T05:50:55.293 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-09-19T05:51:06.379 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-19T05:51:06.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:51:06.695 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:51:06.695 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-19T05:51:06.711 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:51:06.711 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:51:06.711 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:51:06.712 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:51:07.712 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T05:51:07.713 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:51:07.779 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-09-19T05:51:07.800 DEBUG:teuthology.parallel:result is None 2024-09-19T05:51:10.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:51:10.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:51:10.689 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-09-19T05:51:11.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:51:11.257 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:51:11.257 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-09-19T05:51:11.273 INFO:teuthology.orchestra.run.smithi174.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:51:11.274 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:51:11.274 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:51:11.274 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:51:12.275 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-19T05:51:12.275 DEBUG:teuthology.orchestra.run.smithi174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:51:12.343 INFO:teuthology.orchestra.run.smithi174.stdout:ttyS1 2024-09-19T05:51:12.364 DEBUG:teuthology.parallel:result is None 2024-09-19T05:51:12.365 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T05:51:12.371 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T05:51:12.372 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:51:12.374 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:51:12.378 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:51:12.394 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T05:51:12.401 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T05:51:12.406 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T05:51:12.407 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:51:12.434 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:51:12.437 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:51:12.542 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T05:51:12.549 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T05:51:12.549 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:51:12.552 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:51:12.554 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:51:12.581 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:51:12.583 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:51:12.592 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:51:12.595 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:51:12.595 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:51:12.605 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:51:12.606 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T05:51:12.613 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T05:51:12.613 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:51:12.636 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:51:12.640 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:51:12.671 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T05:51:12.680 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T05:51:12.681 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:51:12.704 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:51:12.707 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:51:12.727 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:51:12.803 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:51:12.849 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:51:12.933 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:51:12.973 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:51:12.974 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:51:13.038 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:51:13.084 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:51:13.135 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:51:13.219 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:51:13.263 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:51:13.263 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:51:13.330 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:51:13.371 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:51:13.419 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:51:13.501 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:51:13.543 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:51:13.543 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:51:13.608 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-19T05:51:13.610 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-09-19T05:51:13.613 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-09-19T05:51:13.652 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:51:13.655 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:51:13.694 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:51:14.201 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T05:51:14.209 INFO:teuthology.task.internal:Starting timer... 2024-09-19T05:51:14.209 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T05:51:14.224 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T05:51:14.233 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T05:51:14.233 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-09-19T05:51:14.280 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-09-19T05:51:14.282 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-09-19T05:51:14.339 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-09-19T05:51:14.341 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-09-19T05:51:14.390 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-09-19T05:51:14.391 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T05:51:14.392 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-09-19T05:51:14.431 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-09-19T05:51:14.432 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-09-19T05:51:14.462 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-09-19T05:51:14.462 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-09-19T05:51:14.484 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-09-19T05:51:14.484 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2024-09-19T05:51:14.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:51:14.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:51:14.514 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:51:14.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:51:14.543 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:51:14.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:51:14.568 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T05:51:14.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:51:14.607 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:51:14.651 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:51:14.685 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T05:51:14.695 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T05:51:14.707 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T05:51:14.708 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi169.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T05:55:02.954 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-09-19T05:55:02.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:55:02.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:55:03.034 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-19T05:55:03.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:55:03.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-19T05:55:03.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:55:03.192 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-19T05:55:03.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-19T05:55:03.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:55:03.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:55:03.353 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-09-19T05:55:03.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:55:03.437 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T05:55:03.450 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T05:55:03.450 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:55:03.451 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:55:03.453 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:55:03.453 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:55:03.456 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:55:03.456 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:55:03.480 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:55:03.485 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:55:03.495 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:55:03.500 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:55:03.506 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:55:03.519 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-09-19T05:55:03.520 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:55:03.525 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-09-19T05:55:03.530 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-09-19T05:55:03.536 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-09-19T05:55:03.544 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:55:03.545 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-09-19T05:55:03.550 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:55:03.556 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-09-19T05:55:03.558 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:55:03.565 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:55:03.570 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:55:03.584 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:55:03.619 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:55:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:55:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-19T05:55:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.623 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.623 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.623 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:55:03.626 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:55:03.626 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-19T05:55:03.626 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.626 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.626 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.627 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.640 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:55:03.643 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:55:03.644 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-09-19T05:55:03.644 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.644 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.644 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.644 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:55:03.645 INFO:teuthology.run_tasks:Running task install... 2024-09-19T05:55:03.653 DEBUG:teuthology.task.install:project ceph 2024-09-19T05:55:03.653 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T05:55:03.653 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T05:55:03.653 INFO:teuthology.task.install:Using flavor: default 2024-09-19T05:55:03.658 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T05:55:03.658 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T05:55:03.659 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:55:03.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:55:03.662 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:55:03.662 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:55:03.663 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:55:03.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:55:03.812 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:55:03.812 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:55:03.816 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:55:03.816 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:55:03.828 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:55:03.829 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:55:03.923 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:55:03.923 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:55:03.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:55:03.930 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:55:03.930 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:55:03.930 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:55:03.937 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:55:03.937 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:55:03.937 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:55:03.950 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:55:03.950 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:55:03.956 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:55:03.957 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:55:03.963 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:55:03.963 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:55:04.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:55:04.022 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:55:04.029 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:55:04.091 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:55:04.097 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:55:04.104 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:55:04.155 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-09-19T05:55:04.156 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-09-19T05:55:04.166 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-09-19T05:55:04.167 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-09-19T05:55:04.168 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-09-19T05:55:04.170 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-09-19T05:55:04.392 INFO:teuthology.orchestra.run.smithi174.stdout:45 files removed 2024-09-19T05:55:04.396 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-09-19T05:55:04.419 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:55:04.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:55:04.434 INFO:teuthology.orchestra.run.smithi169.stdout:45 files removed 2024-09-19T05:55:04.461 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:55:04.970 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-19T05:55:04.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-19T05:55:05.011 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-19T05:55:05.254 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T05:55:05.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T05:55:05.287 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-19T05:55:05.529 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T05:55:05.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T05:55:05.563 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T05:55:06.359 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-19T05:55:07.254 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.3 MB 00:01 2024-09-19T05:55:07.338 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-19T05:55:09.064 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-19T05:55:11.985 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-19T05:55:13.072 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-19T05:55:13.239 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-19T05:55:15.015 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-19T05:55:15.969 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T05:55:16.619 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.5 MB 00:00 2024-09-19T05:55:17.498 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-19T05:55:18.129 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-19T05:55:19.065 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-19T05:55:19.391 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-19T05:55:19.944 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T05:55:21.375 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T05:55:23.543 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:55:23.544 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:55:23.555 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:55:23.556 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:55:23.556 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:55:23.557 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:55:23.559 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:55:23.561 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:55:23.562 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:55:23.624 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-09-19T05:55:23.644 INFO:teuthology.orchestra.run.smithi174.stdout:====================================================================================== 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout:====================================================================================== 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:55:23.645 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:55:23.646 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:55:23.647 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:55:23.649 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:55:23.650 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:55:23.651 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:55:23.652 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:55:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:55:23.654 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:55:23.655 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:55:23.656 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:55:23.657 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:55:23.658 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2024-09-19T05:55:23.658 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:55:23.658 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:55:23.658 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-09-19T05:55:23.658 INFO:teuthology.orchestra.run.smithi174.stdout:====================================================================================== 2024-09-19T05:55:23.658 INFO:teuthology.orchestra.run.smithi174.stdout:Install 148 Packages 2024-09-19T05:55:23.658 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 8 Packages 2024-09-19T05:55:23.658 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:55:23.659 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 226 M 2024-09-19T05:55:23.659 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-09-19T05:55:24.518 INFO:teuthology.orchestra.run.smithi174.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 45 kB/s | 6.6 kB 00:00 2024-09-19T05:55:24.814 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-09-19T05:55:24.835 INFO:teuthology.orchestra.run.smithi174.stdout:(2/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T05:55:24.860 INFO:teuthology.orchestra.run.smithi174.stdout:(3/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.6 MB/s | 896 kB 00:00 2024-09-19T05:55:24.894 INFO:teuthology.orchestra.run.smithi174.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 2.4 MB/s | 145 kB 00:00 2024-09-19T05:55:25.002 INFO:teuthology.orchestra.run.smithi174.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 1.5 MB 00:00 2024-09-19T05:55:25.266 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T05:55:25.269 INFO:teuthology.orchestra.run.smithi174.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 5.8 MB/s | 2.4 MB 00:00 2024-09-19T05:55:25.336 INFO:teuthology.orchestra.run.smithi174.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-19T05:55:25.545 INFO:teuthology.orchestra.run.smithi174.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T05:55:25.595 INFO:teuthology.orchestra.run.smithi174.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 507 kB/s | 25 kB 00:00 2024-09-19T05:55:25.870 INFO:teuthology.orchestra.run.smithi174.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 20 MB/s | 11 MB 00:00 2024-09-19T05:55:25.921 INFO:teuthology.orchestra.run.smithi174.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T05:55:25.988 INFO:teuthology.orchestra.run.smithi174.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 406 kB/s | 27 kB 00:00 2024-09-19T05:55:26.054 INFO:teuthology.orchestra.run.smithi174.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 477 kB/s | 32 kB 00:00 2024-09-19T05:55:26.155 INFO:teuthology.orchestra.run.smithi174.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 7.3 MB/s | 751 kB 00:00 2024-09-19T05:55:26.238 INFO:teuthology.orchestra.run.smithi174.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.9 MB/s | 163 kB 00:00 2024-09-19T05:55:26.330 INFO:teuthology.orchestra.run.smithi174.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.4 MB/s | 127 kB 00:00 2024-09-19T05:55:26.430 INFO:teuthology.orchestra.run.smithi174.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 4.9 MB/s | 506 kB 00:00 2024-09-19T05:55:26.781 INFO:teuthology.orchestra.run.smithi174.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 17 MB 00:01 2024-09-19T05:55:26.822 INFO:teuthology.orchestra.run.smithi174.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.1 MB/s | 45 kB 00:00 2024-09-19T05:55:26.898 INFO:teuthology.orchestra.run.smithi174.stdout:(20/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-19T05:55:26.923 INFO:teuthology.orchestra.run.smithi174.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 1.3 MB/s | 136 kB 00:00 2024-09-19T05:55:26.948 INFO:teuthology.orchestra.run.smithi174.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.1 MB/s | 161 kB 00:00 2024-09-19T05:55:26.982 INFO:teuthology.orchestra.run.smithi174.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 5.4 MB/s | 320 kB 00:00 2024-09-19T05:55:26.982 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:55:26.983 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:55:26.994 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:55:26.995 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:55:26.996 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:55:26.997 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:55:26.998 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:55:27.001 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:55:27.002 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:55:27.007 INFO:teuthology.orchestra.run.smithi174.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T05:55:27.041 INFO:teuthology.orchestra.run.smithi174.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T05:55:27.064 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-19T05:55:27.066 INFO:teuthology.orchestra.run.smithi174.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T05:55:27.089 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-19T05:55:27.089 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-19T05:55:27.089 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-19T05:55:27.089 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-19T05:55:27.089 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:55:27.089 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:55:27.089 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:55:27.090 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:55:27.091 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:55:27.092 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:55:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:55:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:55:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:55:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:55:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:55:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:55:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:55:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:55:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:55:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:55:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:55:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:55:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:55:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:55:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:55:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:55:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:55:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:55:27.103 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:55:27.103 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:55:27.103 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-09-19T05:55:27.103 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:55:27.103 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:55:27.103 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-19T05:55:27.103 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-19T05:55:27.103 INFO:teuthology.orchestra.run.smithi103.stdout:Install 148 Packages 2024-09-19T05:55:27.103 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 8 Packages 2024-09-19T05:55:27.103 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:55:27.104 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 226 M 2024-09-19T05:55:27.104 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-19T05:55:27.116 INFO:teuthology.orchestra.run.smithi174.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T05:55:27.183 INFO:teuthology.orchestra.run.smithi174.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 478 kB/s | 32 kB 00:00 2024-09-19T05:55:27.234 INFO:teuthology.orchestra.run.smithi174.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-19T05:55:27.259 INFO:teuthology.orchestra.run.smithi174.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.9 MB/s | 146 kB 00:00 2024-09-19T05:55:27.462 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:55:27.463 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:55:27.476 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:55:27.477 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:55:27.478 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:55:27.479 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:55:27.481 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:55:27.483 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:55:27.484 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:55:27.546 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-19T05:55:27.562 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-19T05:55:27.562 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:55:27.563 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:55:27.564 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:55:27.565 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:55:27.566 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:55:27.567 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:55:27.568 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:55:27.569 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:55:27.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:55:27.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:55:27.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:55:27.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:55:27.574 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:55:27.575 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-09-19T05:55:27.575 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:55:27.575 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:55:27.575 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-09-19T05:55:27.575 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-19T05:55:27.575 INFO:teuthology.orchestra.run.smithi169.stdout:Install 148 Packages 2024-09-19T05:55:27.575 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 8 Packages 2024-09-19T05:55:27.575 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:55:27.576 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 226 M 2024-09-19T05:55:27.576 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-09-19T05:55:27.712 INFO:teuthology.orchestra.run.smithi174.stdout:(31/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 23 MB/s | 49 MB 00:02 2024-09-19T05:55:27.810 INFO:teuthology.orchestra.run.smithi174.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 6.2 MB/s | 3.6 MB 00:00 2024-09-19T05:55:27.843 INFO:teuthology.orchestra.run.smithi174.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 1.8 MB/s | 249 kB 00:00 2024-09-19T05:55:27.869 INFO:teuthology.orchestra.run.smithi174.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 849 kB/s | 49 kB 00:00 2024-09-19T05:55:27.894 INFO:teuthology.orchestra.run.smithi174.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T05:55:27.919 INFO:teuthology.orchestra.run.smithi174.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T05:55:27.932 INFO:teuthology.orchestra.run.smithi103.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 44 kB/s | 6.6 kB 00:00 2024-09-19T05:55:28.028 INFO:teuthology.orchestra.run.smithi174.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 9.6 MB/s | 7.4 MB 00:00 2024-09-19T05:55:28.053 INFO:teuthology.orchestra.run.smithi174.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 137 kB/s | 18 kB 00:00 2024-09-19T05:55:28.078 INFO:teuthology.orchestra.run.smithi174.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-19T05:55:28.191 INFO:teuthology.orchestra.run.smithi103.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.4 MB/s | 896 kB 00:00 2024-09-19T05:55:28.237 INFO:teuthology.orchestra.run.smithi174.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 383 kB/s | 80 kB 00:00 2024-09-19T05:55:28.275 INFO:teuthology.orchestra.run.smithi103.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T05:55:28.300 INFO:teuthology.orchestra.run.smithi103.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.3 MB/s | 145 kB 00:00 2024-09-19T05:55:28.312 INFO:teuthology.orchestra.run.smithi174.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 818 kB/s | 191 kB 00:00 2024-09-19T05:55:28.362 INFO:teuthology.orchestra.run.smithi174.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-19T05:55:28.388 INFO:teuthology.orchestra.run.smithi174.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-19T05:55:28.421 INFO:teuthology.orchestra.run.smithi174.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T05:55:28.425 INFO:teuthology.orchestra.run.smithi103.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 2.4 MB 00:00 2024-09-19T05:55:28.455 INFO:teuthology.orchestra.run.smithi174.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-19T05:55:28.488 INFO:teuthology.orchestra.run.smithi174.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-09-19T05:55:28.513 INFO:teuthology.orchestra.run.smithi174.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-19T05:55:28.539 INFO:teuthology.orchestra.run.smithi174.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-19T05:55:28.568 INFO:teuthology.orchestra.run.smithi169.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 32 kB/s | 6.6 kB 00:00 2024-09-19T05:55:28.659 INFO:teuthology.orchestra.run.smithi103.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.2 MB/s | 1.5 MB 00:00 2024-09-19T05:55:28.726 INFO:teuthology.orchestra.run.smithi103.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-09-19T05:55:28.943 INFO:teuthology.orchestra.run.smithi103.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T05:55:28.985 INFO:teuthology.orchestra.run.smithi169.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.1 MB/s | 896 kB 00:00 2024-09-19T05:55:28.993 INFO:teuthology.orchestra.run.smithi103.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 503 kB/s | 25 kB 00:00 2024-09-19T05:55:29.093 INFO:teuthology.orchestra.run.smithi169.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.3 MB/s | 145 kB 00:00 2024-09-19T05:55:29.206 INFO:teuthology.orchestra.run.smithi174.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 160 kB/s | 107 kB 00:00 2024-09-19T05:55:29.285 INFO:teuthology.orchestra.run.smithi103.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 19 MB/s | 11 MB 00:00 2024-09-19T05:55:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T05:55:29.381 INFO:teuthology.orchestra.run.smithi174.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 795 kB/s | 689 kB 00:00 2024-09-19T05:55:29.427 INFO:teuthology.orchestra.run.smithi103.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 325 kB/s | 27 kB 00:00 2024-09-19T05:55:29.431 INFO:teuthology.orchestra.run.smithi174.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-19T05:55:29.511 INFO:teuthology.orchestra.run.smithi103.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 381 kB/s | 32 kB 00:00 2024-09-19T05:55:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-19T05:55:29.712 INFO:teuthology.orchestra.run.smithi103.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.7 MB/s | 163 kB 00:00 2024-09-19T05:55:29.765 INFO:teuthology.orchestra.run.smithi174.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 39 kB/s | 22 kB 00:00 2024-09-19T05:55:29.812 INFO:teuthology.orchestra.run.smithi103.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.2 MB/s | 127 kB 00:00 2024-09-19T05:55:29.921 INFO:teuthology.orchestra.run.smithi103.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 4.6 MB/s | 506 kB 00:00 2024-09-19T05:55:29.927 INFO:teuthology.orchestra.run.smithi169.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 2.4 MB 00:00 2024-09-19T05:55:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 60 kB/s | 33 kB 00:00 2024-09-19T05:55:30.160 INFO:teuthology.orchestra.run.smithi169.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.0 MB/s | 5.4 MB 00:01 2024-09-19T05:55:30.240 INFO:teuthology.orchestra.run.smithi174.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 365 kB/s | 313 kB 00:00 2024-09-19T05:55:30.329 INFO:teuthology.orchestra.run.smithi103.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 17 MB 00:01 2024-09-19T05:55:30.402 INFO:teuthology.orchestra.run.smithi169.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 3.2 MB/s | 1.5 MB 00:00 2024-09-19T05:55:30.413 INFO:teuthology.orchestra.run.smithi103.stdout:(19/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-19T05:55:30.438 INFO:teuthology.orchestra.run.smithi103.stdout:(20/156): python3-ceph-argparse-19.1.1-361.g2f5 416 kB/s | 45 kB 00:00 2024-09-19T05:55:30.448 INFO:teuthology.orchestra.run.smithi174.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-19T05:55:30.464 INFO:teuthology.orchestra.run.smithi103.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T05:55:30.497 INFO:teuthology.orchestra.run.smithi103.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T05:55:30.522 INFO:teuthology.orchestra.run.smithi103.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 5.3 MB/s | 320 kB 00:00 2024-09-19T05:55:30.556 INFO:teuthology.orchestra.run.smithi103.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T05:55:30.590 INFO:teuthology.orchestra.run.smithi103.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.4 MB/s | 99 kB 00:00 2024-09-19T05:55:30.615 INFO:teuthology.orchestra.run.smithi103.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T05:55:30.674 INFO:teuthology.orchestra.run.smithi103.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T05:55:30.707 INFO:teuthology.orchestra.run.smithi174.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-09-19T05:55:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 8.4 MB/s | 4.7 MB 00:00 2024-09-19T05:55:30.724 INFO:teuthology.orchestra.run.smithi103.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 638 kB/s | 32 kB 00:00 2024-09-19T05:55:30.783 INFO:teuthology.orchestra.run.smithi103.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-19T05:55:30.791 INFO:teuthology.orchestra.run.smithi174.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-19T05:55:30.817 INFO:teuthology.orchestra.run.smithi103.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.6 MB/s | 146 kB 00:00 2024-09-19T05:55:31.092 INFO:teuthology.orchestra.run.smithi103.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 12 MB/s | 3.6 MB 00:00 2024-09-19T05:55:31.166 INFO:teuthology.orchestra.run.smithi174.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 223 kB/s | 160 kB 00:00 2024-09-19T05:55:31.175 INFO:teuthology.orchestra.run.smithi103.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T05:55:31.267 INFO:teuthology.orchestra.run.smithi103.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-19T05:55:31.284 INFO:teuthology.orchestra.run.smithi103.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 454 kB/s | 49 kB 00:00 2024-09-19T05:55:31.310 INFO:teuthology.orchestra.run.smithi103.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 390 kB/s | 16 kB 00:00 2024-09-19T05:55:31.335 INFO:teuthology.orchestra.run.smithi103.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T05:55:31.341 INFO:teuthology.orchestra.run.smithi174.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-09-19T05:55:31.667 INFO:teuthology.orchestra.run.smithi174.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 757 kB/s | 662 kB 00:00 2024-09-19T05:55:31.769 INFO:teuthology.orchestra.run.smithi103.stdout:(37/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 18 MB/s | 49 MB 00:02 2024-09-19T05:55:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 40 kB/s | 18 kB 00:00 2024-09-19T05:55:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 1.5 MB/s | 765 kB 00:00 2024-09-19T05:55:31.875 INFO:teuthology.orchestra.run.smithi174.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-19T05:55:31.911 INFO:teuthology.orchestra.run.smithi103.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-09-19T05:55:31.945 INFO:teuthology.orchestra.run.smithi103.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-19T05:55:31.996 INFO:teuthology.orchestra.run.smithi103.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-19T05:55:32.029 INFO:teuthology.orchestra.run.smithi103.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 801 kB 00:00 2024-09-19T05:55:32.055 INFO:teuthology.orchestra.run.smithi103.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T05:55:32.080 INFO:teuthology.orchestra.run.smithi103.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T05:55:32.092 INFO:teuthology.orchestra.run.smithi174.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 628 kB/s | 581 kB 00:00 2024-09-19T05:55:32.105 INFO:teuthology.orchestra.run.smithi103.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T05:55:32.130 INFO:teuthology.orchestra.run.smithi103.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T05:55:32.144 INFO:teuthology.orchestra.run.smithi169.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 7.4 MB/s | 11 MB 00:01 2024-09-19T05:55:32.173 INFO:teuthology.orchestra.run.smithi103.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-09-19T05:55:32.326 INFO:teuthology.orchestra.run.smithi174.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 72 kB/s | 47 kB 00:00 2024-09-19T05:55:32.348 INFO:teuthology.orchestra.run.smithi103.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 610 kB/s | 107 kB 00:00 2024-09-19T05:55:32.352 INFO:teuthology.orchestra.run.smithi169.stdout:(9/156): ceph-common-19.1.1-361.g2f599a46.el9.x 5.3 MB/s | 21 MB 00:03 2024-09-19T05:55:32.369 INFO:teuthology.orchestra.run.smithi169.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 112 kB/s | 25 kB 00:00 2024-09-19T05:55:32.398 INFO:teuthology.orchestra.run.smithi103.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 436 kB/s | 22 kB 00:00 2024-09-19T05:55:32.432 INFO:teuthology.orchestra.run.smithi103.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-19T05:55:32.436 INFO:teuthology.orchestra.run.smithi169.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.3 MB/s | 228 kB 00:00 2024-09-19T05:55:32.478 INFO:teuthology.orchestra.run.smithi169.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 655 kB/s | 27 kB 00:00 2024-09-19T05:55:32.482 INFO:teuthology.orchestra.run.smithi103.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-19T05:55:32.512 INFO:teuthology.orchestra.run.smithi169.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 955 kB/s | 32 kB 00:00 2024-09-19T05:55:32.516 INFO:teuthology.orchestra.run.smithi103.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-19T05:55:32.583 INFO:teuthology.orchestra.run.smithi103.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 274 kB/s | 18 kB 00:00 2024-09-19T05:55:32.604 INFO:teuthology.orchestra.run.smithi169.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T05:55:32.641 INFO:teuthology.orchestra.run.smithi103.stdout:(55/156): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 943 kB 00:00 2024-09-19T05:55:32.654 INFO:teuthology.orchestra.run.smithi169.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T05:55:32.658 INFO:teuthology.orchestra.run.smithi103.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-19T05:55:32.659 INFO:teuthology.orchestra.run.smithi174.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 373 kB/s | 292 kB 00:00 2024-09-19T05:55:32.700 INFO:teuthology.orchestra.run.smithi103.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T05:55:32.704 INFO:teuthology.orchestra.run.smithi169.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T05:55:32.725 INFO:teuthology.orchestra.run.smithi103.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-19T05:55:32.771 INFO:teuthology.orchestra.run.smithi169.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T05:55:32.826 INFO:teuthology.orchestra.run.smithi103.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-19T05:55:32.834 INFO:teuthology.orchestra.run.smithi174.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 257 kB/s | 188 kB 00:00 2024-09-19T05:55:32.868 INFO:teuthology.orchestra.run.smithi103.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 588 kB/s | 24 kB 00:00 2024-09-19T05:55:32.910 INFO:teuthology.orchestra.run.smithi103.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T05:55:32.926 INFO:teuthology.orchestra.run.smithi174.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 64 kB/s | 38 kB 00:00 2024-09-19T05:55:32.977 INFO:teuthology.orchestra.run.smithi103.stdout:(62/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-19T05:55:33.003 INFO:teuthology.orchestra.run.smithi103.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 2.1 MB/s | 581 kB 00:00 2024-09-19T05:55:33.036 INFO:teuthology.orchestra.run.smithi103.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-19T05:55:33.038 INFO:teuthology.orchestra.run.smithi169.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 6.4 MB/s | 17 MB 00:02 2024-09-19T05:55:33.061 INFO:teuthology.orchestra.run.smithi103.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 657 kB/s | 38 kB 00:00 2024-09-19T05:55:33.080 INFO:teuthology.orchestra.run.smithi169.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.1 MB/s | 45 kB 00:00 2024-09-19T05:55:33.131 INFO:teuthology.orchestra.run.smithi169.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T05:55:33.145 INFO:teuthology.orchestra.run.smithi103.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.5 MB/s | 3.0 MB 00:00 2024-09-19T05:55:33.181 INFO:teuthology.orchestra.run.smithi169.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T05:55:33.248 INFO:teuthology.orchestra.run.smithi169.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.7 MB/s | 320 kB 00:00 2024-09-19T05:55:33.315 INFO:teuthology.orchestra.run.smithi169.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T05:55:33.407 INFO:teuthology.orchestra.run.smithi169.stdout:(24/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 8.4 MB/s | 5.3 MB 00:00 2024-09-19T05:55:33.432 INFO:teuthology.orchestra.run.smithi169.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 851 kB/s | 99 kB 00:00 2024-09-19T05:55:33.466 INFO:teuthology.orchestra.run.smithi169.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T05:55:33.516 INFO:teuthology.orchestra.run.smithi169.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T05:55:33.583 INFO:teuthology.orchestra.run.smithi169.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 478 kB/s | 32 kB 00:00 2024-09-19T05:55:33.633 INFO:teuthology.orchestra.run.smithi169.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T05:55:33.760 INFO:teuthology.orchestra.run.smithi174.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-19T05:55:33.834 INFO:teuthology.orchestra.run.smithi169.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 7.7 MB/s | 3.1 MB 00:00 2024-09-19T05:55:33.970 INFO:teuthology.orchestra.run.smithi103.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 1.9 MB/s | 1.6 MB 00:00 2024-09-19T05:55:33.977 INFO:teuthology.orchestra.run.smithi174.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-09-19T05:55:34.000 INFO:teuthology.orchestra.run.smithi169.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.7 MB/s | 3.6 MB 00:00 2024-09-19T05:55:34.027 INFO:teuthology.orchestra.run.smithi174.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-09-19T05:55:34.059 INFO:teuthology.orchestra.run.smithi169.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.2 MB/s | 249 kB 00:00 2024-09-19T05:55:34.101 INFO:teuthology.orchestra.run.smithi169.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 1.2 MB/s | 49 kB 00:00 2024-09-19T05:55:34.143 INFO:teuthology.orchestra.run.smithi169.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 398 kB/s | 16 kB 00:00 2024-09-19T05:55:34.193 INFO:teuthology.orchestra.run.smithi169.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T05:55:34.285 INFO:teuthology.orchestra.run.smithi169.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 8.2 MB/s | 765 kB 00:00 2024-09-19T05:55:34.327 INFO:teuthology.orchestra.run.smithi169.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 440 kB/s | 18 kB 00:00 2024-09-19T05:55:34.419 INFO:teuthology.orchestra.run.smithi169.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 874 kB/s | 80 kB 00:00 2024-09-19T05:55:34.463 INFO:teuthology.orchestra.run.smithi103.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-09-19T05:55:34.488 INFO:teuthology.orchestra.run.smithi103.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 1.7 MB/s | 910 kB 00:00 2024-09-19T05:55:34.513 INFO:teuthology.orchestra.run.smithi103.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-19T05:55:34.519 INFO:teuthology.orchestra.run.smithi169.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 7.8 MB/s | 801 kB 00:00 2024-09-19T05:55:34.561 INFO:teuthology.orchestra.run.smithi169.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T05:55:34.603 INFO:teuthology.orchestra.run.smithi169.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-09-19T05:55:34.661 INFO:teuthology.orchestra.run.smithi174.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 1.0 MB/s | 910 kB 00:00 2024-09-19T05:55:34.686 INFO:teuthology.orchestra.run.smithi174.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 196 kB/s | 137 kB 00:00 2024-09-19T05:55:34.687 INFO:teuthology.orchestra.run.smithi169.stdout:(42/156): ceph-mgr-diskprediction-local-19.1.1- 8.7 MB/s | 7.4 MB 00:00 2024-09-19T05:55:34.720 INFO:teuthology.orchestra.run.smithi169.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-19T05:55:34.763 INFO:teuthology.orchestra.run.smithi169.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-19T05:55:34.796 INFO:teuthology.orchestra.run.smithi169.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 3.7 MB/s | 125 kB 00:00 2024-09-19T05:55:34.805 INFO:teuthology.orchestra.run.smithi103.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-09-19T05:55:34.821 INFO:teuthology.orchestra.run.smithi169.stdout:(46/156): python3-ply-3.11-14.el9.noarch.rpm 795 kB/s | 106 kB 00:00 2024-09-19T05:55:34.846 INFO:teuthology.orchestra.run.smithi169.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T05:55:34.864 INFO:teuthology.orchestra.run.smithi103.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T05:55:34.981 INFO:teuthology.orchestra.run.smithi169.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-09-19T05:55:35.039 INFO:teuthology.orchestra.run.smithi169.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-19T05:55:35.064 INFO:teuthology.orchestra.run.smithi169.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-09-19T05:55:35.115 INFO:teuthology.orchestra.run.smithi169.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-19T05:55:35.139 INFO:teuthology.orchestra.run.smithi169.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-19T05:55:35.169 INFO:teuthology.orchestra.run.smithi174.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2024-09-19T05:55:35.190 INFO:teuthology.orchestra.run.smithi169.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 436 kB/s | 33 kB 00:00 2024-09-19T05:55:35.247 INFO:teuthology.orchestra.run.smithi103.stdout:(73/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.2 MB/s | 4.9 MB 00:02 2024-09-19T05:55:35.265 INFO:teuthology.orchestra.run.smithi169.stdout:(54/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-19T05:55:35.291 INFO:teuthology.orchestra.run.smithi169.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-09-19T05:55:35.306 INFO:teuthology.orchestra.run.smithi103.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-19T05:55:35.333 INFO:teuthology.orchestra.run.smithi169.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-09-19T05:55:35.361 INFO:teuthology.orchestra.run.smithi174.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 129 kB/s | 87 kB 00:00 2024-09-19T05:55:35.366 INFO:teuthology.orchestra.run.smithi169.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-19T05:55:35.408 INFO:teuthology.orchestra.run.smithi169.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 603 kB/s | 45 kB 00:00 2024-09-19T05:55:35.465 INFO:teuthology.orchestra.run.smithi103.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-19T05:55:35.467 INFO:teuthology.orchestra.run.smithi169.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-19T05:55:35.501 INFO:teuthology.orchestra.run.smithi169.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-19T05:55:35.526 INFO:teuthology.orchestra.run.smithi169.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-19T05:55:35.568 INFO:teuthology.orchestra.run.smithi169.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-19T05:55:35.601 INFO:teuthology.orchestra.run.smithi169.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-19T05:55:35.606 INFO:teuthology.orchestra.run.smithi103.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-19T05:55:35.635 INFO:teuthology.orchestra.run.smithi169.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-19T05:55:35.657 INFO:teuthology.orchestra.run.smithi103.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-19T05:55:35.669 INFO:teuthology.orchestra.run.smithi169.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-19T05:55:35.687 INFO:teuthology.orchestra.run.smithi174.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-09-19T05:55:35.707 INFO:teuthology.orchestra.run.smithi103.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-19T05:55:35.769 INFO:teuthology.orchestra.run.smithi169.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 37 MB/s | 4.9 MB 00:00 2024-09-19T05:55:35.816 INFO:teuthology.orchestra.run.smithi103.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-19T05:55:35.869 INFO:teuthology.orchestra.run.smithi169.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-19T05:55:35.874 INFO:teuthology.orchestra.run.smithi103.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-09-19T05:55:35.911 INFO:teuthology.orchestra.run.smithi169.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-19T05:55:35.970 INFO:teuthology.orchestra.run.smithi174.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 101 kB/s | 61 kB 00:00 2024-09-19T05:55:36.003 INFO:teuthology.orchestra.run.smithi169.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-19T05:55:36.028 INFO:teuthology.orchestra.run.smithi169.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-19T05:55:36.112 INFO:teuthology.orchestra.run.smithi169.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-19T05:55:36.196 INFO:teuthology.orchestra.run.smithi169.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 30 MB/s | 5.8 MB 00:00 2024-09-19T05:55:36.216 INFO:teuthology.orchestra.run.smithi103.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-09-19T05:55:36.221 INFO:teuthology.orchestra.run.smithi169.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 807 kB/s | 87 kB 00:00 2024-09-19T05:55:36.280 INFO:teuthology.orchestra.run.smithi169.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-19T05:55:36.283 INFO:teuthology.orchestra.run.smithi103.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-19T05:55:36.342 INFO:teuthology.orchestra.run.smithi103.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-19T05:55:36.363 INFO:teuthology.orchestra.run.smithi169.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-09-19T05:55:36.388 INFO:teuthology.orchestra.run.smithi169.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-19T05:55:36.400 INFO:teuthology.orchestra.run.smithi103.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T05:55:36.412 INFO:teuthology.orchestra.run.smithi174.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-09-19T05:55:36.430 INFO:teuthology.orchestra.run.smithi169.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-19T05:55:36.454 INFO:teuthology.orchestra.run.smithi174.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 319 kB/s | 245 kB 00:00 2024-09-19T05:55:36.464 INFO:teuthology.orchestra.run.smithi169.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-09-19T05:55:36.476 INFO:teuthology.orchestra.run.smithi103.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.5 MB/s | 5.1 MB 00:00 2024-09-19T05:55:36.493 INFO:teuthology.orchestra.run.smithi103.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 458 kB/s | 42 kB 00:00 2024-09-19T05:55:36.506 INFO:teuthology.orchestra.run.smithi169.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-09-19T05:55:36.531 INFO:teuthology.orchestra.run.smithi169.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-19T05:55:36.543 INFO:teuthology.orchestra.run.smithi103.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-19T05:55:36.569 INFO:teuthology.orchestra.run.smithi103.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-19T05:55:36.581 INFO:teuthology.orchestra.run.smithi169.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-19T05:55:36.602 INFO:teuthology.orchestra.run.smithi103.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-19T05:55:36.620 INFO:teuthology.orchestra.run.smithi103.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T05:55:36.645 INFO:teuthology.orchestra.run.smithi103.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-19T05:55:36.657 INFO:teuthology.orchestra.run.smithi169.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-19T05:55:36.687 INFO:teuthology.orchestra.run.smithi103.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 996 kB/s | 42 kB 00:00 2024-09-19T05:55:36.724 INFO:teuthology.orchestra.run.smithi169.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 5.1 MB 00:00 2024-09-19T05:55:36.749 INFO:teuthology.orchestra.run.smithi169.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-19T05:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 563 kB/s | 44 kB 00:00 2024-09-19T05:55:36.808 INFO:teuthology.orchestra.run.smithi169.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 725 kB/s | 42 kB 00:00 2024-09-19T05:55:36.829 INFO:teuthology.orchestra.run.smithi103.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.4 MB/s | 221 kB 00:00 2024-09-19T05:55:36.833 INFO:teuthology.orchestra.run.smithi169.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 708 kB/s | 77 kB 00:00 2024-09-19T05:55:36.846 INFO:teuthology.orchestra.run.smithi174.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 284 kB/s | 248 kB 00:00 2024-09-19T05:55:36.875 INFO:teuthology.orchestra.run.smithi169.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-19T05:55:36.879 INFO:teuthology.orchestra.run.smithi103.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-09-19T05:55:36.917 INFO:teuthology.orchestra.run.smithi169.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-19T05:55:36.921 INFO:teuthology.orchestra.run.smithi103.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T05:55:36.929 INFO:teuthology.orchestra.run.smithi174.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-09-19T05:55:36.946 INFO:teuthology.orchestra.run.smithi174.stdout:(80/156): python3-jsonpatch-1.21-16.el9.noarch. 48 kB/s | 26 kB 00:00 2024-09-19T05:55:36.950 INFO:teuthology.orchestra.run.smithi169.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-19T05:55:36.976 INFO:teuthology.orchestra.run.smithi169.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 869 kB/s | 51 kB 00:00 2024-09-19T05:55:36.980 INFO:teuthology.orchestra.run.smithi103.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-19T05:55:37.018 INFO:teuthology.orchestra.run.smithi169.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 802 kB/s | 54 kB 00:00 2024-09-19T05:55:37.030 INFO:teuthology.orchestra.run.smithi103.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T05:55:37.081 INFO:teuthology.orchestra.run.smithi103.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-19T05:55:37.131 INFO:teuthology.orchestra.run.smithi103.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T05:55:37.181 INFO:teuthology.orchestra.run.smithi103.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-19T05:55:37.465 INFO:teuthology.orchestra.run.smithi103.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-09-19T05:55:37.488 INFO:teuthology.orchestra.run.smithi174.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 62 kB/s | 35 kB 00:00 2024-09-19T05:55:37.543 INFO:teuthology.orchestra.run.smithi169.stdout:(92/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 9.4 MB/s | 49 MB 00:05 2024-09-19T05:55:37.568 INFO:teuthology.orchestra.run.smithi169.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 76 kB/s | 42 kB 00:00 2024-09-19T05:55:37.588 INFO:teuthology.orchestra.run.smithi174.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 232 kB/s | 172 kB 00:00 2024-09-19T05:55:37.624 INFO:teuthology.orchestra.run.smithi103.stdout:(103/156): postgresql-server-13.16-1.el9.x86_64 1.8 MB/s | 5.8 MB 00:03 2024-09-19T05:55:37.635 INFO:teuthology.orchestra.run.smithi169.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T05:55:37.661 INFO:teuthology.orchestra.run.smithi169.stdout:(95/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 378 kB/s | 44 kB 00:00 2024-09-19T05:55:37.682 INFO:teuthology.orchestra.run.smithi103.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T05:55:37.694 INFO:teuthology.orchestra.run.smithi169.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-19T05:55:37.707 INFO:teuthology.orchestra.run.smithi103.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-19T05:55:37.733 INFO:teuthology.orchestra.run.smithi103.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-19T05:55:37.858 INFO:teuthology.orchestra.run.smithi103.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-19T05:55:37.869 INFO:teuthology.orchestra.run.smithi169.stdout:(97/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-19T05:55:37.883 INFO:teuthology.orchestra.run.smithi103.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T05:55:37.895 INFO:teuthology.orchestra.run.smithi169.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 203 kB/s | 47 kB 00:00 2024-09-19T05:55:37.909 INFO:teuthology.orchestra.run.smithi103.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T05:55:37.920 INFO:teuthology.orchestra.run.smithi169.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-19T05:55:37.934 INFO:teuthology.orchestra.run.smithi103.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-19T05:55:37.945 INFO:teuthology.orchestra.run.smithi169.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-09-19T05:55:37.959 INFO:teuthology.orchestra.run.smithi103.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-19T05:55:37.987 INFO:teuthology.orchestra.run.smithi169.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-19T05:55:38.010 INFO:teuthology.orchestra.run.smithi103.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T05:55:38.012 INFO:teuthology.orchestra.run.smithi169.stdout:(102/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 816 kB/s | 96 kB 00:00 2024-09-19T05:55:38.037 INFO:teuthology.orchestra.run.smithi169.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 486 kB/s | 45 kB 00:00 2024-09-19T05:55:38.043 INFO:teuthology.orchestra.run.smithi103.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-19T05:55:38.069 INFO:teuthology.orchestra.run.smithi103.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T05:55:38.094 INFO:teuthology.orchestra.run.smithi103.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T05:55:38.096 INFO:teuthology.orchestra.run.smithi169.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T05:55:38.120 INFO:teuthology.orchestra.run.smithi103.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-09-19T05:55:38.122 INFO:teuthology.orchestra.run.smithi169.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-19T05:55:38.145 INFO:teuthology.orchestra.run.smithi103.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-19T05:55:38.147 INFO:teuthology.orchestra.run.smithi169.stdout:(106/156): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-09-19T05:55:38.172 INFO:teuthology.orchestra.run.smithi174.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-09-19T05:55:38.173 INFO:teuthology.orchestra.run.smithi169.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-19T05:55:38.179 INFO:teuthology.orchestra.run.smithi103.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-19T05:55:38.206 INFO:teuthology.orchestra.run.smithi169.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 995 kB/s | 26 kB 00:00 2024-09-19T05:55:38.212 INFO:teuthology.orchestra.run.smithi103.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-19T05:55:38.231 INFO:teuthology.orchestra.run.smithi169.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-19T05:55:38.238 INFO:teuthology.orchestra.run.smithi103.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-19T05:55:38.256 INFO:teuthology.orchestra.run.smithi169.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-19T05:55:38.280 INFO:teuthology.orchestra.run.smithi174.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 316 kB/s | 250 kB 00:00 2024-09-19T05:55:38.281 INFO:teuthology.orchestra.run.smithi169.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-19T05:55:38.288 INFO:teuthology.orchestra.run.smithi103.stdout:(121/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-19T05:55:38.315 INFO:teuthology.orchestra.run.smithi169.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-09-19T05:55:38.347 INFO:teuthology.orchestra.run.smithi103.stdout:(122/156): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-09-19T05:55:38.363 INFO:teuthology.orchestra.run.smithi103.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 723 kB/s | 11 kB 00:00 2024-09-19T05:55:38.374 INFO:teuthology.orchestra.run.smithi169.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-19T05:55:38.381 INFO:teuthology.orchestra.run.smithi103.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-19T05:55:38.381 INFO:teuthology.orchestra.run.smithi174.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 281 kB/s | 222 kB 00:00 2024-09-19T05:55:38.391 INFO:teuthology.orchestra.run.smithi169.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 3.0 MB/s | 43 kB 00:00 2024-09-19T05:55:38.406 INFO:teuthology.orchestra.run.smithi103.stdout:(125/156): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-09-19T05:55:38.408 INFO:teuthology.orchestra.run.smithi169.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T05:55:38.423 INFO:teuthology.orchestra.run.smithi103.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 552 kB/s | 23 kB 00:00 2024-09-19T05:55:38.425 INFO:teuthology.orchestra.run.smithi169.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 854 kB/s | 14 kB 00:00 2024-09-19T05:55:38.440 INFO:teuthology.orchestra.run.smithi103.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 580 kB/s | 19 kB 00:00 2024-09-19T05:55:38.450 INFO:teuthology.orchestra.run.smithi169.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-19T05:55:38.457 INFO:teuthology.orchestra.run.smithi103.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2024-09-19T05:55:38.482 INFO:teuthology.orchestra.run.smithi103.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T05:55:38.484 INFO:teuthology.orchestra.run.smithi169.stdout:(118/156): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-09-19T05:55:38.507 INFO:teuthology.orchestra.run.smithi103.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T05:55:38.519 INFO:teuthology.orchestra.run.smithi169.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-19T05:55:38.533 INFO:teuthology.orchestra.run.smithi103.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-19T05:55:38.542 INFO:teuthology.orchestra.run.smithi169.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T05:55:38.558 INFO:teuthology.orchestra.run.smithi103.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-19T05:55:38.568 INFO:teuthology.orchestra.run.smithi169.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T05:55:38.592 INFO:teuthology.orchestra.run.smithi103.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.7 MB/s | 1.0 MB 00:00 2024-09-19T05:55:38.593 INFO:teuthology.orchestra.run.smithi169.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T05:55:38.617 INFO:teuthology.orchestra.run.smithi103.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-19T05:55:38.627 INFO:teuthology.orchestra.run.smithi169.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 322 kB/s | 11 kB 00:00 2024-09-19T05:55:38.642 INFO:teuthology.orchestra.run.smithi103.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T05:55:38.652 INFO:teuthology.orchestra.run.smithi169.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-19T05:55:38.667 INFO:teuthology.orchestra.run.smithi103.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T05:55:38.677 INFO:teuthology.orchestra.run.smithi169.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 938 kB/s | 23 kB 00:00 2024-09-19T05:55:38.693 INFO:teuthology.orchestra.run.smithi103.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-09-19T05:55:38.702 INFO:teuthology.orchestra.run.smithi169.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-19T05:55:38.719 INFO:teuthology.orchestra.run.smithi103.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T05:55:38.728 INFO:teuthology.orchestra.run.smithi169.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-19T05:55:38.744 INFO:teuthology.orchestra.run.smithi103.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T05:55:38.769 INFO:teuthology.orchestra.run.smithi103.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-19T05:55:38.795 INFO:teuthology.orchestra.run.smithi103.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T05:55:38.797 INFO:teuthology.orchestra.run.smithi174.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 123 kB/s | 77 kB 00:00 2024-09-19T05:55:38.803 INFO:teuthology.orchestra.run.smithi169.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-19T05:55:38.820 INFO:teuthology.orchestra.run.smithi103.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-19T05:55:38.828 INFO:teuthology.orchestra.run.smithi169.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T05:55:38.845 INFO:teuthology.orchestra.run.smithi103.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T05:55:38.853 INFO:teuthology.orchestra.run.smithi169.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T05:55:38.870 INFO:teuthology.orchestra.run.smithi103.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-09-19T05:55:38.895 INFO:teuthology.orchestra.run.smithi169.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-19T05:55:38.896 INFO:teuthology.orchestra.run.smithi103.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T05:55:38.921 INFO:teuthology.orchestra.run.smithi169.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 863 kB/s | 58 kB 00:00 2024-09-19T05:55:38.921 INFO:teuthology.orchestra.run.smithi103.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-19T05:55:38.948 INFO:teuthology.orchestra.run.smithi174.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 63 kB/s | 42 kB 00:00 2024-09-19T05:55:38.954 INFO:teuthology.orchestra.run.smithi169.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-09-19T05:55:38.980 INFO:teuthology.orchestra.run.smithi169.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-19T05:55:39.005 INFO:teuthology.orchestra.run.smithi169.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T05:55:39.030 INFO:teuthology.orchestra.run.smithi169.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T05:55:39.038 INFO:teuthology.orchestra.run.smithi103.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-19T05:55:39.056 INFO:teuthology.orchestra.run.smithi169.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T05:55:39.081 INFO:teuthology.orchestra.run.smithi169.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-19T05:55:39.106 INFO:teuthology.orchestra.run.smithi169.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T05:55:39.132 INFO:teuthology.orchestra.run.smithi169.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-19T05:55:39.148 INFO:teuthology.orchestra.run.smithi174.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 351 kB/s | 269 kB 00:00 2024-09-19T05:55:39.157 INFO:teuthology.orchestra.run.smithi169.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-19T05:55:39.173 INFO:teuthology.orchestra.run.smithi169.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-19T05:55:39.188 INFO:teuthology.orchestra.run.smithi103.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-19T05:55:39.199 INFO:teuthology.orchestra.run.smithi169.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-19T05:55:39.233 INFO:teuthology.orchestra.run.smithi169.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T05:55:39.258 INFO:teuthology.orchestra.run.smithi169.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-19T05:55:39.283 INFO:teuthology.orchestra.run.smithi169.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T05:55:39.308 INFO:teuthology.orchestra.run.smithi169.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-19T05:55:39.314 INFO:teuthology.orchestra.run.smithi103.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-19T05:55:39.367 INFO:teuthology.orchestra.run.smithi169.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T05:55:39.389 INFO:teuthology.orchestra.run.smithi103.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-19T05:55:39.431 INFO:teuthology.orchestra.run.smithi103.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 983 kB/s | 41 kB 00:00 2024-09-19T05:55:39.534 INFO:teuthology.orchestra.run.smithi169.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-09-19T05:55:39.573 INFO:teuthology.orchestra.run.smithi174.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 205 kB/s | 159 kB 00:00 2024-09-19T05:55:39.590 INFO:teuthology.orchestra.run.smithi103.stdout:(152/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.5 MB/s | 16 MB 00:02 2024-09-19T05:55:39.609 INFO:teuthology.orchestra.run.smithi169.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-19T05:55:39.615 INFO:teuthology.orchestra.run.smithi103.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.3 MB/s | 249 kB 00:00 2024-09-19T05:55:39.642 INFO:teuthology.orchestra.run.smithi169.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-09-19T05:55:39.657 INFO:teuthology.orchestra.run.smithi103.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.3 MB/s | 1.8 MB 00:00 2024-09-19T05:55:39.685 INFO:teuthology.orchestra.run.smithi169.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 5.8 MB/s | 249 kB 00:00 2024-09-19T05:55:39.724 INFO:teuthology.orchestra.run.smithi103.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-19T05:55:39.735 INFO:teuthology.orchestra.run.smithi169.stdout:(153/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.4 MB/s | 3.2 MB 00:00 2024-09-19T05:55:39.740 INFO:teuthology.orchestra.run.smithi174.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-19T05:55:39.766 INFO:teuthology.orchestra.run.smithi103.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 7.7 MB/s | 1.4 MB 00:00 2024-09-19T05:55:39.772 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:55:39.772 INFO:teuthology.orchestra.run.smithi103.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-19T05:55:39.793 INFO:teuthology.orchestra.run.smithi169.stdout:(154/156): librados2-19.1.1-361.g2f599a46.el9.x 6.7 MB/s | 3.4 MB 00:00 2024-09-19T05:55:39.799 INFO:teuthology.orchestra.run.smithi174.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 328 kB/s | 279 kB 00:00 2024-09-19T05:55:39.835 INFO:teuthology.orchestra.run.smithi169.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-19T05:55:39.944 INFO:teuthology.orchestra.run.smithi169.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-19T05:55:39.950 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:55:39.950 INFO:teuthology.orchestra.run.smithi169.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-19T05:55:40.183 INFO:teuthology.orchestra.run.smithi174.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 88 kB/s | 54 kB 00:00 2024-09-19T05:55:40.424 INFO:teuthology.orchestra.run.smithi174.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-09-19T05:55:40.800 INFO:teuthology.orchestra.run.smithi174.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 72 kB/s | 44 kB 00:00 2024-09-19T05:55:40.967 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-19T05:55:41.119 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-19T05:55:41.119 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-19T05:55:41.122 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-09-19T05:55:41.192 INFO:teuthology.orchestra.run.smithi174.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T05:55:41.217 INFO:teuthology.orchestra.run.smithi174.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 281 kB/s | 221 kB 00:00 2024-09-19T05:55:41.275 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-09-19T05:55:41.275 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-09-19T05:55:41.459 INFO:teuthology.orchestra.run.smithi174.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 54 kB/s | 36 kB 00:00 2024-09-19T05:55:41.825 INFO:teuthology.orchestra.run.smithi174.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 75 kB/s | 47 kB 00:00 2024-09-19T05:55:42.026 INFO:teuthology.orchestra.run.smithi174.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 376 kB/s | 304 kB 00:00 2024-09-19T05:55:42.067 INFO:teuthology.orchestra.run.smithi174.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 96 kB/s | 58 kB 00:00 2024-09-19T05:55:42.551 INFO:teuthology.orchestra.run.smithi174.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 132 kB/s | 96 kB 00:00 2024-09-19T05:55:42.635 INFO:teuthology.orchestra.run.smithi174.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 270 kB/s | 22 kB 00:00 2024-09-19T05:55:42.668 INFO:teuthology.orchestra.run.smithi174.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 99 kB/s | 64 kB 00:00 2024-09-19T05:55:42.693 INFO:teuthology.orchestra.run.smithi174.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-09-19T05:55:42.752 INFO:teuthology.orchestra.run.smithi174.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T05:55:42.777 INFO:teuthology.orchestra.run.smithi174.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 789 kB/s | 19 kB 00:00 2024-09-19T05:55:42.803 INFO:teuthology.orchestra.run.smithi174.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-19T05:55:42.836 INFO:teuthology.orchestra.run.smithi174.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-19T05:55:42.861 INFO:teuthology.orchestra.run.smithi174.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-19T05:55:42.895 INFO:teuthology.orchestra.run.smithi174.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T05:55:42.928 INFO:teuthology.orchestra.run.smithi174.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-19T05:55:42.954 INFO:teuthology.orchestra.run.smithi174.stdout:(112/156): liboath-2.6.7-2.el9.x86_64.rpm 414 kB/s | 49 kB 00:00 2024-09-19T05:55:43.004 INFO:teuthology.orchestra.run.smithi174.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T05:55:43.038 INFO:teuthology.orchestra.run.smithi174.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-19T05:55:43.063 INFO:teuthology.orchestra.run.smithi174.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T05:55:43.089 INFO:teuthology.orchestra.run.smithi174.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-19T05:55:43.113 INFO:teuthology.orchestra.run.smithi174.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-19T05:55:43.139 INFO:teuthology.orchestra.run.smithi174.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T05:55:43.172 INFO:teuthology.orchestra.run.smithi174.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T05:55:43.197 INFO:teuthology.orchestra.run.smithi174.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T05:55:43.223 INFO:teuthology.orchestra.run.smithi174.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T05:55:43.248 INFO:teuthology.orchestra.run.smithi174.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T05:55:43.273 INFO:teuthology.orchestra.run.smithi174.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-19T05:55:43.299 INFO:teuthology.orchestra.run.smithi174.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-19T05:55:43.324 INFO:teuthology.orchestra.run.smithi174.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 937 kB/s | 23 kB 00:00 2024-09-19T05:55:43.341 INFO:teuthology.orchestra.run.smithi174.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-19T05:55:43.360 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-19T05:55:43.361 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-19T05:55:43.366 INFO:teuthology.orchestra.run.smithi174.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-19T05:55:43.433 INFO:teuthology.orchestra.run.smithi174.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-19T05:55:43.443 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-09-19T05:55:43.443 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-09-19T05:55:43.450 INFO:teuthology.orchestra.run.smithi174.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T05:55:43.484 INFO:teuthology.orchestra.run.smithi174.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T05:55:43.500 INFO:teuthology.orchestra.run.smithi174.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-19T05:55:43.534 INFO:teuthology.orchestra.run.smithi174.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-19T05:55:43.559 INFO:teuthology.orchestra.run.smithi174.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-19T05:55:43.585 INFO:teuthology.orchestra.run.smithi174.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-19T05:55:43.626 INFO:teuthology.orchestra.run.smithi174.stdout:(135/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-09-19T05:55:43.652 INFO:teuthology.orchestra.run.smithi174.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 423 kB/s | 28 kB 00:00 2024-09-19T05:55:43.677 INFO:teuthology.orchestra.run.smithi174.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 767 kB/s | 90 kB 00:00 2024-09-19T05:55:43.719 INFO:teuthology.orchestra.run.smithi174.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-19T05:55:43.744 INFO:teuthology.orchestra.run.smithi174.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T05:55:43.769 INFO:teuthology.orchestra.run.smithi174.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-19T05:55:43.795 INFO:teuthology.orchestra.run.smithi174.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-19T05:55:43.820 INFO:teuthology.orchestra.run.smithi174.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-19T05:55:43.837 INFO:teuthology.orchestra.run.smithi174.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-19T05:55:43.862 INFO:teuthology.orchestra.run.smithi174.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-19T05:55:43.887 INFO:teuthology.orchestra.run.smithi174.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T05:55:43.912 INFO:teuthology.orchestra.run.smithi174.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T05:55:43.938 INFO:teuthology.orchestra.run.smithi174.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-19T05:55:43.988 INFO:teuthology.orchestra.run.smithi174.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T05:55:44.171 INFO:teuthology.orchestra.run.smithi174.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-19T05:55:44.222 INFO:teuthology.orchestra.run.smithi174.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T05:55:44.280 INFO:teuthology.orchestra.run.smithi174.stdout:(151/156): librbd1-19.1.1-361.g2f599a46.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-09-19T05:55:44.306 INFO:teuthology.orchestra.run.smithi174.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 490 kB/s | 41 kB 00:00 2024-09-19T05:55:44.347 INFO:teuthology.orchestra.run.smithi174.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 10 MB/s | 1.8 MB 00:00 2024-09-19T05:55:44.373 INFO:teuthology.orchestra.run.smithi174.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.6 MB/s | 249 kB 00:00 2024-09-19T05:55:44.415 INFO:teuthology.orchestra.run.smithi174.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-19T05:55:44.465 INFO:teuthology.orchestra.run.smithi174.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-19T05:55:44.471 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:55:44.471 INFO:teuthology.orchestra.run.smithi174.stdout:Total 11 MB/s | 226 MB 00:20 2024-09-19T05:55:45.687 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-09-19T05:55:45.837 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-09-19T05:55:45.837 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-09-19T05:55:48.026 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-09-19T05:55:48.027 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-09-19T05:55:49.849 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-19T05:55:49.888 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-09-19T05:55:49.929 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:55:50.014 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:55:50.050 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:55:50.060 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:55:50.126 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:55:50.164 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:55:50.190 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:55:50.245 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:55:50.265 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:55:50.305 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:55:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:55:50.393 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:55:50.680 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:55:50.742 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:55:50.791 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:55:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:55:50.907 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:55:50.935 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:55:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:55:50.997 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:55:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:55:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:55:51.087 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:55:51.127 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:55:51.219 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:55:51.278 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:55:51.303 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:55:51.306 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:55:51.364 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:55:51.393 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:55:51.410 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:55:51.432 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:55:51.495 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:55:51.496 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:55:51.516 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:55:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:55:51.536 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:55:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:55:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:55:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:55:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:55:51.831 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:55:51.875 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:55:51.999 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:55:52.006 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:55:52.133 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:55:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:55:52.216 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:55:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:55:52.346 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:55:52.471 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:55:52.579 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:55:52.584 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:55:52.676 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:55:52.689 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:55:52.713 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:55:52.747 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:55:52.781 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:55:52.812 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:55:52.826 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:55:52.857 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:55:52.869 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:55:52.889 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:55:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:55:52.934 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:55:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:55:52.979 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:55:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:55:53.011 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:55:53.055 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:55:53.061 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:55:53.088 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:55:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:55:53.123 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:55:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:55:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:55:53.202 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:55:53.258 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:55:53.263 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:55:53.291 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:55:53.294 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:55:53.326 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:55:53.337 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:55:53.355 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:55:53.412 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:55:53.425 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:55:53.448 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:55:53.469 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:55:53.491 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:55:53.520 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:55:53.544 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:55:53.589 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:55:53.643 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:55:53.675 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:55:53.717 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:55:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:55:53.850 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:55:53.912 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:55:54.244 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:55:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:55:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:55:54.407 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:55:54.432 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:55:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:55:54.461 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-09-19T05:55:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:55:54.507 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:55:54.537 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:55:54.572 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:55:54.577 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:55:54.610 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:55:54.619 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:55:54.652 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:55:54.671 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:55:54.677 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:55:54.710 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:55:54.714 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:55:54.736 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:55:54.768 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:55:54.787 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:55:54.834 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:55:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:55:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:55:54.888 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:55:54.909 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:55:54.944 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:55:54.956 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:55:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:55:55.016 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:55:55.035 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:55:55.048 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:55:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:55:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:55:55.116 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:55:55.131 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:55:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:55:55.213 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:55:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:55:55.220 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:55:55.254 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:55:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:55:55.295 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:55:55.325 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:55:55.346 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:55:55.397 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:55:55.398 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:55:55.437 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:55:55.475 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:55:55.639 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:55:55.642 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:55:55.681 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:55:55.696 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:55:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:55:55.723 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:55:55.764 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:55:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:55:55.812 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:55:55.826 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:55:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:55:55.836 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:55:55.849 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:55:55.880 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:55:55.912 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:55:55.929 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:55:55.936 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:55:55.953 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:55:55.957 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:55:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:55:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:55:56.135 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:55:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:55:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:55:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:55:56.302 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:55:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:55:56.341 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:55:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:55:56.377 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:55:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:55:56.413 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:55:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:55:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:55:56.447 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:55:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:55:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:55:56.494 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:55:56.526 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:55:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:55:56.532 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:55:56.556 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:55:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:55:56.590 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:55:56.599 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:55:56.624 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:55:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:55:56.665 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:55:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:55:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:55:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:55:56.786 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:55:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:55:56.833 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:55:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:55:56.865 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:55:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:55:56.947 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:55:56.967 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:55:57.024 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:55:57.044 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:55:57.080 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:55:57.114 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:55:57.189 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:55:57.232 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:55:57.264 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:55:57.307 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:55:57.340 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:55:57.367 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:55:57.437 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:55:57.514 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:55:57.545 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:55:57.589 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:55:57.637 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:55:57.674 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:55:57.691 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:55:57.707 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:55:57.725 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:55:57.739 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:55:57.742 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:55:57.771 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:55:57.787 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:55:57.821 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:55:57.822 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:55:57.840 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:55:57.885 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:55:57.889 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:55:57.920 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:55:57.933 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:55:57.960 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:55:57.976 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:55:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:55:58.022 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:55:58.062 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:55:58.090 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:55:58.108 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:55:58.141 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:55:58.145 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:55:58.248 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:55:58.276 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:55:58.326 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:55:58.355 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:55:58.362 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:55:58.433 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:55:58.668 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:55:58.750 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:55:58.778 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:55:58.821 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:55:58.859 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:55:58.902 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:55:59.007 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:55:59.071 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:55:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:55:59.115 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:55:59.137 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:55:59.192 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:55:59.194 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:55:59.265 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:55:59.296 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:55:59.332 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:55:59.379 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:55:59.415 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:55:59.457 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:55:59.500 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:55:59.636 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:55:59.685 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:55:59.726 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:55:59.829 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:55:59.927 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:55:59.976 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:56:00.000 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:56:00.024 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:56:00.110 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:56:00.243 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:56:00.281 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:56:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:56:00.352 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:56:00.377 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:56:00.391 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:56:00.422 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:56:00.443 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:56:00.452 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:56:00.472 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:56:00.486 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:56:00.500 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:56:00.520 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:56:00.533 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:56:00.535 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:56:00.561 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:56:00.563 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:56:00.596 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:56:00.596 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:56:00.682 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:56:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:56:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:56:00.843 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:56:00.860 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:56:00.896 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:56:00.905 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:56:00.917 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:56:00.942 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:56:00.987 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:56:01.026 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:56:01.032 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:56:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:56:01.070 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:56:01.102 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:56:01.557 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:56:01.581 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:56:01.583 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:56:01.605 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:56:01.640 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:56:01.654 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:56:01.676 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:56:01.683 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:56:01.685 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:56:01.707 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:56:01.717 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:56:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:56:01.864 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:56:01.909 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:56:01.997 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:56:02.036 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:56:02.221 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:56:02.251 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:56:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:56:03.006 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:56:03.123 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:56:03.937 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:56:03.974 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:56:04.029 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:56:04.062 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:56:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:56:04.495 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:56:04.523 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:56:04.534 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:56:04.556 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:56:04.577 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:56:04.619 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:56:04.657 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:56:04.674 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:56:04.674 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:56:04.674 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:56:04.674 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:04.712 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:56:04.740 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:56:04.740 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:56:04.740 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:56:04.740 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:04.774 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:56:04.864 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:56:04.919 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:56:04.993 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:56:05.024 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:56:05.068 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:56:05.547 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:56:05.572 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:56:05.643 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:56:05.674 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:56:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:56:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:56:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:56:08.631 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:56:08.720 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:56:08.720 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:56:08.720 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:56:08.720 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:08.766 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:56:16.388 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:56:16.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-09-19T05:56:16.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-09-19T05:56:16.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-09-19T05:56:16.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-09-19T05:56:16.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-09-19T05:56:16.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-09-19T05:56:16.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-09-19T05:56:16.389 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:16.571 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:56:16.586 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:56:16.586 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:16.587 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:56:16.587 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:16.730 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:56:16.730 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-09-19T05:56:16.730 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-09-19T05:56:16.730 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-09-19T05:56:16.730 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-09-19T05:56:16.730 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-09-19T05:56:16.730 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-09-19T05:56:16.730 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-09-19T05:56:16.730 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:16.903 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:56:16.919 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:56:16.919 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:16.919 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:56:16.919 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:18.073 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:56:18.099 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:56:18.100 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:18.100 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:56:18.100 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:56:18.100 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:56:18.100 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:18.323 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:56:18.346 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:56:18.347 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:18.347 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:56:18.347 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:56:18.347 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:56:18.347 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:18.389 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:56:18.416 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:56:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:56:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:56:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:56:18.416 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:18.640 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:56:18.663 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:56:18.663 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:18.664 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:56:18.664 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:56:18.664 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:56:18.664 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:18.790 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:56:18.813 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:56:18.813 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:18.814 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:56:18.814 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:56:18.814 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:56:18.814 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:18.920 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:56:18.969 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:56:19.025 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:56:19.108 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:56:19.131 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:56:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:56:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:56:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:56:19.131 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:19.210 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:56:19.238 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:56:19.266 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:56:19.286 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:56:19.341 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:56:19.343 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:56:19.433 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:56:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:56:19.563 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:56:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:56:19.620 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:56:19.645 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:56:19.656 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:56:19.684 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:56:19.733 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:56:19.873 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:56:19.936 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:56:19.975 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:56:20.002 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:56:20.105 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:56:20.133 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:56:20.164 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:56:20.227 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:56:20.256 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:56:20.491 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:56:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:56:20.550 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:56:20.570 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:56:20.571 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-09-19T05:56:20.571 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-09-19T05:56:20.571 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-09-19T05:56:20.571 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-09-19T05:56:20.571 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-09-19T05:56:20.571 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /root 2024-09-19T05:56:20.571 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-09-19T05:56:20.571 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:20.621 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:56:20.650 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:56:20.750 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:56:20.766 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:56:20.766 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:20.766 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:56:20.766 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:21.298 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:56:21.332 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:56:21.701 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:56:21.735 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:56:22.253 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:56:22.279 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:56:22.280 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:22.280 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:56:22.280 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:56:22.280 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:56:22.280 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:22.292 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:56:22.316 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:56:22.417 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:56:22.503 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:56:22.527 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:56:22.527 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:22.527 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:56:22.527 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:56:22.527 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:56:22.527 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:22.587 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:56:22.618 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:56:22.642 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:56:22.642 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:22.642 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:56:22.642 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:56:22.642 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:56:22.642 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:22.686 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:56:22.697 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:56:22.697 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:56:22.719 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:56:22.795 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:56:22.820 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:56:22.846 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:56:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:56:22.982 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:56:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:56:22.994 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:22.994 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:56:22.994 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:56:22.994 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:56:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:23.012 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:56:23.037 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:56:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:56:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:56:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:56:23.037 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:23.088 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:56:23.100 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:56:23.109 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:56:23.166 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:56:23.207 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:56:23.221 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:56:23.287 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:56:23.413 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:56:23.463 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:56:23.539 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:56:23.653 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:56:23.766 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:56:23.784 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:56:23.796 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:56:23.820 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:56:23.820 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:23.820 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:56:23.820 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:56:23.820 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:56:23.820 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:23.834 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:56:23.864 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:56:23.869 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:56:23.886 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:56:23.886 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:23.886 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:56:23.887 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:23.897 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:56:23.939 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:56:23.962 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:56:23.963 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:23.963 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:56:23.963 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:56:23.963 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:56:23.963 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:24.209 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:56:24.242 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:56:24.265 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:56:24.266 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:56:24.266 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:24.266 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:56:24.266 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:56:24.266 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:56:24.266 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:24.288 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:56:24.289 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:24.289 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:56:24.289 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:56:24.289 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:56:24.289 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:24.309 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:56:24.331 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:56:24.331 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:24.332 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:56:24.332 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:24.342 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:56:24.371 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:56:24.376 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:56:24.400 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:56:24.400 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:24.400 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:56:24.400 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:56:24.400 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:56:24.400 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:24.402 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:56:24.464 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:56:24.493 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:56:24.727 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:56:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:56:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:56:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:56:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:56:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:25.544 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:56:25.570 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:56:26.540 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:56:26.562 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:56:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:56:26.824 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:56:26.856 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:56:26.879 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:56:26.880 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:26.880 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:56:26.880 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:56:26.880 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:56:26.881 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:26.931 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:56:26.943 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:56:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:56:27.094 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:56:28.034 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:56:28.059 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:56:28.083 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:56:28.083 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:28.083 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:56:28.083 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:56:28.083 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:56:28.083 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:28.126 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:56:28.149 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:56:28.149 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:28.149 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:56:28.150 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:28.193 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:56:28.217 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:56:28.217 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:28.217 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:56:28.218 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:56:28.218 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:56:28.218 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:28.544 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:56:28.567 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:56:28.567 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:56:28.567 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:56:28.567 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:56:28.568 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:56:28.568 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:28.852 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:56:28.893 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:56:28.934 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:56:28.966 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:56:28.993 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:56:29.186 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:56:29.232 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:56:29.254 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:56:29.284 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:56:29.330 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:56:29.331 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:56:29.373 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:56:29.414 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:56:29.445 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:56:29.473 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:56:29.665 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:56:29.720 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:56:29.750 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:56:29.789 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:56:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:56:29.930 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:56:29.969 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:56:29.990 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:56:30.464 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:56:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:56:30.832 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:56:30.907 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:56:30.956 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:56:31.039 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:56:31.068 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:56:31.094 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:56:31.128 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:56:31.128 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:56:31.204 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:56:31.204 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:56:31.280 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:56:31.305 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:56:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:56:31.310 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:56:31.357 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:56:31.447 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:56:31.490 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:56:31.490 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:56:31.495 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:56:31.574 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:56:31.580 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:56:31.609 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:56:31.635 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:56:31.639 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:56:31.669 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:56:31.669 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:56:31.753 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:56:31.753 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:56:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:56:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:56:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:56:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:56:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:56:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:56:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:56:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:56:33.122 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:56:33.164 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:56:33.204 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:56:33.236 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:56:33.263 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:56:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:56:33.501 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:56:33.532 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:56:33.567 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:56:33.608 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:56:34.154 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:56:34.196 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:56:34.217 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:56:35.053 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:56:35.134 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:56:35.184 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:56:35.279 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:56:35.329 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:56:35.354 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:56:35.388 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:56:35.388 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:56:35.464 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:56:35.464 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:56:35.539 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:56:35.564 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:56:35.570 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:56:35.570 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:56:35.750 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:56:35.750 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:56:35.842 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:56:35.907 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:56:37.379 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:56:37.379 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:56:37.379 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:56:37.379 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:56:37.379 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:56:37.379 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:56:37.379 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:56:37.380 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:56:37.381 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:56:37.393 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:56:37.393 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:56:37.393 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:56:37.393 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:56:37.393 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:56:37.393 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:56:37.393 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:56:37.393 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:56:37.393 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:56:37.393 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:56:37.394 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:56:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:56:37.396 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:56:37.397 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:56:37.398 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:56:37.399 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:56:37.400 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:56:37.401 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:56:37.402 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:56:37.403 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:56:37.403 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:56:37.403 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:56:37.403 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:56:37.403 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:56:37.403 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:56:37.403 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:56:37.403 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:56:37.951 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:56:37.951 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:56:37.951 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:56:37.951 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:56:37.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:56:37.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:56:37.965 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:56:37.965 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:56:37.965 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:56:37.965 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:56:37.965 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:56:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:56:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:56:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:56:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:56:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:56:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:56:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:56:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:56:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:56:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:56:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:56:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:56:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:56:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:56:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:56:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:56:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:56:40.107 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:56:40.108 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.109 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.110 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:56:40.111 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:56:40.112 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:56:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:56:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:56:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:56:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:56:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:56:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:56:40.113 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:56:40.114 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.115 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:56:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:56:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:56:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:56:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:56:40.116 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:56:40.117 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:56:40.118 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:56:40.119 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:56:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:56:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:56:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:56:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:56:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:56:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:56:40.120 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:56:40.121 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:56:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:56:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:56:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:56:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:56:40.122 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:56:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:56:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T05:56:40.123 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-19T05:56:40.556 DEBUG:teuthology.parallel:result is None 2024-09-19T05:56:40.730 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:56:40.731 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:40.731 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-09-19T05:56:40.731 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:40.731 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:40.731 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:40.731 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:40.731 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.731 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.731 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:56:40.731 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.732 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.733 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:56:40.734 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:56:40.735 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:56:40.736 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:56:40.737 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:56:40.738 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:56:40.739 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:56:40.740 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:56:40.742 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:56:40.743 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:56:40.744 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:56:40.744 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:56:40.744 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:56:40.744 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:56:40.744 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:56:40.744 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-19T05:56:41.168 DEBUG:teuthology.parallel:result is None 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:56:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:56:41.282 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:56:41.283 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:56:41.284 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:56:41.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:56:41.286 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:56:41.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:56:41.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:56:41.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:56:41.290 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:56:41.291 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:56:41.292 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:56:41.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:56:43.929 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:56:43.929 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:43.929 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-09-19T05:56:43.929 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:43.929 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:56:43.930 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:43.931 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:56:43.932 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.933 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:56:43.934 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:56:43.935 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:56:43.936 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:56:43.937 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:56:43.937 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:56:43.937 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:56:43.937 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:56:43.937 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:56:43.937 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:56:43.937 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:56:43.937 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:56:43.937 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:56:43.937 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:56:43.938 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:56:43.939 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:56:43.940 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.941 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:56:43.942 INFO:teuthology.orchestra.run.smithi174.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:56:43.942 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:56:43.942 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:56:43.942 INFO:teuthology.orchestra.run.smithi174.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:56:43.942 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:56:43.942 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:56:43.943 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:56:43.943 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:56:43.943 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-09-19T05:56:44.358 DEBUG:teuthology.parallel:result is None 2024-09-19T05:56:44.359 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:56:44.505 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:56:44.532 INFO:teuthology.orchestra.run.smithi103.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:56:44.532 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:56:44.532 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:56:44.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:56:44.675 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:56:44.701 INFO:teuthology.orchestra.run.smithi169.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:56:44.701 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:56:44.701 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:56:44.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:56:44.843 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:56:44.866 INFO:teuthology.orchestra.run.smithi174.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:56:44.866 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:56:44.866 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:56:44.868 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T05:56:44.868 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:56:44.868 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:56:44.901 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:56:44.902 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:56:44.934 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:56:44.934 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:56:44.961 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T05:56:44.961 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:56:44.961 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:56:44.991 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:56:45.059 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:56:45.060 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:56:45.090 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:56:45.159 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:56:45.159 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:56:45.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:56:45.249 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T05:56:45.283 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:56:45.283 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:56:45.311 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:56:45.378 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:56:45.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:56:45.407 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:56:45.476 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:56:45.476 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:56:45.501 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:56:45.566 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T05:56:45.566 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:56:45.566 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:56:45.593 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:56:45.660 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:56:45.660 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:56:45.687 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:56:45.754 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:56:45.754 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:56:45.778 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:56:45.843 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T05:56:45.942 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2}} 2024-09-19T05:56:45.943 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:56:45.944 INFO:tasks.cephadm:Cluster fsid is f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:45.944 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T05:56:45.944 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.103', 'mon.b': '172.21.15.169', 'mon.c': '172.21.15.174'} 2024-09-19T05:56:45.944 INFO:tasks.cephadm:First mon is mon.a on smithi103 2024-09-19T05:56:45.944 INFO:tasks.cephadm:First mgr is x 2024-09-19T05:56:45.944 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T05:56:45.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname $(hostname -s) 2024-09-19T05:56:45.973 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname $(hostname -s) 2024-09-19T05:56:46.001 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname $(hostname -s) 2024-09-19T05:56:46.026 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T05:56:46.026 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:56:46.168 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T05:56:46.307 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:56:46.309 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T05:56:46.309 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T05:56:46.309 DEBUG:teuthology.orchestra.run.smithi103:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:56:46.700 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:56 /home/ubuntu/cephtest/cephadm 2024-09-19T05:56:46.701 DEBUG:teuthology.orchestra.run.smithi169:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:56:47.093 INFO:teuthology.orchestra.run.smithi169.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:56 /home/ubuntu/cephtest/cephadm 2024-09-19T05:56:47.094 DEBUG:teuthology.orchestra.run.smithi174:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:56:47.478 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:56 /home/ubuntu/cephtest/cephadm 2024-09-19T05:56:47.478 DEBUG:teuthology.orchestra.run.smithi103:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:56:47.497 DEBUG:teuthology.orchestra.run.smithi169:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:56:47.517 DEBUG:teuthology.orchestra.run.smithi174:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:56:47.573 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T05:56:47.573 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:56:47.576 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:56:47.578 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:56:49.055 INFO:teuthology.orchestra.run.smithi174.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:56:49.153 INFO:teuthology.orchestra.run.smithi169.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:56:49.256 INFO:teuthology.orchestra.run.smithi103.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:57:17.247 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-19T05:57:17.247 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:57:17.247 INFO:teuthology.orchestra.run.smithi174.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:57:17.247 INFO:teuthology.orchestra.run.smithi174.stdout: "repo_digests": [ 2024-09-19T05:57:17.248 INFO:teuthology.orchestra.run.smithi174.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:57:17.248 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-09-19T05:57:17.248 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-19T05:57:33.462 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:57:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:57:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:57:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: "repo_digests": [ 2024-09-19T05:57:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:57:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:57:33.463 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:57:50.194 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-19T05:57:50.195 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:57:50.195 INFO:teuthology.orchestra.run.smithi169.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:57:50.195 INFO:teuthology.orchestra.run.smithi169.stdout: "repo_digests": [ 2024-09-19T05:57:50.195 INFO:teuthology.orchestra.run.smithi169.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:57:50.195 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-09-19T05:57:50.195 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-19T05:57:50.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph 2024-09-19T05:57:50.254 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph 2024-09-19T05:57:50.282 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph 2024-09-19T05:57:50.316 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /etc/ceph 2024-09-19T05:57:50.346 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /etc/ceph 2024-09-19T05:57:50.371 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /etc/ceph 2024-09-19T05:57:50.402 INFO:tasks.cephadm:Writing seed config... 2024-09-19T05:57:50.403 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T05:57:50.403 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T05:57:50.403 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T05:57:50.403 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T05:57:50.403 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T05:57:50.403 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T05:57:50.403 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T05:57:50.403 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T05:57:50.403 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T05:57:50.404 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T05:57:50.405 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T05:57:50.406 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-19T05:57:50.407 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:57:50.407 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T05:57:50.426 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f3f6d2a8-764b-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T05:57:50.426 DEBUG:teuthology.orchestra.run.smithi103:mon.a> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T05:57:50.469 DEBUG:teuthology.orchestra.run.smithi103:mgr.x> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T05:57:50.512 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T05:57:50.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.103 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:57:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:57:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', 'f3f6d2a8-764b-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.103', '--skip-admin-label'] 2024-09-19T05:57:50.724 INFO:teuthology.orchestra.run.smithi103.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T05:57:50.725 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying podman|docker is present... 2024-09-19T05:57:50.747 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 5.2.2 2024-09-19T05:57:50.748 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying lvm2 is present... 2024-09-19T05:57:50.748 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying time synchronization is in place... 2024-09-19T05:57:50.755 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T05:57:50.756 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T05:57:50.761 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T05:57:50.762 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-19T05:57:50.768 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout enabled 2024-09-19T05:57:50.775 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout active 2024-09-19T05:57:50.775 INFO:teuthology.orchestra.run.smithi103.stdout:Unit chronyd.service is enabled and running 2024-09-19T05:57:50.776 INFO:teuthology.orchestra.run.smithi103.stdout:Repeating the final host check... 2024-09-19T05:57:50.798 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 5.2.2 2024-09-19T05:57:50.798 INFO:teuthology.orchestra.run.smithi103.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T05:57:50.798 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl is present 2024-09-19T05:57:50.798 INFO:teuthology.orchestra.run.smithi103.stdout:lvcreate is present 2024-09-19T05:57:50.804 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T05:57:50.804 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T05:57:50.810 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T05:57:50.811 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-19T05:57:50.817 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout enabled 2024-09-19T05:57:50.823 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout active 2024-09-19T05:57:50.823 INFO:teuthology.orchestra.run.smithi103.stdout:Unit chronyd.service is enabled and running 2024-09-19T05:57:50.824 INFO:teuthology.orchestra.run.smithi103.stdout:Host looks OK 2024-09-19T05:57:50.824 INFO:teuthology.orchestra.run.smithi103.stdout:Cluster fsid: f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:57:50.824 INFO:teuthology.orchestra.run.smithi103.stdout:Acquiring lock 139795837150208 on /run/cephadm/f3f6d2a8-764b-11ef-bceb-c7b262605968.lock 2024-09-19T05:57:50.824 INFO:teuthology.orchestra.run.smithi103.stdout:Lock 139795837150208 acquired on /run/cephadm/f3f6d2a8-764b-11ef-bceb-c7b262605968.lock 2024-09-19T05:57:50.824 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying IP 172.21.15.103 port 3300 ... 2024-09-19T05:57:50.824 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying IP 172.21.15.103 port 6789 ... 2024-09-19T05:57:50.825 INFO:teuthology.orchestra.run.smithi103.stdout:Base mon IP(s) is [172.21.15.103:3300, 172.21.15.103:6789], mon addrv is [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-09-19T05:57:50.828 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.103 metric 100 2024-09-19T05:57:50.828 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.103 metric 100 2024-09-19T05:57:50.831 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T05:57:50.831 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T05:57:50.831 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T05:57:50.833 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T05:57:50.833 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T05:57:50.833 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T05:57:50.834 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T05:57:50.834 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-19T05:57:50.834 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T05:57:50.834 INFO:teuthology.orchestra.run.smithi103.stdout:Mon IP `172.21.15.103` is in CIDR network `172.21.0.0/20` 2024-09-19T05:57:50.834 INFO:teuthology.orchestra.run.smithi103.stdout:Mon IP `172.21.15.103` is in CIDR network `172.21.0.0/20` 2024-09-19T05:57:50.834 INFO:teuthology.orchestra.run.smithi103.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T05:57:50.835 INFO:teuthology.orchestra.run.smithi103.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T05:57:50.836 INFO:teuthology.orchestra.run.smithi103.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:57:52.038 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T05:57:52.038 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:57:52.039 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T05:57:52.039 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T05:57:52.039 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T05:57:52.039 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T05:57:52.039 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T05:57:52.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T05:57:52.983 INFO:teuthology.orchestra.run.smithi103.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T05:57:52.983 INFO:teuthology.orchestra.run.smithi103.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T05:57:53.980 INFO:teuthology.orchestra.run.smithi103.stdout:stat: stdout 167 167 2024-09-19T05:57:53.980 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial keys... 2024-09-19T05:57:54.844 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQBivetmy2SOEhAAFS86oLGTRzG1D291VUpx+Q== 2024-09-19T05:57:55.808 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQBjvetmhPMHCRAAoU1ktRf/PLDtg6cRSCTJ0g== 2024-09-19T05:57:56.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQBkvetmnYbXBhAA+m7q4NWc/JWIJjq/JYSlrQ== 2024-09-19T05:57:56.706 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial monmap... 2024-09-19T05:57:57.838 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T05:57:57.838 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T05:57:57.838 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:57:57.838 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T05:57:57.838 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool for a [v2:172.21.15.103:3300,v1:172.21.15.103:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T05:57:57.838 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = quincy 2024-09-19T05:57:57.838 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: set fsid to f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:57:57.838 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T05:57:57.838 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:57:57.838 INFO:teuthology.orchestra.run.smithi103.stdout:Creating mon... 2024-09-19T05:57:58.709 INFO:teuthology.orchestra.run.smithi103.stdout:create mon.a on 2024-09-19T05:57:58.917 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T05:57:59.062 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T05:57:59.269 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968.target. 2024-09-19T05:57:59.269 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968.target. 2024-09-19T05:57:59.538 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.a 2024-09-19T05:57:59.539 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T05:57:59.709 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968.target.wants/ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@.service. 2024-09-19T05:57:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:57:59 smithi103 podman[30533]: 2024-09-19 05:57:59.95937051 +0000 UTC m=+0.126210195 container create 60b8a881fdda8aa32bcd20e6a8e9158243757dbca236e0e1e15b6d51ebcbeeec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T05:58:00.252 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:58:00.252 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-19T05:58:00.261 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:58:00.261 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-19T05:58:00.261 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-19T05:58:00.261 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T05:58:00.261 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mon to start... 2024-09-19T05:58:00.261 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mon... 2024-09-19T05:58:00.381 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:00 smithi103 podman[30533]: 2024-09-19 05:58:00.161839354 +0000 UTC m=+0.328679037 container init 60b8a881fdda8aa32bcd20e6a8e9158243757dbca236e0e1e15b6d51ebcbeeec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T05:58:00.381 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:00 smithi103 podman[30533]: 2024-09-19 05:58:00.165334829 +0000 UTC m=+0.332174513 container start 60b8a881fdda8aa32bcd20e6a8e9158243757dbca236e0e1e15b6d51ebcbeeec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T05:58:00.381 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:00 smithi103 ceph-mon[30554]: mkfs f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:00.381 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:00 smithi103 ceph-mon[30554]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T05:58:00.381 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:00 smithi103 bash[30533]: 60b8a881fdda8aa32bcd20e6a8e9158243757dbca236e0e1e15b6d51ebcbeeec 2024-09-19T05:58:00.381 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:00 smithi103 systemd[1]: Started Ceph mon.a for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T05:58:01.311 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout id: f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout services: 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.555885s) 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout data: 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T05:58:01.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.690+0000 7fc9580c3640 1 Processor -- start 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.690+0000 7fc9580c3640 1 -- start start 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.690+0000 7fc9580c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.690+0000 7fc9580c3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc95007c800 con 0x7fc95007ddc0 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.691+0000 7fc955e5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.691+0000 7fc955e5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95007c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50352/0 (socket says 172.21.15.103:50352) 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.691+0000 7fc955e5f640 1 -- 172.21.15.103:0/2478660417 learned_addr learned my addr 172.21.15.103:0/2478660417 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.691+0000 7fc955e5f640 1 -- 172.21.15.103:0/2478660417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95007c980 con 0x7fc95007ddc0 2024-09-19T05:58:01.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.693+0000 7fc955e5f640 1 --2- 172.21.15.103:0/2478660417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95007c2c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009820 tx=0x7fc94c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5127e7d4e30be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:01.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.693+0000 7fc954e5d640 1 -- 172.21.15.103:0/2478660417 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94c037070 con 0x7fc95007ddc0 2024-09-19T05:58:01.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.693+0000 7fc954e5d640 1 -- 172.21.15.103:0/2478660417 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94c032440 con 0x7fc95007ddc0 2024-09-19T05:58:01.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.693+0000 7fc954e5d640 1 -- 172.21.15.103:0/2478660417 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94c032740 con 0x7fc95007ddc0 2024-09-19T05:58:01.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.694+0000 7fc9580c3640 1 -- 172.21.15.103:0/2478660417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 msgr2=0x7fc95007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:01.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.694+0000 7fc9580c3640 1 --2- 172.21.15.103:0/2478660417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95007c2c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009820 tx=0x7fc94c02a270 comp rx=0 tx=0).stop 2024-09-19T05:58:01.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.694+0000 7fc9580c3640 1 -- 172.21.15.103:0/2478660417 shutdown_connections 2024-09-19T05:58:01.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.694+0000 7fc9580c3640 1 --2- 172.21.15.103:0/2478660417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95007c2c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:01.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.694+0000 7fc9580c3640 1 -- 172.21.15.103:0/2478660417 >> 172.21.15.103:0/2478660417 conn(0x7fc950102ed0 msgr2=0x7fc9501052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.694+0000 7fc9580c3640 1 -- 172.21.15.103:0/2478660417 shutdown_connections 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.694+0000 7fc9580c3640 1 -- 172.21.15.103:0/2478660417 wait complete. 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.695+0000 7fc9580c3640 1 Processor -- start 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.695+0000 7fc9580c3640 1 -- start start 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.695+0000 7fc9580c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95019d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.695+0000 7fc9580c3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc95007cf20 con 0x7fc95007ddc0 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.695+0000 7fc955e5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95019d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.695+0000 7fc955e5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95019d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50362/0 (socket says 172.21.15.103:50362) 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.695+0000 7fc955e5f640 1 -- 172.21.15.103:0/1048293658 learned_addr learned my addr 172.21.15.103:0/1048293658 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.695+0000 7fc955e5f640 1 -- 172.21.15.103:0/1048293658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95019d540 con 0x7fc95007ddc0 2024-09-19T05:58:01.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.695+0000 7fc955e5f640 1 --2- 172.21.15.103:0/1048293658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95019d000 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0090b0 tx=0x7fc94c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:01.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.696+0000 7fc946ffd640 1 -- 172.21.15.103:0/1048293658 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94c041070 con 0x7fc95007ddc0 2024-09-19T05:58:01.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.696+0000 7fc946ffd640 1 -- 172.21.15.103:0/1048293658 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94c03c7a0 con 0x7fc95007ddc0 2024-09-19T05:58:01.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.696+0000 7fc9580c3640 1 -- 172.21.15.103:0/1048293658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95019d7d0 con 0x7fc95007ddc0 2024-09-19T05:58:01.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.696+0000 7fc946ffd640 1 -- 172.21.15.103:0/1048293658 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94c037040 con 0x7fc95007ddc0 2024-09-19T05:58:01.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.696+0000 7fc9580c3640 1 -- 172.21.15.103:0/1048293658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9501a04c0 con 0x7fc95007ddc0 2024-09-19T05:58:01.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.696+0000 7fc946ffd640 1 -- 172.21.15.103:0/1048293658 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc94c044070 con 0x7fc95007ddc0 2024-09-19T05:58:01.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.696+0000 7fc946ffd640 1 -- 172.21.15.103:0/1048293658 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc94c03d3f0 con 0x7fc95007ddc0 2024-09-19T05:58:01.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.697+0000 7fc9580c3640 1 -- 172.21.15.103:0/1048293658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95007c2c0 con 0x7fc95007ddc0 2024-09-19T05:58:01.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.699+0000 7fc946ffd640 1 -- 172.21.15.103:0/1048293658 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc94c046450 con 0x7fc95007ddc0 2024-09-19T05:58:01.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.757+0000 7fc9580c3640 1 -- 172.21.15.103:0/1048293658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fc9501a0a10 con 0x7fc95007ddc0 2024-09-19T05:58:01.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.758+0000 7fc946ffd640 1 -- 172.21.15.103:0/1048293658 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fc94c046630 con 0x7fc95007ddc0 2024-09-19T05:58:01.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.758+0000 7fc9580c3640 1 -- 172.21.15.103:0/1048293658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 msgr2=0x7fc95019d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:01.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.758+0000 7fc9580c3640 1 --2- 172.21.15.103:0/1048293658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95019d000 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0090b0 tx=0x7fc94c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:58:01.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.758+0000 7fc9580c3640 1 -- 172.21.15.103:0/1048293658 shutdown_connections 2024-09-19T05:58:01.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.758+0000 7fc9580c3640 1 --2- 172.21.15.103:0/1048293658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc95007ddc0 0x7fc95019d000 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:01.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.758+0000 7fc9580c3640 1 -- 172.21.15.103:0/1048293658 >> 172.21.15.103:0/1048293658 conn(0x7fc950102ed0 msgr2=0x7fc950103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:01.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.759+0000 7fc9580c3640 1 -- 172.21.15.103:0/1048293658 shutdown_connections 2024-09-19T05:58:01.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:00.759+0000 7fc9580c3640 1 -- 172.21.15.103:0/1048293658 wait complete. 2024-09-19T05:58:01.317 INFO:teuthology.orchestra.run.smithi103.stdout:mon is available 2024-09-19T05:58:01.317 INFO:teuthology.orchestra.run.smithi103.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T05:58:01.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T05:58:01.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: monmap epoch 1 2024-09-19T05:58:01.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:01.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: last_changed 2024-09-19T05:57:57.043810+0000 2024-09-19T05:58:01.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: created 2024-09-19T05:57:57.043810+0000 2024-09-19T05:58:01.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: min_mon_release 19 (squid) 2024-09-19T05:58:01.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: election_strategy: 1 2024-09-19T05:58:01.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-19T05:58:01.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: fsmap 2024-09-19T05:58:01.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T05:58:01.431 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: mgrmap e1: no daemons active 2024-09-19T05:58:01.431 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:01 smithi103 ceph-mon[30554]: from='client.? 172.21.15.103:0/1048293658' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T05:58:02.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:02 smithi103 ceph-mon[30554]: from='client.? 172.21.15.103:0/704473907' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T05:58:02.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:02 smithi103 ceph-mon[30554]: from='client.? 172.21.15.103:0/704473907' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout fsid = f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T05:58:02.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.703+0000 7f3756696640 1 Processor -- start 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.703+0000 7f3756696640 1 -- start start 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.703+0000 7f3756696640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f3750107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.703+0000 7f3756696640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f37501080b0 con 0x7f37501076e0 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.704+0000 7f374ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f3750107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:02.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.704+0000 7f374ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f3750107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50366/0 (socket says 172.21.15.103:50366) 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.704+0000 7f374ffff640 1 -- 172.21.15.103:0/150286653 learned_addr learned my addr 172.21.15.103:0/150286653 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.704+0000 7f374ffff640 1 -- 172.21.15.103:0/150286653 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3750108840 con 0x7f37501076e0 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.705+0000 7f374ffff640 1 --2- 172.21.15.103:0/150286653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f3750107ae0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3740009820 tx=0x7f374002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e57025a8b5d0925 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.705+0000 7f374effd640 1 -- 172.21.15.103:0/150286653 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3740037070 con 0x7f37501076e0 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.705+0000 7f374effd640 1 -- 172.21.15.103:0/150286653 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3740032440 con 0x7f37501076e0 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.705+0000 7f374effd640 1 -- 172.21.15.103:0/150286653 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3740032740 con 0x7f37501076e0 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.706+0000 7f3756696640 1 -- 172.21.15.103:0/150286653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 msgr2=0x7f3750107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.706+0000 7f3756696640 1 --2- 172.21.15.103:0/150286653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f3750107ae0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3740009820 tx=0x7f374002a270 comp rx=0 tx=0).stop 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.706+0000 7f3756696640 1 -- 172.21.15.103:0/150286653 shutdown_connections 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.706+0000 7f3756696640 1 --2- 172.21.15.103:0/150286653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f3750107ae0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.706+0000 7f3756696640 1 -- 172.21.15.103:0/150286653 >> 172.21.15.103:0/150286653 conn(0x7f3750102ed0 msgr2=0x7f37501052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.706+0000 7f3756696640 1 -- 172.21.15.103:0/150286653 shutdown_connections 2024-09-19T05:58:02.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.706+0000 7f3756696640 1 -- 172.21.15.103:0/150286653 wait complete. 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.706+0000 7f3756696640 1 Processor -- start 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.707+0000 7f3756696640 1 -- start start 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.707+0000 7f3756696640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f375007db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.707+0000 7f3756696640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3750108de0 con 0x7f37501076e0 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.707+0000 7f374ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f375007db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.707+0000 7f374ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f375007db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50370/0 (socket says 172.21.15.103:50370) 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.707+0000 7f374ffff640 1 -- 172.21.15.103:0/704473907 learned_addr learned my addr 172.21.15.103:0/704473907 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.707+0000 7f374ffff640 1 -- 172.21.15.103:0/704473907 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375007e090 con 0x7f37501076e0 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.707+0000 7f374ffff640 1 --2- 172.21.15.103:0/704473907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f375007db50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f37400090b0 tx=0x7f37400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.708+0000 7f374d7fa640 1 -- 172.21.15.103:0/704473907 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3740041070 con 0x7f37501076e0 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.708+0000 7f374d7fa640 1 -- 172.21.15.103:0/704473907 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f374003c7a0 con 0x7f37501076e0 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.708+0000 7f3756696640 1 -- 172.21.15.103:0/704473907 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375007c280 con 0x7f37501076e0 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.708+0000 7f374d7fa640 1 -- 172.21.15.103:0/704473907 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3740037040 con 0x7f37501076e0 2024-09-19T05:58:02.405 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.708+0000 7f3756696640 1 -- 172.21.15.103:0/704473907 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375007c7c0 con 0x7f37501076e0 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.708+0000 7f374d7fa640 1 -- 172.21.15.103:0/704473907 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3740044070 con 0x7f37501076e0 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.708+0000 7f374d7fa640 1 -- 172.21.15.103:0/704473907 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f374003d3f0 con 0x7f37501076e0 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.709+0000 7f3756696640 1 -- 172.21.15.103:0/704473907 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3750109430 con 0x7f37501076e0 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.711+0000 7f374d7fa640 1 -- 172.21.15.103:0/704473907 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3740046450 con 0x7f37501076e0 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.767+0000 7f3756696640 1 -- 172.21.15.103:0/704473907 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f375007cb00 con 0x7f37501076e0 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.770+0000 7f374d7fa640 1 -- 172.21.15.103:0/704473907 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f3740046630 con 0x7f37501076e0 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.771+0000 7f3756696640 1 -- 172.21.15.103:0/704473907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 msgr2=0x7f375007db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.771+0000 7f3756696640 1 --2- 172.21.15.103:0/704473907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f375007db50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f37400090b0 tx=0x7f37400046c0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.771+0000 7f3756696640 1 -- 172.21.15.103:0/704473907 shutdown_connections 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.771+0000 7f3756696640 1 --2- 172.21.15.103:0/704473907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37501076e0 0x7f375007db50 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.771+0000 7f3756696640 1 -- 172.21.15.103:0/704473907 >> 172.21.15.103:0/704473907 conn(0x7f3750102ed0 msgr2=0x7f375018f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.771+0000 7f3756696640 1 -- 172.21.15.103:0/704473907 shutdown_connections 2024-09-19T05:58:02.406 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:01.771+0000 7f3756696640 1 -- 172.21.15.103:0/704473907 wait complete. 2024-09-19T05:58:02.407 INFO:teuthology.orchestra.run.smithi103.stdout:Generating new minimal ceph.conf... 2024-09-19T05:58:03.492 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:03 smithi103 ceph-mon[30554]: from='client.? 172.21.15.103:0/174975079' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:03.500 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.813+0000 7fdadedef640 1 Processor -- start 2024-09-19T05:58:03.500 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.813+0000 7fdadedef640 1 -- start start 2024-09-19T05:58:03.500 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.813+0000 7fdadedef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad8107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.813+0000 7fdadedef640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81080b0 con 0x7fdad81076e0 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.813+0000 7fdadcb8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad8107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.813+0000 7fdadcb8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad8107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50382/0 (socket says 172.21.15.103:50382) 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.813+0000 7fdadcb8b640 1 -- 172.21.15.103:0/1953371763 learned_addr learned my addr 172.21.15.103:0/1953371763 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.813+0000 7fdadcb8b640 1 -- 172.21.15.103:0/1953371763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad8108840 con 0x7fdad81076e0 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.814+0000 7fdadcb8b640 1 --2- 172.21.15.103:0/1953371763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad8107ae0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009820 tx=0x7fdacc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d137c56c079646 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.814+0000 7fdad77fe640 1 -- 172.21.15.103:0/1953371763 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc037070 con 0x7fdad81076e0 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.814+0000 7fdad77fe640 1 -- 172.21.15.103:0/1953371763 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fdacc0328d0 con 0x7fdad81076e0 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.814+0000 7fdad77fe640 1 -- 172.21.15.103:0/1953371763 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc0307d0 con 0x7fdad81076e0 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.815+0000 7fdadedef640 1 -- 172.21.15.103:0/1953371763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 msgr2=0x7fdad8107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.815+0000 7fdadedef640 1 --2- 172.21.15.103:0/1953371763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad8107ae0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009820 tx=0x7fdacc02a270 comp rx=0 tx=0).stop 2024-09-19T05:58:03.501 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.815+0000 7fdadedef640 1 -- 172.21.15.103:0/1953371763 shutdown_connections 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.815+0000 7fdadedef640 1 --2- 172.21.15.103:0/1953371763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad8107ae0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.815+0000 7fdadedef640 1 -- 172.21.15.103:0/1953371763 >> 172.21.15.103:0/1953371763 conn(0x7fdad8102ed0 msgr2=0x7fdad81052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.815+0000 7fdadedef640 1 -- 172.21.15.103:0/1953371763 shutdown_connections 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.815+0000 7fdadedef640 1 -- 172.21.15.103:0/1953371763 wait complete. 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.815+0000 7fdadedef640 1 Processor -- start 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdadedef640 1 -- start start 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdadedef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad819d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdadedef640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdad810bbf0 con 0x7fdad81076e0 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdadcb8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad819d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdadcb8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad819d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50384/0 (socket says 172.21.15.103:50384) 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdadcb8b640 1 -- 172.21.15.103:0/174975079 learned_addr learned my addr 172.21.15.103:0/174975079 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:03.502 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdadcb8b640 1 -- 172.21.15.103:0/174975079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad819dda0 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdadcb8b640 1 --2- 172.21.15.103:0/174975079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad819d860 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009940 tx=0x7fdacc032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdad5ffb640 1 -- 172.21.15.103:0/174975079 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc042070 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdad5ffb640 1 -- 172.21.15.103:0/174975079 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fdacc030c80 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdadedef640 1 -- 172.21.15.103:0/174975079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad819e030 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.816+0000 7fdad5ffb640 1 -- 172.21.15.103:0/174975079 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc037040 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.817+0000 7fdadedef640 1 -- 172.21.15.103:0/174975079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad81a0d20 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.817+0000 7fdad5ffb640 1 -- 172.21.15.103:0/174975079 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdacc045070 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.817+0000 7fdad5ffb640 1 -- 172.21.15.103:0/174975079 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdacc0479e0 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.818+0000 7fdadedef640 1 -- 172.21.15.103:0/174975079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad810bd70 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.820+0000 7fdad5ffb640 1 -- 172.21.15.103:0/174975079 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdacc03c5f0 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.877+0000 7fdadedef640 1 -- 172.21.15.103:0/174975079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fdad81a12b0 con 0x7fdad81076e0 2024-09-19T05:58:03.503 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.877+0000 7fdad5ffb640 1 -- 172.21.15.103:0/174975079 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7fdacc03c7d0 con 0x7fdad81076e0 2024-09-19T05:58:03.504 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.878+0000 7fdadedef640 1 -- 172.21.15.103:0/174975079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 msgr2=0x7fdad819d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:03.504 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.878+0000 7fdadedef640 1 --2- 172.21.15.103:0/174975079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad819d860 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009940 tx=0x7fdacc032e10 comp rx=0 tx=0).stop 2024-09-19T05:58:03.504 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.878+0000 7fdadedef640 1 -- 172.21.15.103:0/174975079 shutdown_connections 2024-09-19T05:58:03.504 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.878+0000 7fdadedef640 1 --2- 172.21.15.103:0/174975079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad81076e0 0x7fdad819d860 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:03.504 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.878+0000 7fdadedef640 1 -- 172.21.15.103:0/174975079 >> 172.21.15.103:0/174975079 conn(0x7fdad8102ed0 msgr2=0x7fdad81039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:03.504 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.878+0000 7fdadedef640 1 -- 172.21.15.103:0/174975079 shutdown_connections 2024-09-19T05:58:03.504 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:02.878+0000 7fdadedef640 1 -- 172.21.15.103:0/174975079 wait complete. 2024-09-19T05:58:03.504 INFO:teuthology.orchestra.run.smithi103.stdout:Restarting the monitor... 2024-09-19T05:58:03.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:03 smithi103 systemd[1]: Stopping Ceph mon.a for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T05:58:04.213 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:03 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a[30550]: 2024-09-19T05:58:03.787+0000 7fb8ee991640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:58:04.213 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:03 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a[30550]: 2024-09-19T05:58:03.787+0000 7fb8ee991640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T05:58:04.213 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:03 smithi103 podman[30796]: 2024-09-19 05:58:03.921113306 +0000 UTC m=+0.259126979 container died 60b8a881fdda8aa32bcd20e6a8e9158243757dbca236e0e1e15b6d51ebcbeeec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T05:58:04.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:04 smithi103 podman[30796]: 2024-09-19 05:58:04.302508709 +0000 UTC m=+0.640522369 container cleanup 60b8a881fdda8aa32bcd20e6a8e9158243757dbca236e0e1e15b6d51ebcbeeec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T05:58:04.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:04 smithi103 bash[30796]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a 2024-09-19T05:58:04.934 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:04 smithi103 podman[30808]: 2024-09-19 05:58:04.578569556 +0000 UTC m=+0.660810916 container remove 60b8a881fdda8aa32bcd20e6a8e9158243757dbca236e0e1e15b6d51ebcbeeec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T05:58:04.935 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:04 smithi103 systemd[1]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T05:58:04.935 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:04 smithi103 systemd[1]: Stopped Ceph mon.a for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T05:58:04.935 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:04 smithi103 systemd[1]: Starting Ceph mon.a for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T05:58:05.190 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:04 smithi103 podman[30906]: 2024-09-19 05:58:04.835861388 +0000 UTC m=+0.015768459 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:58:05.190 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:04 smithi103 podman[30906]: 2024-09-19 05:58:04.937589348 +0000 UTC m=+0.117496405 container create d758afa5ef0d243034fe9d6a16b8f2ab6ea89d665efa9783b342a29bdb5dbf2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T05:58:05.190 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 podman[30906]: 2024-09-19 05:58:05.164851728 +0000 UTC m=+0.344758785 container init d758afa5ef0d243034fe9d6a16b8f2ab6ea89d665efa9783b342a29bdb5dbf2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:58:05.190 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 podman[30906]: 2024-09-19 05:58:05.167950427 +0000 UTC m=+0.347857485 container start d758afa5ef0d243034fe9d6a16b8f2ab6ea89d665efa9783b342a29bdb5dbf2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T05:58:05.287 INFO:teuthology.orchestra.run.smithi103.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T05:58:05.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: pidfile_write: ignore empty --pid-file 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: load: jerasure load: lrc 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: RocksDB version: 7.9.2 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Git sha 0 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: DB SUMMARY 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: DB Session ID: 8CDEG416RAN7G4DSAW7O 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: CURRENT file: CURRENT 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106084 ; 2024-09-19T05:58:05.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.error_if_exists: 0 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.create_if_missing: 0 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.paranoid_checks: 1 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.env: 0x5619bf0a4940 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.info_log: 0x5619c18e36e0 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.statistics: (nil) 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.use_fsync: 0 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_log_file_size: 0 2024-09-19T05:58:05.496 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.allow_fallocate: 1 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.use_direct_reads: 0 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.db_log_dir: 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.wal_dir: 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T05:58:05.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.write_buffer_manager: 0x5619c18f2dc0 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T05:58:05.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.unordered_write: 0 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.row_cache: None 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.wal_filter: None 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.two_write_queues: 0 2024-09-19T05:58:05.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.wal_compression: 0 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.atomic_flush: 0 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.log_readahead_size: 0 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T05:58:05.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_background_jobs: 2 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_background_compactions: -1 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_subcompactions: 1 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T05:58:05.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_open_files: -1 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_background_flushes: -1 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Compression algorithms supported: 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: kZSTD supported: 0 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: kXpressCompression supported: 0 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: kBZip2Compression supported: 0 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: kLZ4Compression supported: 1 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: kZlibCompression supported: 1 2024-09-19T05:58:05.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: kSnappyCompression supported: 1 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.merge_operator: 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_filter: None 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T05:58:05.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5619c18e3320) 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: cache_index_and_filter_blocks: 1 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: pin_top_level_index_and_filter: 1 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: index_type: 0 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: data_block_index_type: 0 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: index_shortening: 1 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: checksum: 4 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: no_block_cache: 0 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache: 0x5619c18d71f0 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache_name: BinnedLRUCache 2024-09-19T05:58:05.505 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache_options: 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: capacity : 536870912 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: num_shard_bits : 4 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: strict_capacity_limit : 0 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: high_pri_pool_ratio: 0.000 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache_compressed: (nil) 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: persistent_cache: (nil) 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_size: 4096 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_size_deviation: 10 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_restart_interval: 16 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: index_block_restart_interval: 1 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: metadata_block_size: 4096 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: partition_filters: 0 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: use_delta_encoding: 1 2024-09-19T05:58:05.506 INFO:journalctl@ceph.mon.a.smithi103.stdout: filter_policy: bloomfilter 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout: whole_key_filtering: 1 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout: verify_compression: 0 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout: read_amp_bytes_per_bit: 0 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout: format_version: 5 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout: enable_index_compression: 1 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_align: 0 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout: max_auto_readahead_size: 262144 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout: prepopulate_block_cache: 0 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout: initial_auto_readahead_size: 8192 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compression: NoCompression 2024-09-19T05:58:05.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.num_levels: 7 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:58:05.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T05:58:05.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T05:58:05.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.inplace_update_support: 0 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T05:58:05.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.bloom_locality: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.max_successive_merges: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.ttl: 2592000 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.enable_blob_files: false 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.min_blob_size: 0 2024-09-19T05:58:05.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fc9bd67f-704b-47e9-a088-4568789a9a9a 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725485194302, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725485195262, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101054, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 332, "table_properties": {"data_size": 98939, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14506, "raw_average_key_size": 49, "raw_value_size": 91113, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 291, "num_filter_entries": 291, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726725485, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fc9bd67f-704b-47e9-a088-4568789a9a9a", "db_session_id": "8CDEG416RAN7G4DSAW7O", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T05:58:05.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725485195360, "job": 1, "event": "recovery_finished"} 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5619c1904e00 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: DB pointer 0x5619c1a00000 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** DB Stats ** 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:58:05.514 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** Compaction Stats [default] ** 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: L0 2/0 100.55 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 164.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: Sum 2/0 100.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 164.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 164.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** Compaction Stats [default] ** 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 164.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-19T05:58:05.515 INFO:journalctl@ceph.mon.a.smithi103.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative compaction: 0.00 GB write, 30.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval compaction: 0.00 GB write, 30.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: Block cache BinnedLRUCache@0x5619c18d71f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-19T05:58:05.516 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: starting mon.a rank 0 at public addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] at bind addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: mon.a@-1(???) e1 preinit fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: mon.a@-1(???).mds e1 new map 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: mon.a@-1(???).mds e1 print_map 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout: e1 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout: btime 2024-09-19T05:58:00:204409+0000 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout: legacy client fscid: -1 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout: No filesystems configured 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:58:05.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: monmap epoch 1 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: last_changed 2024-09-19T05:57:57.043810+0000 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: created 2024-09-19T05:57:57.043810+0000 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: min_mon_release 19 (squid) 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: election_strategy: 1 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: fsmap 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 ceph-mon[30925]: mgrmap e1: no daemons active 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 bash[30906]: d758afa5ef0d243034fe9d6a16b8f2ab6ea89d665efa9783b342a29bdb5dbf2f 2024-09-19T05:58:05.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:05 smithi103 systemd[1]: Started Ceph mon.a for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T05:58:06.400 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.748+0000 7f659597c640 1 Processor -- start 2024-09-19T05:58:06.400 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.748+0000 7f659597c640 1 -- start start 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.748+0000 7f659597c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f6590107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.748+0000 7f659597c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6590108080 con 0x7f6590107740 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.749+0000 7f658effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f6590107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.749+0000 7f658effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f6590107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50398/0 (socket says 172.21.15.103:50398) 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.749+0000 7f658effd640 1 -- 172.21.15.103:0/2051172253 learned_addr learned my addr 172.21.15.103:0/2051172253 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.749+0000 7f658effd640 1 -- 172.21.15.103:0/2051172253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6590108200 con 0x7f6590107740 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.751+0000 7f658effd640 1 --2- 172.21.15.103:0/2051172253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f6590107b40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6580009e80 tx=0x7f658002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba127d753fb2590 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.751+0000 7f658dffb640 1 -- 172.21.15.103:0/2051172253 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6580036070 con 0x7f6590107740 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.751+0000 7f658dffb640 1 -- 172.21.15.103:0/2051172253 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6580031890 con 0x7f6590107740 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.751+0000 7f658dffb640 1 -- 172.21.15.103:0/2051172253 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6580007980 con 0x7f6590107740 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.752+0000 7f659597c640 1 -- 172.21.15.103:0/2051172253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 msgr2=0x7f6590107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.752+0000 7f659597c640 1 --2- 172.21.15.103:0/2051172253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f6590107b40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6580009e80 tx=0x7f658002a7a0 comp rx=0 tx=0).stop 2024-09-19T05:58:06.401 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.752+0000 7f659597c640 1 -- 172.21.15.103:0/2051172253 shutdown_connections 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.752+0000 7f659597c640 1 --2- 172.21.15.103:0/2051172253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f6590107b40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.752+0000 7f659597c640 1 -- 172.21.15.103:0/2051172253 >> 172.21.15.103:0/2051172253 conn(0x7f6590102f90 msgr2=0x7f65901053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.752+0000 7f659597c640 1 -- 172.21.15.103:0/2051172253 shutdown_connections 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.752+0000 7f659597c640 1 -- 172.21.15.103:0/2051172253 wait complete. 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.752+0000 7f659597c640 1 Processor -- start 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.753+0000 7f659597c640 1 -- start start 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.753+0000 7f659597c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f659019b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.753+0000 7f659597c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6590109740 con 0x7f6590107740 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.753+0000 7f658effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f659019b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.753+0000 7f658effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f659019b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50410/0 (socket says 172.21.15.103:50410) 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.753+0000 7f658effd640 1 -- 172.21.15.103:0/726061228 learned_addr learned my addr 172.21.15.103:0/726061228 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.753+0000 7f658effd640 1 -- 172.21.15.103:0/726061228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659019bb50 con 0x7f6590107740 2024-09-19T05:58:06.402 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.753+0000 7f658effd640 1 --2- 172.21.15.103:0/726061228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f659019b610 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6580009680 tx=0x7f6580031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.754+0000 7f659497a640 1 -- 172.21.15.103:0/726061228 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6580041020 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.754+0000 7f659597c640 1 -- 172.21.15.103:0/726061228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f659019bde0 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.754+0000 7f659497a640 1 -- 172.21.15.103:0/726061228 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f658003c900 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.754+0000 7f659497a640 1 -- 172.21.15.103:0/726061228 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6580036040 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.754+0000 7f659597c640 1 -- 172.21.15.103:0/726061228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f659019ead0 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.754+0000 7f659497a640 1 -- 172.21.15.103:0/726061228 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6580044020 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.754+0000 7f659497a640 1 -- 172.21.15.103:0/726061228 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6580046930 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.755+0000 7f659597c640 1 -- 172.21.15.103:0/726061228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6590107bc0 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.757+0000 7f659497a640 1 -- 172.21.15.103:0/726061228 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f658004b020 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.814+0000 7f659597c640 1 -- 172.21.15.103:0/726061228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f659019f0e0 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.816+0000 7f659497a640 1 -- 172.21.15.103:0/726061228 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f6580031830 con 0x7f6590107740 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.817+0000 7f659597c640 1 -- 172.21.15.103:0/726061228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 msgr2=0x7f659019b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:06.403 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.817+0000 7f659597c640 1 --2- 172.21.15.103:0/726061228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f659019b610 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6580009680 tx=0x7f6580031c70 comp rx=0 tx=0).stop 2024-09-19T05:58:06.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.817+0000 7f659597c640 1 -- 172.21.15.103:0/726061228 shutdown_connections 2024-09-19T05:58:06.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.817+0000 7f659597c640 1 --2- 172.21.15.103:0/726061228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6590107740 0x7f659019b610 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:06.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.817+0000 7f659597c640 1 -- 172.21.15.103:0/726061228 >> 172.21.15.103:0/726061228 conn(0x7f6590102f90 msgr2=0x7f6590103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:06.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.817+0000 7f659597c640 1 -- 172.21.15.103:0/726061228 shutdown_connections 2024-09-19T05:58:06.404 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:05.817+0000 7f659597c640 1 -- 172.21.15.103:0/726061228 wait complete. 2024-09-19T05:58:06.404 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T05:58:06.422 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:58:06.423 INFO:teuthology.orchestra.run.smithi103.stdout:Creating mgr... 2024-09-19T05:58:06.423 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T05:58:06.423 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T05:58:06.678 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.x 2024-09-19T05:58:06.678 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T05:58:06.827 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968.target.wants/ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@.service. 2024-09-19T05:58:06.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:06 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/726061228' entity='client.admin' 2024-09-19T05:58:06.994 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:06 smithi103 systemd[1]: Starting Ceph mgr.x for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T05:58:07.328 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 podman[31136]: 2024-09-19 05:58:07.04939048 +0000 UTC m=+0.107179687 container create d9f2da171f7537487ae8552423ad0836878134afed3b63e3a1dfd6331e18129d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T05:58:07.328 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 podman[31136]: 2024-09-19 05:58:06.958317527 +0000 UTC m=+0.016106678 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:58:07.328 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 podman[31136]: 2024-09-19 05:58:07.251844403 +0000 UTC m=+0.309633544 container init d9f2da171f7537487ae8552423ad0836878134afed3b63e3a1dfd6331e18129d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:58:07.328 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 podman[31136]: 2024-09-19 05:58:07.254727944 +0000 UTC m=+0.312517087 container start d9f2da171f7537487ae8552423ad0836878134afed3b63e3a1dfd6331e18129d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T05:58:07.328 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 bash[31136]: d9f2da171f7537487ae8552423ad0836878134afed3b63e3a1dfd6331e18129d 2024-09-19T05:58:07.343 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:58:07.343 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-19T05:58:07.350 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:58:07.351 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-19T05:58:07.351 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-19T05:58:07.351 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T05:58:07.359 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:58:07.359 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-19T05:58:07.367 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:58:07.367 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-19T05:58:07.367 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-19T05:58:07.367 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T05:58:07.367 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr to start... 2024-09-19T05:58:07.367 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr... 2024-09-19T05:58:07.591 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 systemd[1]: Started Ceph mgr.x for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T05:58:07.591 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:07.376+0000 7f4717dd0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:58:07.591 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:07.436+0000 7f4717dd0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:58:07.591 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:07.588+0000 7f4717dd0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:58:07.864 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:07.656+0000 7f4717dd0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:58:07.865 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:07.811+0000 7f4717dd0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:58:08.184 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:07 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2293449309' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:58:08.184 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:07.959+0000 7f4717dd0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:58:08.468 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:08 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:08.279+0000 7f4717dd0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:58:08.468 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:08 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:08.339+0000 7f4717dd0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:58:08.472 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:08.472 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:58:08.472 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "f3f6d2a8-764b-11ef-bceb-c7b262605968", 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T05:58:08.473 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:58:08.474 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:08.474 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:58:08.474 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:58:08.474 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:08.474 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:58:08.474 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:08.474 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:58:08.474 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:58:08.474 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:58:08.482 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:58:00:204409+0000", 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:58:08.483 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:58:00.205247+0000", 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:58:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.791+0000 7f55611de640 1 Processor -- start 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.791+0000 7f55611de640 1 -- start start 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.791+0000 7f55611de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c1062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.791+0000 7f55611de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f555c07be40 con 0x7f555c105ed0 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.792+0000 7f555ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c1062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.792+0000 7f555ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c1062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50422/0 (socket says 172.21.15.103:50422) 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.792+0000 7f555ad9d640 1 -- 172.21.15.103:0/3196898863 learned_addr learned my addr 172.21.15.103:0/3196898863 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.792+0000 7f555ad9d640 1 -- 172.21.15.103:0/3196898863 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555c106810 con 0x7f555c105ed0 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.793+0000 7f555ad9d640 1 --2- 172.21.15.103:0/3196898863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c1062d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f554c009820 tx=0x7f554c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d250106fc5a65b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.793+0000 7f5559d9b640 1 -- 172.21.15.103:0/3196898863 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f554c037070 con 0x7f555c105ed0 2024-09-19T05:58:08.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.793+0000 7f5559d9b640 1 -- 172.21.15.103:0/3196898863 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f554c0328d0 con 0x7f555c105ed0 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.793+0000 7f5559d9b640 1 -- 172.21.15.103:0/3196898863 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f554c0307d0 con 0x7f555c105ed0 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.794+0000 7f55611de640 1 -- 172.21.15.103:0/3196898863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 msgr2=0x7f555c1062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.794+0000 7f55611de640 1 --2- 172.21.15.103:0/3196898863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c1062d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f554c009820 tx=0x7f554c02a270 comp rx=0 tx=0).stop 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.794+0000 7f55611de640 1 -- 172.21.15.103:0/3196898863 shutdown_connections 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.794+0000 7f55611de640 1 --2- 172.21.15.103:0/3196898863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c1062d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.794+0000 7f55611de640 1 -- 172.21.15.103:0/3196898863 >> 172.21.15.103:0/3196898863 conn(0x7f555c101d80 msgr2=0x7f555c1041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.794+0000 7f55611de640 1 -- 172.21.15.103:0/3196898863 shutdown_connections 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.794+0000 7f55611de640 1 -- 172.21.15.103:0/3196898863 wait complete. 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.794+0000 7f55611de640 1 Processor -- start 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.795+0000 7f55611de640 1 -- start start 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.795+0000 7f55611de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c19d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.795+0000 7f55611de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f555c1078b0 con 0x7f555c105ed0 2024-09-19T05:58:08.486 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.795+0000 7f555ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c19d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.795+0000 7f555ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c19d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50436/0 (socket says 172.21.15.103:50436) 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.795+0000 7f555ad9d640 1 -- 172.21.15.103:0/2293449309 learned_addr learned my addr 172.21.15.103:0/2293449309 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.795+0000 7f555ad9d640 1 -- 172.21.15.103:0/2293449309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555c19dd70 con 0x7f555c105ed0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.796+0000 7f555ad9d640 1 --2- 172.21.15.103:0/2293449309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c19d830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f554c0097f0 tx=0x7f554c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.796+0000 7f5543fff640 1 -- 172.21.15.103:0/2293449309 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f554c037040 con 0x7f555c105ed0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.796+0000 7f5543fff640 1 -- 172.21.15.103:0/2293449309 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f554c03b3f0 con 0x7f555c105ed0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.796+0000 7f55611de640 1 -- 172.21.15.103:0/2293449309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555c19e000 con 0x7f555c105ed0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.796+0000 7f5543fff640 1 -- 172.21.15.103:0/2293449309 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f554c03a520 con 0x7f555c105ed0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.796+0000 7f55611de640 1 -- 172.21.15.103:0/2293449309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555c1a0cf0 con 0x7f555c105ed0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.796+0000 7f5543fff640 1 -- 172.21.15.103:0/2293449309 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f554c03a6c0 con 0x7f555c105ed0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.796+0000 7f5543fff640 1 -- 172.21.15.103:0/2293449309 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f554c044b00 con 0x7f555c105ed0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.797+0000 7f55611de640 1 -- 172.21.15.103:0/2293449309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f555c1062d0 con 0x7f555c105ed0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.801+0000 7f5543fff640 1 -- 172.21.15.103:0/2293449309 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f554c03b980 con 0x7f555c105ed0 2024-09-19T05:58:08.487 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.862+0000 7f55611de640 1 -- 172.21.15.103:0/2293449309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f555c196ca0 con 0x7f555c105ed0 2024-09-19T05:58:08.488 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.862+0000 7f5543fff640 1 -- 172.21.15.103:0/2293449309 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f554c03b5a0 con 0x7f555c105ed0 2024-09-19T05:58:08.488 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.863+0000 7f55611de640 1 -- 172.21.15.103:0/2293449309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 msgr2=0x7f555c19d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:08.488 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.863+0000 7f55611de640 1 --2- 172.21.15.103:0/2293449309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c19d830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f554c0097f0 tx=0x7f554c030d00 comp rx=0 tx=0).stop 2024-09-19T05:58:08.488 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.864+0000 7f55611de640 1 -- 172.21.15.103:0/2293449309 shutdown_connections 2024-09-19T05:58:08.488 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.864+0000 7f55611de640 1 --2- 172.21.15.103:0/2293449309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f555c105ed0 0x7f555c19d830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:08.488 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.864+0000 7f55611de640 1 -- 172.21.15.103:0/2293449309 >> 172.21.15.103:0/2293449309 conn(0x7f555c101d80 msgr2=0x7f555c191b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:08.488 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.864+0000 7f55611de640 1 -- 172.21.15.103:0/2293449309 shutdown_connections 2024-09-19T05:58:08.488 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:07.864+0000 7f55611de640 1 -- 172.21.15.103:0/2293449309 wait complete. 2024-09-19T05:58:08.488 INFO:teuthology.orchestra.run.smithi103.stdout:mgr not available, waiting (1/15)... 2024-09-19T05:58:08.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:08 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:08.527+0000 7f4717dd0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:58:09.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:09 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:09.407+0000 7f4717dd0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:58:09.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:09 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:09.473+0000 7f4717dd0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:58:10.447 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:10.188+0000 7f4717dd0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:58:10.447 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:10.302+0000 7f4717dd0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:58:10.447 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:10.444+0000 7f4717dd0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:58:10.735 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:10.508+0000 7f4717dd0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:58:10.735 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:10.662+0000 7f4717dd0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:58:10.735 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:10.732+0000 7f4717dd0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:58:10.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:10.794+0000 7f4717dd0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:58:10.988 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:10.956+0000 7f4717dd0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:58:11.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:11 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/339979658' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:58:11.243 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:11 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:11.026+0000 7f4717dd0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:58:11.243 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:11 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:11.097+0000 7f4717dd0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:58:11.243 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:11 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:11.180+0000 7f4717dd0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:58:11.494 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:11 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:11.240+0000 7f4717dd0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:58:11.494 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:11 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:11.301+0000 7f4717dd0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:58:11.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:11.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:58:11.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "f3f6d2a8-764b-11ef-bceb-c7b262605968", 2024-09-19T05:58:11.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:58:11.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:58:11.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:58:11.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:58:11.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:11.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:58:11.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:58:11.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:58:11.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:58:11.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:58:11.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:58:11.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:58:11.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T05:58:11.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:58:11.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:58:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:11.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:58:00:204409+0000", 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:58:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:58:00.205247+0000", 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.987+0000 7fe73e852640 1 Processor -- start 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.987+0000 7fe73e852640 1 -- start start 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.988+0000 7fe73e852640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73810a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.988+0000 7fe73e852640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe73807bde0 con 0x7fe738108140 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.988+0000 7fe737fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73810a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.988+0000 7fe737fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73810a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38404/0 (socket says 172.21.15.103:38404) 2024-09-19T05:58:11.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.988+0000 7fe737fff640 1 -- 172.21.15.103:0/2421442332 learned_addr learned my addr 172.21.15.103:0/2421442332 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.988+0000 7fe737fff640 1 -- 172.21.15.103:0/2421442332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73810aa70 con 0x7fe738108140 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.989+0000 7fe737fff640 1 --2- 172.21.15.103:0/2421442332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73810a530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe728009820 tx=0x7fe72802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926c4d4fbee0aadd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.989+0000 7fe736ffd640 1 -- 172.21.15.103:0/2421442332 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe728037070 con 0x7fe738108140 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.989+0000 7fe736ffd640 1 -- 172.21.15.103:0/2421442332 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe7280328d0 con 0x7fe738108140 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.989+0000 7fe736ffd640 1 -- 172.21.15.103:0/2421442332 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7280307d0 con 0x7fe738108140 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.990+0000 7fe73e852640 1 -- 172.21.15.103:0/2421442332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 msgr2=0x7fe73810a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.990+0000 7fe73e852640 1 --2- 172.21.15.103:0/2421442332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73810a530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe728009820 tx=0x7fe72802a270 comp rx=0 tx=0).stop 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.990+0000 7fe73e852640 1 -- 172.21.15.103:0/2421442332 shutdown_connections 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.990+0000 7fe73e852640 1 --2- 172.21.15.103:0/2421442332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73810a530 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.990+0000 7fe73e852640 1 -- 172.21.15.103:0/2421442332 >> 172.21.15.103:0/2421442332 conn(0x7fe738101d80 msgr2=0x7fe7381041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.990+0000 7fe73e852640 1 -- 172.21.15.103:0/2421442332 shutdown_connections 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.990+0000 7fe73e852640 1 -- 172.21.15.103:0/2421442332 wait complete. 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.990+0000 7fe73e852640 1 Processor -- start 2024-09-19T05:58:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.990+0000 7fe73e852640 1 -- start start 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.991+0000 7fe73e852640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73819b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.991+0000 7fe73e852640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe73810b9f0 con 0x7fe738108140 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.991+0000 7fe737fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73819b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.991+0000 7fe737fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73819b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38416/0 (socket says 172.21.15.103:38416) 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.991+0000 7fe737fff640 1 -- 172.21.15.103:0/339979658 learned_addr learned my addr 172.21.15.103:0/339979658 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.991+0000 7fe737fff640 1 -- 172.21.15.103:0/339979658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73819bb30 con 0x7fe738108140 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.991+0000 7fe737fff640 1 --2- 172.21.15.103:0/339979658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73819b5f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe7280097f0 tx=0x7fe728030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.991+0000 7fe7357fa640 1 -- 172.21.15.103:0/339979658 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe728037040 con 0x7fe738108140 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.991+0000 7fe7357fa640 1 -- 172.21.15.103:0/339979658 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe72803b3f0 con 0x7fe738108140 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.991+0000 7fe73e852640 1 -- 172.21.15.103:0/339979658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73819bdc0 con 0x7fe738108140 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.992+0000 7fe7357fa640 1 -- 172.21.15.103:0/339979658 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe72803a520 con 0x7fe738108140 2024-09-19T05:58:11.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.992+0000 7fe73e852640 1 -- 172.21.15.103:0/339979658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73819eab0 con 0x7fe738108140 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.992+0000 7fe7357fa640 1 -- 172.21.15.103:0/339979658 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe72803a710 con 0x7fe738108140 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.992+0000 7fe7357fa640 1 -- 172.21.15.103:0/339979658 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe728044b50 con 0x7fe738108140 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.993+0000 7fe73e852640 1 -- 172.21.15.103:0/339979658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7381085a0 con 0x7fe738108140 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:10.996+0000 7fe7357fa640 1 -- 172.21.15.103:0/339979658 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe72803b980 con 0x7fe738108140 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:11.057+0000 7fe73e852640 1 -- 172.21.15.103:0/339979658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe73819f020 con 0x7fe738108140 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:11.057+0000 7fe7357fa640 1 -- 172.21.15.103:0/339979658 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fe72803b5a0 con 0x7fe738108140 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:11.058+0000 7fe73e852640 1 -- 172.21.15.103:0/339979658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 msgr2=0x7fe73819b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:11.058+0000 7fe73e852640 1 --2- 172.21.15.103:0/339979658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73819b5f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe7280097f0 tx=0x7fe728030d00 comp rx=0 tx=0).stop 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:11.058+0000 7fe73e852640 1 -- 172.21.15.103:0/339979658 shutdown_connections 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:11.058+0000 7fe73e852640 1 --2- 172.21.15.103:0/339979658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe738108140 0x7fe73819b5f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:11.058+0000 7fe73e852640 1 -- 172.21.15.103:0/339979658 >> 172.21.15.103:0/339979658 conn(0x7fe738101d80 msgr2=0x7fe738102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:11.058+0000 7fe73e852640 1 -- 172.21.15.103:0/339979658 shutdown_connections 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:11.058+0000 7fe73e852640 1 -- 172.21.15.103:0/339979658 wait complete. 2024-09-19T05:58:11.721 INFO:teuthology.orchestra.run.smithi103.stdout:mgr not available, waiting (2/15)... 2024-09-19T05:58:12.494 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:12 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:12.099+0000 7f4717dd0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:58:12.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:12 smithi103 ceph-mon[30925]: Activating manager daemon x 2024-09-19T05:58:12.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:12 smithi103 ceph-mon[30925]: mgrmap e2: x(active, starting, since 0.00308605s) 2024-09-19T05:58:12.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:12 smithi103 ceph-mon[30925]: from='mgr.14100 172.21.15.103:0/1221068177' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:58:12.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:12 smithi103 ceph-mon[30925]: from='mgr.14100 172.21.15.103:0/1221068177' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:58:12.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:12 smithi103 ceph-mon[30925]: from='mgr.14100 172.21.15.103:0/1221068177' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:58:12.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:12 smithi103 ceph-mon[30925]: from='mgr.14100 172.21.15.103:0/1221068177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:58:12.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:12 smithi103 ceph-mon[30925]: from='mgr.14100 172.21.15.103:0/1221068177' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:58:13.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:13 smithi103 ceph-mon[30925]: Manager daemon x is now available 2024-09-19T05:58:13.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:13 smithi103 ceph-mon[30925]: from='mgr.14100 172.21.15.103:0/1221068177' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:58:13.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:13 smithi103 ceph-mon[30925]: from='mgr.14100 172.21.15.103:0/1221068177' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:58:13.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:13 smithi103 ceph-mon[30925]: from='mgr.14100 172.21.15.103:0/1221068177' entity='mgr.x' 2024-09-19T05:58:13.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:13 smithi103 ceph-mon[30925]: from='mgr.14100 172.21.15.103:0/1221068177' entity='mgr.x' 2024-09-19T05:58:13.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:13 smithi103 ceph-mon[30925]: from='mgr.14100 172.21.15.103:0/1221068177' entity='mgr.x' 2024-09-19T05:58:13.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:13 smithi103 ceph-mon[30925]: mgrmap e3: x(active, since 1.00702s) 2024-09-19T05:58:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:58:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "f3f6d2a8-764b-11ef-bceb-c7b262605968", 2024-09-19T05:58:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:58:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:58:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:58:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:58:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:14.987 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:58:14.988 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:58:00:204409+0000", 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:58:00.205247+0000", 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.168+0000 7fd7ae1d7640 1 Processor -- start 2024-09-19T05:58:14.990 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.169+0000 7fd7ae1d7640 1 -- start start 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.169+0000 7fd7ae1d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a810a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.169+0000 7fd7ae1d7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a807be40 con 0x7fd7a81080e0 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.169+0000 7fd7a77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a810a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.169+0000 7fd7a77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a810a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38484/0 (socket says 172.21.15.103:38484) 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.169+0000 7fd7a77fe640 1 -- 172.21.15.103:0/1997468847 learned_addr learned my addr 172.21.15.103:0/1997468847 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.169+0000 7fd7a77fe640 1 -- 172.21.15.103:0/1997468847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a810aa10 con 0x7fd7a81080e0 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.170+0000 7fd7a77fe640 1 --2- 172.21.15.103:0/1997468847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a810a4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd798009820 tx=0x7fd79802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc7f8e92630e2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.170+0000 7fd7a6ffd640 1 -- 172.21.15.103:0/1997468847 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd798037070 con 0x7fd7a81080e0 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.170+0000 7fd7a6ffd640 1 -- 172.21.15.103:0/1997468847 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd7980328d0 con 0x7fd7a81080e0 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.170+0000 7fd7a6ffd640 1 -- 172.21.15.103:0/1997468847 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7980307d0 con 0x7fd7a81080e0 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.171+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/1997468847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 msgr2=0x7fd7a810a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.171+0000 7fd7ae1d7640 1 --2- 172.21.15.103:0/1997468847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a810a4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd798009820 tx=0x7fd79802a270 comp rx=0 tx=0).stop 2024-09-19T05:58:14.991 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.171+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/1997468847 shutdown_connections 2024-09-19T05:58:14.992 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.171+0000 7fd7ae1d7640 1 --2- 172.21.15.103:0/1997468847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a810a4d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:14.992 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.171+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/1997468847 >> 172.21.15.103:0/1997468847 conn(0x7fd7a8101d80 msgr2=0x7fd7a81041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:14.992 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.171+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/1997468847 shutdown_connections 2024-09-19T05:58:14.992 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.171+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/1997468847 wait complete. 2024-09-19T05:58:14.992 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.171+0000 7fd7ae1d7640 1 Processor -- start 2024-09-19T05:58:14.992 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7ae1d7640 1 -- start start 2024-09-19T05:58:14.992 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7ae1d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a819b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:14.992 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7ae1d7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a810b9f0 con 0x7fd7a81080e0 2024-09-19T05:58:14.992 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7a77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a819b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7a77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a819b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38488/0 (socket says 172.21.15.103:38488) 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7a77fe640 1 -- 172.21.15.103:0/286693403 learned_addr learned my addr 172.21.15.103:0/286693403 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7a77fe640 1 -- 172.21.15.103:0/286693403 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a819bb30 con 0x7fd7a81080e0 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7a77fe640 1 --2- 172.21.15.103:0/286693403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a819b5f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd798030520 tx=0x7fd798032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7a57fa640 1 -- 172.21.15.103:0/286693403 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd798042070 con 0x7fd7a81080e0 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7a57fa640 1 -- 172.21.15.103:0/286693403 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd798030cc0 con 0x7fd7a81080e0 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/286693403 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a819bdc0 con 0x7fd7a81080e0 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7a57fa640 1 -- 172.21.15.103:0/286693403 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd798037040 con 0x7fd7a81080e0 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.172+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/286693403 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a819eab0 con 0x7fd7a81080e0 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.173+0000 7fd7a57fa640 1 -- 172.21.15.103:0/286693403 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fd798045070 con 0x7fd7a81080e0 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.173+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/286693403 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a8108540 con 0x7fd7a81080e0 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.173+0000 7fd7a57fa640 1 --2- 172.21.15.103:0/286693403 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7fd7940391b0 0x7fd79403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:14.993 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.173+0000 7fd7a57fa640 1 -- 172.21.15.103:0/286693403 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd79806c3a0 con 0x7fd7a81080e0 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.174+0000 7fd79ffff640 1 --2- 172.21.15.103:0/286693403 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7fd7940391b0 0x7fd79403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.174+0000 7fd79ffff640 1 --2- 172.21.15.103:0/286693403 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7fd7940391b0 0x7fd79403b670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd7900098c0 tx=0x7fd790006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.178+0000 7fd7a57fa640 1 -- 172.21.15.103:0/286693403 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd798045360 con 0x7fd7a81080e0 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.410+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/286693403 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd7a819f130 con 0x7fd7a81080e0 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.411+0000 7fd7a57fa640 1 -- 172.21.15.103:0/286693403 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fd79806bdc0 con 0x7fd7a81080e0 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.413+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/286693403 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7fd7940391b0 msgr2=0x7fd79403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.413+0000 7fd7ae1d7640 1 --2- 172.21.15.103:0/286693403 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7fd7940391b0 0x7fd79403b670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd7900098c0 tx=0x7fd790006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.413+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/286693403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 msgr2=0x7fd7a819b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.413+0000 7fd7ae1d7640 1 --2- 172.21.15.103:0/286693403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a819b5f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd798030520 tx=0x7fd798032dd0 comp rx=0 tx=0).stop 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.413+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/286693403 shutdown_connections 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.413+0000 7fd7ae1d7640 1 --2- 172.21.15.103:0/286693403 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7fd7940391b0 0x7fd79403b670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.413+0000 7fd7ae1d7640 1 --2- 172.21.15.103:0/286693403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7a81080e0 0x7fd7a819b5f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:14.995 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.413+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/286693403 >> 172.21.15.103:0/286693403 conn(0x7fd7a8101d80 msgr2=0x7fd7a8102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:14.995 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.413+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/286693403 shutdown_connections 2024-09-19T05:58:14.995 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:14.413+0000 7fd7ae1d7640 1 -- 172.21.15.103:0/286693403 wait complete. 2024-09-19T05:58:14.995 INFO:teuthology.orchestra.run.smithi103.stdout:mgr is available 2024-09-19T05:58:15.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:15 smithi103 ceph-mon[30925]: mgrmap e4: x(active, since 2s) 2024-09-19T05:58:15.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:15 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/286693403' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:58:16.221 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:16 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2633382511' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T05:58:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout fsid = f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T05:58:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.392+0000 7faa85f15640 1 Processor -- start 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.392+0000 7faa85f15640 1 -- start start 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.392+0000 7faa85f15640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa80107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.392+0000 7faa85f15640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faa801080b0 con 0x7faa801076e0 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.392+0000 7faa7f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa80107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.392+0000 7faa7f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa80107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38496/0 (socket says 172.21.15.103:38496) 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.392+0000 7faa7f7fe640 1 -- 172.21.15.103:0/1258243690 learned_addr learned my addr 172.21.15.103:0/1258243690 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.393+0000 7faa7f7fe640 1 -- 172.21.15.103:0/1258243690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa80108840 con 0x7faa801076e0 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa7f7fe640 1 --2- 172.21.15.103:0/1258243690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa80107ae0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa70009820 tx=0x7faa7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11127b70e482d4d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa7e7fc640 1 -- 172.21.15.103:0/1258243690 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa70037070 con 0x7faa801076e0 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa7e7fc640 1 -- 172.21.15.103:0/1258243690 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7faa700328d0 con 0x7faa801076e0 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa7e7fc640 1 -- 172.21.15.103:0/1258243690 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa700307d0 con 0x7faa801076e0 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa85f15640 1 -- 172.21.15.103:0/1258243690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 msgr2=0x7faa80107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa85f15640 1 --2- 172.21.15.103:0/1258243690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa80107ae0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa70009820 tx=0x7faa7002a270 comp rx=0 tx=0).stop 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa85f15640 1 -- 172.21.15.103:0/1258243690 shutdown_connections 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa85f15640 1 --2- 172.21.15.103:0/1258243690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa80107ae0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa85f15640 1 -- 172.21.15.103:0/1258243690 >> 172.21.15.103:0/1258243690 conn(0x7faa80102ed0 msgr2=0x7faa801052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa85f15640 1 -- 172.21.15.103:0/1258243690 shutdown_connections 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.394+0000 7faa85f15640 1 -- 172.21.15.103:0/1258243690 wait complete. 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.395+0000 7faa85f15640 1 Processor -- start 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.395+0000 7faa85f15640 1 -- start start 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.395+0000 7faa85f15640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa8019b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.395+0000 7faa85f15640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faa8010bbf0 con 0x7faa801076e0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.395+0000 7faa7f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa8019b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.395+0000 7faa7f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa8019b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38504/0 (socket says 172.21.15.103:38504) 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.395+0000 7faa7f7fe640 1 -- 172.21.15.103:0/2633382511 learned_addr learned my addr 172.21.15.103:0/2633382511 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.396+0000 7faa7f7fe640 1 -- 172.21.15.103:0/2633382511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8019bb50 con 0x7faa801076e0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.396+0000 7faa7f7fe640 1 --2- 172.21.15.103:0/2633382511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa8019b610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faa700097f0 tx=0x7faa70030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.396+0000 7faa7cff9640 1 -- 172.21.15.103:0/2633382511 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa70037040 con 0x7faa801076e0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.396+0000 7faa85f15640 1 -- 172.21.15.103:0/2633382511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8019bde0 con 0x7faa801076e0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.396+0000 7faa7cff9640 1 -- 172.21.15.103:0/2633382511 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7faa70032bb0 con 0x7faa801076e0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.396+0000 7faa7cff9640 1 -- 172.21.15.103:0/2633382511 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa7003a390 con 0x7faa801076e0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.396+0000 7faa85f15640 1 -- 172.21.15.103:0/2633382511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8019ead0 con 0x7faa801076e0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.397+0000 7faa7cff9640 1 -- 172.21.15.103:0/2633382511 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7faa7003a5d0 con 0x7faa801076e0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.397+0000 7faa7cff9640 1 --2- 172.21.15.103:0/2633382511 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7faa68039160 0x7faa6803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.397+0000 7faa7cff9640 1 -- 172.21.15.103:0/2633382511 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faa7006c490 con 0x7faa801076e0 2024-09-19T05:58:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.397+0000 7faa7effd640 1 --2- 172.21.15.103:0/2633382511 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7faa68039160 0x7faa6803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.397+0000 7faa85f15640 1 -- 172.21.15.103:0/2633382511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8010bd70 con 0x7faa801076e0 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.397+0000 7faa7effd640 1 --2- 172.21.15.103:0/2633382511 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7faa68039160 0x7faa6803b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa740098c0 tx=0x7faa74006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.402+0000 7faa7cff9640 1 -- 172.21.15.103:0/2633382511 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa70040210 con 0x7faa801076e0 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.569+0000 7faa85f15640 1 -- 172.21.15.103:0/2633382511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7faa801a00e0 con 0x7faa801076e0 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.570+0000 7faa7cff9640 1 -- 172.21.15.103:0/2633382511 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7faa70031560 con 0x7faa801076e0 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.572+0000 7faa85f15640 1 -- 172.21.15.103:0/2633382511 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7faa68039160 msgr2=0x7faa6803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.572+0000 7faa85f15640 1 --2- 172.21.15.103:0/2633382511 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7faa68039160 0x7faa6803b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa740098c0 tx=0x7faa74006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.572+0000 7faa85f15640 1 -- 172.21.15.103:0/2633382511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 msgr2=0x7faa8019b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.572+0000 7faa85f15640 1 --2- 172.21.15.103:0/2633382511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa8019b610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faa700097f0 tx=0x7faa70030d00 comp rx=0 tx=0).stop 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.572+0000 7faa85f15640 1 -- 172.21.15.103:0/2633382511 shutdown_connections 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.572+0000 7faa85f15640 1 --2- 172.21.15.103:0/2633382511 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7faa68039160 0x7faa6803b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.572+0000 7faa85f15640 1 --2- 172.21.15.103:0/2633382511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa801076e0 0x7faa8019b610 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.572+0000 7faa85f15640 1 -- 172.21.15.103:0/2633382511 >> 172.21.15.103:0/2633382511 conn(0x7faa80102ed0 msgr2=0x7faa80103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.573+0000 7faa85f15640 1 -- 172.21.15.103:0/2633382511 shutdown_connections 2024-09-19T05:58:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:15.573+0000 7faa85f15640 1 -- 172.21.15.103:0/2633382511 wait complete. 2024-09-19T05:58:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:Enabling cephadm module... 2024-09-19T05:58:17.460 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:17 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/449491641' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T05:58:17.461 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: ignoring --setuser ceph since I am not root 2024-09-19T05:58:17.461 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: ignoring --setgroup ceph since I am not root 2024-09-19T05:58:17.461 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:17.252+0000 7f52f04a0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:58:17.461 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:17.309+0000 7f52f04a0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:58:17.461 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:17.457+0000 7f52f04a0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:58:17.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:17.525+0000 7f52f04a0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:58:17.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:17.675+0000 7f52f04a0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:58:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.620+0000 7feb63d9e640 1 Processor -- start 2024-09-19T05:58:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.620+0000 7feb63d9e640 1 -- start start 2024-09-19T05:58:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.620+0000 7feb63d9e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c106940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.620+0000 7feb63d9e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c106f10 con 0x7feb5c106540 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.620+0000 7feb61b3a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c106940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.621+0000 7feb61b3a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c106940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38512/0 (socket says 172.21.15.103:38512) 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.621+0000 7feb61b3a640 1 -- 172.21.15.103:0/4168038645 learned_addr learned my addr 172.21.15.103:0/4168038645 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.621+0000 7feb61b3a640 1 -- 172.21.15.103:0/4168038645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c107740 con 0x7feb5c106540 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.621+0000 7feb61b3a640 1 --2- 172.21.15.103:0/4168038645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c106940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb54009820 tx=0x7feb5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5507ccc3920be12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.622+0000 7feb60b38640 1 -- 172.21.15.103:0/4168038645 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb54037070 con 0x7feb5c106540 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.622+0000 7feb60b38640 1 -- 172.21.15.103:0/4168038645 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7feb540328d0 con 0x7feb5c106540 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.622+0000 7feb60b38640 1 -- 172.21.15.103:0/4168038645 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb540307d0 con 0x7feb5c106540 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.622+0000 7feb63d9e640 1 -- 172.21.15.103:0/4168038645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 msgr2=0x7feb5c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.622+0000 7feb63d9e640 1 --2- 172.21.15.103:0/4168038645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c106940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb54009820 tx=0x7feb5402a270 comp rx=0 tx=0).stop 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.622+0000 7feb63d9e640 1 -- 172.21.15.103:0/4168038645 shutdown_connections 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.622+0000 7feb63d9e640 1 --2- 172.21.15.103:0/4168038645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c106940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.622+0000 7feb63d9e640 1 -- 172.21.15.103:0/4168038645 >> 172.21.15.103:0/4168038645 conn(0x7feb5c101d90 msgr2=0x7feb5c1041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.622+0000 7feb63d9e640 1 -- 172.21.15.103:0/4168038645 shutdown_connections 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.622+0000 7feb63d9e640 1 -- 172.21.15.103:0/4168038645 wait complete. 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.623+0000 7feb63d9e640 1 Processor -- start 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.623+0000 7feb63d9e640 1 -- start start 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.623+0000 7feb63d9e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c191770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.623+0000 7feb63d9e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c10aaf0 con 0x7feb5c106540 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.623+0000 7feb61b3a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c191770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.623+0000 7feb61b3a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c191770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38518/0 (socket says 172.21.15.103:38518) 2024-09-19T05:58:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.623+0000 7feb61b3a640 1 -- 172.21.15.103:0/449491641 learned_addr learned my addr 172.21.15.103:0/449491641 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.624+0000 7feb61b3a640 1 -- 172.21.15.103:0/449491641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c191cb0 con 0x7feb5c106540 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.624+0000 7feb61b3a640 1 --2- 172.21.15.103:0/449491641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c191770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feb54009940 tx=0x7feb54032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.624+0000 7feb5affd640 1 -- 172.21.15.103:0/449491641 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb54042070 con 0x7feb5c106540 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.624+0000 7feb5affd640 1 -- 172.21.15.103:0/449491641 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7feb54030c80 con 0x7feb5c106540 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.624+0000 7feb63d9e640 1 -- 172.21.15.103:0/449491641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5c18fea0 con 0x7feb5c106540 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.624+0000 7feb5affd640 1 -- 172.21.15.103:0/449491641 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb54037040 con 0x7feb5c106540 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.624+0000 7feb63d9e640 1 -- 172.21.15.103:0/449491641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5c1903e0 con 0x7feb5c106540 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.625+0000 7feb5affd640 1 -- 172.21.15.103:0/449491641 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7feb54045070 con 0x7feb5c106540 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.625+0000 7feb5affd640 1 --2- 172.21.15.103:0/449491641 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feb44039160 0x7feb4403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.625+0000 7feb63d9e640 1 -- 172.21.15.103:0/449491641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5c10ac70 con 0x7feb5c106540 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.625+0000 7feb5affd640 1 -- 172.21.15.103:0/449491641 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7feb5406c170 con 0x7feb5c106540 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.625+0000 7feb61339640 1 --2- 172.21.15.103:0/449491641 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feb44039160 0x7feb4403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.626+0000 7feb61339640 1 --2- 172.21.15.103:0/449491641 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feb44039160 0x7feb4403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb500098c0 tx=0x7feb50006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.630+0000 7feb5affd640 1 -- 172.21.15.103:0/449491641 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feb54045360 con 0x7feb5c106540 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:16.842+0000 7feb63d9e640 1 -- 172.21.15.103:0/449491641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7feb5c0008d0 con 0x7feb5c106540 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.116+0000 7feb5affd640 1 -- 172.21.15.103:0/449491641 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7feb5403c670 con 0x7feb5c106540 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.118+0000 7feb5affd640 1 -- 172.21.15.103:0/449491641 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7feb54043260 con 0x7feb5c106540 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.119+0000 7feb63d9e640 1 -- 172.21.15.103:0/449491641 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feb44039160 msgr2=0x7feb4403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.119+0000 7feb63d9e640 1 --2- 172.21.15.103:0/449491641 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feb44039160 0x7feb4403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb500098c0 tx=0x7feb50006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.119+0000 7feb63d9e640 1 -- 172.21.15.103:0/449491641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 msgr2=0x7feb5c191770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.119+0000 7feb63d9e640 1 --2- 172.21.15.103:0/449491641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c191770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feb54009940 tx=0x7feb54032e10 comp rx=0 tx=0).stop 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.119+0000 7feb63d9e640 1 -- 172.21.15.103:0/449491641 shutdown_connections 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.119+0000 7feb63d9e640 1 --2- 172.21.15.103:0/449491641 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feb44039160 0x7feb4403b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.119+0000 7feb63d9e640 1 --2- 172.21.15.103:0/449491641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb5c106540 0x7feb5c191770 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feb54009940 tx=0x7feb54032e10 comp rx=0 tx=0).stop 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.119+0000 7feb63d9e640 1 -- 172.21.15.103:0/449491641 >> 172.21.15.103:0/449491641 conn(0x7feb5c101d90 msgr2=0x7feb5c102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.119+0000 7feb63d9e640 1 -- 172.21.15.103:0/449491641 shutdown_connections 2024-09-19T05:58:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:17.119+0000 7feb63d9e640 1 -- 172.21.15.103:0/449491641 wait complete. 2024-09-19T05:58:18.073 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:17.820+0000 7f52f04a0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:58:18.355 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:18 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/449491641' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T05:58:18.356 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:18 smithi103 ceph-mon[30925]: mgrmap e5: x(active, since 5s) 2024-09-19T05:58:18.356 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:18.147+0000 7f52f04a0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:58:18.356 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:18.211+0000 7f52f04a0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:58:18.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:18.404+0000 7f52f04a0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:58:18.956 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.147+0000 7f02d0cc6640 1 Processor -- start 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.147+0000 7f02d0cc6640 1 -- start start 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.147+0000 7f02d0cc6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc10a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.147+0000 7f02d0cc6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc07be00 con 0x7f02cc108120 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.147+0000 7f02ca59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc10a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.147+0000 7f02ca59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc10a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38534/0 (socket says 172.21.15.103:38534) 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.147+0000 7f02ca59c640 1 -- 172.21.15.103:0/1416762875 learned_addr learned my addr 172.21.15.103:0/1416762875 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.148+0000 7f02ca59c640 1 -- 172.21.15.103:0/1416762875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02cc10aa50 con 0x7f02cc108120 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.148+0000 7f02ca59c640 1 --2- 172.21.15.103:0/1416762875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc10a510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009820 tx=0x7f02bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973e8194b4631ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.148+0000 7f02c959a640 1 -- 172.21.15.103:0/1416762875 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02bc037070 con 0x7f02cc108120 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.149+0000 7f02c959a640 1 -- 172.21.15.103:0/1416762875 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f02bc0328d0 con 0x7f02cc108120 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.149+0000 7f02c959a640 1 -- 172.21.15.103:0/1416762875 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02bc0307d0 con 0x7f02cc108120 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.149+0000 7f02d0cc6640 1 -- 172.21.15.103:0/1416762875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 msgr2=0x7f02cc10a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.149+0000 7f02d0cc6640 1 --2- 172.21.15.103:0/1416762875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc10a510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009820 tx=0x7f02bc02a270 comp rx=0 tx=0).stop 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.149+0000 7f02d0cc6640 1 -- 172.21.15.103:0/1416762875 shutdown_connections 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.149+0000 7f02d0cc6640 1 --2- 172.21.15.103:0/1416762875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc10a510 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.149+0000 7f02d0cc6640 1 -- 172.21.15.103:0/1416762875 >> 172.21.15.103:0/1416762875 conn(0x7f02cc101d80 msgr2=0x7f02cc1041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.149+0000 7f02d0cc6640 1 -- 172.21.15.103:0/1416762875 shutdown_connections 2024-09-19T05:58:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.149+0000 7f02d0cc6640 1 -- 172.21.15.103:0/1416762875 wait complete. 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.150+0000 7f02d0cc6640 1 Processor -- start 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.150+0000 7f02d0cc6640 1 -- start start 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.150+0000 7f02d0cc6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc19b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.150+0000 7f02d0cc6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc10b9d0 con 0x7f02cc108120 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.151+0000 7f02ca59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc19b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.151+0000 7f02ca59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc19b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38540/0 (socket says 172.21.15.103:38540) 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.151+0000 7f02ca59c640 1 -- 172.21.15.103:0/749685116 learned_addr learned my addr 172.21.15.103:0/749685116 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.151+0000 7f02ca59c640 1 -- 172.21.15.103:0/749685116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02cc19bb40 con 0x7f02cc108120 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.151+0000 7f02ca59c640 1 --2- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc19b600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f02bc030520 tx=0x7f02bc032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.151+0000 7f02bb7fe640 1 -- 172.21.15.103:0/749685116 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02bc042070 con 0x7f02cc108120 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.151+0000 7f02d0cc6640 1 -- 172.21.15.103:0/749685116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02cc19bdd0 con 0x7f02cc108120 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.151+0000 7f02bb7fe640 1 -- 172.21.15.103:0/749685116 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f02bc030cc0 con 0x7f02cc108120 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.151+0000 7f02bb7fe640 1 -- 172.21.15.103:0/749685116 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02bc037040 con 0x7f02cc108120 2024-09-19T05:58:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.151+0000 7f02d0cc6640 1 -- 172.21.15.103:0/749685116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02cc19eac0 con 0x7f02cc108120 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.152+0000 7f02bb7fe640 1 -- 172.21.15.103:0/749685116 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f02bc045070 con 0x7f02cc108120 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.152+0000 7f02bb7fe640 1 --2- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7f02b40391b0 0x7f02b403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.152+0000 7f02bb7fe640 1 -- 172.21.15.103:0/749685116 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f02bc06d110 con 0x7f02cc108120 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.152+0000 7f02c9d9b640 1 -- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7f02b40391b0 msgr2=0x7f02b403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3148507486 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.152+0000 7f02c9d9b640 1 --2- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7f02b40391b0 0x7f02b403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.152+0000 7f02d0cc6640 1 -- 172.21.15.103:0/749685116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02cc108580 con 0x7f02cc108120 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.157+0000 7f02bb7fe640 1 -- 172.21.15.103:0/749685116 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02bc045360 con 0x7f02cc108120 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.353+0000 7f02c9d9b640 1 -- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7f02b40391b0 msgr2=0x7f02b403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3148507486 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.353+0000 7f02c9d9b640 1 --2- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7f02b40391b0 0x7f02b403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.378+0000 7f02d0cc6640 1 -- 172.21.15.103:0/749685116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f02cc19ef70 con 0x7f02cc108120 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.378+0000 7f02bb7fe640 1 -- 172.21.15.103:0/749685116 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f02bc03ae30 con 0x7f02cc108120 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.380+0000 7f02d0cc6640 1 -- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7f02b40391b0 msgr2=0x7f02b403b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.381+0000 7f02d0cc6640 1 --2- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7f02b40391b0 0x7f02b403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.381+0000 7f02d0cc6640 1 -- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 msgr2=0x7f02cc19b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.381+0000 7f02d0cc6640 1 --2- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc19b600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f02bc030520 tx=0x7f02bc032dd0 comp rx=0 tx=0).stop 2024-09-19T05:58:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.381+0000 7f02d0cc6640 1 -- 172.21.15.103:0/749685116 shutdown_connections 2024-09-19T05:58:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.381+0000 7f02d0cc6640 1 --2- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7f02b40391b0 0x7f02b403b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.381+0000 7f02d0cc6640 1 --2- 172.21.15.103:0/749685116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02cc108120 0x7f02cc19b600 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.381+0000 7f02d0cc6640 1 -- 172.21.15.103:0/749685116 >> 172.21.15.103:0/749685116 conn(0x7f02cc101d80 msgr2=0x7f02cc102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.381+0000 7f02d0cc6640 1 -- 172.21.15.103:0/749685116 shutdown_connections 2024-09-19T05:58:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:18.381+0000 7f02d0cc6640 1 -- 172.21.15.103:0/749685116 wait complete. 2024-09-19T05:58:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for the mgr to restart... 2024-09-19T05:58:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr epoch 5... 2024-09-19T05:58:19.238 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:19 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/749685116' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T05:58:19.494 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:19.314+0000 7f52f04a0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:58:19.494 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:19.384+0000 7f52f04a0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:58:20.350 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:20.092+0000 7f52f04a0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:58:20.350 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:20.206+0000 7f52f04a0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:58:20.627 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:20.347+0000 7f52f04a0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:58:20.627 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:20.409+0000 7f52f04a0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:58:20.627 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:20.557+0000 7f52f04a0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:58:20.627 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:20.624+0000 7f52f04a0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:58:20.909 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:20.684+0000 7f52f04a0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:58:20.909 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:20.842+0000 7f52f04a0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:58:20.909 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:20.906+0000 7f52f04a0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:58:21.172 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:20.972+0000 7f52f04a0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:58:21.172 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:21.053+0000 7f52f04a0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:58:21.172 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:21.111+0000 7f52f04a0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:58:21.172 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:21.169+0000 7f52f04a0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:58:22.244 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:21.951+0000 7f52f04a0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:58:22.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: Active manager daemon x restarted 2024-09-19T05:58:22.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: Activating manager daemon x 2024-09-19T05:58:22.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T05:58:22.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: mgrmap e6: x(active, starting, since 0.00343741s) 2024-09-19T05:58:22.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: Manager daemon x is now available 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:58:22.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:22 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:58:23.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-mon[30925]: Found migration_current of "None". Setting to last migration. 2024-09-19T05:58:23.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:23.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:23.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-mon[30925]: mgrmap e7: x(active, since 1.00559s) 2024-09-19T05:58:23.244 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:23.202+0000 7f52577fa640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:05:58:23] ENGINE Error in HTTPServer.serve 2024-09-19T05:58:23.244 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: Traceback (most recent call last): 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self._connections.run(self.expiration_interval) 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self._run(expiration_interval) 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: s = self.context.wrap_socket( 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: return self.sslsocket_class._create( 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:58:23.245 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self.do_handshake() 2024-09-19T05:58:23.246 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:58:23.246 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self._sslobj.do_handshake() 2024-09-19T05:58:23.246 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:58:23.246 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:23.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:58:23.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T05:58:23.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T05:58:23.620 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:58:23.620 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.398+0000 7feebe43f640 1 Processor -- start 2024-09-19T05:58:23.620 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.398+0000 7feebe43f640 1 -- start start 2024-09-19T05:58:23.620 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.399+0000 7feebe43f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb8106350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:23.620 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.399+0000 7feebe43f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feeb807bdc0 con 0x7feeb8105f50 2024-09-19T05:58:23.620 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.399+0000 7feeb7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb8106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:23.621 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.399+0000 7feeb7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb8106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38548/0 (socket says 172.21.15.103:38548) 2024-09-19T05:58:23.621 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.399+0000 7feeb7fff640 1 -- 172.21.15.103:0/3792885679 learned_addr learned my addr 172.21.15.103:0/3792885679 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:23.621 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.399+0000 7feeb7fff640 1 -- 172.21.15.103:0/3792885679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb8106890 con 0x7feeb8105f50 2024-09-19T05:58:23.621 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.400+0000 7feeb7fff640 1 --2- 172.21.15.103:0/3792885679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb8106350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feea8009820 tx=0x7feea802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db23262bd4b4fdfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:23.621 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.400+0000 7feeb77fe640 1 -- 172.21.15.103:0/3792885679 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea8037070 con 0x7feeb8105f50 2024-09-19T05:58:23.622 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.400+0000 7feeb77fe640 1 -- 172.21.15.103:0/3792885679 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7feea80328d0 con 0x7feeb8105f50 2024-09-19T05:58:23.622 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.400+0000 7feeb77fe640 1 -- 172.21.15.103:0/3792885679 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea80307d0 con 0x7feeb8105f50 2024-09-19T05:58:23.622 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.401+0000 7feebe43f640 1 -- 172.21.15.103:0/3792885679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 msgr2=0x7feeb8106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:23.622 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.401+0000 7feebe43f640 1 --2- 172.21.15.103:0/3792885679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb8106350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feea8009820 tx=0x7feea802a270 comp rx=0 tx=0).stop 2024-09-19T05:58:23.622 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.401+0000 7feebe43f640 1 -- 172.21.15.103:0/3792885679 shutdown_connections 2024-09-19T05:58:23.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.401+0000 7feebe43f640 1 --2- 172.21.15.103:0/3792885679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb8106350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:23.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.401+0000 7feebe43f640 1 -- 172.21.15.103:0/3792885679 >> 172.21.15.103:0/3792885679 conn(0x7feeb8101d80 msgr2=0x7feeb81041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:23.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.401+0000 7feebe43f640 1 -- 172.21.15.103:0/3792885679 shutdown_connections 2024-09-19T05:58:23.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.401+0000 7feebe43f640 1 -- 172.21.15.103:0/3792885679 wait complete. 2024-09-19T05:58:23.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.402+0000 7feebe43f640 1 Processor -- start 2024-09-19T05:58:23.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.402+0000 7feebe43f640 1 -- start start 2024-09-19T05:58:23.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.402+0000 7feebe43f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb819d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:23.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.402+0000 7feebe43f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feeb81077b0 con 0x7feeb8105f50 2024-09-19T05:58:23.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.402+0000 7feeb7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb819d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:23.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.402+0000 7feeb7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb819d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38564/0 (socket says 172.21.15.103:38564) 2024-09-19T05:58:23.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.402+0000 7feeb7fff640 1 -- 172.21.15.103:0/993122085 learned_addr learned my addr 172.21.15.103:0/993122085 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:23.625 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.402+0000 7feeb7fff640 1 -- 172.21.15.103:0/993122085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb819dd40 con 0x7feeb8105f50 2024-09-19T05:58:23.625 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.403+0000 7feeb7fff640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb819d800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feea8030520 tx=0x7feea8032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:23.625 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.403+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea8042070 con 0x7feeb8105f50 2024-09-19T05:58:23.625 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.403+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7feea8030cc0 con 0x7feeb8105f50 2024-09-19T05:58:23.625 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.403+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea8037040 con 0x7feeb8105f50 2024-09-19T05:58:23.626 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.403+0000 7feebe43f640 1 -- 172.21.15.103:0/993122085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb819dfd0 con 0x7feeb8105f50 2024-09-19T05:58:23.626 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.403+0000 7feebe43f640 1 -- 172.21.15.103:0/993122085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb81a0cc0 con 0x7feeb8105f50 2024-09-19T05:58:23.626 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.404+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7feea8045070 con 0x7feeb8105f50 2024-09-19T05:58:23.626 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.404+0000 7feeb5ffb640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 0x7feea403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:23.626 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.404+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 --> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7feea403bd80 con 0x7feea40391b0 2024-09-19T05:58:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.404+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7feea806c270 con 0x7feeb8105f50 2024-09-19T05:58:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.404+0000 7feeaffff640 1 -- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 msgr2=0x7feea403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3148507486 2024-09-19T05:58:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.404+0000 7feeaffff640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 0x7feea403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:58:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.605+0000 7feeaffff640 1 -- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 msgr2=0x7feea403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3148507486 2024-09-19T05:58:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:19.605+0000 7feeaffff640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 0x7feea403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:58:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:20.006+0000 7feeaffff640 1 -- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 msgr2=0x7feea403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3148507486 2024-09-19T05:58:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:20.006+0000 7feeaffff640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 0x7feea403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:58:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:20.807+0000 7feeaffff640 1 -- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 msgr2=0x7feea403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3148507486 2024-09-19T05:58:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:20.807+0000 7feeaffff640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 0x7feea403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:58:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:21.954+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7feea806ad30 con 0x7feeb8105f50 2024-09-19T05:58:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:21.954+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 msgr2=0x7feea403b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:58:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:21.954+0000 7feeb5ffb640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 0x7feea403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.955+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7feea80313a0 con 0x7feeb8105f50 2024-09-19T05:58:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.955+0000 7feeb5ffb640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7feea403cae0 0x7feea403eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.955+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 --> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7feea802bba0 con 0x7feea403cae0 2024-09-19T05:58:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.956+0000 7feeaffff640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7feea403cae0 0x7feea403eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.957+0000 7feeaffff640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7feea403cae0 0x7feea403eed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7feea0003980 tx=0x7feea0006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.957+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 <== mgr.14118 v2:172.21.15.103:6800/1007431406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7feea802bba0 con 0x7feea403cae0 2024-09-19T05:58:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.964+0000 7feebe43f640 1 -- 172.21.15.103:0/993122085 --> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7feeb8107e80 con 0x7feea403cae0 2024-09-19T05:58:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.964+0000 7feeb5ffb640 1 -- 172.21.15.103:0/993122085 <== mgr.14118 v2:172.21.15.103:6800/1007431406 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7feeb8107e80 con 0x7feea403cae0 2024-09-19T05:58:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 -- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7feea403cae0 msgr2=0x7feea403eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:23.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7feea403cae0 0x7feea403eed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7feea0003980 tx=0x7feea0006e10 comp rx=0 tx=0).stop 2024-09-19T05:58:23.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 -- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 msgr2=0x7feeb819d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:23.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb819d800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feea8030520 tx=0x7feea8032dd0 comp rx=0 tx=0).stop 2024-09-19T05:58:23.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 -- 172.21.15.103:0/993122085 shutdown_connections 2024-09-19T05:58:23.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7feea403cae0 0x7feea403eed0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:23.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:6800/3148507486,v1:172.21.15.103:6801/3148507486] conn(0x7feea40391b0 0x7feea403b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:23.632 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 --2- 172.21.15.103:0/993122085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb8105f50 0x7feeb819d800 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:23.632 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 -- 172.21.15.103:0/993122085 >> 172.21.15.103:0/993122085 conn(0x7feeb8101d80 msgr2=0x7feeb8191b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:23.632 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 -- 172.21.15.103:0/993122085 shutdown_connections 2024-09-19T05:58:23.632 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:22.965+0000 7feebe43f640 1 -- 172.21.15.103:0/993122085 wait complete. 2024-09-19T05:58:23.632 INFO:teuthology.orchestra.run.smithi103.stdout:mgr epoch 5 is available 2024-09-19T05:58:23.633 INFO:teuthology.orchestra.run.smithi103.stdout:Setting orchestrator backend to cephadm... 2024-09-19T05:58:24.227 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:24 smithi103 ceph-mon[30925]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T05:58:24.227 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:24 smithi103 ceph-mon[30925]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T05:58:24.227 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:24 smithi103 ceph-mon[30925]: [19/Sep/2024:05:58:22] ENGINE Bus STARTING 2024-09-19T05:58:24.227 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:24 smithi103 ceph-mon[30925]: [19/Sep/2024:05:58:23] ENGINE Serving on http://172.21.15.103:8765 2024-09-19T05:58:24.227 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:24 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:24.749 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.034+0000 7f03672df640 1 Processor -- start 2024-09-19T05:58:24.749 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.034+0000 7f03672df640 1 -- start start 2024-09-19T05:58:24.749 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.034+0000 7f03672df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f0360106970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:24.749 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.034+0000 7f03672df640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0360106f40 con 0x7f0360106570 2024-09-19T05:58:24.749 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.035+0000 7f036507b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f0360106970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:24.749 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.035+0000 7f036507b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f0360106970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37648/0 (socket says 172.21.15.103:37648) 2024-09-19T05:58:24.749 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.035+0000 7f036507b640 1 -- 172.21.15.103:0/2600881795 learned_addr learned my addr 172.21.15.103:0/2600881795 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:24.749 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.035+0000 7f036507b640 1 -- 172.21.15.103:0/2600881795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0360107720 con 0x7f0360106570 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f036507b640 1 --2- 172.21.15.103:0/2600881795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f0360106970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f035c009820 tx=0x7f035c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491b77d53043f428 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f0353fff640 1 -- 172.21.15.103:0/2600881795 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f035c037070 con 0x7f0360106570 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f0353fff640 1 -- 172.21.15.103:0/2600881795 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f035c0328d0 con 0x7f0360106570 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f0353fff640 1 -- 172.21.15.103:0/2600881795 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f035c0307d0 con 0x7f0360106570 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f03672df640 1 -- 172.21.15.103:0/2600881795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 msgr2=0x7f0360106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f03672df640 1 --2- 172.21.15.103:0/2600881795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f0360106970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f035c009820 tx=0x7f035c02a270 comp rx=0 tx=0).stop 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f03672df640 1 -- 172.21.15.103:0/2600881795 shutdown_connections 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f03672df640 1 --2- 172.21.15.103:0/2600881795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f0360106970 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f03672df640 1 -- 172.21.15.103:0/2600881795 >> 172.21.15.103:0/2600881795 conn(0x7f0360101d80 msgr2=0x7f03601041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f03672df640 1 -- 172.21.15.103:0/2600881795 shutdown_connections 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.036+0000 7f03672df640 1 -- 172.21.15.103:0/2600881795 wait complete. 2024-09-19T05:58:24.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.037+0000 7f03672df640 1 Processor -- start 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.037+0000 7f03672df640 1 -- start start 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.037+0000 7f03672df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f036019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.037+0000 7f03672df640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f036010aad0 con 0x7f0360106570 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.037+0000 7f036507b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f036019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.037+0000 7f036507b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f036019b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37656/0 (socket says 172.21.15.103:37656) 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.037+0000 7f036507b640 1 -- 172.21.15.103:0/2413120611 learned_addr learned my addr 172.21.15.103:0/2413120611 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.037+0000 7f036507b640 1 -- 172.21.15.103:0/2413120611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036019bbf0 con 0x7f0360106570 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.038+0000 7f036507b640 1 --2- 172.21.15.103:0/2413120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f036019b6b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f035c030520 tx=0x7f035c032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.038+0000 7f03527fc640 1 -- 172.21.15.103:0/2413120611 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f035c042070 con 0x7f0360106570 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.038+0000 7f03527fc640 1 -- 172.21.15.103:0/2413120611 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f035c030cc0 con 0x7f0360106570 2024-09-19T05:58:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.038+0000 7f03527fc640 1 -- 172.21.15.103:0/2413120611 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f035c037040 con 0x7f0360106570 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.038+0000 7f03672df640 1 -- 172.21.15.103:0/2413120611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036019be80 con 0x7f0360106570 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.038+0000 7f03672df640 1 -- 172.21.15.103:0/2413120611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f036019eb70 con 0x7f0360106570 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.039+0000 7f03527fc640 1 -- 172.21.15.103:0/2413120611 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f035c045070 con 0x7f0360106570 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.039+0000 7f03527fc640 1 --2- 172.21.15.103:0/2413120611 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f034c0391b0 0x7f034c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.039+0000 7f03527fc640 1 -- 172.21.15.103:0/2413120611 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f035c06c2d0 con 0x7f0360106570 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.039+0000 7f036487a640 1 --2- 172.21.15.103:0/2413120611 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f034c0391b0 0x7f034c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.039+0000 7f03672df640 1 -- 172.21.15.103:0/2413120611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f036010ac50 con 0x7f0360106570 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.039+0000 7f036487a640 1 --2- 172.21.15.103:0/2413120611 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f034c0391b0 0x7f034c03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03540098c0 tx=0x7f0354006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.044+0000 7f03527fc640 1 -- 172.21.15.103:0/2413120611 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f035c046e00 con 0x7f0360106570 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.225+0000 7f03672df640 1 -- 172.21.15.103:0/2413120611 --> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f036002d980 con 0x7f034c0391b0 2024-09-19T05:58:24.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.230+0000 7f03527fc640 1 -- 172.21.15.103:0/2413120611 <== mgr.14118 v2:172.21.15.103:6800/1007431406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f036002d980 con 0x7f034c0391b0 2024-09-19T05:58:24.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.232+0000 7f03672df640 1 -- 172.21.15.103:0/2413120611 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f034c0391b0 msgr2=0x7f034c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:24.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.232+0000 7f03672df640 1 --2- 172.21.15.103:0/2413120611 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f034c0391b0 0x7f034c03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03540098c0 tx=0x7f0354006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:24.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.232+0000 7f03672df640 1 -- 172.21.15.103:0/2413120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 msgr2=0x7f036019b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:24.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.232+0000 7f03672df640 1 --2- 172.21.15.103:0/2413120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f036019b6b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f035c030520 tx=0x7f035c032dd0 comp rx=0 tx=0).stop 2024-09-19T05:58:24.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.233+0000 7f03672df640 1 -- 172.21.15.103:0/2413120611 shutdown_connections 2024-09-19T05:58:24.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.233+0000 7f03672df640 1 --2- 172.21.15.103:0/2413120611 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f034c0391b0 0x7f034c03b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:24.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.233+0000 7f03672df640 1 --2- 172.21.15.103:0/2413120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0360106570 0x7f036019b6b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:24.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.233+0000 7f03672df640 1 -- 172.21.15.103:0/2413120611 >> 172.21.15.103:0/2413120611 conn(0x7f0360101d80 msgr2=0x7f0360102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:24.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.233+0000 7f03672df640 1 -- 172.21.15.103:0/2413120611 shutdown_connections 2024-09-19T05:58:24.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:24.233+0000 7f03672df640 1 -- 172.21.15.103:0/2413120611 wait complete. 2024-09-19T05:58:25.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:25 smithi103 ceph-mon[30925]: [19/Sep/2024:05:58:23] ENGINE Serving on https://172.21.15.103:7150 2024-09-19T05:58:25.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:25 smithi103 ceph-mon[30925]: [19/Sep/2024:05:58:23] ENGINE Bus STARTED 2024-09-19T05:58:25.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:25 smithi103 ceph-mon[30925]: [19/Sep/2024:05:58:23] ENGINE Error in HTTPServer.serve 2024-09-19T05:58:25.140 INFO:journalctl@ceph.mon.a.smithi103.stdout: Traceback (most recent call last): 2024-09-19T05:58:25.140 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:58:25.140 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:58:25.140 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:58:25.140 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._run(expiration_interval) 2024-09-19T05:58:25.140 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:58:25.140 INFO:journalctl@ceph.mon.a.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: s = self.context.wrap_socket( 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: return self.sslsocket_class._create( 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: self.do_handshake() 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._sslobj.do_handshake() 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:25 smithi103 ceph-mon[30925]: mgrmap e8: x(active, since 2s) 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:25 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:25.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:25 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:25.939 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T05:58:25.939 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.138+0000 7f5259635640 1 Processor -- start 2024-09-19T05:58:25.939 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.138+0000 7f5259635640 1 -- start start 2024-09-19T05:58:25.939 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.138+0000 7f5259635640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f5254106940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:25.939 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.138+0000 7f5259635640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5254106f10 con 0x7f5254106540 2024-09-19T05:58:25.939 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.138+0000 7f5252ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f5254106940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:25.939 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.138+0000 7f5252ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f5254106940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37668/0 (socket says 172.21.15.103:37668) 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.138+0000 7f5252ffd640 1 -- 172.21.15.103:0/584573232 learned_addr learned my addr 172.21.15.103:0/584573232 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.139+0000 7f5252ffd640 1 -- 172.21.15.103:0/584573232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5254107740 con 0x7f5254106540 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.139+0000 7f5252ffd640 1 --2- 172.21.15.103:0/584573232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f5254106940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5244009820 tx=0x7f524402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6ca1ccc4336c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.139+0000 7f52527fc640 1 -- 172.21.15.103:0/584573232 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5244037070 con 0x7f5254106540 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.139+0000 7f52527fc640 1 -- 172.21.15.103:0/584573232 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f52440328d0 con 0x7f5254106540 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.139+0000 7f52527fc640 1 -- 172.21.15.103:0/584573232 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52440307d0 con 0x7f5254106540 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.140+0000 7f5259635640 1 -- 172.21.15.103:0/584573232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 msgr2=0x7f5254106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.140+0000 7f5259635640 1 --2- 172.21.15.103:0/584573232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f5254106940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5244009820 tx=0x7f524402a270 comp rx=0 tx=0).stop 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.140+0000 7f5259635640 1 -- 172.21.15.103:0/584573232 shutdown_connections 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.140+0000 7f5259635640 1 --2- 172.21.15.103:0/584573232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f5254106940 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.140+0000 7f5259635640 1 -- 172.21.15.103:0/584573232 >> 172.21.15.103:0/584573232 conn(0x7f5254101d90 msgr2=0x7f52541041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.140+0000 7f5259635640 1 -- 172.21.15.103:0/584573232 shutdown_connections 2024-09-19T05:58:25.940 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.140+0000 7f5259635640 1 -- 172.21.15.103:0/584573232 wait complete. 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.141+0000 7f5259635640 1 Processor -- start 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.141+0000 7f5259635640 1 -- start start 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.141+0000 7f5259635640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f525407ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.141+0000 7f5259635640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f525410aaf0 con 0x7f5254106540 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.141+0000 7f5252ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f525407ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.141+0000 7f5252ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f525407ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37678/0 (socket says 172.21.15.103:37678) 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.141+0000 7f5252ffd640 1 -- 172.21.15.103:0/3294079506 learned_addr learned my addr 172.21.15.103:0/3294079506 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.141+0000 7f5252ffd640 1 -- 172.21.15.103:0/3294079506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525419e350 con 0x7f5254106540 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.142+0000 7f5252ffd640 1 --2- 172.21.15.103:0/3294079506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f525407ba30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f52440097f0 tx=0x7f5244030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.142+0000 7f5250ff9640 1 -- 172.21.15.103:0/3294079506 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5244037040 con 0x7f5254106540 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.142+0000 7f5250ff9640 1 -- 172.21.15.103:0/3294079506 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5244032bb0 con 0x7f5254106540 2024-09-19T05:58:25.941 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.142+0000 7f5259635640 1 -- 172.21.15.103:0/3294079506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525419e520 con 0x7f5254106540 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.142+0000 7f5250ff9640 1 -- 172.21.15.103:0/3294079506 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f524403a390 con 0x7f5254106540 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.142+0000 7f5259635640 1 -- 172.21.15.103:0/3294079506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525419e8c0 con 0x7f5254106540 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.142+0000 7f5250ff9640 1 -- 172.21.15.103:0/3294079506 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f524403a580 con 0x7f5254106540 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.143+0000 7f5250ff9640 1 --2- 172.21.15.103:0/3294079506 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f5240039200 0x7f524003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.143+0000 7f5250ff9640 1 -- 172.21.15.103:0/3294079506 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f524406c4a0 con 0x7f5254106540 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.143+0000 7f524a7fc640 1 --2- 172.21.15.103:0/3294079506 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f5240039200 0x7f524003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.143+0000 7f5259635640 1 -- 172.21.15.103:0/3294079506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525410ac70 con 0x7f5254106540 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.143+0000 7f524a7fc640 1 --2- 172.21.15.103:0/3294079506 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f5240039200 0x7f524003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f523c0098c0 tx=0x7f523c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.148+0000 7f5250ff9640 1 -- 172.21.15.103:0/3294079506 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5244040210 con 0x7f5254106540 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.318+0000 7f5259635640 1 -- 172.21.15.103:0/3294079506 --> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f5254103010 con 0x7f5240039200 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.319+0000 7f5250ff9640 1 -- 172.21.15.103:0/3294079506 <== mgr.14118 v2:172.21.15.103:6800/1007431406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f5254103010 con 0x7f5240039200 2024-09-19T05:58:25.942 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.321+0000 7f5259635640 1 -- 172.21.15.103:0/3294079506 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f5240039200 msgr2=0x7f524003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:25.943 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.321+0000 7f5259635640 1 --2- 172.21.15.103:0/3294079506 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f5240039200 0x7f524003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f523c0098c0 tx=0x7f523c006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:25.943 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.321+0000 7f5259635640 1 -- 172.21.15.103:0/3294079506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 msgr2=0x7f525407ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:25.943 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.321+0000 7f5259635640 1 --2- 172.21.15.103:0/3294079506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f525407ba30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f52440097f0 tx=0x7f5244030d00 comp rx=0 tx=0).stop 2024-09-19T05:58:25.943 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.321+0000 7f5259635640 1 -- 172.21.15.103:0/3294079506 shutdown_connections 2024-09-19T05:58:25.943 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.321+0000 7f5259635640 1 --2- 172.21.15.103:0/3294079506 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f5240039200 0x7f524003b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:25.943 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.321+0000 7f5259635640 1 --2- 172.21.15.103:0/3294079506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5254106540 0x7f525407ba30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:25.943 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.321+0000 7f5259635640 1 -- 172.21.15.103:0/3294079506 >> 172.21.15.103:0/3294079506 conn(0x7f5254101d90 msgr2=0x7f5254102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:25.943 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.321+0000 7f5259635640 1 -- 172.21.15.103:0/3294079506 shutdown_connections 2024-09-19T05:58:25.943 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:25.321+0000 7f5259635640 1 -- 172.21.15.103:0/3294079506 wait complete. 2024-09-19T05:58:25.943 INFO:teuthology.orchestra.run.smithi103.stdout:Generating ssh key... 2024-09-19T05:58:26.197 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-mon[30925]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:26.912 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: Generating public/private rsa key pair. 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: Your identification has been saved in /tmp/tmp1vukxkvr/key 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: Your public key has been saved in /tmp/tmp1vukxkvr/key.pub 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: The key fingerprint is: 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: SHA256:iia2reFPnfvfVXSz26Hc/T2cYgRAmnwlDv8dqQsCHUk ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: The key's randomart image is: 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: +---[RSA 3072]----+ 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: | .Eoo . | 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: | o.B.o . | 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: | . = +. o .o| 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: | . . ..o ..+| 2024-09-19T05:58:26.913 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: | .S. o.. o.| 2024-09-19T05:58:26.914 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: | o o. . o.o.=| 2024-09-19T05:58:26.914 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: | + + + ..ooo+| 2024-09-19T05:58:26.914 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: | o B . . + +o| 2024-09-19T05:58:26.914 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: | +oo ..... o . +| 2024-09-19T05:58:26.914 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:26 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: +----[SHA256]-----+ 2024-09-19T05:58:27.197 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:27 smithi103 ceph-mon[30925]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:27.197 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:27 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:27.197 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:27 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:27.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.388+0000 7f7840bbb640 1 Processor -- start 2024-09-19T05:58:27.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.388+0000 7f7840bbb640 1 -- start start 2024-09-19T05:58:27.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.388+0000 7f7840bbb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:27.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.388+0000 7f7840bbb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f783c1080b0 con 0x7f783c1076e0 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.388+0000 7f783a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.388+0000 7f783a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37686/0 (socket says 172.21.15.103:37686) 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.388+0000 7f783a59c640 1 -- 172.21.15.103:0/2800149962 learned_addr learned my addr 172.21.15.103:0/2800149962 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.388+0000 7f783a59c640 1 -- 172.21.15.103:0/2800149962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c108840 con 0x7f783c1076e0 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.389+0000 7f783a59c640 1 --2- 172.21.15.103:0/2800149962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c107ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f782c009820 tx=0x7f782c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c209d3ad1e40927 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.389+0000 7f7839d9b640 1 -- 172.21.15.103:0/2800149962 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f782c037070 con 0x7f783c1076e0 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.389+0000 7f7839d9b640 1 -- 172.21.15.103:0/2800149962 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f782c0328d0 con 0x7f783c1076e0 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.389+0000 7f7839d9b640 1 -- 172.21.15.103:0/2800149962 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f782c0307d0 con 0x7f783c1076e0 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.390+0000 7f7840bbb640 1 -- 172.21.15.103:0/2800149962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 msgr2=0x7f783c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.390+0000 7f7840bbb640 1 --2- 172.21.15.103:0/2800149962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c107ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f782c009820 tx=0x7f782c02a270 comp rx=0 tx=0).stop 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.390+0000 7f7840bbb640 1 -- 172.21.15.103:0/2800149962 shutdown_connections 2024-09-19T05:58:27.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.390+0000 7f7840bbb640 1 --2- 172.21.15.103:0/2800149962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c107ae0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:27.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.390+0000 7f7840bbb640 1 -- 172.21.15.103:0/2800149962 >> 172.21.15.103:0/2800149962 conn(0x7f783c102ed0 msgr2=0x7f783c1052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:27.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.390+0000 7f7840bbb640 1 -- 172.21.15.103:0/2800149962 shutdown_connections 2024-09-19T05:58:27.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.390+0000 7f7840bbb640 1 -- 172.21.15.103:0/2800149962 wait complete. 2024-09-19T05:58:27.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.391+0000 7f7840bbb640 1 Processor -- start 2024-09-19T05:58:27.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.391+0000 7f7840bbb640 1 -- start start 2024-09-19T05:58:27.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.391+0000 7f7840bbb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:27.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.391+0000 7f7840bbb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f783c10bbf0 con 0x7f783c1076e0 2024-09-19T05:58:27.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.391+0000 7f783a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.391+0000 7f783a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c19b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37702/0 (socket says 172.21.15.103:37702) 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.391+0000 7f783a59c640 1 -- 172.21.15.103:0/1927023450 learned_addr learned my addr 172.21.15.103:0/1927023450 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.391+0000 7f783a59c640 1 -- 172.21.15.103:0/1927023450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c19bb50 con 0x7f783c1076e0 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.392+0000 7f783a59c640 1 --2- 172.21.15.103:0/1927023450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c19b610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f782c0097f0 tx=0x7f782c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.392+0000 7f78337fe640 1 -- 172.21.15.103:0/1927023450 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f782c037040 con 0x7f783c1076e0 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.392+0000 7f78337fe640 1 -- 172.21.15.103:0/1927023450 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f782c032bb0 con 0x7f783c1076e0 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.392+0000 7f7840bbb640 1 -- 172.21.15.103:0/1927023450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c19bde0 con 0x7f783c1076e0 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.392+0000 7f78337fe640 1 -- 172.21.15.103:0/1927023450 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f782c03a390 con 0x7f783c1076e0 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.392+0000 7f7840bbb640 1 -- 172.21.15.103:0/1927023450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c19ead0 con 0x7f783c1076e0 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.393+0000 7f78337fe640 1 -- 172.21.15.103:0/1927023450 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f782c03a5d0 con 0x7f783c1076e0 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.393+0000 7f78337fe640 1 --2- 172.21.15.103:0/1927023450 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f78280391b0 0x7f782803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:27.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.393+0000 7f78337fe640 1 -- 172.21.15.103:0/1927023450 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f782c06c800 con 0x7f783c1076e0 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.393+0000 7f7840bbb640 1 -- 172.21.15.103:0/1927023450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f783c10bd70 con 0x7f783c1076e0 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.393+0000 7f7833fff640 1 --2- 172.21.15.103:0/1927023450 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f78280391b0 0x7f782803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.393+0000 7f7833fff640 1 --2- 172.21.15.103:0/1927023450 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f78280391b0 0x7f782803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f78240098c0 tx=0x7f7824006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.398+0000 7f78337fe640 1 -- 172.21.15.103:0/1927023450 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f782c032d60 con 0x7f783c1076e0 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.569+0000 7f7840bbb640 1 -- 172.21.15.103:0/1927023450 --> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f783c104130 con 0x7f78280391b0 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.635+0000 7f78337fe640 1 -- 172.21.15.103:0/1927023450 <== mgr.14118 v2:172.21.15.103:6800/1007431406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f783c104130 con 0x7f78280391b0 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.638+0000 7f7840bbb640 1 -- 172.21.15.103:0/1927023450 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f78280391b0 msgr2=0x7f782803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.638+0000 7f7840bbb640 1 --2- 172.21.15.103:0/1927023450 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f78280391b0 0x7f782803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f78240098c0 tx=0x7f7824006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.638+0000 7f7840bbb640 1 -- 172.21.15.103:0/1927023450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 msgr2=0x7f783c19b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.638+0000 7f7840bbb640 1 --2- 172.21.15.103:0/1927023450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c19b610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f782c0097f0 tx=0x7f782c030d00 comp rx=0 tx=0).stop 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.638+0000 7f7840bbb640 1 -- 172.21.15.103:0/1927023450 shutdown_connections 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.638+0000 7f7840bbb640 1 --2- 172.21.15.103:0/1927023450 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f78280391b0 0x7f782803b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:27.208 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.638+0000 7f7840bbb640 1 --2- 172.21.15.103:0/1927023450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c1076e0 0x7f783c19b610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:27.209 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.638+0000 7f7840bbb640 1 -- 172.21.15.103:0/1927023450 >> 172.21.15.103:0/1927023450 conn(0x7f783c102ed0 msgr2=0x7f783c103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:27.209 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.638+0000 7f7840bbb640 1 -- 172.21.15.103:0/1927023450 shutdown_connections 2024-09-19T05:58:27.209 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:26.638+0000 7f7840bbb640 1 -- 172.21.15.103:0/1927023450 wait complete. 2024-09-19T05:58:28.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:28 smithi103 ceph-mon[30925]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:28.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:28 smithi103 ceph-mon[30925]: Generating ssh key... 2024-09-19T05:58:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC71t1nvdfWwswDYSGNEqBSbrIZ9gLvBhfKzjtrWayEG2zVHR6UOEGcNvs3uparSvei3olDIR+dIdsZG2/jrOWQpdFjM9/zr6zhkXiXqFofpjmuU+L98f/YayFuynB5ZzQmG3ADtMmoqZVSp8YZ2FpoTA86rYCW2DwNWT2EQSuLNozhnIPcWAnT+wUBsUEre7mrmcmL12aPdW2dyMwNphU+dJLxqkj5y+2ZCDKqWl+OxXcv+FP09JSNguIn8xLF/j3JMCrlaSKtCyxHr/DqSyf2RXM5MEgTIk7GfgvDKN4QJAoF1KH0c/+Oif5rKapK6wAwOds2/APNdG7+CM3QZG+LeGRH9bHghv/8DRET+YU34omfygzOxoHmzE1sdM67jOxwNIPI766VOCiuUL2/ceh8upt4bOs67kvvt8bZvCdGyRYBnJeD2RM2zxPtqfM343OLUeTXEK9vZJR0Tu8YiAiW7KaDCeieqgfgaWRKXzNfVWbgaGeP9hOhWVbVuudzkh8= ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.607+0000 7f6db4aba640 1 Processor -- start 2024-09-19T05:58:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.607+0000 7f6db4aba640 1 -- start start 2024-09-19T05:58:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.607+0000 7f6db4aba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db0107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.607+0000 7f6db4aba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6db01080b0 con 0x7f6db01076e0 2024-09-19T05:58:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.608+0000 7f6dae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db0107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.608+0000 7f6dae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db0107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37706/0 (socket says 172.21.15.103:37706) 2024-09-19T05:58:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.608+0000 7f6dae59c640 1 -- 172.21.15.103:0/1116418896 learned_addr learned my addr 172.21.15.103:0/1116418896 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.608+0000 7f6dae59c640 1 -- 172.21.15.103:0/1116418896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db0108840 con 0x7f6db01076e0 2024-09-19T05:58:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6dae59c640 1 --2- 172.21.15.103:0/1116418896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db0107ae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009820 tx=0x7f6da002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ae23f998c1632f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6dadd9b640 1 -- 172.21.15.103:0/1116418896 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da0037070 con 0x7f6db01076e0 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6dadd9b640 1 -- 172.21.15.103:0/1116418896 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6da00328d0 con 0x7f6db01076e0 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6dadd9b640 1 -- 172.21.15.103:0/1116418896 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da00307d0 con 0x7f6db01076e0 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6db4aba640 1 -- 172.21.15.103:0/1116418896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 msgr2=0x7f6db0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6db4aba640 1 --2- 172.21.15.103:0/1116418896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db0107ae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009820 tx=0x7f6da002a270 comp rx=0 tx=0).stop 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6db4aba640 1 -- 172.21.15.103:0/1116418896 shutdown_connections 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6db4aba640 1 --2- 172.21.15.103:0/1116418896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db0107ae0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6db4aba640 1 -- 172.21.15.103:0/1116418896 >> 172.21.15.103:0/1116418896 conn(0x7f6db0102ed0 msgr2=0x7f6db01052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6db4aba640 1 -- 172.21.15.103:0/1116418896 shutdown_connections 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.609+0000 7f6db4aba640 1 -- 172.21.15.103:0/1116418896 wait complete. 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.610+0000 7f6db4aba640 1 Processor -- start 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.610+0000 7f6db4aba640 1 -- start start 2024-09-19T05:58:28.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.610+0000 7f6db4aba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db007db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.610+0000 7f6db4aba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6db010bbf0 con 0x7f6db01076e0 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.610+0000 7f6dae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db007db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.610+0000 7f6dae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db007db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37708/0 (socket says 172.21.15.103:37708) 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.610+0000 7f6dae59c640 1 -- 172.21.15.103:0/82095685 learned_addr learned my addr 172.21.15.103:0/82095685 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.611+0000 7f6dae59c640 1 -- 172.21.15.103:0/82095685 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db007e090 con 0x7f6db01076e0 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.611+0000 7f6dae59c640 1 --2- 172.21.15.103:0/82095685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db007db50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6da00097f0 tx=0x7f6da0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.611+0000 7f6da77fe640 1 -- 172.21.15.103:0/82095685 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da0037040 con 0x7f6db01076e0 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.611+0000 7f6da77fe640 1 -- 172.21.15.103:0/82095685 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6da0032bb0 con 0x7f6db01076e0 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.611+0000 7f6db4aba640 1 -- 172.21.15.103:0/82095685 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db007c280 con 0x7f6db01076e0 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.611+0000 7f6da77fe640 1 -- 172.21.15.103:0/82095685 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da003a390 con 0x7f6db01076e0 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.611+0000 7f6db4aba640 1 -- 172.21.15.103:0/82095685 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db007c7c0 con 0x7f6db01076e0 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.612+0000 7f6da77fe640 1 -- 172.21.15.103:0/82095685 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6da003a580 con 0x7f6db01076e0 2024-09-19T05:58:28.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.612+0000 7f6da77fe640 1 --2- 172.21.15.103:0/82095685 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f6d9c039200 0x7f6d9c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.612+0000 7f6da77fe640 1 -- 172.21.15.103:0/82095685 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6da006c4a0 con 0x7f6db01076e0 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.612+0000 7f6da7fff640 1 --2- 172.21.15.103:0/82095685 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f6d9c039200 0x7f6d9c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.612+0000 7f6db4aba640 1 -- 172.21.15.103:0/82095685 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db010bd70 con 0x7f6db01076e0 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.613+0000 7f6da7fff640 1 --2- 172.21.15.103:0/82095685 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f6d9c039200 0x7f6d9c03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6d980098c0 tx=0x7f6d98006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.617+0000 7f6da77fe640 1 -- 172.21.15.103:0/82095685 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6da0040210 con 0x7f6db01076e0 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.784+0000 7f6db4aba640 1 -- 172.21.15.103:0/82095685 --> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f6db007cf40 con 0x7f6d9c039200 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.785+0000 7f6da77fe640 1 -- 172.21.15.103:0/82095685 <== mgr.14118 v2:172.21.15.103:6800/1007431406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f6db007cf40 con 0x7f6d9c039200 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.787+0000 7f6db4aba640 1 -- 172.21.15.103:0/82095685 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f6d9c039200 msgr2=0x7f6d9c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.787+0000 7f6db4aba640 1 --2- 172.21.15.103:0/82095685 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f6d9c039200 0x7f6d9c03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6d980098c0 tx=0x7f6d98006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.787+0000 7f6db4aba640 1 -- 172.21.15.103:0/82095685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 msgr2=0x7f6db007db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.787+0000 7f6db4aba640 1 --2- 172.21.15.103:0/82095685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db007db50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6da00097f0 tx=0x7f6da0030d00 comp rx=0 tx=0).stop 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.787+0000 7f6db4aba640 1 -- 172.21.15.103:0/82095685 shutdown_connections 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.787+0000 7f6db4aba640 1 --2- 172.21.15.103:0/82095685 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f6d9c039200 0x7f6d9c03b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.787+0000 7f6db4aba640 1 --2- 172.21.15.103:0/82095685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db01076e0 0x7f6db007db50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:28.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.787+0000 7f6db4aba640 1 -- 172.21.15.103:0/82095685 >> 172.21.15.103:0/82095685 conn(0x7f6db0102ed0 msgr2=0x7f6db0103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:28.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.787+0000 7f6db4aba640 1 -- 172.21.15.103:0/82095685 shutdown_connections 2024-09-19T05:58:28.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:27.787+0000 7f6db4aba640 1 -- 172.21.15.103:0/82095685 wait complete. 2024-09-19T05:58:28.374 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:58:28.374 INFO:teuthology.orchestra.run.smithi103.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T05:58:28.374 INFO:teuthology.orchestra.run.smithi103.stdout:Adding host smithi103... 2024-09-19T05:58:29.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:29 smithi103 ceph-mon[30925]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:30.040 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:30 smithi103 ceph-mon[30925]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "addr": "172.21.15.103", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:31.493 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:31 smithi103 ceph-mon[30925]: Deploying cephadm binary to smithi103 2024-09-19T05:58:32.787 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Added host 'smithi103' with addr '172.21.15.103' 2024-09-19T05:58:32.787 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.804+0000 7fb91c859640 1 Processor -- start 2024-09-19T05:58:32.787 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.804+0000 7fb91c859640 1 -- start start 2024-09-19T05:58:32.787 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.804+0000 7fb91c859640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb918107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:32.787 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.804+0000 7fb91c859640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb9181080b0 con 0x7fb9181076e0 2024-09-19T05:58:32.787 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.804+0000 7fb91659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb918107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.804+0000 7fb91659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb918107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37714/0 (socket says 172.21.15.103:37714) 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.804+0000 7fb91659c640 1 -- 172.21.15.103:0/2330388746 learned_addr learned my addr 172.21.15.103:0/2330388746 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.804+0000 7fb91659c640 1 -- 172.21.15.103:0/2330388746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb918108840 con 0x7fb9181076e0 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.805+0000 7fb91659c640 1 --2- 172.21.15.103:0/2330388746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb918107ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb908009820 tx=0x7fb90802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6af6c5f1335b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.805+0000 7fb91559a640 1 -- 172.21.15.103:0/2330388746 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb908037070 con 0x7fb9181076e0 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.805+0000 7fb91559a640 1 -- 172.21.15.103:0/2330388746 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb9080328d0 con 0x7fb9181076e0 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.805+0000 7fb91559a640 1 -- 172.21.15.103:0/2330388746 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9080307d0 con 0x7fb9181076e0 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.806+0000 7fb91c859640 1 -- 172.21.15.103:0/2330388746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 msgr2=0x7fb918107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.806+0000 7fb91c859640 1 --2- 172.21.15.103:0/2330388746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb918107ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb908009820 tx=0x7fb90802a270 comp rx=0 tx=0).stop 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.806+0000 7fb91c859640 1 -- 172.21.15.103:0/2330388746 shutdown_connections 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.806+0000 7fb91c859640 1 --2- 172.21.15.103:0/2330388746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb918107ae0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.806+0000 7fb91c859640 1 -- 172.21.15.103:0/2330388746 >> 172.21.15.103:0/2330388746 conn(0x7fb918102ed0 msgr2=0x7fb9181052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:32.788 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.806+0000 7fb91c859640 1 -- 172.21.15.103:0/2330388746 shutdown_connections 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.806+0000 7fb91c859640 1 -- 172.21.15.103:0/2330388746 wait complete. 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.807+0000 7fb91c859640 1 Processor -- start 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.807+0000 7fb91c859640 1 -- start start 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.807+0000 7fb91c859640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb91807db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.807+0000 7fb91c859640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810bbf0 con 0x7fb9181076e0 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.807+0000 7fb91659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb91807db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.807+0000 7fb91659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb91807db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37730/0 (socket says 172.21.15.103:37730) 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.807+0000 7fb91659c640 1 -- 172.21.15.103:0/1513881973 learned_addr learned my addr 172.21.15.103:0/1513881973 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.807+0000 7fb91659c640 1 -- 172.21.15.103:0/1513881973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91807e090 con 0x7fb9181076e0 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.808+0000 7fb91659c640 1 --2- 172.21.15.103:0/1513881973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb91807db50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb9080097f0 tx=0x7fb908030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.808+0000 7fb9077fe640 1 -- 172.21.15.103:0/1513881973 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb908037040 con 0x7fb9181076e0 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.808+0000 7fb91c859640 1 -- 172.21.15.103:0/1513881973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91807c280 con 0x7fb9181076e0 2024-09-19T05:58:32.789 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.808+0000 7fb9077fe640 1 -- 172.21.15.103:0/1513881973 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb908032bb0 con 0x7fb9181076e0 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.808+0000 7fb9077fe640 1 -- 172.21.15.103:0/1513881973 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb90803a390 con 0x7fb9181076e0 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.808+0000 7fb91c859640 1 -- 172.21.15.103:0/1513881973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91807c7c0 con 0x7fb9181076e0 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.809+0000 7fb9077fe640 1 -- 172.21.15.103:0/1513881973 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fb90803a580 con 0x7fb9181076e0 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.809+0000 7fb9077fe640 1 --2- 172.21.15.103:0/1513881973 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7fb900039200 0x7fb90003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.809+0000 7fb9077fe640 1 -- 172.21.15.103:0/1513881973 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb90806c5a0 con 0x7fb9181076e0 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.809+0000 7fb915d9b640 1 --2- 172.21.15.103:0/1513881973 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7fb900039200 0x7fb90003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.809+0000 7fb91c859640 1 -- 172.21.15.103:0/1513881973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb91810bd70 con 0x7fb9181076e0 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.809+0000 7fb915d9b640 1 --2- 172.21.15.103:0/1513881973 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7fb900039200 0x7fb90003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0098c0 tx=0x7fb90c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.814+0000 7fb9077fe640 1 -- 172.21.15.103:0/1513881973 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb908040210 con 0x7fb9181076e0 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:28.983+0000 7fb91c859640 1 -- 172.21.15.103:0/1513881973 --> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi103", "addr": "172.21.15.103", "target": ["mon-mgr", ""]}) -- 0x7fb91807cf40 con 0x7fb900039200 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.172+0000 7fb9077fe640 1 -- 172.21.15.103:0/1513881973 <== mgr.14118 v2:172.21.15.103:6800/1007431406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fb91807cf40 con 0x7fb900039200 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.175+0000 7fb91c859640 1 -- 172.21.15.103:0/1513881973 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7fb900039200 msgr2=0x7fb90003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.175+0000 7fb91c859640 1 --2- 172.21.15.103:0/1513881973 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7fb900039200 0x7fb90003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0098c0 tx=0x7fb90c006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:32.790 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.175+0000 7fb91c859640 1 -- 172.21.15.103:0/1513881973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 msgr2=0x7fb91807db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:32.791 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.175+0000 7fb91c859640 1 --2- 172.21.15.103:0/1513881973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb91807db50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb9080097f0 tx=0x7fb908030d00 comp rx=0 tx=0).stop 2024-09-19T05:58:32.791 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.175+0000 7fb91c859640 1 -- 172.21.15.103:0/1513881973 shutdown_connections 2024-09-19T05:58:32.791 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.175+0000 7fb91c859640 1 --2- 172.21.15.103:0/1513881973 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7fb900039200 0x7fb90003b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:32.791 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.175+0000 7fb91c859640 1 --2- 172.21.15.103:0/1513881973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9181076e0 0x7fb91807db50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:32.791 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.175+0000 7fb91c859640 1 -- 172.21.15.103:0/1513881973 >> 172.21.15.103:0/1513881973 conn(0x7fb918102ed0 msgr2=0x7fb918103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:32.791 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.175+0000 7fb91c859640 1 -- 172.21.15.103:0/1513881973 shutdown_connections 2024-09-19T05:58:32.791 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:32.175+0000 7fb91c859640 1 -- 172.21.15.103:0/1513881973 wait complete. 2024-09-19T05:58:32.791 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying unmanaged mon service... 2024-09-19T05:58:33.351 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:33 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:33.351 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:33 smithi103 ceph-mon[30925]: Added host smithi103 2024-09-19T05:58:33.351 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:33 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:34.685 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:34 smithi103 ceph-mon[30925]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:34.686 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:34 smithi103 ceph-mon[30925]: Saving service mon spec with placement count:5 2024-09-19T05:58:34.686 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:34 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:34.687 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T05:58:34.693 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.153+0000 7f867ded4640 1 Processor -- start 2024-09-19T05:58:34.693 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.153+0000 7f867ded4640 1 -- start start 2024-09-19T05:58:34.693 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.153+0000 7f867ded4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f8678106970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:34.693 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.153+0000 7f867ded4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8678106f40 con 0x7f8678106570 2024-09-19T05:58:34.693 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.154+0000 7f86777fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f8678106970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:34.693 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.154+0000 7f86777fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f8678106970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44580/0 (socket says 172.21.15.103:44580) 2024-09-19T05:58:34.693 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.154+0000 7f86777fe640 1 -- 172.21.15.103:0/1529198928 learned_addr learned my addr 172.21.15.103:0/1529198928 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:34.693 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.154+0000 7f86777fe640 1 -- 172.21.15.103:0/1529198928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8678107720 con 0x7f8678106570 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.155+0000 7f86777fe640 1 --2- 172.21.15.103:0/1529198928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f8678106970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f866c009820 tx=0x7f866c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28f4a0d5053c949 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.155+0000 7f86767fc640 1 -- 172.21.15.103:0/1529198928 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c037070 con 0x7f8678106570 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.155+0000 7f86767fc640 1 -- 172.21.15.103:0/1529198928 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f866c0328d0 con 0x7f8678106570 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.155+0000 7f86767fc640 1 -- 172.21.15.103:0/1529198928 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c0307d0 con 0x7f8678106570 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.155+0000 7f867ded4640 1 -- 172.21.15.103:0/1529198928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 msgr2=0x7f8678106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.155+0000 7f867ded4640 1 --2- 172.21.15.103:0/1529198928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f8678106970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f866c009820 tx=0x7f866c02a270 comp rx=0 tx=0).stop 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.155+0000 7f867ded4640 1 -- 172.21.15.103:0/1529198928 shutdown_connections 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.155+0000 7f867ded4640 1 --2- 172.21.15.103:0/1529198928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f8678106970 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.155+0000 7f867ded4640 1 -- 172.21.15.103:0/1529198928 >> 172.21.15.103:0/1529198928 conn(0x7f8678101d80 msgr2=0x7f86781041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.155+0000 7f867ded4640 1 -- 172.21.15.103:0/1529198928 shutdown_connections 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.156+0000 7f867ded4640 1 -- 172.21.15.103:0/1529198928 wait complete. 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.156+0000 7f867ded4640 1 Processor -- start 2024-09-19T05:58:34.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.156+0000 7f867ded4640 1 -- start start 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.156+0000 7f867ded4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f867819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.156+0000 7f867ded4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f867810aad0 con 0x7f8678106570 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.156+0000 7f86777fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f867819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.157+0000 7f86777fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f867819b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44592/0 (socket says 172.21.15.103:44592) 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.157+0000 7f86777fe640 1 -- 172.21.15.103:0/2010332675 learned_addr learned my addr 172.21.15.103:0/2010332675 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.157+0000 7f86777fe640 1 -- 172.21.15.103:0/2010332675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867819bbc0 con 0x7f8678106570 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.157+0000 7f86777fe640 1 --2- 172.21.15.103:0/2010332675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f867819b680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f866c030520 tx=0x7f866c032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.157+0000 7f8674ff9640 1 -- 172.21.15.103:0/2010332675 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c042070 con 0x7f8678106570 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.157+0000 7f8674ff9640 1 -- 172.21.15.103:0/2010332675 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f866c030cc0 con 0x7f8678106570 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.157+0000 7f867ded4640 1 -- 172.21.15.103:0/2010332675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867819be50 con 0x7f8678106570 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.157+0000 7f8674ff9640 1 -- 172.21.15.103:0/2010332675 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c037040 con 0x7f8678106570 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.157+0000 7f867ded4640 1 -- 172.21.15.103:0/2010332675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867819eb40 con 0x7f8678106570 2024-09-19T05:58:34.695 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.158+0000 7f8674ff9640 1 -- 172.21.15.103:0/2010332675 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f866c045070 con 0x7f8678106570 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.158+0000 7f8674ff9640 1 --2- 172.21.15.103:0/2010332675 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f8660039200 0x7f866003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.158+0000 7f8674ff9640 1 -- 172.21.15.103:0/2010332675 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f866c06c230 con 0x7f8678106570 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.158+0000 7f8676ffd640 1 --2- 172.21.15.103:0/2010332675 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f8660039200 0x7f866003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.158+0000 7f867ded4640 1 -- 172.21.15.103:0/2010332675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867810ac50 con 0x7f8678106570 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.159+0000 7f8676ffd640 1 --2- 172.21.15.103:0/2010332675 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f8660039200 0x7f866003b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f86680098c0 tx=0x7f8668006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.163+0000 7f8674ff9640 1 -- 172.21.15.103:0/2010332675 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f866c04b170 con 0x7f8678106570 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.349+0000 7f867ded4640 1 -- 172.21.15.103:0/2010332675 --> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f867802d9b0 con 0x7f8660039200 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.355+0000 7f8674ff9640 1 -- 172.21.15.103:0/2010332675 <== mgr.14118 v2:172.21.15.103:6800/1007431406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f867802d9b0 con 0x7f8660039200 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.356+0000 7f867ded4640 1 -- 172.21.15.103:0/2010332675 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f8660039200 msgr2=0x7f866003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.356+0000 7f867ded4640 1 --2- 172.21.15.103:0/2010332675 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f8660039200 0x7f866003b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f86680098c0 tx=0x7f8668006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.356+0000 7f867ded4640 1 -- 172.21.15.103:0/2010332675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 msgr2=0x7f867819b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.357+0000 7f867ded4640 1 --2- 172.21.15.103:0/2010332675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f867819b680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f866c030520 tx=0x7f866c032dd0 comp rx=0 tx=0).stop 2024-09-19T05:58:34.696 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.357+0000 7f867ded4640 1 -- 172.21.15.103:0/2010332675 shutdown_connections 2024-09-19T05:58:34.697 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.357+0000 7f867ded4640 1 --2- 172.21.15.103:0/2010332675 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f8660039200 0x7f866003b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:34.697 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.357+0000 7f867ded4640 1 --2- 172.21.15.103:0/2010332675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8678106570 0x7f867819b680 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:34.697 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.357+0000 7f867ded4640 1 -- 172.21.15.103:0/2010332675 >> 172.21.15.103:0/2010332675 conn(0x7f8678101d80 msgr2=0x7f8678102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:34.697 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.357+0000 7f867ded4640 1 -- 172.21.15.103:0/2010332675 shutdown_connections 2024-09-19T05:58:34.697 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:33.357+0000 7f867ded4640 1 -- 172.21.15.103:0/2010332675 wait complete. 2024-09-19T05:58:34.697 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying unmanaged mgr service... 2024-09-19T05:58:36.093 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.064+0000 7efeb4e2c640 1 Processor -- start 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.064+0000 7efeb4e2c640 1 -- start start 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.065+0000 7efeb4e2c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb0107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.065+0000 7efeb4e2c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01080b0 con 0x7efeb01076e0 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.065+0000 7efeae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb0107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.065+0000 7efeae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb0107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44600/0 (socket says 172.21.15.103:44600) 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.065+0000 7efeae59c640 1 -- 172.21.15.103:0/4231994261 learned_addr learned my addr 172.21.15.103:0/4231994261 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.065+0000 7efeae59c640 1 -- 172.21.15.103:0/4231994261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb0108840 con 0x7efeb01076e0 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.066+0000 7efeae59c640 1 --2- 172.21.15.103:0/4231994261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb0107ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efea8009e80 tx=0x7efea802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29c0f20dcdcb4e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.066+0000 7efead59a640 1 -- 172.21.15.103:0/4231994261 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efea8036070 con 0x7efeb01076e0 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.066+0000 7efead59a640 1 -- 172.21.15.103:0/4231994261 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7efea8031890 con 0x7efeb01076e0 2024-09-19T05:58:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.066+0000 7efead59a640 1 -- 172.21.15.103:0/4231994261 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efea8007980 con 0x7efeb01076e0 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.067+0000 7efeb4e2c640 1 -- 172.21.15.103:0/4231994261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 msgr2=0x7efeb0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.067+0000 7efeb4e2c640 1 --2- 172.21.15.103:0/4231994261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb0107ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efea8009e80 tx=0x7efea802a7a0 comp rx=0 tx=0).stop 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.067+0000 7efeb4e2c640 1 -- 172.21.15.103:0/4231994261 shutdown_connections 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.067+0000 7efeb4e2c640 1 --2- 172.21.15.103:0/4231994261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb0107ae0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.067+0000 7efeb4e2c640 1 -- 172.21.15.103:0/4231994261 >> 172.21.15.103:0/4231994261 conn(0x7efeb0102ed0 msgr2=0x7efeb01052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.067+0000 7efeb4e2c640 1 -- 172.21.15.103:0/4231994261 shutdown_connections 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.067+0000 7efeb4e2c640 1 -- 172.21.15.103:0/4231994261 wait complete. 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efeb4e2c640 1 Processor -- start 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efeb4e2c640 1 -- start start 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efeb4e2c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb019b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efeb4e2c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efeb010bbf0 con 0x7efeb01076e0 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efeae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb019b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efeae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb019b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44604/0 (socket says 172.21.15.103:44604) 2024-09-19T05:58:36.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efeae59c640 1 -- 172.21.15.103:0/44563270 learned_addr learned my addr 172.21.15.103:0/44563270 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efeae59c640 1 -- 172.21.15.103:0/44563270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb019bb40 con 0x7efeb01076e0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efeae59c640 1 --2- 172.21.15.103:0/44563270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb019b600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efea8007bb0 tx=0x7efea8031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efea77fe640 1 -- 172.21.15.103:0/44563270 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efea8041020 con 0x7efeb01076e0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efea77fe640 1 -- 172.21.15.103:0/44563270 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7efea803c900 con 0x7efeb01076e0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efeb4e2c640 1 -- 172.21.15.103:0/44563270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb019bdd0 con 0x7efeb01076e0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.068+0000 7efea77fe640 1 -- 172.21.15.103:0/44563270 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efea8036040 con 0x7efeb01076e0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.069+0000 7efeb4e2c640 1 -- 172.21.15.103:0/44563270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb019eac0 con 0x7efeb01076e0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.069+0000 7efea77fe640 1 -- 172.21.15.103:0/44563270 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7efea8044020 con 0x7efeb01076e0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.069+0000 7efeb4e2c640 1 -- 172.21.15.103:0/44563270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb010bd70 con 0x7efeb01076e0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.070+0000 7efea77fe640 1 --2- 172.21.15.103:0/44563270 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7efe9c0391b0 0x7efe9c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.070+0000 7efea77fe640 1 -- 172.21.15.103:0/44563270 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efea806d800 con 0x7efeb01076e0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.070+0000 7efeadd9b640 1 --2- 172.21.15.103:0/44563270 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7efe9c0391b0 0x7efe9c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:36.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.070+0000 7efeadd9b640 1 --2- 172.21.15.103:0/44563270 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7efe9c0391b0 0x7efe9c03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efe980098c0 tx=0x7efe98006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.074+0000 7efea77fe640 1 -- 172.21.15.103:0/44563270 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efea804b020 con 0x7efeb01076e0 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.256+0000 7efeb4e2c640 1 -- 172.21.15.103:0/44563270 --> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7efeb0104140 con 0x7efe9c0391b0 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.260+0000 7efea77fe640 1 -- 172.21.15.103:0/44563270 <== mgr.14118 v2:172.21.15.103:6800/1007431406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7efeb0104140 con 0x7efe9c0391b0 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.263+0000 7efeb4e2c640 1 -- 172.21.15.103:0/44563270 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7efe9c0391b0 msgr2=0x7efe9c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.263+0000 7efeb4e2c640 1 --2- 172.21.15.103:0/44563270 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7efe9c0391b0 0x7efe9c03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efe980098c0 tx=0x7efe98006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.263+0000 7efeb4e2c640 1 -- 172.21.15.103:0/44563270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 msgr2=0x7efeb019b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.263+0000 7efeb4e2c640 1 --2- 172.21.15.103:0/44563270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb019b600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efea8007bb0 tx=0x7efea8031c70 comp rx=0 tx=0).stop 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.263+0000 7efeb4e2c640 1 -- 172.21.15.103:0/44563270 shutdown_connections 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.263+0000 7efeb4e2c640 1 --2- 172.21.15.103:0/44563270 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7efe9c0391b0 0x7efe9c03b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.263+0000 7efeb4e2c640 1 --2- 172.21.15.103:0/44563270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb01076e0 0x7efeb019b600 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.263+0000 7efeb4e2c640 1 -- 172.21.15.103:0/44563270 >> 172.21.15.103:0/44563270 conn(0x7efeb0102ed0 msgr2=0x7efeb0103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.263+0000 7efeb4e2c640 1 -- 172.21.15.103:0/44563270 shutdown_connections 2024-09-19T05:58:36.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:35.263+0000 7efeb4e2c640 1 -- 172.21.15.103:0/44563270 wait complete. 2024-09-19T05:58:36.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:36 smithi103 ceph-mon[30925]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:36.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:36 smithi103 ceph-mon[30925]: Saving service mgr spec with placement count:2 2024-09-19T05:58:36.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:36 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:36.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:36 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:37.259 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.476+0000 7f2c59618640 1 Processor -- start 2024-09-19T05:58:37.259 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.476+0000 7f2c59618640 1 -- start start 2024-09-19T05:58:37.259 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.476+0000 7f2c59618640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c54107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:37.259 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.476+0000 7f2c59618640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2c541080b0 con 0x7f2c541076e0 2024-09-19T05:58:37.259 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.477+0000 7f2c52ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c54107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:37.259 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.477+0000 7f2c52ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c54107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44618/0 (socket says 172.21.15.103:44618) 2024-09-19T05:58:37.259 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.477+0000 7f2c52ffd640 1 -- 172.21.15.103:0/3064413637 learned_addr learned my addr 172.21.15.103:0/3064413637 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:37.259 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.477+0000 7f2c52ffd640 1 -- 172.21.15.103:0/3064413637 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c54108840 con 0x7f2c541076e0 2024-09-19T05:58:37.259 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c52ffd640 1 --2- 172.21.15.103:0/3064413637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c54107ae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009e80 tx=0x7f2c4402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44d71aa9f90d71a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:37.259 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c51ffb640 1 -- 172.21.15.103:0/3064413637 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c44036070 con 0x7f2c541076e0 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c51ffb640 1 -- 172.21.15.103:0/3064413637 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c440318b0 con 0x7f2c541076e0 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c51ffb640 1 -- 172.21.15.103:0/3064413637 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c44007930 con 0x7f2c541076e0 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c59618640 1 -- 172.21.15.103:0/3064413637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 msgr2=0x7f2c54107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c59618640 1 --2- 172.21.15.103:0/3064413637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c54107ae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009e80 tx=0x7f2c4402a7a0 comp rx=0 tx=0).stop 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c59618640 1 -- 172.21.15.103:0/3064413637 shutdown_connections 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c59618640 1 --2- 172.21.15.103:0/3064413637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c54107ae0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c59618640 1 -- 172.21.15.103:0/3064413637 >> 172.21.15.103:0/3064413637 conn(0x7f2c54102e90 msgr2=0x7f2c541052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c59618640 1 -- 172.21.15.103:0/3064413637 shutdown_connections 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.478+0000 7f2c59618640 1 -- 172.21.15.103:0/3064413637 wait complete. 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.479+0000 7f2c59618640 1 Processor -- start 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.479+0000 7f2c59618640 1 -- start start 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.479+0000 7f2c59618640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c5419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:37.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.479+0000 7f2c59618640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5410bbf0 con 0x7f2c541076e0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.479+0000 7f2c52ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c5419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.479+0000 7f2c52ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c5419b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44624/0 (socket says 172.21.15.103:44624) 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.479+0000 7f2c52ffd640 1 -- 172.21.15.103:0/408362845 learned_addr learned my addr 172.21.15.103:0/408362845 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.480+0000 7f2c52ffd640 1 -- 172.21.15.103:0/408362845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5419bbd0 con 0x7f2c541076e0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.480+0000 7f2c52ffd640 1 --2- 172.21.15.103:0/408362845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c5419b690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c44031c90 tx=0x7f2c44031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.480+0000 7f2c3bfff640 1 -- 172.21.15.103:0/408362845 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c44036050 con 0x7f2c541076e0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.480+0000 7f2c3bfff640 1 -- 172.21.15.103:0/408362845 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c44042070 con 0x7f2c541076e0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.480+0000 7f2c3bfff640 1 -- 172.21.15.103:0/408362845 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4403da30 con 0x7f2c541076e0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.480+0000 7f2c59618640 1 -- 172.21.15.103:0/408362845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5419be60 con 0x7f2c541076e0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.480+0000 7f2c59618640 1 -- 172.21.15.103:0/408362845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5419eb50 con 0x7f2c541076e0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.481+0000 7f2c3bfff640 1 -- 172.21.15.103:0/408362845 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f2c4403dce0 con 0x7f2c541076e0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.481+0000 7f2c59618640 1 -- 172.21.15.103:0/408362845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5410bd70 con 0x7f2c541076e0 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.481+0000 7f2c3bfff640 1 --2- 172.21.15.103:0/408362845 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f2c3c039200 0x7f2c3c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.481+0000 7f2c3bfff640 1 -- 172.21.15.103:0/408362845 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2c4406d810 con 0x7f2c541076e0 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.481+0000 7f2c527fc640 1 --2- 172.21.15.103:0/408362845 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f2c3c039200 0x7f2c3c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.482+0000 7f2c527fc640 1 --2- 172.21.15.103:0/408362845 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f2c3c039200 0x7f2c3c03b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c480098c0 tx=0x7f2c48006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.486+0000 7f2c3bfff640 1 -- 172.21.15.103:0/408362845 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c44047460 con 0x7f2c541076e0 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.662+0000 7f2c59618640 1 -- 172.21.15.103:0/408362845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f2c54107b60 con 0x7f2c541076e0 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.667+0000 7f2c3bfff640 1 -- 172.21.15.103:0/408362845 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f2c4403b740 con 0x7f2c541076e0 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.670+0000 7f2c59618640 1 -- 172.21.15.103:0/408362845 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f2c3c039200 msgr2=0x7f2c3c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.670+0000 7f2c59618640 1 --2- 172.21.15.103:0/408362845 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f2c3c039200 0x7f2c3c03b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c480098c0 tx=0x7f2c48006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.670+0000 7f2c59618640 1 -- 172.21.15.103:0/408362845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 msgr2=0x7f2c5419b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.670+0000 7f2c59618640 1 --2- 172.21.15.103:0/408362845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c5419b690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c44031c90 tx=0x7f2c44031cc0 comp rx=0 tx=0).stop 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.670+0000 7f2c59618640 1 -- 172.21.15.103:0/408362845 shutdown_connections 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.670+0000 7f2c59618640 1 --2- 172.21.15.103:0/408362845 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f2c3c039200 0x7f2c3c03b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:37.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.670+0000 7f2c59618640 1 --2- 172.21.15.103:0/408362845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c541076e0 0x7f2c5419b690 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:37.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.670+0000 7f2c59618640 1 -- 172.21.15.103:0/408362845 >> 172.21.15.103:0/408362845 conn(0x7f2c54102e90 msgr2=0x7f2c54103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:37.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.670+0000 7f2c59618640 1 -- 172.21.15.103:0/408362845 shutdown_connections 2024-09-19T05:58:37.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:36.670+0000 7f2c59618640 1 -- 172.21.15.103:0/408362845 wait complete. 2024-09-19T05:58:37.846 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:37 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:37.846 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:37 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/408362845' entity='client.admin' 2024-09-19T05:58:39.071 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:38 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/706309172' entity='client.admin' 2024-09-19T05:58:39.071 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:38 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:39.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.658+0000 7ff38cf08640 1 Processor -- start 2024-09-19T05:58:39.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.658+0000 7ff38cf08640 1 -- start start 2024-09-19T05:58:39.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.658+0000 7ff38cf08640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff388106970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.659+0000 7ff38cf08640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff388106f40 con 0x7ff388106570 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.659+0000 7ff38659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff388106970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.659+0000 7ff38659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff388106970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44640/0 (socket says 172.21.15.103:44640) 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.659+0000 7ff38659c640 1 -- 172.21.15.103:0/2469384165 learned_addr learned my addr 172.21.15.103:0/2469384165 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.659+0000 7ff38659c640 1 -- 172.21.15.103:0/2469384165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff388107720 con 0x7ff388106570 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38659c640 1 --2- 172.21.15.103:0/2469384165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff388106970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff378009820 tx=0x7ff37802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a39d3882c0adf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38559a640 1 -- 172.21.15.103:0/2469384165 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff378037070 con 0x7ff388106570 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38559a640 1 -- 172.21.15.103:0/2469384165 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3780328f0 con 0x7ff388106570 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38559a640 1 -- 172.21.15.103:0/2469384165 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff378030740 con 0x7ff388106570 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38cf08640 1 -- 172.21.15.103:0/2469384165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 msgr2=0x7ff388106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:39.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38cf08640 1 --2- 172.21.15.103:0/2469384165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff388106970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff378009820 tx=0x7ff37802a270 comp rx=0 tx=0).stop 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38cf08640 1 -- 172.21.15.103:0/2469384165 shutdown_connections 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38cf08640 1 --2- 172.21.15.103:0/2469384165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff388106970 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38cf08640 1 -- 172.21.15.103:0/2469384165 >> 172.21.15.103:0/2469384165 conn(0x7ff388101d80 msgr2=0x7ff3881041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38cf08640 1 -- 172.21.15.103:0/2469384165 shutdown_connections 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.660+0000 7ff38cf08640 1 -- 172.21.15.103:0/2469384165 wait complete. 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.661+0000 7ff38cf08640 1 Processor -- start 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.661+0000 7ff38cf08640 1 -- start start 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.661+0000 7ff38cf08640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff38819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.661+0000 7ff38cf08640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff38810aad0 con 0x7ff388106570 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.661+0000 7ff38659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff38819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.661+0000 7ff38659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff38819b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44646/0 (socket says 172.21.15.103:44646) 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.662+0000 7ff38659c640 1 -- 172.21.15.103:0/706309172 learned_addr learned my addr 172.21.15.103:0/706309172 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:39.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.662+0000 7ff38659c640 1 -- 172.21.15.103:0/706309172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38819bbf0 con 0x7ff388106570 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.663+0000 7ff38659c640 1 --2- 172.21.15.103:0/706309172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff38819b6b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3780097f0 tx=0x7ff378030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.663+0000 7ff3777fe640 1 -- 172.21.15.103:0/706309172 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff378042070 con 0x7ff388106570 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.663+0000 7ff3777fe640 1 -- 172.21.15.103:0/706309172 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff378030e80 con 0x7ff388106570 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.663+0000 7ff38cf08640 1 -- 172.21.15.103:0/706309172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38819be80 con 0x7ff388106570 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.663+0000 7ff3777fe640 1 -- 172.21.15.103:0/706309172 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff378037040 con 0x7ff388106570 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.663+0000 7ff38cf08640 1 -- 172.21.15.103:0/706309172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38819eb70 con 0x7ff388106570 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.664+0000 7ff3777fe640 1 -- 172.21.15.103:0/706309172 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff378045070 con 0x7ff388106570 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.664+0000 7ff3777fe640 1 --2- 172.21.15.103:0/706309172 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7ff370039200 0x7ff37003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.664+0000 7ff3777fe640 1 -- 172.21.15.103:0/706309172 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff37806d260 con 0x7ff388106570 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.664+0000 7ff385d9b640 1 --2- 172.21.15.103:0/706309172 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7ff370039200 0x7ff37003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.664+0000 7ff38cf08640 1 -- 172.21.15.103:0/706309172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff38810ac50 con 0x7ff388106570 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.664+0000 7ff385d9b640 1 --2- 172.21.15.103:0/706309172 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7ff370039200 0x7ff37003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0098c0 tx=0x7ff37c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:39.081 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.669+0000 7ff3777fe640 1 -- 172.21.15.103:0/706309172 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff378045360 con 0x7ff388106570 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.844+0000 7ff38cf08640 1 -- 172.21.15.103:0/706309172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7ff38802d930 con 0x7ff388106570 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.848+0000 7ff3777fe640 1 -- 172.21.15.103:0/706309172 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7ff37802ed90 con 0x7ff388106570 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.852+0000 7ff38cf08640 1 -- 172.21.15.103:0/706309172 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7ff370039200 msgr2=0x7ff37003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.852+0000 7ff38cf08640 1 --2- 172.21.15.103:0/706309172 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7ff370039200 0x7ff37003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0098c0 tx=0x7ff37c006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.852+0000 7ff38cf08640 1 -- 172.21.15.103:0/706309172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 msgr2=0x7ff38819b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.852+0000 7ff38cf08640 1 --2- 172.21.15.103:0/706309172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff38819b6b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3780097f0 tx=0x7ff378030c70 comp rx=0 tx=0).stop 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.852+0000 7ff38cf08640 1 -- 172.21.15.103:0/706309172 shutdown_connections 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.852+0000 7ff38cf08640 1 --2- 172.21.15.103:0/706309172 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7ff370039200 0x7ff37003b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.852+0000 7ff38cf08640 1 --2- 172.21.15.103:0/706309172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388106570 0x7ff38819b6b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.852+0000 7ff38cf08640 1 -- 172.21.15.103:0/706309172 >> 172.21.15.103:0/706309172 conn(0x7ff388101d80 msgr2=0x7ff388102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.852+0000 7ff38cf08640 1 -- 172.21.15.103:0/706309172 shutdown_connections 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:37.852+0000 7ff38cf08640 1 -- 172.21.15.103:0/706309172 wait complete. 2024-09-19T05:58:39.082 INFO:teuthology.orchestra.run.smithi103.stdout:Enabling the dashboard module... 2024-09-19T05:58:40.798 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:40 smithi103 ceph-mon[30925]: from='mgr.14118 172.21.15.103:0/2948400791' entity='mgr.x' 2024-09-19T05:58:40.798 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:40 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3277686210' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T05:58:40.798 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:40 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: ignoring --setuser ceph since I am not root 2024-09-19T05:58:40.798 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:40 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: ignoring --setgroup ceph since I am not root 2024-09-19T05:58:40.798 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:40 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:40.687+0000 7fe398060040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:58:40.798 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:40 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:40.746+0000 7fe398060040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:58:41.113 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:40 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:40.896+0000 7fe398060040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:58:41.113 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:40 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:40.963+0000 7fe398060040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:58:41.113 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:41 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:41.111+0000 7fe398060040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:58:41.459 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:41 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:41.252+0000 7fe398060040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:58:41.466 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.496+0000 7f3fd4883640 1 Processor -- start 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.496+0000 7f3fd4883640 1 -- start start 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.497+0000 7f3fd4883640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0105d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.497+0000 7f3fd4883640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd01062e0 con 0x7f3fd0105910 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.497+0000 7f3fce59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0105d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.497+0000 7f3fce59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0105d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44660/0 (socket says 172.21.15.103:44660) 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.497+0000 7f3fce59c640 1 -- 172.21.15.103:0/3074872729 learned_addr learned my addr 172.21.15.103:0/3074872729 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.497+0000 7f3fce59c640 1 -- 172.21.15.103:0/3074872729 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd01088f0 con 0x7f3fd0105910 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.498+0000 7f3fce59c640 1 --2- 172.21.15.103:0/3074872729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0105d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009820 tx=0x7f3fc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386006faef5532ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.498+0000 7f3fcd59a640 1 -- 172.21.15.103:0/3074872729 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc0037070 con 0x7f3fd0105910 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.498+0000 7f3fcd59a640 1 -- 172.21.15.103:0/3074872729 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fc00328f0 con 0x7f3fd0105910 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.498+0000 7f3fcd59a640 1 -- 172.21.15.103:0/3074872729 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc0030740 con 0x7f3fd0105910 2024-09-19T05:58:41.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.499+0000 7f3fd4883640 1 -- 172.21.15.103:0/3074872729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 msgr2=0x7f3fd0105d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.499+0000 7f3fd4883640 1 --2- 172.21.15.103:0/3074872729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0105d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009820 tx=0x7f3fc002a270 comp rx=0 tx=0).stop 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.499+0000 7f3fd4883640 1 -- 172.21.15.103:0/3074872729 shutdown_connections 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.499+0000 7f3fd4883640 1 --2- 172.21.15.103:0/3074872729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0105d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.499+0000 7f3fd4883640 1 -- 172.21.15.103:0/3074872729 >> 172.21.15.103:0/3074872729 conn(0x7f3fd01014a0 msgr2=0x7f3fd01038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.499+0000 7f3fd4883640 1 -- 172.21.15.103:0/3074872729 shutdown_connections 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.499+0000 7f3fd4883640 1 -- 172.21.15.103:0/3074872729 wait complete. 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.500+0000 7f3fd4883640 1 Processor -- start 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.500+0000 7f3fd4883640 1 -- start start 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.500+0000 7f3fd4883640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0108170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.500+0000 7f3fd4883640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd010bb20 con 0x7f3fd0105910 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.500+0000 7f3fce59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0108170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.500+0000 7f3fce59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0108170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44662/0 (socket says 172.21.15.103:44662) 2024-09-19T05:58:41.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.500+0000 7f3fce59c640 1 -- 172.21.15.103:0/3277686210 learned_addr learned my addr 172.21.15.103:0/3277686210 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.501+0000 7f3fce59c640 1 -- 172.21.15.103:0/3277686210 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd01086b0 con 0x7f3fd0105910 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.501+0000 7f3fce59c640 1 --2- 172.21.15.103:0/3277686210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0108170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00097f0 tx=0x7f3fc0030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.501+0000 7f3fbf7fe640 1 -- 172.21.15.103:0/3277686210 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc0042070 con 0x7f3fd0105910 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.501+0000 7f3fd4883640 1 -- 172.21.15.103:0/3277686210 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd01068a0 con 0x7f3fd0105910 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.501+0000 7f3fbf7fe640 1 -- 172.21.15.103:0/3277686210 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fc0030d80 con 0x7f3fd0105910 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.501+0000 7f3fbf7fe640 1 -- 172.21.15.103:0/3277686210 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc0037040 con 0x7f3fd0105910 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.501+0000 7f3fd4883640 1 -- 172.21.15.103:0/3277686210 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd0106de0 con 0x7f3fd0105910 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.502+0000 7f3fbf7fe640 1 -- 172.21.15.103:0/3277686210 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3fc0045070 con 0x7f3fd0105910 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.502+0000 7f3fbf7fe640 1 --2- 172.21.15.103:0/3277686210 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f3fb80391b0 0x7f3fb803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.502+0000 7f3fbf7fe640 1 -- 172.21.15.103:0/3277686210 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3fc006c440 con 0x7f3fd0105910 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.502+0000 7f3fd4883640 1 -- 172.21.15.103:0/3277686210 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd0105d90 con 0x7f3fd0105910 2024-09-19T05:58:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.503+0000 7f3fcdd9b640 1 --2- 172.21.15.103:0/3277686210 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f3fb80391b0 0x7f3fb803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.503+0000 7f3fcdd9b640 1 --2- 172.21.15.103:0/3277686210 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f3fb80391b0 0x7f3fb803b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40098c0 tx=0x7f3fc4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.507+0000 7f3fbf7fe640 1 -- 172.21.15.103:0/3277686210 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3fc003add0 con 0x7f3fd0105910 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:39.727+0000 7f3fd4883640 1 -- 172.21.15.103:0/3277686210 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f3fd0107580 con 0x7f3fd0105910 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.541+0000 7f3fbf7fe640 1 -- 172.21.15.103:0/3277686210 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f3fc0045520 con 0x7f3fd0105910 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.543+0000 7f3fbf7fe640 1 -- 172.21.15.103:0/3277686210 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f3fc003db00 con 0x7f3fd0105910 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.544+0000 7f3fd4883640 1 -- 172.21.15.103:0/3277686210 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f3fb80391b0 msgr2=0x7f3fb803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.544+0000 7f3fd4883640 1 --2- 172.21.15.103:0/3277686210 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f3fb80391b0 0x7f3fb803b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40098c0 tx=0x7f3fc4006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.544+0000 7f3fd4883640 1 -- 172.21.15.103:0/3277686210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 msgr2=0x7f3fd0108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.544+0000 7f3fd4883640 1 --2- 172.21.15.103:0/3277686210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0108170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00097f0 tx=0x7f3fc0030c70 comp rx=0 tx=0).stop 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.544+0000 7f3fd4883640 1 -- 172.21.15.103:0/3277686210 shutdown_connections 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.544+0000 7f3fd4883640 1 --2- 172.21.15.103:0/3277686210 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f3fb80391b0 0x7f3fb803b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.544+0000 7f3fd4883640 1 --2- 172.21.15.103:0/3277686210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd0105910 0x7f3fd0108170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.544+0000 7f3fd4883640 1 -- 172.21.15.103:0/3277686210 >> 172.21.15.103:0/3277686210 conn(0x7f3fd01014a0 msgr2=0x7f3fd0102040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:41.471 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.544+0000 7f3fd4883640 1 -- 172.21.15.103:0/3277686210 shutdown_connections 2024-09-19T05:58:41.471 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:40.544+0000 7f3fd4883640 1 -- 172.21.15.103:0/3277686210 wait complete. 2024-09-19T05:58:41.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:41 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3277686210' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T05:58:41.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:41 smithi103 ceph-mon[30925]: mgrmap e9: x(active, since 18s) 2024-09-19T05:58:41.711 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:41 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:41.573+0000 7fe398060040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:58:41.711 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:41 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:41.635+0000 7fe398060040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:58:42.148 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:41 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:41.822+0000 7fe398060040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:58:42.724 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:42 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3942955206' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T05:58:42.742 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:58:42.742 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T05:58:42.742 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:58:42.742 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T05:58:42.742 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T05:58:42.742 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:58:42.742 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.940+0000 7f6078304640 1 Processor -- start 2024-09-19T05:58:42.742 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.940+0000 7f6078304640 1 -- start start 2024-09-19T05:58:42.742 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.941+0000 7f6078304640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070106970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:42.742 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.941+0000 7f6078304640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6070106f40 con 0x7f6070106570 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.941+0000 7f60760a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070106970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.941+0000 7f60760a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070106970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56770/0 (socket says 172.21.15.103:56770) 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.941+0000 7f60760a0640 1 -- 172.21.15.103:0/2312462373 learned_addr learned my addr 172.21.15.103:0/2312462373 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.941+0000 7f60760a0640 1 -- 172.21.15.103:0/2312462373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6070107720 con 0x7f6070106570 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.942+0000 7f60760a0640 1 --2- 172.21.15.103:0/2312462373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070106970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f606c009820 tx=0x7f606c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07eb499fb0e16cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.942+0000 7f607509e640 1 -- 172.21.15.103:0/2312462373 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c037070 con 0x7f6070106570 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.942+0000 7f607509e640 1 -- 172.21.15.103:0/2312462373 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f606c0328f0 con 0x7f6070106570 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.942+0000 7f607509e640 1 -- 172.21.15.103:0/2312462373 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c030740 con 0x7f6070106570 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.943+0000 7f6078304640 1 -- 172.21.15.103:0/2312462373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 msgr2=0x7f6070106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.943+0000 7f6078304640 1 --2- 172.21.15.103:0/2312462373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070106970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f606c009820 tx=0x7f606c02a270 comp rx=0 tx=0).stop 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.943+0000 7f6078304640 1 -- 172.21.15.103:0/2312462373 shutdown_connections 2024-09-19T05:58:42.743 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.943+0000 7f6078304640 1 --2- 172.21.15.103:0/2312462373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070106970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.943+0000 7f6078304640 1 -- 172.21.15.103:0/2312462373 >> 172.21.15.103:0/2312462373 conn(0x7f6070101d80 msgr2=0x7f60701041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.943+0000 7f6078304640 1 -- 172.21.15.103:0/2312462373 shutdown_connections 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.943+0000 7f6078304640 1 -- 172.21.15.103:0/2312462373 wait complete. 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.943+0000 7f6078304640 1 Processor -- start 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.943+0000 7f6078304640 1 -- start start 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f6078304640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070191750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f6078304640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f607010aad0 con 0x7f6070106570 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f60760a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070191750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f60760a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070191750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56786/0 (socket says 172.21.15.103:56786) 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f60760a0640 1 -- 172.21.15.103:0/3942955206 learned_addr learned my addr 172.21.15.103:0/3942955206 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f60760a0640 1 -- 172.21.15.103:0/3942955206 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6070191c90 con 0x7f6070106570 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f60760a0640 1 --2- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070191750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f606c0097f0 tx=0x7f606c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f60677fe640 1 -- 172.21.15.103:0/3942955206 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c042070 con 0x7f6070106570 2024-09-19T05:58:42.744 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f60677fe640 1 -- 172.21.15.103:0/3942955206 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f606c030e80 con 0x7f6070106570 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f60677fe640 1 -- 172.21.15.103:0/3942955206 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c037040 con 0x7f6070106570 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f6078304640 1 -- 172.21.15.103:0/3942955206 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607018fe80 con 0x7f6070106570 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.944+0000 7f6078304640 1 -- 172.21.15.103:0/3942955206 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60701903c0 con 0x7f6070106570 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.945+0000 7f60677fe640 1 -- 172.21.15.103:0/3942955206 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f606c045070 con 0x7f6070106570 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.945+0000 7f6078304640 1 -- 172.21.15.103:0/3942955206 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f607010ac50 con 0x7f6070106570 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.945+0000 7f60677fe640 1 --2- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f605c039200 0x7f605c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.946+0000 7f60677fe640 1 -- 172.21.15.103:0/3942955206 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f606c06c4f0 con 0x7f6070106570 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.946+0000 7f607589f640 1 -- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f605c039200 msgr2=0x7f605c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1007431406 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.946+0000 7f607589f640 1 --2- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f605c039200 0x7f605c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:41.950+0000 7f60677fe640 1 -- 172.21.15.103:0/3942955206 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f606c03add0 con 0x7f6070106570 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.147+0000 7f607589f640 1 -- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f605c039200 msgr2=0x7f605c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1007431406 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.147+0000 7f607589f640 1 --2- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f605c039200 0x7f605c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.167+0000 7f6078304640 1 -- 172.21.15.103:0/3942955206 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f6070195530 con 0x7f6070106570 2024-09-19T05:58:42.745 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.167+0000 7f60677fe640 1 -- 172.21.15.103:0/3942955206 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f606c045520 con 0x7f6070106570 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.169+0000 7f6078304640 1 -- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f605c039200 msgr2=0x7f605c03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.169+0000 7f6078304640 1 --2- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f605c039200 0x7f605c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.169+0000 7f6078304640 1 -- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 msgr2=0x7f6070191750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.169+0000 7f6078304640 1 --2- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070191750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f606c0097f0 tx=0x7f606c030c70 comp rx=0 tx=0).stop 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.169+0000 7f6078304640 1 -- 172.21.15.103:0/3942955206 shutdown_connections 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.169+0000 7f6078304640 1 --2- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f605c039200 0x7f605c03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.169+0000 7f6078304640 1 --2- 172.21.15.103:0/3942955206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6070106570 0x7f6070191750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.169+0000 7f6078304640 1 -- 172.21.15.103:0/3942955206 >> 172.21.15.103:0/3942955206 conn(0x7f6070101d80 msgr2=0x7f6070102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.170+0000 7f6078304640 1 -- 172.21.15.103:0/3942955206 shutdown_connections 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:42.170+0000 7f6078304640 1 -- 172.21.15.103:0/3942955206 wait complete. 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for the mgr to restart... 2024-09-19T05:58:42.746 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr epoch 9... 2024-09-19T05:58:42.989 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:42 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:42.722+0000 7fe398060040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:58:42.989 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:42 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:42.794+0000 7fe398060040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:58:43.637 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:43 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:43.518+0000 7fe398060040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:58:43.637 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:43 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:43.635+0000 7fe398060040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:58:43.984 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:43 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:43.776+0000 7fe398060040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:58:43.984 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:43 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:43.837+0000 7fe398060040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:58:43.985 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:43 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:43.983+0000 7fe398060040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:58:44.244 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:44.050+0000 7fe398060040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:58:44.244 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:44.108+0000 7fe398060040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:58:44.535 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:44.265+0000 7fe398060040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:58:44.535 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:44.329+0000 7fe398060040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:58:44.535 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:44.394+0000 7fe398060040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:58:44.535 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:44.475+0000 7fe398060040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:58:44.535 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:44.533+0000 7fe398060040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:58:44.994 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:44.592+0000 7fe398060040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:58:45.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:45.369+0000 7fe398060040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:58:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: Active manager daemon x restarted 2024-09-19T05:58:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: Activating manager daemon x 2024-09-19T05:58:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T05:58:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: mgrmap e10: x(active, starting, since 0.00311779s) 2024-09-19T05:58:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:58:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:58:45.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:58:45.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:58:45.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:58:45.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: Manager daemon x is now available 2024-09-19T05:58:45.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:45.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:58:45.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:58:47.162 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:58:47.162 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T05:58:47.162 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T05:58:47.162 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:58:47.162 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.173+0000 7f749285c640 1 Processor -- start 2024-09-19T05:58:47.162 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.173+0000 7f749285c640 1 -- start start 2024-09-19T05:58:47.162 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.173+0000 7f749285c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:47.162 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.173+0000 7f749285c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f748c1080b0 con 0x7f748c1076e0 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.173+0000 7f748bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.173+0000 7f748bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56798/0 (socket says 172.21.15.103:56798) 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.173+0000 7f748bfff640 1 -- 172.21.15.103:0/2597948097 learned_addr learned my addr 172.21.15.103:0/2597948097 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.173+0000 7f748bfff640 1 -- 172.21.15.103:0/2597948097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c108840 con 0x7f748c1076e0 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.174+0000 7f748bfff640 1 --2- 172.21.15.103:0/2597948097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c107ae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f747c009820 tx=0x7f747c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa61f35a80016ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.174+0000 7f748affd640 1 -- 172.21.15.103:0/2597948097 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f747c037070 con 0x7f748c1076e0 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.174+0000 7f748affd640 1 -- 172.21.15.103:0/2597948097 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f747c0328f0 con 0x7f748c1076e0 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.174+0000 7f748affd640 1 -- 172.21.15.103:0/2597948097 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f747c030740 con 0x7f748c1076e0 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.175+0000 7f749285c640 1 -- 172.21.15.103:0/2597948097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 msgr2=0x7f748c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.175+0000 7f749285c640 1 --2- 172.21.15.103:0/2597948097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c107ae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f747c009820 tx=0x7f747c02a270 comp rx=0 tx=0).stop 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.175+0000 7f749285c640 1 -- 172.21.15.103:0/2597948097 shutdown_connections 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.175+0000 7f749285c640 1 --2- 172.21.15.103:0/2597948097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c107ae0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:47.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.175+0000 7f749285c640 1 -- 172.21.15.103:0/2597948097 >> 172.21.15.103:0/2597948097 conn(0x7f748c102e90 msgr2=0x7f748c1052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.175+0000 7f749285c640 1 -- 172.21.15.103:0/2597948097 shutdown_connections 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.175+0000 7f749285c640 1 -- 172.21.15.103:0/2597948097 wait complete. 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.176+0000 7f749285c640 1 Processor -- start 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.176+0000 7f749285c640 1 -- start start 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.176+0000 7f749285c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c19d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.176+0000 7f749285c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f748c10bbf0 con 0x7f748c1076e0 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.176+0000 7f748bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c19d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.176+0000 7f748bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c19d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56812/0 (socket says 172.21.15.103:56812) 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.176+0000 7f748bfff640 1 -- 172.21.15.103:0/1840902768 learned_addr learned my addr 172.21.15.103:0/1840902768 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.176+0000 7f748bfff640 1 -- 172.21.15.103:0/1840902768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c19de00 con 0x7f748c1076e0 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.177+0000 7f748bfff640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c19d8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f747c009940 tx=0x7f747c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.177+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f747c042070 con 0x7f748c1076e0 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.177+0000 7f749285c640 1 -- 172.21.15.103:0/1840902768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748c19e090 con 0x7f748c1076e0 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.177+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f747c030d00 con 0x7f748c1076e0 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.177+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f747c037040 con 0x7f748c1076e0 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.177+0000 7f749285c640 1 -- 172.21.15.103:0/1840902768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f748c1a0d80 con 0x7f748c1076e0 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.178+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f747c045070 con 0x7f748c1076e0 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.178+0000 7f74897fa640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 0x7f747803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.178+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 --> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f747803bdd0 con 0x7f7478039200 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.178+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f747c06c360 con 0x7f748c1076e0 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.178+0000 7f748b7fe640 1 -- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 msgr2=0x7f747803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1007431406 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.178+0000 7f748b7fe640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 0x7f747803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.379+0000 7f748b7fe640 1 -- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 msgr2=0x7f747803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1007431406 2024-09-19T05:58:47.165 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.379+0000 7f748b7fe640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 0x7f747803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.780+0000 7f748b7fe640 1 -- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 msgr2=0x7f747803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1007431406 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:43.780+0000 7f748b7fe640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 0x7f747803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:44.581+0000 7f748b7fe640 1 -- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 msgr2=0x7f747803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1007431406 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:44.581+0000 7f748b7fe640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 0x7f747803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:45.373+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f747c06ae10 con 0x7f748c1076e0 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:45.373+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 msgr2=0x7f747803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:45.373+0000 7f74897fa640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 0x7f747803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.374+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f747c03b330 con 0x7f748c1076e0 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.375+0000 7f74897fa640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f747803ccc0 0x7f747803f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.375+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f747803bdd0 con 0x7f747803ccc0 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.375+0000 7f748b7fe640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f747803ccc0 0x7f747803f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.376+0000 7f748b7fe640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f747803ccc0 0x7f747803f0b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7474003980 tx=0x7f7474006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.376+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f747803bdd0 con 0x7f747803ccc0 2024-09-19T05:58:47.166 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.384+0000 7f749285c640 1 -- 172.21.15.103:0/1840902768 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f748c10bd70 con 0x7f747803ccc0 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.384+0000 7f74897fa640 1 -- 172.21.15.103:0/1840902768 <== mgr.14150 v2:172.21.15.103:6800/253046125 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f748c10bd70 con 0x7f747803ccc0 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 -- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f747803ccc0 msgr2=0x7f747803f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f747803ccc0 0x7f747803f0b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7474003980 tx=0x7f7474006e10 comp rx=0 tx=0).stop 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 -- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 msgr2=0x7f748c19d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c19d8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f747c009940 tx=0x7f747c0327b0 comp rx=0 tx=0).stop 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 -- 172.21.15.103:0/1840902768 shutdown_connections 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f747803ccc0 0x7f747803f0b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:6800/1007431406,v1:172.21.15.103:6801/1007431406] conn(0x7f7478039200 0x7f747803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 --2- 172.21.15.103:0/1840902768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1076e0 0x7f748c19d8c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 -- 172.21.15.103:0/1840902768 >> 172.21.15.103:0/1840902768 conn(0x7f748c102e90 msgr2=0x7f748c1039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 -- 172.21.15.103:0/1840902768 shutdown_connections 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:46.385+0000 7f749285c640 1 -- 172.21.15.103:0/1840902768 wait complete. 2024-09-19T05:58:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:mgr epoch 9 is available 2024-09-19T05:58:47.168 INFO:teuthology.orchestra.run.smithi103.stdout:Generating a dashboard self-signed certificate... 2024-09-19T05:58:47.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-mon[30925]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T05:58:47.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-mon[30925]: mgrmap e11: x(active, since 1.00554s) 2024-09-19T05:58:47.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-mon[30925]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T05:58:47.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:47.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:47.408+0000 7fe303334640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:05:58:47] ENGINE Error in HTTPServer.serve 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: Traceback (most recent call last): 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self._connections.run(self.expiration_interval) 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self._run(expiration_interval) 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:58:47.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: s = self.context.wrap_socket( 2024-09-19T05:58:47.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:58:47.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: return self.sslsocket_class._create( 2024-09-19T05:58:47.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:58:47.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self.do_handshake() 2024-09-19T05:58:47.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:58:47.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self._sslobj.do_handshake() 2024-09-19T05:58:47.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:58:47.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:58:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:58:48.492 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.632+0000 7f3a8921d640 1 Processor -- start 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.632+0000 7f3a8921d640 1 -- start start 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.632+0000 7f3a8921d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8407bcd0 0x7f3a8410a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.632+0000 7f3a8921d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8410a7a0 con 0x7f3a8407bcd0 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.633+0000 7f3a82d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8407bcd0 0x7f3a8410a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.633+0000 7f3a82d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8407bcd0 0x7f3a8410a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56894/0 (socket says 172.21.15.103:56894) 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.633+0000 7f3a82d9d640 1 -- 172.21.15.103:0/1851078120 learned_addr learned my addr 172.21.15.103:0/1851078120 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.633+0000 7f3a82d9d640 1 -- 172.21.15.103:0/1851078120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8410a920 con 0x7f3a8407bcd0 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a82d9d640 1 --2- 172.21.15.103:0/1851078120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8407bcd0 0x7f3a8410a1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009e80 tx=0x7f3a7402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345542b041c65180 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a81d9b640 1 -- 172.21.15.103:0/1851078120 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a74036070 con 0x7f3a8407bcd0 2024-09-19T05:58:48.493 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a81d9b640 1 -- 172.21.15.103:0/1851078120 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a740318b0 con 0x7f3a8407bcd0 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a81d9b640 1 -- 172.21.15.103:0/1851078120 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a74007930 con 0x7f3a8407bcd0 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a8921d640 1 -- 172.21.15.103:0/1851078120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8407bcd0 msgr2=0x7f3a8410a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a8921d640 1 --2- 172.21.15.103:0/1851078120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8407bcd0 0x7f3a8410a1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009e80 tx=0x7f3a7402a7a0 comp rx=0 tx=0).stop 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a8921d640 1 -- 172.21.15.103:0/1851078120 shutdown_connections 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a8921d640 1 --2- 172.21.15.103:0/1851078120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8407bcd0 0x7f3a8410a1d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a8921d640 1 -- 172.21.15.103:0/1851078120 >> 172.21.15.103:0/1851078120 conn(0x7f3a84101d80 msgr2=0x7f3a841041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a8921d640 1 -- 172.21.15.103:0/1851078120 shutdown_connections 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.634+0000 7f3a8921d640 1 -- 172.21.15.103:0/1851078120 wait complete. 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.635+0000 7f3a8921d640 1 Processor -- start 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.635+0000 7f3a8921d640 1 -- start start 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.635+0000 7f3a8921d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8419d800 0x7f3a8419dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.635+0000 7f3a8921d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8410ba00 con 0x7f3a8419d800 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.636+0000 7f3a82d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8419d800 0x7f3a8419dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.636+0000 7f3a82d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8419d800 0x7f3a8419dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56910/0 (socket says 172.21.15.103:56910) 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.636+0000 7f3a82d9d640 1 -- 172.21.15.103:0/2792883616 learned_addr learned my addr 172.21.15.103:0/2792883616 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.636+0000 7f3a82d9d640 1 -- 172.21.15.103:0/2792883616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8419e160 con 0x7f3a8419d800 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.636+0000 7f3a82d9d640 1 --2- 172.21.15.103:0/2792883616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8419d800 0x7f3a8419dc20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a74031cc0 tx=0x7f3a74031cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.636+0000 7f3a7bfff640 1 -- 172.21.15.103:0/2792883616 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a74036050 con 0x7f3a8419d800 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.636+0000 7f3a7bfff640 1 -- 172.21.15.103:0/2792883616 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a74042070 con 0x7f3a8419d800 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.636+0000 7f3a7bfff640 1 -- 172.21.15.103:0/2792883616 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a7403db10 con 0x7f3a8419d800 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.636+0000 7f3a8921d640 1 -- 172.21.15.103:0/2792883616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8419e3f0 con 0x7f3a8419d800 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.636+0000 7f3a8921d640 1 -- 172.21.15.103:0/2792883616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a841a0ed0 con 0x7f3a8419d800 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.637+0000 7f3a8921d640 1 -- 172.21.15.103:0/2792883616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a84108240 con 0x7f3a8419d800 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.637+0000 7f3a7bfff640 1 -- 172.21.15.103:0/2792883616 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f3a7403b740 con 0x7f3a8419d800 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.637+0000 7f3a7bfff640 1 --2- 172.21.15.103:0/2792883616 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3a70039140 0x7f3a7003b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.638+0000 7f3a7bfff640 1 -- 172.21.15.103:0/2792883616 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3a7406d820 con 0x7f3a8419d800 2024-09-19T05:58:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.638+0000 7f3a8259c640 1 --2- 172.21.15.103:0/2792883616 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3a70039140 0x7f3a7003b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.638+0000 7f3a8259c640 1 --2- 172.21.15.103:0/2792883616 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3a70039140 0x7f3a7003b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0098c0 tx=0x7f3a6c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.642+0000 7f3a7bfff640 1 -- 172.21.15.103:0/2792883616 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a740477e0 con 0x7f3a8419d800 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.756+0000 7f3a7bfff640 1 -- 172.21.15.103:0/2792883616 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f3a74038260 con 0x7f3a8419d800 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.820+0000 7f3a8921d640 1 -- 172.21.15.103:0/2792883616 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f3a84103040 con 0x7f3a70039140 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.892+0000 7f3a7bfff640 1 -- 172.21.15.103:0/2792883616 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f3a84103040 con 0x7f3a70039140 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.895+0000 7f3a8921d640 1 -- 172.21.15.103:0/2792883616 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3a70039140 msgr2=0x7f3a7003b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.895+0000 7f3a8921d640 1 --2- 172.21.15.103:0/2792883616 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3a70039140 0x7f3a7003b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0098c0 tx=0x7f3a6c006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.895+0000 7f3a8921d640 1 -- 172.21.15.103:0/2792883616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8419d800 msgr2=0x7f3a8419dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.895+0000 7f3a8921d640 1 --2- 172.21.15.103:0/2792883616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8419d800 0x7f3a8419dc20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a74031cc0 tx=0x7f3a74031cf0 comp rx=0 tx=0).stop 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.895+0000 7f3a8921d640 1 -- 172.21.15.103:0/2792883616 shutdown_connections 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.895+0000 7f3a8921d640 1 --2- 172.21.15.103:0/2792883616 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3a70039140 0x7f3a7003b600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:48.496 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.895+0000 7f3a8921d640 1 --2- 172.21.15.103:0/2792883616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8419d800 0x7f3a8419dc20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:48.497 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.895+0000 7f3a8921d640 1 -- 172.21.15.103:0/2792883616 >> 172.21.15.103:0/2792883616 conn(0x7f3a84101d80 msgr2=0x7f3a84102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:48.497 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.895+0000 7f3a8921d640 1 -- 172.21.15.103:0/2792883616 shutdown_connections 2024-09-19T05:58:48.497 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:47.895+0000 7f3a8921d640 1 -- 172.21.15.103:0/2792883616 wait complete. 2024-09-19T05:58:48.497 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial admin user... 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:48 smithi103 ceph-mon[30925]: [19/Sep/2024:05:58:47] ENGINE Bus STARTING 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:48 smithi103 ceph-mon[30925]: [19/Sep/2024:05:58:47] ENGINE Serving on https://172.21.15.103:7150 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:48 smithi103 ceph-mon[30925]: [19/Sep/2024:05:58:47] ENGINE Error in HTTPServer.serve 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout: Traceback (most recent call last): 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._run(expiration_interval) 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:58:48.611 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout: s = self.context.wrap_socket( 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout: return self.sslsocket_class._create( 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout: self.do_handshake() 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._sslobj.do_handshake() 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:48 smithi103 ceph-mon[30925]: [19/Sep/2024:05:58:47] ENGINE Serving on http://172.21.15.103:8765 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:48 smithi103 ceph-mon[30925]: [19/Sep/2024:05:58:47] ENGINE Bus STARTED 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:48.612 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:48 smithi103 ceph-mon[30925]: mgrmap e12: x(active, since 2s) 2024-09-19T05:58:48.613 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:48.613 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:49.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:49 smithi103 ceph-mon[30925]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:49.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:49 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:50.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:50 smithi103 ceph-mon[30925]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:50.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$gswtx/NRKrcQrSM.AoMbTe2Ns2mmes5kNoZTcGNkIBauWFihhZsJK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726725529, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T05:58:50.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.892+0000 7f78cc25e640 1 Processor -- start 2024-09-19T05:58:50.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.892+0000 7f78cc25e640 1 -- start start 2024-09-19T05:58:50.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.893+0000 7f78cc25e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4106970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:50.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.893+0000 7f78cc25e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78c4106f40 con 0x7f78c4106570 2024-09-19T05:58:50.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.893+0000 7f78c9ffa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4106970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:50.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.893+0000 7f78c9ffa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4106970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56926/0 (socket says 172.21.15.103:56926) 2024-09-19T05:58:50.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.893+0000 7f78c9ffa640 1 -- 172.21.15.103:0/4270788682 learned_addr learned my addr 172.21.15.103:0/4270788682 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:50.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.893+0000 7f78c9ffa640 1 -- 172.21.15.103:0/4270788682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c4107720 con 0x7f78c4106570 2024-09-19T05:58:50.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.894+0000 7f78c9ffa640 1 --2- 172.21.15.103:0/4270788682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4106970 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009e80 tx=0x7f78b402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e267ac448048f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.894+0000 7f78c8ff8640 1 -- 172.21.15.103:0/4270788682 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78b4036070 con 0x7f78c4106570 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.894+0000 7f78c8ff8640 1 -- 172.21.15.103:0/4270788682 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78b40318b0 con 0x7f78c4106570 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.894+0000 7f78c8ff8640 1 -- 172.21.15.103:0/4270788682 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78b4007930 con 0x7f78c4106570 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.895+0000 7f78cc25e640 1 -- 172.21.15.103:0/4270788682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 msgr2=0x7f78c4106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.895+0000 7f78cc25e640 1 --2- 172.21.15.103:0/4270788682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4106970 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009e80 tx=0x7f78b402a7a0 comp rx=0 tx=0).stop 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.895+0000 7f78cc25e640 1 -- 172.21.15.103:0/4270788682 shutdown_connections 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.895+0000 7f78cc25e640 1 --2- 172.21.15.103:0/4270788682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4106970 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.895+0000 7f78cc25e640 1 -- 172.21.15.103:0/4270788682 >> 172.21.15.103:0/4270788682 conn(0x7f78c4101d80 msgr2=0x7f78c41041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.895+0000 7f78cc25e640 1 -- 172.21.15.103:0/4270788682 shutdown_connections 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.895+0000 7f78cc25e640 1 -- 172.21.15.103:0/4270788682 wait complete. 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.895+0000 7f78cc25e640 1 Processor -- start 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.895+0000 7f78cc25e640 1 -- start start 2024-09-19T05:58:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78cc25e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4191750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:50.725 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78cc25e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78c410aad0 con 0x7f78c4106570 2024-09-19T05:58:50.725 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78c9ffa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4191750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:50.725 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78c9ffa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4191750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56936/0 (socket says 172.21.15.103:56936) 2024-09-19T05:58:50.725 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78c9ffa640 1 -- 172.21.15.103:0/1766724792 learned_addr learned my addr 172.21.15.103:0/1766724792 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78c9ffa640 1 -- 172.21.15.103:0/1766724792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c4191c90 con 0x7f78c4106570 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78c9ffa640 1 --2- 172.21.15.103:0/1766724792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4191750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78b4031c90 tx=0x7f78b4031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78c2ffd640 1 -- 172.21.15.103:0/1766724792 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78b4036050 con 0x7f78c4106570 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78c2ffd640 1 -- 172.21.15.103:0/1766724792 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78b4042070 con 0x7f78c4106570 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78cc25e640 1 -- 172.21.15.103:0/1766724792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c418fe80 con 0x7f78c4106570 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78c2ffd640 1 -- 172.21.15.103:0/1766724792 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78b403da30 con 0x7f78c4106570 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.896+0000 7f78cc25e640 1 -- 172.21.15.103:0/1766724792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c41903c0 con 0x7f78c4106570 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.897+0000 7f78c2ffd640 1 -- 172.21.15.103:0/1766724792 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f78b403dce0 con 0x7f78c4106570 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.897+0000 7f78c2ffd640 1 --2- 172.21.15.103:0/1766724792 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f78ac039260 0x7f78ac03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.897+0000 7f78cc25e640 1 -- 172.21.15.103:0/1766724792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c410ac50 con 0x7f78c4106570 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.897+0000 7f78c2ffd640 1 -- 172.21.15.103:0/1766724792 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f78b406d9a0 con 0x7f78c4106570 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.898+0000 7f78c97f9640 1 --2- 172.21.15.103:0/1766724792 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f78ac039260 0x7f78ac03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:50.726 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.898+0000 7f78c97f9640 1 --2- 172.21.15.103:0/1766724792 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f78ac039260 0x7f78ac03b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098c0 tx=0x7f78b8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:48.902+0000 7f78c2ffd640 1 -- 172.21.15.103:0/1766724792 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78b4044310 con 0x7f78c4106570 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.104+0000 7f78cc25e640 1 -- 172.21.15.103:0/1766724792 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f78c41069f0 con 0x7f78ac039260 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.330+0000 7f78c2ffd640 1 -- 172.21.15.103:0/1766724792 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f78c41069f0 con 0x7f78ac039260 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.332+0000 7f78cc25e640 1 -- 172.21.15.103:0/1766724792 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f78ac039260 msgr2=0x7f78ac03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.332+0000 7f78cc25e640 1 --2- 172.21.15.103:0/1766724792 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f78ac039260 0x7f78ac03b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098c0 tx=0x7f78b8006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.332+0000 7f78cc25e640 1 -- 172.21.15.103:0/1766724792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 msgr2=0x7f78c4191750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.332+0000 7f78cc25e640 1 --2- 172.21.15.103:0/1766724792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4191750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78b4031c90 tx=0x7f78b4031cc0 comp rx=0 tx=0).stop 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.332+0000 7f78cc25e640 1 -- 172.21.15.103:0/1766724792 shutdown_connections 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.332+0000 7f78cc25e640 1 --2- 172.21.15.103:0/1766724792 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f78ac039260 0x7f78ac03b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.332+0000 7f78cc25e640 1 --2- 172.21.15.103:0/1766724792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4106570 0x7f78c4191750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.332+0000 7f78cc25e640 1 -- 172.21.15.103:0/1766724792 >> 172.21.15.103:0/1766724792 conn(0x7f78c4101d80 msgr2=0x7f78c4102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.332+0000 7f78cc25e640 1 -- 172.21.15.103:0/1766724792 shutdown_connections 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:49.332+0000 7f78cc25e640 1 -- 172.21.15.103:0/1766724792 wait complete. 2024-09-19T05:58:50.727 INFO:teuthology.orchestra.run.smithi103.stdout:Fetching dashboard port number... 2024-09-19T05:58:51.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:51 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2179139144' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T05:58:51.921 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T05:58:51.921 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.161+0000 7efcfdca5640 1 Processor -- start 2024-09-19T05:58:51.921 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.161+0000 7efcfdca5640 1 -- start start 2024-09-19T05:58:51.921 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.161+0000 7efcfdca5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf8107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:51.921 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.161+0000 7efcfdca5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efcf81080b0 con 0x7efcf81076e0 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.161+0000 7efcf77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf8107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.162+0000 7efcf77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf8107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43810/0 (socket says 172.21.15.103:43810) 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.162+0000 7efcf77fe640 1 -- 172.21.15.103:0/853809226 learned_addr learned my addr 172.21.15.103:0/853809226 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.162+0000 7efcf77fe640 1 -- 172.21.15.103:0/853809226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf8108840 con 0x7efcf81076e0 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.162+0000 7efcf77fe640 1 --2- 172.21.15.103:0/853809226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf8107ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efce8009820 tx=0x7efce802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c903d51e112d535a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.163+0000 7efcf67fc640 1 -- 172.21.15.103:0/853809226 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efce8037070 con 0x7efcf81076e0 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.163+0000 7efcf67fc640 1 -- 172.21.15.103:0/853809226 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efce80328f0 con 0x7efcf81076e0 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.163+0000 7efcf67fc640 1 -- 172.21.15.103:0/853809226 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efce8030740 con 0x7efcf81076e0 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.163+0000 7efcfdca5640 1 -- 172.21.15.103:0/853809226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 msgr2=0x7efcf8107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.163+0000 7efcfdca5640 1 --2- 172.21.15.103:0/853809226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf8107ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efce8009820 tx=0x7efce802a270 comp rx=0 tx=0).stop 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.163+0000 7efcfdca5640 1 -- 172.21.15.103:0/853809226 shutdown_connections 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.163+0000 7efcfdca5640 1 --2- 172.21.15.103:0/853809226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf8107ae0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.163+0000 7efcfdca5640 1 -- 172.21.15.103:0/853809226 >> 172.21.15.103:0/853809226 conn(0x7efcf8102ed0 msgr2=0x7efcf81052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.163+0000 7efcfdca5640 1 -- 172.21.15.103:0/853809226 shutdown_connections 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.163+0000 7efcfdca5640 1 -- 172.21.15.103:0/853809226 wait complete. 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.164+0000 7efcfdca5640 1 Processor -- start 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.164+0000 7efcfdca5640 1 -- start start 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.164+0000 7efcfdca5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.164+0000 7efcfdca5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efcf810bbf0 con 0x7efcf81076e0 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.164+0000 7efcf77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.164+0000 7efcf77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf819b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43816/0 (socket says 172.21.15.103:43816) 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.164+0000 7efcf77fe640 1 -- 172.21.15.103:0/2179139144 learned_addr learned my addr 172.21.15.103:0/2179139144 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.165+0000 7efcf77fe640 1 -- 172.21.15.103:0/2179139144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf819bb70 con 0x7efcf81076e0 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.165+0000 7efcf77fe640 1 --2- 172.21.15.103:0/2179139144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf819b630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efce8009940 tx=0x7efce8030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.165+0000 7efcf4ff9640 1 -- 172.21.15.103:0/2179139144 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efce8042070 con 0x7efcf81076e0 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.165+0000 7efcfdca5640 1 -- 172.21.15.103:0/2179139144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf819be00 con 0x7efcf81076e0 2024-09-19T05:58:51.923 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.165+0000 7efcf4ff9640 1 -- 172.21.15.103:0/2179139144 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efce8030e30 con 0x7efcf81076e0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.165+0000 7efcf4ff9640 1 -- 172.21.15.103:0/2179139144 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efce8037040 con 0x7efcf81076e0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.165+0000 7efcfdca5640 1 -- 172.21.15.103:0/2179139144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf819eaf0 con 0x7efcf81076e0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.166+0000 7efcf4ff9640 1 -- 172.21.15.103:0/2179139144 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7efce8045070 con 0x7efcf81076e0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.166+0000 7efcfdca5640 1 -- 172.21.15.103:0/2179139144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf810bd70 con 0x7efcf81076e0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.166+0000 7efcf4ff9640 1 --2- 172.21.15.103:0/2179139144 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7efce0039200 0x7efce003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.166+0000 7efcf4ff9640 1 -- 172.21.15.103:0/2179139144 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efce806c620 con 0x7efcf81076e0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.166+0000 7efcf6ffd640 1 --2- 172.21.15.103:0/2179139144 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7efce0039200 0x7efce003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.166+0000 7efcf6ffd640 1 --2- 172.21.15.103:0/2179139144 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7efce0039200 0x7efce003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efcec0098c0 tx=0x7efcec006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.171+0000 7efcf4ff9640 1 -- 172.21.15.103:0/2179139144 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efce8045360 con 0x7efcf81076e0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.337+0000 7efcfdca5640 1 -- 172.21.15.103:0/2179139144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7efcf819ecc0 con 0x7efcf81076e0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.338+0000 7efcf4ff9640 1 -- 172.21.15.103:0/2179139144 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7efce803b330 con 0x7efcf81076e0 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.340+0000 7efcfdca5640 1 -- 172.21.15.103:0/2179139144 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7efce0039200 msgr2=0x7efce003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.340+0000 7efcfdca5640 1 --2- 172.21.15.103:0/2179139144 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7efce0039200 0x7efce003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efcec0098c0 tx=0x7efcec006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:51.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.340+0000 7efcfdca5640 1 -- 172.21.15.103:0/2179139144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 msgr2=0x7efcf819b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:51.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.340+0000 7efcfdca5640 1 --2- 172.21.15.103:0/2179139144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf819b630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efce8009940 tx=0x7efce8030cc0 comp rx=0 tx=0).stop 2024-09-19T05:58:51.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.340+0000 7efcfdca5640 1 -- 172.21.15.103:0/2179139144 shutdown_connections 2024-09-19T05:58:51.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.340+0000 7efcfdca5640 1 --2- 172.21.15.103:0/2179139144 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7efce0039200 0x7efce003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:51.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.340+0000 7efcfdca5640 1 --2- 172.21.15.103:0/2179139144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf81076e0 0x7efcf819b630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:51.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.340+0000 7efcfdca5640 1 -- 172.21.15.103:0/2179139144 >> 172.21.15.103:0/2179139144 conn(0x7efcf8102ed0 msgr2=0x7efcf8103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:51.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.340+0000 7efcfdca5640 1 -- 172.21.15.103:0/2179139144 shutdown_connections 2024-09-19T05:58:51.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:51.340+0000 7efcfdca5640 1 -- 172.21.15.103:0/2179139144 wait complete. 2024-09-19T05:58:51.929 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:58:51.929 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-19T05:58:51.936 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:58:51.937 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-19T05:58:51.937 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-19T05:58:51.937 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T05:58:51.938 INFO:teuthology.orchestra.run.smithi103.stdout:Ceph Dashboard is now available at: 2024-09-19T05:58:51.938 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:58:51.938 INFO:teuthology.orchestra.run.smithi103.stdout: URL: https://smithi103.front.sepia.ceph.com:8443/ 2024-09-19T05:58:51.938 INFO:teuthology.orchestra.run.smithi103.stdout: User: admin 2024-09-19T05:58:51.939 INFO:teuthology.orchestra.run.smithi103.stdout: Password: uip2dqxmw6 2024-09-19T05:58:51.939 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:58:51.939 INFO:teuthology.orchestra.run.smithi103.stdout:Saving cluster configuration to /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config directory 2024-09-19T05:58:52.607 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:52 smithi103 ceph-mon[30925]: mgrmap e13: x(active, since 6s) 2024-09-19T05:58:53.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.344+0000 7f67801d6640 1 Processor -- start 2024-09-19T05:58:53.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.344+0000 7f67801d6640 1 -- start start 2024-09-19T05:58:53.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.344+0000 7f67801d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f6778107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.344+0000 7f67801d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f67781080b0 con 0x7f67781076e0 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.344+0000 7f677df72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f6778107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.344+0000 7f677df72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f6778107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43826/0 (socket says 172.21.15.103:43826) 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.344+0000 7f677df72640 1 -- 172.21.15.103:0/3282794068 learned_addr learned my addr 172.21.15.103:0/3282794068 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.345+0000 7f677df72640 1 -- 172.21.15.103:0/3282794068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6778108840 con 0x7f67781076e0 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.345+0000 7f677df72640 1 --2- 172.21.15.103:0/3282794068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f6778107ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6774009820 tx=0x7f677402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992e645f04cadb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.346+0000 7f677cf70640 1 -- 172.21.15.103:0/3282794068 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6774037070 con 0x7f67781076e0 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.346+0000 7f677cf70640 1 -- 172.21.15.103:0/3282794068 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67740328f0 con 0x7f67781076e0 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.346+0000 7f677cf70640 1 -- 172.21.15.103:0/3282794068 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6774030740 con 0x7f67781076e0 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.346+0000 7f67801d6640 1 -- 172.21.15.103:0/3282794068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 msgr2=0x7f6778107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.346+0000 7f67801d6640 1 --2- 172.21.15.103:0/3282794068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f6778107ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6774009820 tx=0x7f677402a270 comp rx=0 tx=0).stop 2024-09-19T05:58:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.346+0000 7f67801d6640 1 -- 172.21.15.103:0/3282794068 shutdown_connections 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.346+0000 7f67801d6640 1 --2- 172.21.15.103:0/3282794068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f6778107ae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.346+0000 7f67801d6640 1 -- 172.21.15.103:0/3282794068 >> 172.21.15.103:0/3282794068 conn(0x7f6778102ed0 msgr2=0x7f67781052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.346+0000 7f67801d6640 1 -- 172.21.15.103:0/3282794068 shutdown_connections 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.346+0000 7f67801d6640 1 -- 172.21.15.103:0/3282794068 wait complete. 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.347+0000 7f67801d6640 1 Processor -- start 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.347+0000 7f67801d6640 1 -- start start 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.347+0000 7f67801d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f677819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.347+0000 7f67801d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f677810bbf0 con 0x7f67781076e0 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.347+0000 7f677df72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f677819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.347+0000 7f677df72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f677819b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43842/0 (socket says 172.21.15.103:43842) 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.347+0000 7f677df72640 1 -- 172.21.15.103:0/824247069 learned_addr learned my addr 172.21.15.103:0/824247069 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.347+0000 7f677df72640 1 -- 172.21.15.103:0/824247069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677819bb70 con 0x7f67781076e0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.348+0000 7f677df72640 1 --2- 172.21.15.103:0/824247069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f677819b630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67740097f0 tx=0x7f6774030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.348+0000 7f676effd640 1 -- 172.21.15.103:0/824247069 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6774042070 con 0x7f67781076e0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.348+0000 7f676effd640 1 -- 172.21.15.103:0/824247069 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6774030d80 con 0x7f67781076e0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.348+0000 7f67801d6640 1 -- 172.21.15.103:0/824247069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677819be00 con 0x7f67781076e0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.348+0000 7f676effd640 1 -- 172.21.15.103:0/824247069 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6774037040 con 0x7f67781076e0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.348+0000 7f67801d6640 1 -- 172.21.15.103:0/824247069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f677819eaf0 con 0x7f67781076e0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.349+0000 7f676effd640 1 -- 172.21.15.103:0/824247069 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f6774045070 con 0x7f67781076e0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.349+0000 7f67801d6640 1 -- 172.21.15.103:0/824247069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f677810bd70 con 0x7f67781076e0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.349+0000 7f676effd640 1 --2- 172.21.15.103:0/824247069 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f67640392a0 0x7f676403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.349+0000 7f676effd640 1 -- 172.21.15.103:0/824247069 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f677406c6e0 con 0x7f67781076e0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.349+0000 7f677d771640 1 --2- 172.21.15.103:0/824247069 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f67640392a0 0x7f676403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.349+0000 7f677d771640 1 --2- 172.21.15.103:0/824247069 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f67640392a0 0x7f676403b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f67680098c0 tx=0x7f6768006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.353+0000 7f676effd640 1 -- 172.21.15.103:0/824247069 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f677403add0 con 0x7f67781076e0 2024-09-19T05:58:53.206 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.605+0000 7f67801d6640 1 -- 172.21.15.103:0/824247069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f677819ecc0 con 0x7f67781076e0 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.607+0000 7f676effd640 1 -- 172.21.15.103:0/824247069 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f6774045520 con 0x7f67781076e0 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.609+0000 7f67801d6640 1 -- 172.21.15.103:0/824247069 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f67640392a0 msgr2=0x7f676403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.609+0000 7f67801d6640 1 --2- 172.21.15.103:0/824247069 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f67640392a0 0x7f676403b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f67680098c0 tx=0x7f6768006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.609+0000 7f67801d6640 1 -- 172.21.15.103:0/824247069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 msgr2=0x7f677819b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.609+0000 7f67801d6640 1 --2- 172.21.15.103:0/824247069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f677819b630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67740097f0 tx=0x7f6774030c70 comp rx=0 tx=0).stop 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.609+0000 7f67801d6640 1 -- 172.21.15.103:0/824247069 shutdown_connections 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.609+0000 7f67801d6640 1 --2- 172.21.15.103:0/824247069 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f67640392a0 0x7f676403b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.609+0000 7f67801d6640 1 --2- 172.21.15.103:0/824247069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67781076e0 0x7f677819b630 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.609+0000 7f67801d6640 1 -- 172.21.15.103:0/824247069 >> 172.21.15.103:0/824247069 conn(0x7f6778102ed0 msgr2=0x7f6778103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.609+0000 7f67801d6640 1 -- 172.21.15.103:0/824247069 shutdown_connections 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-19T05:58:52.609+0000 7f67801d6640 1 -- 172.21.15.103:0/824247069 wait complete. 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:58:53.207 INFO:teuthology.orchestra.run.smithi103.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout: ceph telemetry on 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout:For more information see: 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T05:58:53.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:58:53.209 INFO:teuthology.orchestra.run.smithi103.stdout:Bootstrap complete. 2024-09-19T05:58:53.240 INFO:tasks.cephadm:Fetching config... 2024-09-19T05:58:53.240 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:58:53.240 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T05:58:53.257 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T05:58:53.338 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:58:53.338 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T05:58:53.354 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T05:58:53.354 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:58:53.354 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T05:58:53.420 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T05:58:53.420 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:58:53.420 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T05:58:53.475 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T05:58:53.476 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC71t1nvdfWwswDYSGNEqBSbrIZ9gLvBhfKzjtrWayEG2zVHR6UOEGcNvs3uparSvei3olDIR+dIdsZG2/jrOWQpdFjM9/zr6zhkXiXqFofpjmuU+L98f/YayFuynB5ZzQmG3ADtMmoqZVSp8YZ2FpoTA86rYCW2DwNWT2EQSuLNozhnIPcWAnT+wUBsUEre7mrmcmL12aPdW2dyMwNphU+dJLxqkj5y+2ZCDKqWl+OxXcv+FP09JSNguIn8xLF/j3JMCrlaSKtCyxHr/DqSyf2RXM5MEgTIk7GfgvDKN4QJAoF1KH0c/+Oif5rKapK6wAwOds2/APNdG7+CM3QZG+LeGRH9bHghv/8DRET+YU34omfygzOxoHmzE1sdM67jOxwNIPI766VOCiuUL2/ceh8upt4bOs67kvvt8bZvCdGyRYBnJeD2RM2zxPtqfM343OLUeTXEK9vZJR0Tu8YiAiW7KaDCeieqgfgaWRKXzNfVWbgaGeP9hOhWVbVuudzkh8= ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:58:53.550 INFO:teuthology.orchestra.run.smithi103.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC71t1nvdfWwswDYSGNEqBSbrIZ9gLvBhfKzjtrWayEG2zVHR6UOEGcNvs3uparSvei3olDIR+dIdsZG2/jrOWQpdFjM9/zr6zhkXiXqFofpjmuU+L98f/YayFuynB5ZzQmG3ADtMmoqZVSp8YZ2FpoTA86rYCW2DwNWT2EQSuLNozhnIPcWAnT+wUBsUEre7mrmcmL12aPdW2dyMwNphU+dJLxqkj5y+2ZCDKqWl+OxXcv+FP09JSNguIn8xLF/j3JMCrlaSKtCyxHr/DqSyf2RXM5MEgTIk7GfgvDKN4QJAoF1KH0c/+Oif5rKapK6wAwOds2/APNdG7+CM3QZG+LeGRH9bHghv/8DRET+YU34omfygzOxoHmzE1sdM67jOxwNIPI766VOCiuUL2/ceh8upt4bOs67kvvt8bZvCdGyRYBnJeD2RM2zxPtqfM343OLUeTXEK9vZJR0Tu8YiAiW7KaDCeieqgfgaWRKXzNfVWbgaGeP9hOhWVbVuudzkh8= ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:53.561 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC71t1nvdfWwswDYSGNEqBSbrIZ9gLvBhfKzjtrWayEG2zVHR6UOEGcNvs3uparSvei3olDIR+dIdsZG2/jrOWQpdFjM9/zr6zhkXiXqFofpjmuU+L98f/YayFuynB5ZzQmG3ADtMmoqZVSp8YZ2FpoTA86rYCW2DwNWT2EQSuLNozhnIPcWAnT+wUBsUEre7mrmcmL12aPdW2dyMwNphU+dJLxqkj5y+2ZCDKqWl+OxXcv+FP09JSNguIn8xLF/j3JMCrlaSKtCyxHr/DqSyf2RXM5MEgTIk7GfgvDKN4QJAoF1KH0c/+Oif5rKapK6wAwOds2/APNdG7+CM3QZG+LeGRH9bHghv/8DRET+YU34omfygzOxoHmzE1sdM67jOxwNIPI766VOCiuUL2/ceh8upt4bOs67kvvt8bZvCdGyRYBnJeD2RM2zxPtqfM343OLUeTXEK9vZJR0Tu8YiAiW7KaDCeieqgfgaWRKXzNfVWbgaGeP9hOhWVbVuudzkh8= ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:58:53.606 INFO:teuthology.orchestra.run.smithi169.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC71t1nvdfWwswDYSGNEqBSbrIZ9gLvBhfKzjtrWayEG2zVHR6UOEGcNvs3uparSvei3olDIR+dIdsZG2/jrOWQpdFjM9/zr6zhkXiXqFofpjmuU+L98f/YayFuynB5ZzQmG3ADtMmoqZVSp8YZ2FpoTA86rYCW2DwNWT2EQSuLNozhnIPcWAnT+wUBsUEre7mrmcmL12aPdW2dyMwNphU+dJLxqkj5y+2ZCDKqWl+OxXcv+FP09JSNguIn8xLF/j3JMCrlaSKtCyxHr/DqSyf2RXM5MEgTIk7GfgvDKN4QJAoF1KH0c/+Oif5rKapK6wAwOds2/APNdG7+CM3QZG+LeGRH9bHghv/8DRET+YU34omfygzOxoHmzE1sdM67jOxwNIPI766VOCiuUL2/ceh8upt4bOs67kvvt8bZvCdGyRYBnJeD2RM2zxPtqfM343OLUeTXEK9vZJR0Tu8YiAiW7KaDCeieqgfgaWRKXzNfVWbgaGeP9hOhWVbVuudzkh8= ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:53.619 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC71t1nvdfWwswDYSGNEqBSbrIZ9gLvBhfKzjtrWayEG2zVHR6UOEGcNvs3uparSvei3olDIR+dIdsZG2/jrOWQpdFjM9/zr6zhkXiXqFofpjmuU+L98f/YayFuynB5ZzQmG3ADtMmoqZVSp8YZ2FpoTA86rYCW2DwNWT2EQSuLNozhnIPcWAnT+wUBsUEre7mrmcmL12aPdW2dyMwNphU+dJLxqkj5y+2ZCDKqWl+OxXcv+FP09JSNguIn8xLF/j3JMCrlaSKtCyxHr/DqSyf2RXM5MEgTIk7GfgvDKN4QJAoF1KH0c/+Oif5rKapK6wAwOds2/APNdG7+CM3QZG+LeGRH9bHghv/8DRET+YU34omfygzOxoHmzE1sdM67jOxwNIPI766VOCiuUL2/ceh8upt4bOs67kvvt8bZvCdGyRYBnJeD2RM2zxPtqfM343OLUeTXEK9vZJR0Tu8YiAiW7KaDCeieqgfgaWRKXzNfVWbgaGeP9hOhWVbVuudzkh8= ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:58:53.671 INFO:teuthology.orchestra.run.smithi174.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC71t1nvdfWwswDYSGNEqBSbrIZ9gLvBhfKzjtrWayEG2zVHR6UOEGcNvs3uparSvei3olDIR+dIdsZG2/jrOWQpdFjM9/zr6zhkXiXqFofpjmuU+L98f/YayFuynB5ZzQmG3ADtMmoqZVSp8YZ2FpoTA86rYCW2DwNWT2EQSuLNozhnIPcWAnT+wUBsUEre7mrmcmL12aPdW2dyMwNphU+dJLxqkj5y+2ZCDKqWl+OxXcv+FP09JSNguIn8xLF/j3JMCrlaSKtCyxHr/DqSyf2RXM5MEgTIk7GfgvDKN4QJAoF1KH0c/+Oif5rKapK6wAwOds2/APNdG7+CM3QZG+LeGRH9bHghv/8DRET+YU34omfygzOxoHmzE1sdM67jOxwNIPI766VOCiuUL2/ceh8upt4bOs67kvvt8bZvCdGyRYBnJeD2RM2zxPtqfM343OLUeTXEK9vZJR0Tu8YiAiW7KaDCeieqgfgaWRKXzNfVWbgaGeP9hOhWVbVuudzkh8= ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:53.685 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T05:58:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:58:53.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:53 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/824247069' entity='client.admin' 2024-09-19T05:58:54.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.454+0000 7f4238ad5640 1 -- 172.21.15.103:0/4154217893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4234100530 msgr2=0x7f4234100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:54.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.454+0000 7f4238ad5640 1 --2- 172.21.15.103:0/4154217893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4234100530 0x7f4234100930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4224009880 tx=0x7f422402a5d0 comp rx=0 tx=0).stop 2024-09-19T05:58:54.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.454+0000 7f4238ad5640 1 -- 172.21.15.103:0/4154217893 shutdown_connections 2024-09-19T05:58:54.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.454+0000 7f4238ad5640 1 --2- 172.21.15.103:0/4154217893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4234100530 0x7f4234100930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:54.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.454+0000 7f4238ad5640 1 -- 172.21.15.103:0/4154217893 >> 172.21.15.103:0/4154217893 conn(0x7f42340fbca0 msgr2=0x7f42340fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:54.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.454+0000 7f4238ad5640 1 -- 172.21.15.103:0/4154217893 shutdown_connections 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.454+0000 7f4238ad5640 1 -- 172.21.15.103:0/4154217893 wait complete. 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.455+0000 7f4238ad5640 1 Processor -- start 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.455+0000 7f4238ad5640 1 -- start start 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.455+0000 7f4238ad5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4234100530 0x7f4234196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.455+0000 7f4238ad5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f42341064f0 con 0x7f4234100530 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.456+0000 7f423259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4234100530 0x7f4234196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.456+0000 7f423259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4234100530 0x7f4234196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43868/0 (socket says 172.21.15.103:43868) 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.456+0000 7f423259c640 1 -- 172.21.15.103:0/3191624085 learned_addr learned my addr 172.21.15.103:0/3191624085 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.456+0000 7f423259c640 1 -- 172.21.15.103:0/3191624085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4234197240 con 0x7f4234100530 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.456+0000 7f423259c640 1 --2- 172.21.15.103:0/3191624085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4234100530 0x7f4234196d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4224009230 tx=0x7f42240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.456+0000 7f422b7fe640 1 -- 172.21.15.103:0/3191624085 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f422403f070 con 0x7f4234100530 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.456+0000 7f422b7fe640 1 -- 172.21.15.103:0/3191624085 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4224003aa0 con 0x7f4234100530 2024-09-19T05:58:54.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.456+0000 7f4238ad5640 1 -- 172.21.15.103:0/3191624085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42341974d0 con 0x7f4234100530 2024-09-19T05:58:54.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.456+0000 7f422b7fe640 1 -- 172.21.15.103:0/3191624085 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4224035030 con 0x7f4234100530 2024-09-19T05:58:54.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.456+0000 7f4238ad5640 1 -- 172.21.15.103:0/3191624085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423419a1b0 con 0x7f4234100530 2024-09-19T05:58:54.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.457+0000 7f422b7fe640 1 -- 172.21.15.103:0/3191624085 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f4224042070 con 0x7f4234100530 2024-09-19T05:58:54.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.457+0000 7f4238ad5640 1 -- 172.21.15.103:0/3191624085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4234106c70 con 0x7f4234100530 2024-09-19T05:58:54.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.457+0000 7f422b7fe640 1 --2- 172.21.15.103:0/3191624085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f42200392a0 0x7f422003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:54.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.458+0000 7f422b7fe640 1 -- 172.21.15.103:0/3191624085 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f422406d130 con 0x7f4234100530 2024-09-19T05:58:54.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.458+0000 7f422bfff640 1 --2- 172.21.15.103:0/3191624085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f42200392a0 0x7f422003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:54.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.458+0000 7f422bfff640 1 --2- 172.21.15.103:0/3191624085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f42200392a0 0x7f422003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f421c00ad30 tx=0x7f421c0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:54.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.462+0000 7f422b7fe640 1 -- 172.21.15.103:0/3191624085 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f422402f300 con 0x7f4234100530 2024-09-19T05:58:54.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.637+0000 7f4238ad5640 1 -- 172.21.15.103:0/3191624085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f423419a6f0 con 0x7f4234100530 2024-09-19T05:58:54.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.639+0000 7f422b7fe640 1 -- 172.21.15.103:0/3191624085 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f4224042c60 con 0x7f4234100530 2024-09-19T05:58:54.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.642+0000 7f4238ad5640 1 -- 172.21.15.103:0/3191624085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f42200392a0 msgr2=0x7f422003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:54.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.642+0000 7f4238ad5640 1 --2- 172.21.15.103:0/3191624085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f42200392a0 0x7f422003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f421c00ad30 tx=0x7f421c0093f0 comp rx=0 tx=0).stop 2024-09-19T05:58:54.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.642+0000 7f4238ad5640 1 -- 172.21.15.103:0/3191624085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4234100530 msgr2=0x7f4234196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:54.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.642+0000 7f4238ad5640 1 --2- 172.21.15.103:0/3191624085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4234100530 0x7f4234196d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4224009230 tx=0x7f42240048f0 comp rx=0 tx=0).stop 2024-09-19T05:58:54.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.642+0000 7f4238ad5640 1 -- 172.21.15.103:0/3191624085 shutdown_connections 2024-09-19T05:58:54.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.642+0000 7f4238ad5640 1 --2- 172.21.15.103:0/3191624085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f42200392a0 0x7f422003b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:54.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.642+0000 7f4238ad5640 1 --2- 172.21.15.103:0/3191624085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4234100530 0x7f4234196d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:54.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.642+0000 7f4238ad5640 1 -- 172.21.15.103:0/3191624085 >> 172.21.15.103:0/3191624085 conn(0x7f42340fbca0 msgr2=0x7f42340fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:54.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.642+0000 7f4238ad5640 1 -- 172.21.15.103:0/3191624085 shutdown_connections 2024-09-19T05:58:54.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:54.642+0000 7f4238ad5640 1 -- 172.21.15.103:0/3191624085 wait complete. 2024-09-19T05:58:55.226 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T05:58:55.226 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T05:58:55.872 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:55 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3191624085' entity='client.admin' 2024-09-19T05:58:56.211 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:58:56.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.677+0000 7f01dea97640 1 -- 172.21.15.103:0/495988596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d8100530 msgr2=0x7f01d8100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:56.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.677+0000 7f01dea97640 1 --2- 172.21.15.103:0/495988596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d8100530 0x7f01d8100930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009880 tx=0x7f01cc02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.677+0000 7f01dea97640 1 -- 172.21.15.103:0/495988596 shutdown_connections 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.677+0000 7f01dea97640 1 --2- 172.21.15.103:0/495988596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d8100530 0x7f01d8100930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.677+0000 7f01dea97640 1 -- 172.21.15.103:0/495988596 >> 172.21.15.103:0/495988596 conn(0x7f01d80fbca0 msgr2=0x7f01d80fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.677+0000 7f01dea97640 1 -- 172.21.15.103:0/495988596 shutdown_connections 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.677+0000 7f01dea97640 1 -- 172.21.15.103:0/495988596 wait complete. 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.677+0000 7f01dea97640 1 Processor -- start 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.677+0000 7f01dea97640 1 -- start start 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.678+0000 7f01dea97640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d8100530 0x7f01d8196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.678+0000 7f01dea97640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f01d81064f0 con 0x7f01d8100530 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.678+0000 7f01dc833640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d8100530 0x7f01d8196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.678+0000 7f01dc833640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d8100530 0x7f01d8196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43880/0 (socket says 172.21.15.103:43880) 2024-09-19T05:58:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.678+0000 7f01dc833640 1 -- 172.21.15.103:0/707786883 learned_addr learned my addr 172.21.15.103:0/707786883 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.678+0000 7f01dc833640 1 -- 172.21.15.103:0/707786883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d8197250 con 0x7f01d8100530 2024-09-19T05:58:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.678+0000 7f01dc833640 1 --2- 172.21.15.103:0/707786883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d8100530 0x7f01d8196d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009230 tx=0x7f01cc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.678+0000 7f01d5ffb640 1 -- 172.21.15.103:0/707786883 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01cc03f070 con 0x7f01d8100530 2024-09-19T05:58:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.678+0000 7f01d5ffb640 1 -- 172.21.15.103:0/707786883 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01cc003aa0 con 0x7f01d8100530 2024-09-19T05:58:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.678+0000 7f01dea97640 1 -- 172.21.15.103:0/707786883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d81974e0 con 0x7f01d8100530 2024-09-19T05:58:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.679+0000 7f01d5ffb640 1 -- 172.21.15.103:0/707786883 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01cc035030 con 0x7f01d8100530 2024-09-19T05:58:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.679+0000 7f01dea97640 1 -- 172.21.15.103:0/707786883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d819a1c0 con 0x7f01d8100530 2024-09-19T05:58:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.680+0000 7f01dea97640 1 -- 172.21.15.103:0/707786883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d8106c70 con 0x7f01d8100530 2024-09-19T05:58:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.680+0000 7f01d5ffb640 1 -- 172.21.15.103:0/707786883 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f01cc042070 con 0x7f01d8100530 2024-09-19T05:58:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.680+0000 7f01d5ffb640 1 --2- 172.21.15.103:0/707786883 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f01c80392a0 0x7f01c803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.680+0000 7f01d5ffb640 1 -- 172.21.15.103:0/707786883 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f01cc06d100 con 0x7f01d8100530 2024-09-19T05:58:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.680+0000 7f01d7fff640 1 --2- 172.21.15.103:0/707786883 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f01c80392a0 0x7f01c803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.681+0000 7f01d7fff640 1 --2- 172.21.15.103:0/707786883 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f01c80392a0 0x7f01c803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f01c40098c0 tx=0x7f01c4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.685+0000 7f01d5ffb640 1 -- 172.21.15.103:0/707786883 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f01cc039350 con 0x7f01d8100530 2024-09-19T05:58:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.888+0000 7f01dea97640 1 -- 172.21.15.103:0/707786883 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f01d802d830 con 0x7f01c80392a0 2024-09-19T05:58:56.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.891+0000 7f01d5ffb640 1 -- 172.21.15.103:0/707786883 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f01d802d830 con 0x7f01c80392a0 2024-09-19T05:58:56.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.894+0000 7f01dea97640 1 -- 172.21.15.103:0/707786883 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f01c80392a0 msgr2=0x7f01c803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:56.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.894+0000 7f01dea97640 1 --2- 172.21.15.103:0/707786883 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f01c80392a0 0x7f01c803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f01c40098c0 tx=0x7f01c4006db0 comp rx=0 tx=0).stop 2024-09-19T05:58:56.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.894+0000 7f01dea97640 1 -- 172.21.15.103:0/707786883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d8100530 msgr2=0x7f01d8196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:56.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.894+0000 7f01dea97640 1 --2- 172.21.15.103:0/707786883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d8100530 0x7f01d8196d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009230 tx=0x7f01cc0048f0 comp rx=0 tx=0).stop 2024-09-19T05:58:56.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.894+0000 7f01dea97640 1 -- 172.21.15.103:0/707786883 shutdown_connections 2024-09-19T05:58:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.894+0000 7f01dea97640 1 --2- 172.21.15.103:0/707786883 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f01c80392a0 0x7f01c803b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.894+0000 7f01dea97640 1 --2- 172.21.15.103:0/707786883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d8100530 0x7f01d8196d10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.894+0000 7f01dea97640 1 -- 172.21.15.103:0/707786883 >> 172.21.15.103:0/707786883 conn(0x7f01d80fbca0 msgr2=0x7f01d8069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.894+0000 7f01dea97640 1 -- 172.21.15.103:0/707786883 shutdown_connections 2024-09-19T05:58:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:56.894+0000 7f01dea97640 1 -- 172.21.15.103:0/707786883 wait complete. 2024-09-19T05:58:58.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:57 smithi103 ceph-mon[30925]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:58.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:58.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:58.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:58.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:58:58.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:58.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:58.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:57 smithi103 ceph-mon[30925]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-19T05:58:58.177 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi169 2024-09-19T05:58:58.178 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:58:58.178 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.conf 2024-09-19T05:58:58.197 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:58:58.197 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:58:58.256 INFO:tasks.cephadm:Adding host smithi169 to orchestrator... 2024-09-19T05:58:58.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch host add smithi169 2024-09-19T05:58:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:58:58.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 -- 172.21.15.103:0/143343822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe958107660 msgr2=0x7fe958107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 --2- 172.21.15.103:0/143343822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe958107660 0x7fe958107a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe948009880 tx=0x7fe94802a5d0 comp rx=0 tx=0).stop 2024-09-19T05:58:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 -- 172.21.15.103:0/143343822 shutdown_connections 2024-09-19T05:58:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 --2- 172.21.15.103:0/143343822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe958107660 0x7fe958107a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 -- 172.21.15.103:0/143343822 >> 172.21.15.103:0/143343822 conn(0x7fe9580fd2b0 msgr2=0x7fe9580ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 -- 172.21.15.103:0/143343822 shutdown_connections 2024-09-19T05:58:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 -- 172.21.15.103:0/143343822 wait complete. 2024-09-19T05:58:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 Processor -- start 2024-09-19T05:58:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 -- start start 2024-09-19T05:58:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe958107660 0x7fe9580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.904+0000 7fe95e0d4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe95810bb20 con 0x7fe958107660 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.905+0000 7fe9577fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe958107660 0x7fe9580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.905+0000 7fe9577fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe958107660 0x7fe9580744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43900/0 (socket says 172.21.15.103:43900) 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.905+0000 7fe9577fe640 1 -- 172.21.15.103:0/4292000300 learned_addr learned my addr 172.21.15.103:0/4292000300 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.905+0000 7fe9577fe640 1 -- 172.21.15.103:0/4292000300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9580763e0 con 0x7fe958107660 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.905+0000 7fe9577fe640 1 --2- 172.21.15.103:0/4292000300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe958107660 0x7fe9580744f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe948009230 tx=0x7fe9480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.905+0000 7fe9557fa640 1 -- 172.21.15.103:0/4292000300 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe94803f070 con 0x7fe958107660 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.905+0000 7fe9557fa640 1 -- 172.21.15.103:0/4292000300 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe948004d10 con 0x7fe958107660 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.905+0000 7fe9557fa640 1 -- 172.21.15.103:0/4292000300 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe948035030 con 0x7fe958107660 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.905+0000 7fe95e0d4640 1 -- 172.21.15.103:0/4292000300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe958074a90 con 0x7fe958107660 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.905+0000 7fe95e0d4640 1 -- 172.21.15.103:0/4292000300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe958074f50 con 0x7fe958107660 2024-09-19T05:58:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.907+0000 7fe95e0d4640 1 -- 172.21.15.103:0/4292000300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe958102d10 con 0x7fe958107660 2024-09-19T05:58:58.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.907+0000 7fe9557fa640 1 -- 172.21.15.103:0/4292000300 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fe948042070 con 0x7fe958107660 2024-09-19T05:58:58.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.907+0000 7fe9557fa640 1 --2- 172.21.15.103:0/4292000300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe944039300 0x7fe94403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:58.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.907+0000 7fe9557fa640 1 -- 172.21.15.103:0/4292000300 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe94806cfc0 con 0x7fe958107660 2024-09-19T05:58:58.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.907+0000 7fe94ffff640 1 --2- 172.21.15.103:0/4292000300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe944039300 0x7fe94403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:58.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.908+0000 7fe94ffff640 1 --2- 172.21.15.103:0/4292000300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe944039300 0x7fe94403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe9400098c0 tx=0x7fe940006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:58.912+0000 7fe9557fa640 1 -- 172.21.15.103:0/4292000300 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe948042360 con 0x7fe958107660 2024-09-19T05:58:59.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:58:59.082+0000 7fe95e0d4640 1 -- 172.21.15.103:0/4292000300 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}) -- 0x7fe958075a90 con 0x7fe944039300 2024-09-19T05:58:59.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:59 smithi103 ceph-mon[30925]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:58:59.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:59 smithi103 ceph-mon[30925]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:58:59.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:59 smithi103 ceph-mon[30925]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:58:59.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:59.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:59.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:58:59.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:59.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:59.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:59.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:58:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:00.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:00 smithi103 ceph-mon[30925]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:01.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:01 smithi103 ceph-mon[30925]: Deploying cephadm binary to smithi169 2024-09-19T05:59:02.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.189+0000 7fe9557fa640 1 -- 172.21.15.103:0/4292000300 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fe958075a90 con 0x7fe944039300 2024-09-19T05:59:02.191 INFO:teuthology.orchestra.run.smithi103.stdout:Added host 'smithi169' with addr '172.21.15.169' 2024-09-19T05:59:02.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.191+0000 7fe95e0d4640 1 -- 172.21.15.103:0/4292000300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe944039300 msgr2=0x7fe94403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:02.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.191+0000 7fe95e0d4640 1 --2- 172.21.15.103:0/4292000300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe944039300 0x7fe94403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe9400098c0 tx=0x7fe940006db0 comp rx=0 tx=0).stop 2024-09-19T05:59:02.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.191+0000 7fe95e0d4640 1 -- 172.21.15.103:0/4292000300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe958107660 msgr2=0x7fe9580744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:02.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.191+0000 7fe95e0d4640 1 --2- 172.21.15.103:0/4292000300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe958107660 0x7fe9580744f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe948009230 tx=0x7fe9480048f0 comp rx=0 tx=0).stop 2024-09-19T05:59:02.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.191+0000 7fe95e0d4640 1 -- 172.21.15.103:0/4292000300 shutdown_connections 2024-09-19T05:59:02.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.191+0000 7fe95e0d4640 1 --2- 172.21.15.103:0/4292000300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe944039300 0x7fe94403b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:02.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.191+0000 7fe95e0d4640 1 --2- 172.21.15.103:0/4292000300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe958107660 0x7fe9580744f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:02.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.191+0000 7fe95e0d4640 1 -- 172.21.15.103:0/4292000300 >> 172.21.15.103:0/4292000300 conn(0x7fe9580fd2b0 msgr2=0x7fe9580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:02.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.191+0000 7fe95e0d4640 1 -- 172.21.15.103:0/4292000300 shutdown_connections 2024-09-19T05:59:02.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:02.191+0000 7fe95e0d4640 1 -- 172.21.15.103:0/4292000300 wait complete. 2024-09-19T05:59:02.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T05:59:03.053 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:59:03.432 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:03.432 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:03 smithi103 ceph-mon[30925]: Added host smithi169 2024-09-19T05:59:03.432 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:03.432 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:03.432 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:03.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.509+0000 7f11bbb9b640 1 -- 172.21.15.103:0/2933537292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11b4106590 msgr2=0x7f11b4106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:03.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.509+0000 7f11bbb9b640 1 --2- 172.21.15.103:0/2933537292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11b4106590 0x7f11b4106970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009880 tx=0x7f11b002a5d0 comp rx=0 tx=0).stop 2024-09-19T05:59:03.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.509+0000 7f11bbb9b640 1 -- 172.21.15.103:0/2933537292 shutdown_connections 2024-09-19T05:59:03.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.509+0000 7f11bbb9b640 1 --2- 172.21.15.103:0/2933537292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11b4106590 0x7f11b4106970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:03.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.509+0000 7f11bbb9b640 1 -- 172.21.15.103:0/2933537292 >> 172.21.15.103:0/2933537292 conn(0x7f11b40fc1a0 msgr2=0x7f11b40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:03.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.509+0000 7f11bbb9b640 1 -- 172.21.15.103:0/2933537292 shutdown_connections 2024-09-19T05:59:03.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.509+0000 7f11bbb9b640 1 -- 172.21.15.103:0/2933537292 wait complete. 2024-09-19T05:59:03.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.510+0000 7f11bbb9b640 1 Processor -- start 2024-09-19T05:59:03.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.510+0000 7f11bbb9b640 1 -- start start 2024-09-19T05:59:03.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.510+0000 7f11bbb9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11b4106590 0x7f11b41970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:03.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.510+0000 7f11bbb9b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f11b410aa70 con 0x7f11b4106590 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.510+0000 7f11b9937640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11b4106590 0x7f11b41970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.510+0000 7f11b9937640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11b4106590 0x7f11b41970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38632/0 (socket says 172.21.15.103:38632) 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.510+0000 7f11b9937640 1 -- 172.21.15.103:0/4107937423 learned_addr learned my addr 172.21.15.103:0/4107937423 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.510+0000 7f11b9937640 1 -- 172.21.15.103:0/4107937423 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b41975f0 con 0x7f11b4106590 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.511+0000 7f11b9937640 1 --2- 172.21.15.103:0/4107937423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11b4106590 0x7f11b41970b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009230 tx=0x7f11b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.511+0000 7f11aaffd640 1 -- 172.21.15.103:0/4107937423 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11b003f070 con 0x7f11b4106590 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.511+0000 7f11aaffd640 1 -- 172.21.15.103:0/4107937423 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f11b0004d10 con 0x7f11b4106590 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.511+0000 7f11bbb9b640 1 -- 172.21.15.103:0/4107937423 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b4197880 con 0x7f11b4106590 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.511+0000 7f11aaffd640 1 -- 172.21.15.103:0/4107937423 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11b0035030 con 0x7f11b4106590 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.511+0000 7f11bbb9b640 1 -- 172.21.15.103:0/4107937423 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b4197ce0 con 0x7f11b4106590 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.512+0000 7f11aaffd640 1 -- 172.21.15.103:0/4107937423 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f11b0042070 con 0x7f11b4106590 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.512+0000 7f11aaffd640 1 --2- 172.21.15.103:0/4107937423 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11a0039300 0x7f11a003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:03.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.512+0000 7f11bbb9b640 1 -- 172.21.15.103:0/4107937423 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b4101c00 con 0x7f11b4106590 2024-09-19T05:59:03.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.512+0000 7f11aaffd640 1 -- 172.21.15.103:0/4107937423 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f11b006d000 con 0x7f11b4106590 2024-09-19T05:59:03.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.512+0000 7f11b9136640 1 --2- 172.21.15.103:0/4107937423 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11a0039300 0x7f11a003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:03.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.512+0000 7f11b9136640 1 --2- 172.21.15.103:0/4107937423 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11a0039300 0x7f11a003b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11a40098c0 tx=0x7f11a4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:03.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.517+0000 7f11aaffd640 1 -- 172.21.15.103:0/4107937423 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f11b0039350 con 0x7f11b4106590 2024-09-19T05:59:03.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.691+0000 7f11bbb9b640 1 -- 172.21.15.103:0/4107937423 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11b4198440 con 0x7f11a0039300 2024-09-19T05:59:03.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.692+0000 7f11aaffd640 1 -- 172.21.15.103:0/4107937423 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f11b4198440 con 0x7f11a0039300 2024-09-19T05:59:03.694 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:59:03.695 INFO:teuthology.orchestra.run.smithi103.stdout:[{"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.169", "hostname": "smithi169", "labels": [], "status": ""}] 2024-09-19T05:59:03.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.694+0000 7f11bbb9b640 1 -- 172.21.15.103:0/4107937423 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11a0039300 msgr2=0x7f11a003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:03.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.694+0000 7f11bbb9b640 1 --2- 172.21.15.103:0/4107937423 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11a0039300 0x7f11a003b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11a40098c0 tx=0x7f11a4006db0 comp rx=0 tx=0).stop 2024-09-19T05:59:03.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.694+0000 7f11bbb9b640 1 -- 172.21.15.103:0/4107937423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11b4106590 msgr2=0x7f11b41970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:03.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.694+0000 7f11bbb9b640 1 --2- 172.21.15.103:0/4107937423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11b4106590 0x7f11b41970b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009230 tx=0x7f11b00048f0 comp rx=0 tx=0).stop 2024-09-19T05:59:03.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.694+0000 7f11bbb9b640 1 -- 172.21.15.103:0/4107937423 shutdown_connections 2024-09-19T05:59:03.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.694+0000 7f11bbb9b640 1 --2- 172.21.15.103:0/4107937423 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11a0039300 0x7f11a003b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:03.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.694+0000 7f11bbb9b640 1 --2- 172.21.15.103:0/4107937423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11b4106590 0x7f11b41970b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:03.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.694+0000 7f11bbb9b640 1 -- 172.21.15.103:0/4107937423 >> 172.21.15.103:0/4107937423 conn(0x7f11b40fc1a0 msgr2=0x7f11b4069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:03.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.694+0000 7f11bbb9b640 1 -- 172.21.15.103:0/4107937423 shutdown_connections 2024-09-19T05:59:03.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:03.694+0000 7f11bbb9b640 1 -- 172.21.15.103:0/4107937423 wait complete. 2024-09-19T05:59:04.314 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi174 2024-09-19T05:59:04.314 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:59:04.314 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.conf 2024-09-19T05:59:04.333 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:59:04.333 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:59:04.392 INFO:tasks.cephadm:Adding host smithi174 to orchestrator... 2024-09-19T05:59:04.392 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch host add smithi174 2024-09-19T05:59:04.634 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:59:04.873 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:05.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.067+0000 7fb8da7ca640 1 -- 172.21.15.103:0/3376232039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d4106590 msgr2=0x7fb8d4106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:05.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.067+0000 7fb8da7ca640 1 --2- 172.21.15.103:0/3376232039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d4106590 0x7fb8d4106970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009880 tx=0x7fb8c402a5d0 comp rx=0 tx=0).stop 2024-09-19T05:59:05.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.067+0000 7fb8da7ca640 1 -- 172.21.15.103:0/3376232039 shutdown_connections 2024-09-19T05:59:05.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.067+0000 7fb8da7ca640 1 --2- 172.21.15.103:0/3376232039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d4106590 0x7fb8d4106970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:05.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.067+0000 7fb8da7ca640 1 -- 172.21.15.103:0/3376232039 >> 172.21.15.103:0/3376232039 conn(0x7fb8d40fc1a0 msgr2=0x7fb8d40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:05.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.067+0000 7fb8da7ca640 1 -- 172.21.15.103:0/3376232039 shutdown_connections 2024-09-19T05:59:05.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.067+0000 7fb8da7ca640 1 -- 172.21.15.103:0/3376232039 wait complete. 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.068+0000 7fb8da7ca640 1 Processor -- start 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.068+0000 7fb8da7ca640 1 -- start start 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.068+0000 7fb8da7ca640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d4106590 0x7fb8d41970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.068+0000 7fb8da7ca640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d410aa70 con 0x7fb8d4106590 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.068+0000 7fb8d3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d4106590 0x7fb8d41970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.068+0000 7fb8d3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d4106590 0x7fb8d41970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38650/0 (socket says 172.21.15.103:38650) 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.068+0000 7fb8d3fff640 1 -- 172.21.15.103:0/739919215 learned_addr learned my addr 172.21.15.103:0/739919215 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.069+0000 7fb8d3fff640 1 -- 172.21.15.103:0/739919215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d41975f0 con 0x7fb8d4106590 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.069+0000 7fb8d3fff640 1 --2- 172.21.15.103:0/739919215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d4106590 0x7fb8d41970b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009230 tx=0x7fb8c40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.069+0000 7fb8d1ffb640 1 -- 172.21.15.103:0/739919215 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c403f070 con 0x7fb8d4106590 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.069+0000 7fb8da7ca640 1 -- 172.21.15.103:0/739919215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d4197880 con 0x7fb8d4106590 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.069+0000 7fb8d1ffb640 1 -- 172.21.15.103:0/739919215 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb8c4004d10 con 0x7fb8d4106590 2024-09-19T05:59:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.069+0000 7fb8d1ffb640 1 -- 172.21.15.103:0/739919215 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c4035030 con 0x7fb8d4106590 2024-09-19T05:59:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.069+0000 7fb8da7ca640 1 -- 172.21.15.103:0/739919215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d4197ce0 con 0x7fb8d4106590 2024-09-19T05:59:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.070+0000 7fb8d1ffb640 1 -- 172.21.15.103:0/739919215 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fb8c4042070 con 0x7fb8d4106590 2024-09-19T05:59:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.070+0000 7fb8d1ffb640 1 --2- 172.21.15.103:0/739919215 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8c00392a0 0x7fb8c003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.070+0000 7fb8d1ffb640 1 -- 172.21.15.103:0/739919215 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb8c406cfd0 con 0x7fb8d4106590 2024-09-19T05:59:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.070+0000 7fb8da7ca640 1 -- 172.21.15.103:0/739919215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d4101c00 con 0x7fb8d4106590 2024-09-19T05:59:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.070+0000 7fb8cbfff640 1 --2- 172.21.15.103:0/739919215 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8c00392a0 0x7fb8c003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.070+0000 7fb8cbfff640 1 --2- 172.21.15.103:0/739919215 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8c00392a0 0x7fb8c003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0098c0 tx=0x7fb8bc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:05.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.075+0000 7fb8d1ffb640 1 -- 172.21.15.103:0/739919215 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8c40372d0 con 0x7fb8d4106590 2024-09-19T05:59:05.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:05.246+0000 7fb8da7ca640 1 -- 172.21.15.103:0/739919215 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}) -- 0x7fb8d4198440 con 0x7fb8c00392a0 2024-09-19T05:59:05.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:05 smithi103 ceph-mon[30925]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:59:06.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:06 smithi103 ceph-mon[30925]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:06.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:06 smithi103 ceph-mon[30925]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:06.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:06.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:06.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:06.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:06.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:06.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:06.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:07.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:07 smithi103 ceph-mon[30925]: Deploying cephadm binary to smithi174 2024-09-19T05:59:07.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:07 smithi103 ceph-mon[30925]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-19T05:59:07.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:07 smithi103 ceph-mon[30925]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:08.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.364+0000 7fb8d1ffb640 1 -- 172.21.15.103:0/739919215 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fb8d4198440 con 0x7fb8c00392a0 2024-09-19T05:59:08.367 INFO:teuthology.orchestra.run.smithi103.stdout:Added host 'smithi174' with addr '172.21.15.174' 2024-09-19T05:59:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.367+0000 7fb8da7ca640 1 -- 172.21.15.103:0/739919215 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8c00392a0 msgr2=0x7fb8c003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.367+0000 7fb8da7ca640 1 --2- 172.21.15.103:0/739919215 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8c00392a0 0x7fb8c003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0098c0 tx=0x7fb8bc006db0 comp rx=0 tx=0).stop 2024-09-19T05:59:08.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.367+0000 7fb8da7ca640 1 -- 172.21.15.103:0/739919215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d4106590 msgr2=0x7fb8d41970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:08.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.367+0000 7fb8da7ca640 1 --2- 172.21.15.103:0/739919215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d4106590 0x7fb8d41970b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009230 tx=0x7fb8c40048f0 comp rx=0 tx=0).stop 2024-09-19T05:59:08.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.367+0000 7fb8da7ca640 1 -- 172.21.15.103:0/739919215 shutdown_connections 2024-09-19T05:59:08.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.367+0000 7fb8da7ca640 1 --2- 172.21.15.103:0/739919215 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8c00392a0 0x7fb8c003b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:08.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.367+0000 7fb8da7ca640 1 --2- 172.21.15.103:0/739919215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d4106590 0x7fb8d41970b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:08.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.367+0000 7fb8da7ca640 1 -- 172.21.15.103:0/739919215 >> 172.21.15.103:0/739919215 conn(0x7fb8d40fc1a0 msgr2=0x7fb8d4069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:08.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.367+0000 7fb8da7ca640 1 -- 172.21.15.103:0/739919215 shutdown_connections 2024-09-19T05:59:08.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:08.367+0000 7fb8da7ca640 1 -- 172.21.15.103:0/739919215 wait complete. 2024-09-19T05:59:08.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:08 smithi103 ceph-mon[30925]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:59:08.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:08 smithi103 ceph-mon[30925]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:59:08.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:08 smithi103 ceph-mon[30925]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:08.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:08.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:08.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:08.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:08.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:09.022 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T05:59:09.262 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:59:09.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:09 smithi103 ceph-mon[30925]: Added host smithi174 2024-09-19T05:59:09.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:09.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:09.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.717+0000 7f90a75b5640 1 -- 172.21.15.103:0/50870641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a01065b0 msgr2=0x7f90a0106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.717+0000 7f90a75b5640 1 --2- 172.21.15.103:0/50870641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a01065b0 0x7f90a0106990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f909c009880 tx=0x7f909c02a670 comp rx=0 tx=0).stop 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.717+0000 7f90a75b5640 1 -- 172.21.15.103:0/50870641 shutdown_connections 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.717+0000 7f90a75b5640 1 --2- 172.21.15.103:0/50870641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a01065b0 0x7f90a0106990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.717+0000 7f90a75b5640 1 -- 172.21.15.103:0/50870641 >> 172.21.15.103:0/50870641 conn(0x7f90a00fb920 msgr2=0x7f90a00fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.717+0000 7f90a75b5640 1 -- 172.21.15.103:0/50870641 shutdown_connections 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.717+0000 7f90a75b5640 1 -- 172.21.15.103:0/50870641 wait complete. 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.718+0000 7f90a75b5640 1 Processor -- start 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.718+0000 7f90a75b5640 1 -- start start 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.718+0000 7f90a75b5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a01065b0 0x7f90a0197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.718+0000 7f90a75b5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f90a010aa20 con 0x7f90a01065b0 2024-09-19T05:59:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.718+0000 7f90a5351640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a01065b0 0x7f90a0197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.718+0000 7f90a5351640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a01065b0 0x7f90a0197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38666/0 (socket says 172.21.15.103:38666) 2024-09-19T05:59:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.718+0000 7f90a5351640 1 -- 172.21.15.103:0/655081861 learned_addr learned my addr 172.21.15.103:0/655081861 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:59:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.718+0000 7f90a5351640 1 -- 172.21.15.103:0/655081861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a0198440 con 0x7f90a01065b0 2024-09-19T05:59:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.719+0000 7f90a5351640 1 --2- 172.21.15.103:0/655081861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a01065b0 0x7f90a0197f00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f909c009230 tx=0x7f909c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.719+0000 7f90967fc640 1 -- 172.21.15.103:0/655081861 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f909c03f070 con 0x7f90a01065b0 2024-09-19T05:59:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.719+0000 7f90a75b5640 1 -- 172.21.15.103:0/655081861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a0198730 con 0x7f90a01065b0 2024-09-19T05:59:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.719+0000 7f90967fc640 1 -- 172.21.15.103:0/655081861 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f909c003aa0 con 0x7f90a01065b0 2024-09-19T05:59:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.719+0000 7f90967fc640 1 -- 172.21.15.103:0/655081861 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f909c035030 con 0x7f90a01065b0 2024-09-19T05:59:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.719+0000 7f90a75b5640 1 -- 172.21.15.103:0/655081861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a0198bf0 con 0x7f90a01065b0 2024-09-19T05:59:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.720+0000 7f90a75b5640 1 -- 172.21.15.103:0/655081861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a0101dc0 con 0x7f90a01065b0 2024-09-19T05:59:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.720+0000 7f90967fc640 1 -- 172.21.15.103:0/655081861 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f909c042070 con 0x7f90a01065b0 2024-09-19T05:59:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.720+0000 7f90967fc640 1 --2- 172.21.15.103:0/655081861 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f908c0392a0 0x7f908c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.720+0000 7f90967fc640 1 -- 172.21.15.103:0/655081861 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f909c06cf50 con 0x7f90a01065b0 2024-09-19T05:59:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.720+0000 7f90a4b50640 1 --2- 172.21.15.103:0/655081861 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f908c0392a0 0x7f908c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.721+0000 7f90a4b50640 1 --2- 172.21.15.103:0/655081861 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f908c0392a0 0x7f908c03b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f90900098c0 tx=0x7f9090006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:09.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.725+0000 7f90967fc640 1 -- 172.21.15.103:0/655081861 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f909c02f300 con 0x7f90a01065b0 2024-09-19T05:59:09.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.896+0000 7f90a75b5640 1 -- 172.21.15.103:0/655081861 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90a0106a10 con 0x7f908c0392a0 2024-09-19T05:59:09.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.897+0000 7f90967fc640 1 -- 172.21.15.103:0/655081861 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f90a0106a10 con 0x7f908c0392a0 2024-09-19T05:59:09.899 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:59:09.900 INFO:teuthology.orchestra.run.smithi103.stdout:[{"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.169", "hostname": "smithi169", "labels": [], "status": ""}, {"addr": "172.21.15.174", "hostname": "smithi174", "labels": [], "status": ""}] 2024-09-19T05:59:09.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.899+0000 7f90a75b5640 1 -- 172.21.15.103:0/655081861 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f908c0392a0 msgr2=0x7f908c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:09.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.899+0000 7f90a75b5640 1 --2- 172.21.15.103:0/655081861 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f908c0392a0 0x7f908c03b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f90900098c0 tx=0x7f9090006db0 comp rx=0 tx=0).stop 2024-09-19T05:59:09.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.899+0000 7f90a75b5640 1 -- 172.21.15.103:0/655081861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a01065b0 msgr2=0x7f90a0197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:09.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.899+0000 7f90a75b5640 1 --2- 172.21.15.103:0/655081861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a01065b0 0x7f90a0197f00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f909c009230 tx=0x7f909c0048f0 comp rx=0 tx=0).stop 2024-09-19T05:59:09.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.899+0000 7f90a75b5640 1 -- 172.21.15.103:0/655081861 shutdown_connections 2024-09-19T05:59:09.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.899+0000 7f90a75b5640 1 --2- 172.21.15.103:0/655081861 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f908c0392a0 0x7f908c03b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:09.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.899+0000 7f90a75b5640 1 --2- 172.21.15.103:0/655081861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a01065b0 0x7f90a0197f00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:09.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.899+0000 7f90a75b5640 1 -- 172.21.15.103:0/655081861 >> 172.21.15.103:0/655081861 conn(0x7f90a00fb920 msgr2=0x7f90a00fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:09.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.900+0000 7f90a75b5640 1 -- 172.21.15.103:0/655081861 shutdown_connections 2024-09-19T05:59:09.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:09.900+0000 7f90a75b5640 1 -- 172.21.15.103:0/655081861 wait complete. 2024-09-19T05:59:10.495 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T05:59:10.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T05:59:10.733 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:59:10.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:10 smithi103 ceph-mon[30925]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:10.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:11.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 -- 172.21.15.103:0/1522215418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0050106590 msgr2=0x7f0050106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:11.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 --2- 172.21.15.103:0/1522215418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0050106590 0x7f0050106970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0044009880 tx=0x7f004402a5d0 comp rx=0 tx=0).stop 2024-09-19T05:59:11.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 -- 172.21.15.103:0/1522215418 shutdown_connections 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 --2- 172.21.15.103:0/1522215418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0050106590 0x7f0050106970 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 -- 172.21.15.103:0/1522215418 >> 172.21.15.103:0/1522215418 conn(0x7f00500fc1a0 msgr2=0x7f00500fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 -- 172.21.15.103:0/1522215418 shutdown_connections 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 -- 172.21.15.103:0/1522215418 wait complete. 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 Processor -- start 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 -- start start 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0050106590 0x7f0050197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.174+0000 7f0056deb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f005010aa70 con 0x7f0050106590 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.175+0000 7f0054b87640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0050106590 0x7f0050197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.175+0000 7f0054b87640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0050106590 0x7f0050197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52756/0 (socket says 172.21.15.103:52756) 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.175+0000 7f0054b87640 1 -- 172.21.15.103:0/1792086376 learned_addr learned my addr 172.21.15.103:0/1792086376 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.175+0000 7f0054b87640 1 -- 172.21.15.103:0/1792086376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00501975c0 con 0x7f0050106590 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.175+0000 7f0054b87640 1 --2- 172.21.15.103:0/1792086376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0050106590 0x7f0050197080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0044009230 tx=0x7f00440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.175+0000 7f004dffb640 1 -- 172.21.15.103:0/1792086376 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f004403f070 con 0x7f0050106590 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.175+0000 7f004dffb640 1 -- 172.21.15.103:0/1792086376 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0044004d10 con 0x7f0050106590 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.175+0000 7f0056deb640 1 -- 172.21.15.103:0/1792086376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0050197850 con 0x7f0050106590 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.175+0000 7f004dffb640 1 -- 172.21.15.103:0/1792086376 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0044035030 con 0x7f0050106590 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.176+0000 7f0056deb640 1 -- 172.21.15.103:0/1792086376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0050197cb0 con 0x7f0050106590 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.176+0000 7f004dffb640 1 -- 172.21.15.103:0/1792086376 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f0044042070 con 0x7f0050106590 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.177+0000 7f0056deb640 1 -- 172.21.15.103:0/1792086376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0050101c00 con 0x7f0050106590 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.177+0000 7f004dffb640 1 --2- 172.21.15.103:0/1792086376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f00400392a0 0x7f004003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.177+0000 7f004dffb640 1 -- 172.21.15.103:0/1792086376 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f004406d160 con 0x7f0050106590 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.177+0000 7f004ffff640 1 --2- 172.21.15.103:0/1792086376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f00400392a0 0x7f004003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.177+0000 7f004ffff640 1 --2- 172.21.15.103:0/1792086376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f00400392a0 0x7f004003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f003c0098c0 tx=0x7f003c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.181+0000 7f004dffb640 1 -- 172.21.15.103:0/1792086376 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0044039350 con 0x7f0050106590 2024-09-19T05:59:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.353+0000 7f0056deb640 1 -- 172.21.15.103:0/1792086376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f00501983e0 con 0x7f0050106590 2024-09-19T05:59:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.545+0000 7f004dffb640 1 -- 172.21.15.103:0/1792086376 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f0044003b10 con 0x7f0050106590 2024-09-19T05:59:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-09-19T05:59:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.548+0000 7f0056deb640 1 -- 172.21.15.103:0/1792086376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f00400392a0 msgr2=0x7f004003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.548+0000 7f0056deb640 1 --2- 172.21.15.103:0/1792086376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f00400392a0 0x7f004003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f003c0098c0 tx=0x7f003c006db0 comp rx=0 tx=0).stop 2024-09-19T05:59:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.548+0000 7f0056deb640 1 -- 172.21.15.103:0/1792086376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0050106590 msgr2=0x7f0050197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:11.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.548+0000 7f0056deb640 1 --2- 172.21.15.103:0/1792086376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0050106590 0x7f0050197080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0044009230 tx=0x7f00440048f0 comp rx=0 tx=0).stop 2024-09-19T05:59:11.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.548+0000 7f0056deb640 1 -- 172.21.15.103:0/1792086376 shutdown_connections 2024-09-19T05:59:11.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.548+0000 7f0056deb640 1 --2- 172.21.15.103:0/1792086376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f00400392a0 0x7f004003b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:11.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.548+0000 7f0056deb640 1 --2- 172.21.15.103:0/1792086376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0050106590 0x7f0050197080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:11.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.548+0000 7f0056deb640 1 -- 172.21.15.103:0/1792086376 >> 172.21.15.103:0/1792086376 conn(0x7f00500fc1a0 msgr2=0x7f00500fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:11.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.548+0000 7f0056deb640 1 -- 172.21.15.103:0/1792086376 shutdown_connections 2024-09-19T05:59:11.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:11.548+0000 7f0056deb640 1 -- 172.21.15.103:0/1792086376 wait complete. 2024-09-19T05:59:11.848 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:11 smithi103 ceph-mon[30925]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:59:11.848 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:11 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1792086376' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T05:59:12.147 INFO:tasks.cephadm:Adding mon.a on smithi103 2024-09-19T05:59:12.147 INFO:tasks.cephadm:Adding mon.b on smithi169 2024-09-19T05:59:12.148 INFO:tasks.cephadm:Adding mon.c on smithi174 2024-09-19T05:59:12.148 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi103:172.21.15.103=a;smithi169:172.21.15.169=b;smithi174:172.21.15.174=c' 2024-09-19T05:59:12.417 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T05:59:12.462 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T05:59:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:12 smithi103 ceph-mon[30925]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:12 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1792086376' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T05:59:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:12 smithi103 ceph-mon[30925]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:59:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:12 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:12 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:12 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:12 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:12 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:12.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:12 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:12.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:12 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:13.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.990+0000 7eff34cbb640 1 -- 172.21.15.174:0/2760992611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff30100520 msgr2=0x7eff30100920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:13.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.990+0000 7eff34cbb640 1 --2- 172.21.15.174:0/2760992611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff30100520 0x7eff30100920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff20009880 tx=0x7eff2002a5d0 comp rx=0 tx=0).stop 2024-09-19T05:59:13.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.990+0000 7eff34cbb640 1 -- 172.21.15.174:0/2760992611 shutdown_connections 2024-09-19T05:59:13.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.990+0000 7eff34cbb640 1 --2- 172.21.15.174:0/2760992611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff30100520 0x7eff30100920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:13.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.990+0000 7eff34cbb640 1 -- 172.21.15.174:0/2760992611 >> 172.21.15.174:0/2760992611 conn(0x7eff300fbcb0 msgr2=0x7eff300fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:13.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.990+0000 7eff34cbb640 1 -- 172.21.15.174:0/2760992611 shutdown_connections 2024-09-19T05:59:13.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.990+0000 7eff34cbb640 1 -- 172.21.15.174:0/2760992611 wait complete. 2024-09-19T05:59:13.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.991+0000 7eff34cbb640 1 Processor -- start 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.991+0000 7eff34cbb640 1 -- start start 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.991+0000 7eff34cbb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff30100520 0x7eff30195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.991+0000 7eff34cbb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff301064e0 con 0x7eff30100520 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.992+0000 7eff2e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff30100520 0x7eff30195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.992+0000 7eff2e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff30100520 0x7eff30195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.174:36424/0 (socket says 172.21.15.174:36424) 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.992+0000 7eff2e59c640 1 -- 172.21.15.174:0/1839766046 learned_addr learned my addr 172.21.15.174:0/1839766046 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.992+0000 7eff2e59c640 1 -- 172.21.15.174:0/1839766046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff301960f0 con 0x7eff30100520 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.992+0000 7eff2e59c640 1 --2- 172.21.15.174:0/1839766046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff30100520 0x7eff30195bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff20009230 tx=0x7eff200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.992+0000 7eff277fe640 1 -- 172.21.15.174:0/1839766046 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff2003f070 con 0x7eff30100520 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.992+0000 7eff277fe640 1 -- 172.21.15.174:0/1839766046 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff20003aa0 con 0x7eff30100520 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.992+0000 7eff34cbb640 1 -- 172.21.15.174:0/1839766046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff30196380 con 0x7eff30100520 2024-09-19T05:59:13.042 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.992+0000 7eff277fe640 1 -- 172.21.15.174:0/1839766046 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff20035030 con 0x7eff30100520 2024-09-19T05:59:13.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.992+0000 7eff34cbb640 1 -- 172.21.15.174:0/1839766046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff30199070 con 0x7eff30100520 2024-09-19T05:59:13.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.993+0000 7eff277fe640 1 -- 172.21.15.174:0/1839766046 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7eff20042070 con 0x7eff30100520 2024-09-19T05:59:13.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.993+0000 7eff34cbb640 1 -- 172.21.15.174:0/1839766046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff30106c60 con 0x7eff30100520 2024-09-19T05:59:13.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.993+0000 7eff277fe640 1 --2- 172.21.15.174:0/1839766046 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7eff1c0392a0 0x7eff1c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:13.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.993+0000 7eff277fe640 1 -- 172.21.15.174:0/1839766046 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7eff2006d1c0 con 0x7eff30100520 2024-09-19T05:59:13.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.994+0000 7eff27fff640 1 --2- 172.21.15.174:0/1839766046 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7eff1c0392a0 0x7eff1c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:13.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.994+0000 7eff27fff640 1 --2- 172.21.15.174:0/1839766046 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7eff1c0392a0 0x7eff1c03b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7eff180098c0 tx=0x7eff18006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:13.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:12.998+0000 7eff277fe640 1 -- 172.21.15.174:0/1839766046 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7eff20041e50 con 0x7eff30100520 2024-09-19T05:59:13.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.187+0000 7eff34cbb640 1 -- 172.21.15.174:0/1839766046 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi103:172.21.15.103=a;smithi169:172.21.15.169=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}) -- 0x7eff3002d8f0 con 0x7eff1c0392a0 2024-09-19T05:59:13.194 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.193+0000 7eff277fe640 1 -- 172.21.15.174:0/1839766046 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7eff3002d8f0 con 0x7eff1c0392a0 2024-09-19T05:59:13.194 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mon update... 2024-09-19T05:59:13.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.195+0000 7eff34cbb640 1 -- 172.21.15.174:0/1839766046 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7eff1c0392a0 msgr2=0x7eff1c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:13.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.195+0000 7eff34cbb640 1 --2- 172.21.15.174:0/1839766046 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7eff1c0392a0 0x7eff1c03b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7eff180098c0 tx=0x7eff18006db0 comp rx=0 tx=0).stop 2024-09-19T05:59:13.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.195+0000 7eff34cbb640 1 -- 172.21.15.174:0/1839766046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff30100520 msgr2=0x7eff30195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:13.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.195+0000 7eff34cbb640 1 --2- 172.21.15.174:0/1839766046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff30100520 0x7eff30195bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff20009230 tx=0x7eff200048f0 comp rx=0 tx=0).stop 2024-09-19T05:59:13.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.195+0000 7eff34cbb640 1 -- 172.21.15.174:0/1839766046 shutdown_connections 2024-09-19T05:59:13.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.195+0000 7eff34cbb640 1 --2- 172.21.15.174:0/1839766046 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7eff1c0392a0 0x7eff1c03b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:13.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.195+0000 7eff34cbb640 1 --2- 172.21.15.174:0/1839766046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff30100520 0x7eff30195bb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:13.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.195+0000 7eff34cbb640 1 -- 172.21.15.174:0/1839766046 >> 172.21.15.174:0/1839766046 conn(0x7eff300fbcb0 msgr2=0x7eff300fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:13.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.195+0000 7eff34cbb640 1 -- 172.21.15.174:0/1839766046 shutdown_connections 2024-09-19T05:59:13.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:13.195+0000 7eff34cbb640 1 -- 172.21.15.174:0/1839766046 wait complete. 2024-09-19T05:59:13.858 DEBUG:teuthology.orchestra.run.smithi169:mon.b> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T05:59:13.860 DEBUG:teuthology.orchestra.run.smithi174:mon.c> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T05:59:13.863 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:59:13.863 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:59:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:13 smithi103 ceph-mon[30925]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-19T05:59:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:14.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:14 smithi103 ceph-mon[30925]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:14.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:14 smithi103 ceph-mon[30925]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:59:14.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:14 smithi103 ceph-mon[30925]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:59:14.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:14 smithi103 ceph-mon[30925]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi103:172.21.15.103=a;smithi169:172.21.15.169=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:14.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:14 smithi103 ceph-mon[30925]: Saving service mon spec with placement smithi103:172.21.15.103=a;smithi169:172.21.15.169=b;smithi174:172.21.15.174=c;count:3 2024-09-19T05:59:14.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:14 smithi103 ceph-mon[30925]: Deploying daemon mon.c on smithi174 2024-09-19T05:59:14.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:14 smithi103 ceph-mon[30925]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:15.849 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:59:16.463 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.435+0000 7fd005cec640 1 -- 172.21.15.174:0/441674188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd000106650 msgr2=0x7fd000106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:16.463 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.435+0000 7fd005cec640 1 --2- 172.21.15.174:0/441674188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd000106650 0x7fd000106a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009880 tx=0x7fcff002a5d0 comp rx=0 tx=0).stop 2024-09-19T05:59:16.463 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.435+0000 7fd005cec640 1 -- 172.21.15.174:0/441674188 shutdown_connections 2024-09-19T05:59:16.463 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.435+0000 7fd005cec640 1 --2- 172.21.15.174:0/441674188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd000106650 0x7fd000106a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.435+0000 7fd005cec640 1 -- 172.21.15.174:0/441674188 >> 172.21.15.174:0/441674188 conn(0x7fd0000fc280 msgr2=0x7fd0000fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.435+0000 7fd005cec640 1 -- 172.21.15.174:0/441674188 shutdown_connections 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.435+0000 7fd005cec640 1 -- 172.21.15.174:0/441674188 wait complete. 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.436+0000 7fd005cec640 1 Processor -- start 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.436+0000 7fd005cec640 1 -- start start 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.436+0000 7fd005cec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd000106650 0x7fd000197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.436+0000 7fd005cec640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd00010ab30 con 0x7fd000106650 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.437+0000 7fcfff7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd000106650 0x7fd000197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.437+0000 7fcfff7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd000106650 0x7fd000197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.174:36442/0 (socket says 172.21.15.174:36442) 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.437+0000 7fcfff7fe640 1 -- 172.21.15.174:0/1182179376 learned_addr learned my addr 172.21.15.174:0/1182179376 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.437+0000 7fcfff7fe640 1 -- 172.21.15.174:0/1182179376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0001976a0 con 0x7fd000106650 2024-09-19T05:59:16.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.437+0000 7fcfff7fe640 1 --2- 172.21.15.174:0/1182179376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd000106650 0x7fd000197160 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009230 tx=0x7fcff00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.437+0000 7fcffcff9640 1 -- 172.21.15.174:0/1182179376 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcff003f070 con 0x7fd000106650 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.437+0000 7fcffcff9640 1 -- 172.21.15.174:0/1182179376 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcff0004d10 con 0x7fd000106650 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.437+0000 7fd005cec640 1 -- 172.21.15.174:0/1182179376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd000197930 con 0x7fd000106650 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.437+0000 7fcffcff9640 1 -- 172.21.15.174:0/1182179376 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcff0035030 con 0x7fd000106650 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.438+0000 7fd005cec640 1 -- 172.21.15.174:0/1182179376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00019ba30 con 0x7fd000106650 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.438+0000 7fcffcff9640 1 -- 172.21.15.174:0/1182179376 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fcff0042070 con 0x7fd000106650 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.438+0000 7fd005cec640 1 -- 172.21.15.174:0/1182179376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd000101cc0 con 0x7fd000106650 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.439+0000 7fcffcff9640 1 --2- 172.21.15.174:0/1182179376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcfe80392a0 0x7fcfe803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.439+0000 7fcffcff9640 1 -- 172.21.15.174:0/1182179376 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcff006d0b0 con 0x7fd000106650 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.439+0000 7fcffeffd640 1 --2- 172.21.15.174:0/1182179376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcfe80392a0 0x7fcfe803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.440+0000 7fcffeffd640 1 --2- 172.21.15.174:0/1182179376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcfe80392a0 0x7fcfe803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcff40098c0 tx=0x7fcff4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:16.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.444+0000 7fcffcff9640 1 -- 172.21.15.174:0/1182179376 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcff0039350 con 0x7fd000106650 2024-09-19T05:59:16.697 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.695+0000 7fd005cec640 1 -- 172.21.15.174:0/1182179376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd000106ab0 con 0x7fd000106650 2024-09-19T05:59:16.697 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.696+0000 7fcffcff9640 1 -- 172.21.15.174:0/1182179376 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7fcff002f300 con 0x7fd000106650 2024-09-19T05:59:16.698 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:59:16.698 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","modified":"2024-09-19T05:57:57.043810Z","created":"2024-09-19T05:57:57.043810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T05:59:16.698 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-09-19T05:59:16.700 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.698+0000 7fd005cec640 1 -- 172.21.15.174:0/1182179376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcfe80392a0 msgr2=0x7fcfe803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:16.700 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.698+0000 7fd005cec640 1 --2- 172.21.15.174:0/1182179376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcfe80392a0 0x7fcfe803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcff40098c0 tx=0x7fcff4006db0 comp rx=0 tx=0).stop 2024-09-19T05:59:16.700 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.698+0000 7fd005cec640 1 -- 172.21.15.174:0/1182179376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd000106650 msgr2=0x7fd000197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:16.700 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.698+0000 7fd005cec640 1 --2- 172.21.15.174:0/1182179376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd000106650 0x7fd000197160 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009230 tx=0x7fcff00048f0 comp rx=0 tx=0).stop 2024-09-19T05:59:16.700 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.698+0000 7fd005cec640 1 -- 172.21.15.174:0/1182179376 shutdown_connections 2024-09-19T05:59:16.700 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.698+0000 7fd005cec640 1 --2- 172.21.15.174:0/1182179376 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcfe80392a0 0x7fcfe803b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:16.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.698+0000 7fd005cec640 1 --2- 172.21.15.174:0/1182179376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd000106650 0x7fd000197160 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:16.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.698+0000 7fd005cec640 1 -- 172.21.15.174:0/1182179376 >> 172.21.15.174:0/1182179376 conn(0x7fd0000fc280 msgr2=0x7fd000069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:16.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.698+0000 7fd005cec640 1 -- 172.21.15.174:0/1182179376 shutdown_connections 2024-09-19T05:59:16.701 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:16.698+0000 7fd005cec640 1 -- 172.21.15.174:0/1182179376 wait complete. 2024-09-19T05:59:16.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:16 smithi103 ceph-mon[30925]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:17.040 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:16 smithi174 systemd[1]: Starting Ceph mon.c for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T05:59:17.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 podman[34469]: 2024-09-19 05:59:17.497662945 +0000 UTC m=+0.101430889 container create e9c25c0a3fe4dd7b85e1011979594caca8c1af370909e9f7af5637495fc7ed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T05:59:17.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 podman[34469]: 2024-09-19 05:59:17.412366714 +0000 UTC m=+0.016134614 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:59:17.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 podman[34469]: 2024-09-19 05:59:17.666301325 +0000 UTC m=+0.270069217 container init e9c25c0a3fe4dd7b85e1011979594caca8c1af370909e9f7af5637495fc7ed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-c, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 podman[34469]: 2024-09-19 05:59:17.669366485 +0000 UTC m=+0.273134369 container start e9c25c0a3fe4dd7b85e1011979594caca8c1af370909e9f7af5637495fc7ed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: pidfile_write: ignore empty --pid-file 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: load: jerasure load: lrc 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: RocksDB version: 7.9.2 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Git sha 0 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: DB SUMMARY 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: DB Session ID: ERL1YQWH2GKHIE3QQJ4A 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: CURRENT file: CURRENT 2024-09-19T05:59:17.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.error_if_exists: 0 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.create_if_missing: 0 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.paranoid_checks: 1 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.env: 0x558f07cc3940 2024-09-19T05:59:17.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T05:59:17.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.info_log: 0x558f09aa96e0 2024-09-19T05:59:17.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T05:59:17.958 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.statistics: (nil) 2024-09-19T05:59:17.958 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.use_fsync: 0 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_log_file_size: 0 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.allow_fallocate: 1 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.use_direct_reads: 0 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.db_log_dir: 2024-09-19T05:59:17.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.wal_dir: 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.write_buffer_manager: 0x558f09ab8dc0 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T05:59:17.960 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.unordered_write: 0 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.row_cache: None 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.wal_filter: None 2024-09-19T05:59:17.961 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.two_write_queues: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.wal_compression: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.atomic_flush: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.log_readahead_size: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T05:59:17.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_background_jobs: 2 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_background_compactions: -1 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_subcompactions: 1 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T05:59:17.963 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_open_files: -1 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_background_flushes: -1 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Compression algorithms supported: 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: kZSTD supported: 0 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: kXpressCompression supported: 0 2024-09-19T05:59:17.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: kBZip2Compression supported: 0 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: kLZ4Compression supported: 1 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: kZlibCompression supported: 1 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: kSnappyCompression supported: 1 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.merge_operator: 2024-09-19T05:59:17.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_filter: None 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558f09aa9320) 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout: cache_index_and_filter_blocks: 1 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout: pin_top_level_index_and_filter: 1 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_type: 0 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout: data_block_index_type: 0 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_shortening: 1 2024-09-19T05:59:17.966 INFO:journalctl@ceph.mon.c.smithi174.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: checksum: 4 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: no_block_cache: 0 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache: 0x558f09a9d1f0 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_name: BinnedLRUCache 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_options: 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: capacity : 536870912 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: num_shard_bits : 4 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: strict_capacity_limit : 0 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: high_pri_pool_ratio: 0.000 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_compressed: (nil) 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: persistent_cache: (nil) 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_size: 4096 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_size_deviation: 10 2024-09-19T05:59:17.967 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_restart_interval: 16 2024-09-19T05:59:17.968 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_block_restart_interval: 1 2024-09-19T05:59:17.968 INFO:journalctl@ceph.mon.c.smithi174.stdout: metadata_block_size: 4096 2024-09-19T05:59:17.968 INFO:journalctl@ceph.mon.c.smithi174.stdout: partition_filters: 0 2024-09-19T05:59:17.968 INFO:journalctl@ceph.mon.c.smithi174.stdout: use_delta_encoding: 1 2024-09-19T05:59:17.968 INFO:journalctl@ceph.mon.c.smithi174.stdout: filter_policy: bloomfilter 2024-09-19T05:59:17.968 INFO:journalctl@ceph.mon.c.smithi174.stdout: whole_key_filtering: 1 2024-09-19T05:59:17.968 INFO:journalctl@ceph.mon.c.smithi174.stdout: verify_compression: 0 2024-09-19T05:59:17.968 INFO:journalctl@ceph.mon.c.smithi174.stdout: read_amp_bytes_per_bit: 0 2024-09-19T05:59:17.969 INFO:journalctl@ceph.mon.c.smithi174.stdout: format_version: 5 2024-09-19T05:59:17.969 INFO:journalctl@ceph.mon.c.smithi174.stdout: enable_index_compression: 1 2024-09-19T05:59:17.969 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_align: 0 2024-09-19T05:59:17.969 INFO:journalctl@ceph.mon.c.smithi174.stdout: max_auto_readahead_size: 262144 2024-09-19T05:59:17.969 INFO:journalctl@ceph.mon.c.smithi174.stdout: prepopulate_block_cache: 0 2024-09-19T05:59:17.969 INFO:journalctl@ceph.mon.c.smithi174.stdout: initial_auto_readahead_size: 8192 2024-09-19T05:59:17.969 INFO:journalctl@ceph.mon.c.smithi174.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T05:59:17.969 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T05:59:17.969 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compression: NoCompression 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.num_levels: 7 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T05:59:17.970 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:59:17.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T05:59:17.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T05:59:17.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.inplace_update_support: 0 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T05:59:17.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.bloom_locality: 0 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.max_successive_merges: 0 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.ttl: 2592000 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.enable_blob_files: false 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.min_blob_size: 0 2024-09-19T05:59:17.975 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8d10dd99-1e31-4521-b851-a78996a6d94a 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725557696418, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T05:59:17.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725557696830, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726725557, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8d10dd99-1e31-4521-b851-a78996a6d94a", "db_session_id": "ERL1YQWH2GKHIE3QQJ4A", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725557696936, "job": 1, "event": "recovery_finished"} 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558f09acae00 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: DB pointer 0x558f09bc6000 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** DB Stats ** 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T05:59:17.977 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** Compaction Stats [default] ** 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** Compaction Stats [default] ** 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:59:17.978 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative compaction: 0.00 GB write, 0.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval compaction: 0.00 GB write, 0.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: Block cache BinnedLRUCache@0x558f09a9d1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T05:59:17.979 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: using public_addr v2:172.21.15.174:0/0 -> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: starting mon.c rank -1 at public addrs [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] at bind addrs [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(???) e0 preinit fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout: e1 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout: btime 2024-09-19T05:58:00:204409+0000 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:59:17.980 INFO:journalctl@ceph.mon.c.smithi174.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout: legacy client fscid: -1 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout: No filesystems configured 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:59:17.981 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Deploying cephadm binary to smithi174 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Added host smithi174 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.982 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1792086376' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1792086376' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:17.983 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi103:172.21.15.103=a;smithi169:172.21.15.169=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:17.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Saving service mon spec with placement smithi103:172.21.15.103=a;smithi169:172.21.15.169=b;smithi174:172.21.15.174=c;count:3 2024-09-19T05:59:17.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: Deploying daemon mon.c on smithi174 2024-09-19T05:59:17.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:17.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:17.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/1182179376' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:59:17.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 ceph-mon[34488]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T05:59:17.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 bash[34469]: e9c25c0a3fe4dd7b85e1011979594caca8c1af370909e9f7af5637495fc7ed70 2024-09-19T05:59:17.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:17 smithi174 systemd[1]: Started Ceph mon.c for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T05:59:17.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:17 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/1182179376' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:59:18.286 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:59:18.286 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:59:18.541 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:59:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: mon.a calling monitor election 2024-09-19T05:59:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: mon.c calling monitor election 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: monmap epoch 2 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: last_changed 2024-09-19T05:59:17.723016+0000 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: created 2024-09-19T05:57:57.043810+0000 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: min_mon_release 19 (squid) 2024-09-19T05:59:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: election_strategy: 1 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: fsmap 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: mgrmap e13: x(active, since 37s) 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: overall HEALTH_OK 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:23.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:23.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:23.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: mon.a calling monitor election 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: mon.c calling monitor election 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: monmap epoch 2 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:23.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: last_changed 2024-09-19T05:59:17.723016+0000 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: created 2024-09-19T05:57:57.043810+0000 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: min_mon_release 19 (squid) 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: election_strategy: 1 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: fsmap 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: mgrmap e13: x(active, since 37s) 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: overall HEALTH_OK 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:23.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:23.247 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:23.247 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:23.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.336+0000 7f23ee5d6640 1 -- 172.21.15.174:0/3145110226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d4003530 msgr2=0x7f23d40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:23.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.336+0000 7f23ee5d6640 1 --2- 172.21.15.174:0/3145110226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d4003530 0x7f23d40059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f23e8102b00 tx=0x7f23d802c490 comp rx=0 tx=0).stop 2024-09-19T05:59:23.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.336+0000 7f23ee5d6640 1 -- 172.21.15.174:0/3145110226 shutdown_connections 2024-09-19T05:59:23.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.336+0000 7f23ee5d6640 1 --2- 172.21.15.174:0/3145110226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d4003530 0x7f23d40059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:23.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.336+0000 7f23ee5d6640 1 -- 172.21.15.174:0/3145110226 >> 172.21.15.174:0/3145110226 conn(0x7f23e80fd330 msgr2=0x7f23e80ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:23.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.336+0000 7f23ee5d6640 1 -- 172.21.15.174:0/3145110226 shutdown_connections 2024-09-19T05:59:23.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.336+0000 7f23ee5d6640 1 -- 172.21.15.174:0/3145110226 wait complete. 2024-09-19T05:59:23.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.337+0000 7f23ee5d6640 1 Processor -- start 2024-09-19T05:59:23.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.337+0000 7f23ee5d6640 1 -- start start 2024-09-19T05:59:23.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23ee5d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d4003530 0x7f23e81993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:23.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23ee5d6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e8199920 0x7f23e819dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:23.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23ee5d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8109640 con 0x7f23d4003530 2024-09-19T05:59:23.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23ee5d6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f23e81094c0 con 0x7f23e8199920 2024-09-19T05:59:23.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e8199920 0x7f23e819dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:23.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d4003530 0x7f23e81993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:23.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d4003530 0x7f23e81993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.174:59158/0 (socket says 172.21.15.174:59158) 2024-09-19T05:59:23.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e8199920 0x7f23e819dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:59994/0 (socket says 172.21.15.174:59994) 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e7fff640 1 -- 172.21.15.174:0/2982442052 learned_addr learned my addr 172.21.15.174:0/2982442052 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e77fe640 1 -- 172.21.15.174:0/2982442052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e8199920 msgr2=0x7f23e819dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e77fe640 1 -- 172.21.15.174:0/2982442052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e8199920 msgr2=0x7f23e819dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e77fe640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e8199920 0x7f23e819dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e77fe640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e8199920 0x7f23e819dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e7fff640 1 -- 172.21.15.174:0/2982442052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e8199920 msgr2=0x7f23e819dcb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e7fff640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e8199920 0x7f23e819dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.338+0000 7f23e7fff640 1 -- 172.21.15.174:0/2982442052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e8199f40 con 0x7f23d4003530 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.339+0000 7f23e7fff640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d4003530 0x7f23e81993e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f23d8012c10 tx=0x7f23d80325e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.339+0000 7f23e57fa640 1 -- 172.21.15.174:0/2982442052 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f23d8038040 con 0x7f23d4003530 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.339+0000 7f23e57fa640 1 -- 172.21.15.174:0/2982442052 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23d8032d20 con 0x7f23d4003530 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.339+0000 7f23e57fa640 1 -- 172.21.15.174:0/2982442052 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f23d803cdb0 con 0x7f23d4003530 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.339+0000 7f23ee5d6640 1 -- 172.21.15.174:0/2982442052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e819e1f0 con 0x7f23d4003530 2024-09-19T05:59:23.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.339+0000 7f23ee5d6640 1 -- 172.21.15.174:0/2982442052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e819e730 con 0x7f23d4003530 2024-09-19T05:59:23.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.340+0000 7f23e57fa640 1 -- 172.21.15.174:0/2982442052 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f23d8043070 con 0x7f23d4003530 2024-09-19T05:59:23.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.341+0000 7f23ee5d6640 1 -- 172.21.15.174:0/2982442052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e8102db0 con 0x7f23d4003530 2024-09-19T05:59:23.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.341+0000 7f23e57fa640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f23c8039090 0x7f23c803b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:23.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.341+0000 7f23e57fa640 1 -- 172.21.15.174:0/2982442052 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f23d806e880 con 0x7f23d4003530 2024-09-19T05:59:23.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.341+0000 7f23e77fe640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f23c8039090 0x7f23c803b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:23.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.342+0000 7f23e77fe640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f23c8039090 0x7f23c803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23d0006fd0 tx=0x7f23d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:23.348 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.346+0000 7f23e57fa640 1 -- 172.21.15.174:0/2982442052 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23d8070d00 con 0x7f23d4003530 2024-09-19T05:59:23.585 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.582+0000 7f23ee5d6640 1 -- 172.21.15.174:0/2982442052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f23e81068c0 con 0x7f23d4003530 2024-09-19T05:59:23.585 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.583+0000 7f23e57fa640 1 -- 172.21.15.174:0/2982442052 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f23d804d350 con 0x7f23d4003530 2024-09-19T05:59:23.585 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:59:23.585 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":2,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","modified":"2024-09-19T05:59:17.723016Z","created":"2024-09-19T05:57:57.043810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:59:23.586 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 2 2024-09-19T05:59:23.586 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 -- 172.21.15.174:0/2982442052 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f23c8039090 msgr2=0x7f23c803b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:23.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f23c8039090 0x7f23c803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23d0006fd0 tx=0x7f23d0008040 comp rx=0 tx=0).stop 2024-09-19T05:59:23.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 -- 172.21.15.174:0/2982442052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d4003530 msgr2=0x7f23e81993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:23.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d4003530 0x7f23e81993e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f23d8012c10 tx=0x7f23d80325e0 comp rx=0 tx=0).stop 2024-09-19T05:59:23.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 -- 172.21.15.174:0/2982442052 shutdown_connections 2024-09-19T05:59:23.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f23c8039090 0x7f23c803b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:23.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e8199920 0x7f23e819dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:23.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 --2- 172.21.15.174:0/2982442052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d4003530 0x7f23e81993e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:23.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 -- 172.21.15.174:0/2982442052 >> 172.21.15.174:0/2982442052 conn(0x7f23e80fd330 msgr2=0x7f23e8075000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:23.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 -- 172.21.15.174:0/2982442052 shutdown_connections 2024-09-19T05:59:23.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:23.585+0000 7f23ee5d6640 1 -- 172.21.15.174:0/2982442052 wait complete. 2024-09-19T05:59:23.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:23 smithi174 ceph-mon[34488]: Deploying daemon mon.b on smithi169 2024-09-19T05:59:23.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:23 smithi174 ceph-mon[34488]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:23.932 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:23 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/2982442052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:59:23.932 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:23 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:24.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:23 smithi103 ceph-mon[30925]: Deploying daemon mon.b on smithi169 2024-09-19T05:59:24.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:23 smithi103 ceph-mon[30925]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:24.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:23 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/2982442052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:59:24.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:23 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:25.228 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:59:25.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:59:25.482 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:59:25.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.880+0000 7f1cc5176640 1 -- 172.21.15.174:0/3887508625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0102840 msgr2=0x7f1cc0102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:25.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.880+0000 7f1cc5176640 1 --2- 172.21.15.174:0/3887508625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0102840 0x7f1cc0102c20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009c20 tx=0x7f1cb002ab20 comp rx=0 tx=0).stop 2024-09-19T05:59:25.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.880+0000 7f1cc5176640 1 -- 172.21.15.174:0/3887508625 shutdown_connections 2024-09-19T05:59:25.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.880+0000 7f1cc5176640 1 --2- 172.21.15.174:0/3887508625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0102840 0x7f1cc0102c20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:25.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.880+0000 7f1cc5176640 1 -- 172.21.15.174:0/3887508625 >> 172.21.15.174:0/3887508625 conn(0x7f1cc00fc280 msgr2=0x7f1cc00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:25.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.880+0000 7f1cc5176640 1 -- 172.21.15.174:0/3887508625 shutdown_connections 2024-09-19T05:59:25.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.880+0000 7f1cc5176640 1 -- 172.21.15.174:0/3887508625 wait complete. 2024-09-19T05:59:25.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cc5176640 1 Processor -- start 2024-09-19T05:59:25.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cc5176640 1 -- start start 2024-09-19T05:59:25.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cc5176640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cc0102840 0x7f1cc0197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:25.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cc5176640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0197940 0x7f1cc019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:25.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cc5176640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc010bc60 con 0x7f1cc0197940 2024-09-19T05:59:25.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cc5176640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc010bae0 con 0x7f1cc0102840 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cbed9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cc0102840 0x7f1cc0197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cbed9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cc0102840 0x7f1cc0197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:60006/0 (socket says 172.21.15.174:60006) 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cbed9d640 1 -- 172.21.15.174:0/2280266300 learned_addr learned my addr 172.21.15.174:0/2280266300 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cbed9d640 1 -- 172.21.15.174:0/2280266300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cc0102840 msgr2=0x7f1cc0197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cbed9d640 1 -- 172.21.15.174:0/2280266300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cc0102840 msgr2=0x7f1cc0197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cbed9d640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cc0102840 0x7f1cc0197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.881+0000 7f1cbe59c640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0197940 0x7f1cc019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.882+0000 7f1cbed9d640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cc0102840 0x7f1cc0197400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.882+0000 7f1cbe59c640 1 -- 172.21.15.174:0/2280266300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cc0102840 msgr2=0x7f1cc0197400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.882+0000 7f1cbe59c640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cc0102840 0x7f1cc0197400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.882+0000 7f1cbe59c640 1 -- 172.21.15.174:0/2280266300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc0197f60 con 0x7f1cc0197940 2024-09-19T05:59:25.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.882+0000 7f1cbe59c640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0197940 0x7f1cc019bcd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400b3d0 tx=0x7f1cb400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:25.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.882+0000 7f1ca7fff640 1 -- 172.21.15.174:0/2280266300 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1cb4011630 con 0x7f1cc0197940 2024-09-19T05:59:25.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.882+0000 7f1cc5176640 1 -- 172.21.15.174:0/2280266300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc019c210 con 0x7f1cc0197940 2024-09-19T05:59:25.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.882+0000 7f1ca7fff640 1 -- 172.21.15.174:0/2280266300 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cb4011c80 con 0x7f1cc0197940 2024-09-19T05:59:25.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.882+0000 7f1ca7fff640 1 -- 172.21.15.174:0/2280266300 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1cb4010d70 con 0x7f1cc0197940 2024-09-19T05:59:25.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.882+0000 7f1cc5176640 1 -- 172.21.15.174:0/2280266300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc019c750 con 0x7f1cc0197940 2024-09-19T05:59:25.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.883+0000 7f1ca7fff640 1 -- 172.21.15.174:0/2280266300 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f1cb4018020 con 0x7f1cc0197940 2024-09-19T05:59:25.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.883+0000 7f1ca7fff640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1ca8039040 0x7f1ca803b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:25.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.883+0000 7f1ca7fff640 1 -- 172.21.15.174:0/2280266300 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1cb404cf20 con 0x7f1cc0197940 2024-09-19T05:59:25.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.883+0000 7f1cc5176640 1 -- 172.21.15.174:0/2280266300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc006a4f0 con 0x7f1cc0197940 2024-09-19T05:59:25.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.884+0000 7f1cbed9d640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1ca8039040 0x7f1ca803b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:25.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.884+0000 7f1cbed9d640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1ca8039040 0x7f1ca803b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1cb002b110 tx=0x7f1cb0005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:25.890 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:25.888+0000 7f1ca7fff640 1 -- 172.21.15.174:0/2280266300 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cb401f020 con 0x7f1cc0197940 2024-09-19T05:59:26.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.116+0000 7f1cc5176640 1 -- 172.21.15.174:0/2280266300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1cc0102ca0 con 0x7f1cc0197940 2024-09-19T05:59:26.118 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.116+0000 7f1ca7fff640 1 -- 172.21.15.174:0/2280266300 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f1cc0102ca0 con 0x7f1cc0197940 2024-09-19T05:59:26.118 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:59:26.118 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":2,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","modified":"2024-09-19T05:59:17.723016Z","created":"2024-09-19T05:57:57.043810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:59:26.119 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 2 2024-09-19T05:59:26.120 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.118+0000 7f1cc5176640 1 -- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1ca8039040 msgr2=0x7f1ca803b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:26.120 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.118+0000 7f1cc5176640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1ca8039040 0x7f1ca803b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1cb002b110 tx=0x7f1cb0005dc0 comp rx=0 tx=0).stop 2024-09-19T05:59:26.120 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.118+0000 7f1cc5176640 1 -- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0197940 msgr2=0x7f1cc019bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:26.121 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.118+0000 7f1cc5176640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0197940 0x7f1cc019bcd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400b3d0 tx=0x7f1cb400b890 comp rx=0 tx=0).stop 2024-09-19T05:59:26.121 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.118+0000 7f1cc5176640 1 -- 172.21.15.174:0/2280266300 shutdown_connections 2024-09-19T05:59:26.121 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.118+0000 7f1cc5176640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1ca8039040 0x7f1ca803b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:26.121 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.118+0000 7f1cc5176640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0197940 0x7f1cc019bcd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:26.121 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.118+0000 7f1cc5176640 1 --2- 172.21.15.174:0/2280266300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1cc0102840 0x7f1cc0197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:26.121 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.118+0000 7f1cc5176640 1 -- 172.21.15.174:0/2280266300 >> 172.21.15.174:0/2280266300 conn(0x7f1cc00fc280 msgr2=0x7f1cc0105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:26.121 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.119+0000 7f1cc5176640 1 -- 172.21.15.174:0/2280266300 shutdown_connections 2024-09-19T05:59:26.121 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:26.119+0000 7f1cc5176640 1 -- 172.21.15.174:0/2280266300 wait complete. 2024-09-19T05:59:27.766 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:59:27.767 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:59:28.014 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:59:31.413 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.410+0000 7ff662711640 1 -- 172.21.15.174:0/1325383636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff644003530 msgr2=0x7ff6440059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:31.414 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.411+0000 7ff662711640 1 --2- 172.21.15.174:0/1325383636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff644003530 0x7ff6440059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff65c1016d0 tx=0x7ff64c02bce0 comp rx=0 tx=0).stop 2024-09-19T05:59:31.414 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.411+0000 7ff662711640 1 -- 172.21.15.174:0/1325383636 shutdown_connections 2024-09-19T05:59:31.414 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.411+0000 7ff662711640 1 --2- 172.21.15.174:0/1325383636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff644003530 0x7ff6440059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:31.414 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.411+0000 7ff662711640 1 -- 172.21.15.174:0/1325383636 >> 172.21.15.174:0/1325383636 conn(0x7ff65c0fc250 msgr2=0x7ff65c0fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:31.414 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.411+0000 7ff662711640 1 -- 172.21.15.174:0/1325383636 shutdown_connections 2024-09-19T05:59:31.414 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.411+0000 7ff662711640 1 -- 172.21.15.174:0/1325383636 wait complete. 2024-09-19T05:59:31.414 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.412+0000 7ff662711640 1 Processor -- start 2024-09-19T05:59:31.414 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.412+0000 7ff662711640 1 -- start start 2024-09-19T05:59:31.416 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.412+0000 7ff662711640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff644003530 0x7ff65c1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:31.416 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff662711640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff65c197800 0x7ff65c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:31.416 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff662711640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff65c19c0d0 0x7ff65c19c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:31.416 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff662711640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c108540 con 0x7ff65c197800 2024-09-19T05:59:31.416 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff662711640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c1083c0 con 0x7ff644003530 2024-09-19T05:59:31.416 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff662711640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c1086c0 con 0x7ff65c19c0d0 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff660cae640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff65c19c0d0 0x7ff65c19c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff644003530 0x7ff65c1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff660cae640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff65c19c0d0 0x7ff65c19c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:54724/0 (socket says 172.21.15.174:54724) 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff660cae640 1 -- 172.21.15.174:0/3722298115 learned_addr learned my addr 172.21.15.174:0/3722298115 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff644003530 0x7ff65c1972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.174:45150/0 (socket says 172.21.15.174:45150) 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65b7fe640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff65c197800 0x7ff65c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65bfff640 1 -- 172.21.15.174:0/3722298115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff644003530 msgr2=0x7ff65c1972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65bfff640 1 -- 172.21.15.174:0/3722298115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff644003530 msgr2=0x7ff65c1972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65bfff640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff644003530 0x7ff65c1972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff660cae640 1 -- 172.21.15.174:0/3722298115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff65c19c0d0 msgr2=0x7ff65c19c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff660cae640 1 -- 172.21.15.174:0/3722298115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff65c19c0d0 msgr2=0x7ff65c19c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff660cae640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff65c19c0d0 0x7ff65c19c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:59:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65bfff640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff644003530 0x7ff65c1972c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff660cae640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff65c19c0d0 0x7ff65c19c580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65b7fe640 1 -- 172.21.15.174:0/3722298115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff65c19c0d0 msgr2=0x7ff65c19c580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65b7fe640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff65c19c0d0 0x7ff65c19c580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65b7fe640 1 -- 172.21.15.174:0/3722298115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff644003530 msgr2=0x7ff65c1972c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65b7fe640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff644003530 0x7ff65c1972c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.413+0000 7ff65b7fe640 1 -- 172.21.15.174:0/3722298115 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65c1a3e40 con 0x7ff65c197800 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.414+0000 7ff65b7fe640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff65c197800 0x7ff65c19bb90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff65000b450 tx=0x7ff65000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.414+0000 7ff6597fa640 1 -- 172.21.15.174:0/3722298115 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650004230 con 0x7ff65c197800 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.414+0000 7ff662711640 1 -- 172.21.15.174:0/3722298115 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65c1a4070 con 0x7ff65c197800 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.414+0000 7ff6597fa640 1 -- 172.21.15.174:0/3722298115 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6500043d0 con 0x7ff65c197800 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.414+0000 7ff6597fa640 1 -- 172.21.15.174:0/3722298115 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650003be0 con 0x7ff65c197800 2024-09-19T05:59:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.414+0000 7ff662711640 1 -- 172.21.15.174:0/3722298115 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff65c1a4650 con 0x7ff65c197800 2024-09-19T05:59:31.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.415+0000 7ff6597fa640 1 -- 172.21.15.174:0/3722298115 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7ff65000f050 con 0x7ff65c197800 2024-09-19T05:59:31.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.415+0000 7ff6597fa640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff648039730 0x7ff64803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:31.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.415+0000 7ff6597fa640 1 -- 172.21.15.174:0/3722298115 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff65004c110 con 0x7ff65c197800 2024-09-19T05:59:31.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.415+0000 7ff662711640 1 -- 172.21.15.174:0/3722298115 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff65c109630 con 0x7ff65c197800 2024-09-19T05:59:31.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.415+0000 7ff65bfff640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff648039730 0x7ff64803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:31.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.416+0000 7ff65bfff640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff648039730 0x7ff64803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff64c011c00 tx=0x7ff64c005f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:31.422 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.420+0000 7ff6597fa640 1 -- 172.21.15.174:0/3722298115 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff65000d040 con 0x7ff65c197800 2024-09-19T05:59:31.674 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.672+0000 7ff662711640 1 -- 172.21.15.174:0/3722298115 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff65c1a48e0 con 0x7ff65c197800 2024-09-19T05:59:31.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:31.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: mon.c calling monitor election 2024-09-19T05:59:31.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: mon.a calling monitor election 2024-09-19T05:59:31.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:31.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: monmap epoch 3 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: last_changed 2024-09-19T05:59:26.335181+0000 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: created 2024-09-19T05:57:57.043810+0000 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: min_mon_release 19 (squid) 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: election_strategy: 1 2024-09-19T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-19T05:59:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-19T05:59:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: 2: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-09-19T05:59:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: fsmap 2024-09-19T05:59:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:59:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: mgrmap e13: x(active, since 45s) 2024-09-19T05:59:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: overall HEALTH_OK 2024-09-19T05:59:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:31.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.672+0000 7ff6597fa640 1 -- 172.21.15.174:0/3722298115 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7ff650003e10 con 0x7ff65c197800 2024-09-19T05:59:31.677 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:59:31.677 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":3,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","modified":"2024-09-19T05:59:26.335181Z","created":"2024-09-19T05:57:57.043810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:59:31.678 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 3 2024-09-19T05:59:31.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.674+0000 7ff662711640 1 -- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff648039730 msgr2=0x7ff64803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:31.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.674+0000 7ff662711640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff648039730 0x7ff64803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff64c011c00 tx=0x7ff64c005f10 comp rx=0 tx=0).stop 2024-09-19T05:59:31.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.675+0000 7ff662711640 1 -- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff65c197800 msgr2=0x7ff65c19bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:31.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.675+0000 7ff662711640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff65c197800 0x7ff65c19bb90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff65000b450 tx=0x7ff65000b910 comp rx=0 tx=0).stop 2024-09-19T05:59:31.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.675+0000 7ff662711640 1 -- 172.21.15.174:0/3722298115 shutdown_connections 2024-09-19T05:59:31.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.675+0000 7ff662711640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff648039730 0x7ff64803bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:31.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.675+0000 7ff662711640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff65c19c0d0 0x7ff65c19c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:31.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.675+0000 7ff662711640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff65c197800 0x7ff65c19bb90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:31.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.675+0000 7ff662711640 1 --2- 172.21.15.174:0/3722298115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff644003530 0x7ff65c1972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:31.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.675+0000 7ff662711640 1 -- 172.21.15.174:0/3722298115 >> 172.21.15.174:0/3722298115 conn(0x7ff65c0fc250 msgr2=0x7ff65c105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:31.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.675+0000 7ff662711640 1 -- 172.21.15.174:0/3722298115 shutdown_connections 2024-09-19T05:59:31.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:31.675+0000 7ff662711640 1 -- 172.21.15.174:0/3722298115 wait complete. 2024-09-19T05:59:31.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:31.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: mon.c calling monitor election 2024-09-19T05:59:31.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: mon.a calling monitor election 2024-09-19T05:59:31.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: monmap epoch 3 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: last_changed 2024-09-19T05:59:26.335181+0000 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: created 2024-09-19T05:57:57.043810+0000 2024-09-19T05:59:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: min_mon_release 19 (squid) 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: election_strategy: 1 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: 2: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: fsmap 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: mgrmap e13: x(active, since 45s) 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: overall HEALTH_OK 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:31.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:32.228 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T05:59:32.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T05:59:32.481 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:59:32.602 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:32 smithi103 ceph-mon[30925]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:32.602 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:32.602 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:32 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/3722298115' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:59:32.602 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:32.693 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:32 smithi174 ceph-mon[34488]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:32.693 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:32.693 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:32 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/3722298115' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:59:32.693 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:32.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.923+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1587558281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac4106590 msgr2=0x7f6ac4106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.923+0000 7f6ac9d27640 1 --2- 172.21.15.103:0/1587558281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac4106590 0x7f6ac4106970 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009880 tx=0x7f6aac02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.923+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1587558281 shutdown_connections 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.923+0000 7f6ac9d27640 1 --2- 172.21.15.103:0/1587558281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac4106590 0x7f6ac4106970 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.923+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1587558281 >> 172.21.15.103:0/1587558281 conn(0x7f6ac40fc1a0 msgr2=0x7f6ac40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.923+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1587558281 shutdown_connections 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.923+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1587558281 wait complete. 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac9d27640 1 Processor -- start 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac9d27640 1 -- start start 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac9d27640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac4106590 0x7f6ac4198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac9d27640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ac41986b0 0x7f6ac4198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac9d27640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac41a11e0 0x7f6ac41a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac9d27640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac410aa20 con 0x7f6ac4106590 2024-09-19T05:59:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac9d27640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac410a8a0 con 0x7f6ac41986b0 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac9d27640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac410aba0 con 0x7f6ac41a11e0 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac4106590 0x7f6ac4198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac4106590 0x7f6ac4198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43058/0 (socket says 172.21.15.103:43058) 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac37fe640 1 -- 172.21.15.103:0/1948170229 learned_addr learned my addr 172.21.15.103:0/1948170229 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac3fff640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac41a11e0 0x7f6ac41a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.924+0000 7f6ac2ffd640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ac41986b0 0x7f6ac4198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac37fe640 1 -- 172.21.15.103:0/1948170229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac41a11e0 msgr2=0x7f6ac41a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac37fe640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac41a11e0 0x7f6ac41a35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac37fe640 1 -- 172.21.15.103:0/1948170229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ac41986b0 msgr2=0x7f6ac4198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac37fe640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ac41986b0 0x7f6ac4198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac37fe640 1 -- 172.21.15.103:0/1948170229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac41a3d00 con 0x7f6ac4106590 2024-09-19T05:59:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac2ffd640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ac41986b0 0x7f6ac4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac37fe640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac4106590 0x7f6ac4198170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6aac031440 tx=0x7f6aac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac0ff9640 1 -- 172.21.15.103:0/1948170229 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac03f030 con 0x7f6ac4106590 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac0ff9640 1 -- 172.21.15.103:0/1948170229 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6aac003cb0 con 0x7f6ac4106590 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1948170229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac41a3f90 con 0x7f6ac4106590 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac0ff9640 1 -- 172.21.15.103:0/1948170229 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac035070 con 0x7f6ac4106590 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.925+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1948170229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac41a4440 con 0x7f6ac4106590 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.926+0000 7f6ac0ff9640 1 -- 172.21.15.103:0/1948170229 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f6aac042030 con 0x7f6ac4106590 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.926+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1948170229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac41069f0 con 0x7f6ac4106590 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.926+0000 7f6ac0ff9640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6ab0039730 0x7f6ab003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.926+0000 7f6ac0ff9640 1 -- 172.21.15.103:0/1948170229 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6aac06d230 con 0x7f6ac4106590 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.926+0000 7f6ac2ffd640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6ab0039730 0x7f6ab003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.927+0000 7f6ac2ffd640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6ab0039730 0x7f6ab003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4007920 tx=0x7f6ab4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:32.931+0000 7f6ac0ff9640 1 -- 172.21.15.103:0/1948170229 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6aac04bd70 con 0x7f6ac4106590 2024-09-19T05:59:33.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.113+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1948170229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f6ac41a4790 con 0x7f6ac4106590 2024-09-19T05:59:33.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.114+0000 7f6ac0ff9640 1 -- 172.21.15.103:0/1948170229 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7f6aac03aa10 con 0x7f6ac4106590 2024-09-19T05:59:33.116 INFO:teuthology.orchestra.run.smithi103.stdout:# minimal ceph.conf for f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:33.116 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-09-19T05:59:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: mon_host = [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1948170229 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6ab0039730 msgr2=0x7f6ab003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6ab0039730 0x7f6ab003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4007920 tx=0x7f6ab4008040 comp rx=0 tx=0).stop 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1948170229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac4106590 msgr2=0x7f6ac4198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac4106590 0x7f6ac4198170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6aac031440 tx=0x7f6aac0042f0 comp rx=0 tx=0).stop 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1948170229 shutdown_connections 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6ab0039730 0x7f6ab003bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac41a11e0 0x7f6ac41a35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ac41986b0 0x7f6ac4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 --2- 172.21.15.103:0/1948170229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac4106590 0x7f6ac4198170 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1948170229 >> 172.21.15.103:0/1948170229 conn(0x7f6ac40fc1a0 msgr2=0x7f6ac40fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1948170229 shutdown_connections 2024-09-19T05:59:33.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:33.117+0000 7f6ac9d27640 1 -- 172.21.15.103:0/1948170229 wait complete. 2024-09-19T05:59:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:33.855 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T05:59:33.855 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:59:33.856 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:59:33.884 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:59:33.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:59:33.949 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:59:33.949 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:59:33.979 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:59:33.979 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:59:34.045 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:59:34.045 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:59:34.072 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:59:34.073 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:59:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: mon.b calling monitor election 2024-09-19T05:59:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: mon.b calling monitor election 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: mon.a calling monitor election 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: mon.c calling monitor election 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: monmap epoch 3 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: last_changed 2024-09-19T05:59:26.335181+0000 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: created 2024-09-19T05:57:57.043810+0000 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: min_mon_release 19 (squid) 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: election_strategy: 1 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: 2: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: fsmap 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: mgrmap e13: x(active, since 47s) 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: overall HEALTH_OK 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:59:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:34.138 INFO:tasks.cephadm:Adding mgr.x on smithi103 2024-09-19T05:59:34.138 INFO:tasks.cephadm:Adding mgr.y on smithi169 2024-09-19T05:59:34.138 INFO:tasks.cephadm:Adding mgr.z on smithi174 2024-09-19T05:59:34.138 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi103=x;smithi169=y;smithi174=z' 2024-09-19T05:59:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: mon.b calling monitor election 2024-09-19T05:59:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-19T05:59:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-19T05:59:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-19T05:59:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: mon.b calling monitor election 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: mon.a calling monitor election 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: mon.c calling monitor election 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: monmap epoch 3 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: last_changed 2024-09-19T05:59:26.335181+0000 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: created 2024-09-19T05:57:57.043810+0000 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: min_mon_release 19 (squid) 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: election_strategy: 1 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: 2: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: fsmap 2024-09-19T05:59:34.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: mgrmap e13: x(active, since 47s) 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: overall HEALTH_OK 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:34.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:59:34.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:34.414 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:59:34.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: mon.b calling monitor election 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: mon.b calling monitor election 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: mon.a calling monitor election 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: mon.c calling monitor election 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:59:34.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: monmap epoch 3 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: last_changed 2024-09-19T05:59:26.335181+0000 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: created 2024-09-19T05:57:57.043810+0000 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: min_mon_release 19 (squid) 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: election_strategy: 1 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: 2: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: fsmap 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: mgrmap e13: x(active, since 47s) 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: overall HEALTH_OK 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:34.456 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:59:34.457 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:34.883 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.863+0000 7f35b26d2640 1 -- 172.21.15.174:0/2216631471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac1005f0 msgr2=0x7f35ac1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.863+0000 7f35b26d2640 1 --2- 172.21.15.174:0/2216631471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac1005f0 0x7f35ac1009f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f359c009880 tx=0x7f359c02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.863+0000 7f35b26d2640 1 -- 172.21.15.174:0/2216631471 shutdown_connections 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.863+0000 7f35b26d2640 1 --2- 172.21.15.174:0/2216631471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac1005f0 0x7f35ac1009f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.863+0000 7f35b26d2640 1 -- 172.21.15.174:0/2216631471 >> 172.21.15.174:0/2216631471 conn(0x7f35ac0fbda0 msgr2=0x7f35ac0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.863+0000 7f35b26d2640 1 -- 172.21.15.174:0/2216631471 shutdown_connections 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.863+0000 7f35b26d2640 1 -- 172.21.15.174:0/2216631471 wait complete. 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35b26d2640 1 Processor -- start 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35b26d2640 1 -- start start 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35b26d2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac1005f0 0x7f35ac06af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35b26d2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35ac199c60 0x7f35ac19c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:34.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35b26d2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac19c590 0x7f35ac19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35b26d2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac106590 con 0x7f35ac19c590 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35b26d2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac106410 con 0x7f35ac1005f0 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35b26d2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac106710 con 0x7f35ac199c60 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35ab7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35ac199c60 0x7f35ac19c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35ab7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35ac199c60 0x7f35ac19c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:54736/0 (socket says 172.21.15.174:54736) 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35ab7fe640 1 -- 172.21.15.174:0/2741375045 learned_addr learned my addr 172.21.15.174:0/2741375045 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35b0c6f640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac19c590 0x7f35ac19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.864+0000 7f35abfff640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac1005f0 0x7f35ac06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35ab7fe640 1 -- 172.21.15.174:0/2741375045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac1005f0 msgr2=0x7f35ac06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35ab7fe640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac1005f0 0x7f35ac06af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35ab7fe640 1 -- 172.21.15.174:0/2741375045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac19c590 msgr2=0x7f35ac19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35ab7fe640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac19c590 0x7f35ac19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35ab7fe640 1 -- 172.21.15.174:0/2741375045 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac19f360 con 0x7f35ac199c60 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35ab7fe640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35ac199c60 0x7f35ac19c050 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f35a000b520 tx=0x7f35a000b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35a97fa640 1 -- 172.21.15.174:0/2741375045 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0004230 con 0x7f35ac199c60 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35b26d2640 1 -- 172.21.15.174:0/2741375045 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ac19f5f0 con 0x7f35ac199c60 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35a97fa640 1 -- 172.21.15.174:0/2741375045 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35a00043d0 con 0x7f35ac199c60 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35a97fa640 1 -- 172.21.15.174:0/2741375045 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0003cf0 con 0x7f35ac199c60 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.865+0000 7f35b26d2640 1 -- 172.21.15.174:0/2741375045 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ac19fbb0 con 0x7f35ac199c60 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.866+0000 7f35a97fa640 1 -- 172.21.15.174:0/2741375045 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f35a000e070 con 0x7f35ac199c60 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.866+0000 7f35a97fa640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3594039730 0x7f359403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.866+0000 7f35a97fa640 1 -- 172.21.15.174:0/2741375045 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f35a004be40 con 0x7f35ac199c60 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.866+0000 7f35b26d2640 1 -- 172.21.15.174:0/2741375045 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ac18f350 con 0x7f35ac199c60 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.866+0000 7f35abfff640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3594039730 0x7f359403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.867+0000 7f35abfff640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3594039730 0x7f359403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f359c0314e0 tx=0x7f359c005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:34.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:34.871+0000 7f35a97fa640 1 -- 172.21.15.174:0/2741375045 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f35a0014020 con 0x7f35ac199c60 2024-09-19T05:59:35.053 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.052+0000 7f35b26d2640 1 -- 172.21.15.174:0/2741375045 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi169=y;smithi174=z", "target": ["mon-mgr", ""]}) -- 0x7f35ac062630 con 0x7f3594039730 2024-09-19T05:59:35.054 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:35 smithi174 ceph-mon[34488]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T05:59:35.054 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:35 smithi174 ceph-mon[34488]: Reconfiguring daemon mon.a on smithi103 2024-09-19T05:59:35.054 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:35 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:35.058 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.056+0000 7f35a97fa640 1 -- 172.21.15.174:0/2741375045 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f35ac062630 con 0x7f3594039730 2024-09-19T05:59:35.058 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mgr update... 2024-09-19T05:59:35.060 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.058+0000 7f35b26d2640 1 -- 172.21.15.174:0/2741375045 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3594039730 msgr2=0x7f359403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:35.060 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.058+0000 7f35b26d2640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3594039730 0x7f359403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f359c0314e0 tx=0x7f359c005bd0 comp rx=0 tx=0).stop 2024-09-19T05:59:35.060 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.058+0000 7f35b26d2640 1 -- 172.21.15.174:0/2741375045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35ac199c60 msgr2=0x7f35ac19c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:35.060 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.058+0000 7f35b26d2640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35ac199c60 0x7f35ac19c050 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f35a000b520 tx=0x7f35a000b9e0 comp rx=0 tx=0).stop 2024-09-19T05:59:35.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.059+0000 7f35b26d2640 1 -- 172.21.15.174:0/2741375045 shutdown_connections 2024-09-19T05:59:35.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.059+0000 7f35b26d2640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3594039730 0x7f359403bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:35.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.059+0000 7f35b26d2640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac19c590 0x7f35ac19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:35.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.059+0000 7f35b26d2640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35ac199c60 0x7f35ac19c050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:35.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.059+0000 7f35b26d2640 1 --2- 172.21.15.174:0/2741375045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac1005f0 0x7f35ac06af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:35.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.059+0000 7f35b26d2640 1 -- 172.21.15.174:0/2741375045 >> 172.21.15.174:0/2741375045 conn(0x7f35ac0fbda0 msgr2=0x7f35ac0fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:35.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.059+0000 7f35b26d2640 1 -- 172.21.15.174:0/2741375045 shutdown_connections 2024-09-19T05:59:35.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:59:35.059+0000 7f35b26d2640 1 -- 172.21.15.174:0/2741375045 wait complete. 2024-09-19T05:59:35.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:35 smithi169 ceph-mon[34350]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T05:59:35.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:35 smithi169 ceph-mon[34350]: Reconfiguring daemon mon.a on smithi103 2024-09-19T05:59:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:35 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:35.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:35 smithi103 ceph-mon[30925]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T05:59:35.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:35 smithi103 ceph-mon[30925]: Reconfiguring daemon mon.a on smithi103 2024-09-19T05:59:35.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:35 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:35.622 DEBUG:teuthology.orchestra.run.smithi169:mgr.y> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T05:59:35.625 DEBUG:teuthology.orchestra.run.smithi174:mgr.z> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T05:59:35.627 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T05:59:35.627 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:59:35.628 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:59:35.647 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:59:35.648 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-19T05:59:35.707 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:59:35.708 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:35.708 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T05:59:35.708 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:35.708 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:35.708 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-19 05:58:56.573867037 +0000 2024-09-19T05:59:35.708 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-19 05:54:41.484105972 +0000 2024-09-19T05:59:35.708 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-19 05:54:41.484105972 +0000 2024-09-19T05:59:35.708 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-19 05:54:41.484105972 +0000 2024-09-19T05:59:35.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:59:35.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 05:59:35 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T05:59:35.335+0000 7fe336d69640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T05:59:35.772 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-19T05:59:35.773 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-19T05:59:35.773 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000304138 s, 1.7 MB/s 2024-09-19T05:59:35.774 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:59:35.834 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-19T05:59:35.892 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:59:35.892 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:35.892 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T05:59:35.892 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:35.892 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:35.893 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-19 05:58:56.608866339 +0000 2024-09-19T05:59:35.893 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-19 05:54:41.822099205 +0000 2024-09-19T05:59:35.893 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-19 05:54:41.822099205 +0000 2024-09-19T05:59:35.893 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-19 05:54:41.822099205 +0000 2024-09-19T05:59:35.893 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:59:35.958 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-19T05:59:35.959 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-19T05:59:35.959 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000237529 s, 2.2 MB/s 2024-09-19T05:59:35.960 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:59:36.019 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-19T05:59:36.077 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:59:36.078 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:36.078 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T05:59:36.078 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:36.078 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:36.078 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-19 05:58:56.641865681 +0000 2024-09-19T05:59:36.078 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-19 05:54:42.139092859 +0000 2024-09-19T05:59:36.078 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-19 05:54:42.139092859 +0000 2024-09-19T05:59:36.078 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-19 05:54:42.139092859 +0000 2024-09-19T05:59:36.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:59:36.144 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-19T05:59:36.145 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-19T05:59:36.145 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000201089 s, 2.5 MB/s 2024-09-19T05:59:36.146 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:59:36.205 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-19T05:59:36.262 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:59:36.263 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:36.263 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T05:59:36.263 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:36.263 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:36.263 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-19 05:58:56.674865023 +0000 2024-09-19T05:59:36.263 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-19 05:54:42.484085953 +0000 2024-09-19T05:59:36.263 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-19 05:54:42.484085953 +0000 2024-09-19T05:59:36.263 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-19 05:54:42.484085953 +0000 2024-09-19T05:59:36.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi169=y;smithi174=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: Saving service mgr spec with placement smithi103=x;smithi169=y;smithi174=z;count:3 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: Reconfiguring daemon mon.b on smithi169 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:36.314 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:36 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi169=y;smithi174=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: Saving service mgr spec with placement smithi103=x;smithi169=y;smithi174=z;count:3 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: Reconfiguring daemon mon.b on smithi169 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:36.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:36 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.329 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-19T05:59:36.329 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-19T05:59:36.329 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000201996 s, 2.5 MB/s 2024-09-19T05:59:36.330 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:59:36.387 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T05:59:36.388 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:59:36.404 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:59:36.404 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-09-19T05:59:36.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:59:36.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi169=y;smithi174=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:36.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:36.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: Saving service mgr spec with placement smithi103=x;smithi169=y;smithi174=z;count:3 2024-09-19T05:59:36.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:59:36.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:36.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: Reconfiguring daemon mon.b on smithi169 2024-09-19T05:59:36.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:36.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:36 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:36.460 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:59:36.460 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:36.460 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T05:59:36.460 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:36.460 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:36.460 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 05:59:25.798067817 +0000 2024-09-19T05:59:36.460 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 05:54:43.252149298 +0000 2024-09-19T05:59:36.460 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 05:54:43.252149298 +0000 2024-09-19T05:59:36.461 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 05:54:43.252149298 +0000 2024-09-19T05:59:36.461 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:59:36.526 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T05:59:36.526 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T05:59:36.526 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000256393 s, 2.0 MB/s 2024-09-19T05:59:36.527 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:59:36.584 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-09-19T05:59:36.639 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:59:36.639 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:36.640 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T05:59:36.640 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:36.640 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:36.640 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 05:59:25.798067817 +0000 2024-09-19T05:59:36.640 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 05:54:43.584142365 +0000 2024-09-19T05:59:36.640 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 05:54:43.584142365 +0000 2024-09-19T05:59:36.640 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 05:54:43.584142365 +0000 2024-09-19T05:59:36.640 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:59:36.702 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T05:59:36.703 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T05:59:36.703 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000224068 s, 2.3 MB/s 2024-09-19T05:59:36.704 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:59:36.761 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-09-19T05:59:36.815 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:59:36.815 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:36.816 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T05:59:36.816 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:36.816 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:36.816 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 05:59:25.799067796 +0000 2024-09-19T05:59:36.816 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 05:54:43.920135348 +0000 2024-09-19T05:59:36.816 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 05:54:43.920135348 +0000 2024-09-19T05:59:36.816 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 05:54:43.920135348 +0000 2024-09-19T05:59:36.816 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:59:36.879 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T05:59:36.879 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T05:59:36.879 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000197463 s, 2.6 MB/s 2024-09-19T05:59:36.880 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:59:36.936 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-09-19T05:59:36.991 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:59:36.992 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:36.992 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T05:59:36.992 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:36.992 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:36.992 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 05:59:25.799067796 +0000 2024-09-19T05:59:36.992 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 05:54:44.273127977 +0000 2024-09-19T05:59:36.992 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 05:54:44.273127977 +0000 2024-09-19T05:59:36.992 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 05:54:44.273127977 +0000 2024-09-19T05:59:36.992 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:59:37.054 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T05:59:37.055 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T05:59:37.055 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000215698 s, 2.4 MB/s 2024-09-19T05:59:37.056 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:59:37.112 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:59:37.113 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:59:37.129 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:59:37.130 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-09-19T05:59:37.185 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:59:37.186 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:37.186 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T05:59:37.186 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:37.186 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:37.186 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-19 05:59:16.880349626 +0000 2024-09-19T05:59:37.186 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-19 05:54:42.708177825 +0000 2024-09-19T05:59:37.186 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-19 05:54:42.708177825 +0000 2024-09-19T05:59:37.186 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-19 05:54:42.708177825 +0000 2024-09-19T05:59:37.186 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:59:37.249 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-19T05:59:37.249 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-19T05:59:37.249 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000350914 s, 1.5 MB/s 2024-09-19T05:59:37.250 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:59:37.307 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-09-19T05:59:37.363 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:59:37.363 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:37.363 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T05:59:37.363 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:37.363 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:37.363 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-19 05:59:16.881349613 +0000 2024-09-19T05:59:37.363 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-19 05:54:43.033173559 +0000 2024-09-19T05:59:37.363 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-19 05:54:43.033173559 +0000 2024-09-19T05:59:37.364 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-19 05:54:43.033173559 +0000 2024-09-19T05:59:37.364 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:59:37.426 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-19T05:59:37.427 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-19T05:59:37.427 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000192995 s, 2.7 MB/s 2024-09-19T05:59:37.428 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:59:37.484 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-09-19T05:59:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:59:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:37.542 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T05:59:37.542 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:37.542 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:37.542 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-19 05:59:16.881349613 +0000 2024-09-19T05:59:37.542 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-19 05:54:43.361169254 +0000 2024-09-19T05:59:37.543 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-19 05:54:43.361169254 +0000 2024-09-19T05:59:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-19 05:54:43.361169254 +0000 2024-09-19T05:59:37.543 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:59:37.606 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-19T05:59:37.606 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-19T05:59:37.606 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000194952 s, 2.6 MB/s 2024-09-19T05:59:37.607 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:59:37.663 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-09-19T05:59:37.701 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:37 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:37.702 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:37 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:37.702 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:37 smithi174 ceph-mon[34488]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:59:37.702 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:37 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:37.702 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:37 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:59:37.702 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:37 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:37.702 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:37 smithi174 ceph-mon[34488]: Reconfiguring daemon mon.c on smithi174 2024-09-19T05:59:37.717 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:59:37.717 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:59:37.717 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T05:59:37.717 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:59:37.717 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:59:37.718 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-19 05:59:16.881349613 +0000 2024-09-19T05:59:37.718 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-19 05:54:43.701164791 +0000 2024-09-19T05:59:37.718 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-19 05:54:43.701164791 +0000 2024-09-19T05:59:37.718 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-19 05:54:43.701164791 +0000 2024-09-19T05:59:37.718 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:59:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:37 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:37 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:37 smithi103 ceph-mon[30925]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:59:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:37 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:37 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:59:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:37 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:37 smithi103 ceph-mon[30925]: Reconfiguring daemon mon.c on smithi174 2024-09-19T05:59:37.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:37 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:37.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:37 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:37.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:37 smithi169 ceph-mon[34350]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:59:37.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:37 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:59:37.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:37 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:59:37.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:37 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:37.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:37 smithi169 ceph-mon[34350]: Reconfiguring daemon mon.c on smithi174 2024-09-19T05:59:37.781 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-19T05:59:37.781 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-19T05:59:37.781 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000189307 s, 2.7 MB/s 2024-09-19T05:59:37.783 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:59:37.838 INFO:tasks.cephadm:Deploying osd.0 on smithi103 with /dev/vg_nvme/lv_4... 2024-09-19T05:59:37.838 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T05:59:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:59:38.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:38.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:38.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:38.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:38.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:38.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:38.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:38.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:59:38.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:59:38.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:59:38.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:38.476 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:38.476 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:38.476 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:38.476 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:38.476 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:38.477 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:38.477 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:38.477 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:59:38.477 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:59:38.477 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:59:38.477 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:38.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:38.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:59:38.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:59:38.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:59:38.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:39.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:39 smithi174 ceph-mon[34488]: Deploying daemon mgr.z on smithi174 2024-09-19T05:59:39.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:39 smithi103 ceph-mon[30925]: Deploying daemon mgr.z on smithi174 2024-09-19T05:59:39.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:39 smithi169 ceph-mon[34350]: Deploying daemon mgr.z on smithi174 2024-09-19T05:59:40.191 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:40.189+0000 7f71b544f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:59:40.424 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:59:40.449 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_4 2024-09-19T05:59:40.454 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:40.255+0000 7f71b544f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:59:40.454 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:40.404+0000 7f71b544f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:59:40.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-mon[34488]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:40.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:40.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:40.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:40.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:59:40.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:59:40.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:59:40.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:40.472 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:40 smithi103 ceph-mon[30925]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:40.472 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:40.472 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:40.472 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:40.472 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:59:40.473 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:59:40.473 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:59:40.473 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:40.676 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:40 smithi169 ceph-mon[34350]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:40.676 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:40.676 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:40.676 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:40.676 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:59:40.676 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:59:40.676 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:59:40.677 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:40.692 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:59:40.861 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:40.545+0000 7f71b544f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:59:40.861 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:40.859+0000 7f71b544f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:59:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.170+0000 7fa397c20640 1 -- 172.21.15.103:0/3478413280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa390101cd0 msgr2=0x7fa390102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.170+0000 7fa397c20640 1 --2- 172.21.15.103:0/3478413280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa390101cd0 0x7fa390102150 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa380009900 tx=0x7fa38002a410 comp rx=0 tx=0).stop 2024-09-19T05:59:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 -- 172.21.15.103:0/3478413280 shutdown_connections 2024-09-19T05:59:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 --2- 172.21.15.103:0/3478413280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa390102690 0x7fa390108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 --2- 172.21.15.103:0/3478413280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa390101cd0 0x7fa390102150 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 --2- 172.21.15.103:0/3478413280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa390100ad0 0x7fa390100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 -- 172.21.15.103:0/3478413280 >> 172.21.15.103:0/3478413280 conn(0x7fa3900fc280 msgr2=0x7fa3900fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 -- 172.21.15.103:0/3478413280 shutdown_connections 2024-09-19T05:59:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 -- 172.21.15.103:0/3478413280 wait complete. 2024-09-19T05:59:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 Processor -- start 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 -- start start 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa390100ad0 0x7fa390104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa390101cd0 0x7fa3901030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa390102690 0x7fa3901035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa39010c600 con 0x7fa390102690 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa39010c480 con 0x7fa390100ad0 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa397c20640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa39010c780 con 0x7fa390101cd0 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.171+0000 7fa3961bd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa390102690 0x7fa3901035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3961bd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa390102690 0x7fa3901035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48616/0 (socket says 172.21.15.103:48616) 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3961bd640 1 -- 172.21.15.103:0/3505409085 learned_addr learned my addr 172.21.15.103:0/3505409085 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3951bb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa390101cd0 0x7fa3901030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3959bc640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa390100ad0 0x7fa390104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3961bd640 1 -- 172.21.15.103:0/3505409085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa390101cd0 msgr2=0x7fa3901030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3961bd640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa390101cd0 0x7fa3901030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3961bd640 1 -- 172.21.15.103:0/3505409085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa390100ad0 msgr2=0x7fa390104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3961bd640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa390100ad0 0x7fa390104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3961bd640 1 -- 172.21.15.103:0/3505409085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa390103eb0 con 0x7fa390102690 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3951bb640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa390101cd0 0x7fa3901030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa3961bd640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa390102690 0x7fa3901035f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa388009fd0 tx=0x7fa38800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa386ffd640 1 -- 172.21.15.103:0/3505409085 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388017070 con 0x7fa390102690 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa397c20640 1 -- 172.21.15.103:0/3505409085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3901a20a0 con 0x7fa390102690 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa386ffd640 1 -- 172.21.15.103:0/3505409085 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa388003e20 con 0x7fa390102690 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa386ffd640 1 -- 172.21.15.103:0/3505409085 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388010460 con 0x7fa390102690 2024-09-19T05:59:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.172+0000 7fa397c20640 1 -- 172.21.15.103:0/3505409085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3901a2560 con 0x7fa390102690 2024-09-19T05:59:41.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.173+0000 7fa386ffd640 1 -- 172.21.15.103:0/3505409085 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fa388003970 con 0x7fa390102690 2024-09-19T05:59:41.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.173+0000 7fa397c20640 1 -- 172.21.15.103:0/3505409085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3901a2790 con 0x7fa390102690 2024-09-19T05:59:41.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.173+0000 7fa386ffd640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa37c0394d0 0x7fa37c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:41.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.173+0000 7fa386ffd640 1 -- 172.21.15.103:0/3505409085 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa38804c520 con 0x7fa390102690 2024-09-19T05:59:41.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.174+0000 7fa3959bc640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa37c0394d0 0x7fa37c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:41.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.174+0000 7fa3959bc640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa37c0394d0 0x7fa37c03b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa390101b30 tx=0x7fa38c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:41.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.178+0000 7fa386ffd640 1 -- 172.21.15.103:0/3505409085 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa38800e350 con 0x7fa390102690 2024-09-19T05:59:41.204 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:40 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:40.919+0000 7f71b544f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:59:41.204 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:41 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:41.104+0000 7f71b544f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:59:41.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:41.352+0000 7fa397c20640 1 -- 172.21.15.103:0/3505409085 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa39006a710 con 0x7fa37c0394d0 2024-09-19T05:59:41.558 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:41 smithi169 ceph-mon[34350]: Deploying daemon mgr.y on smithi169 2024-09-19T05:59:41.558 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:41 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:41.558 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:41 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:41.558 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:41 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:41.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:41 smithi174 ceph-mon[34488]: Deploying daemon mgr.y on smithi169 2024-09-19T05:59:41.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:41 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:41.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:41 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:41.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:41 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:41.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:41 smithi103 ceph-mon[30925]: Deploying daemon mgr.y on smithi169 2024-09-19T05:59:41.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:41 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:41.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:41 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:41.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:41 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:41.943 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:41 smithi169 systemd[1]: Starting Ceph mgr.y for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T05:59:42.196 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:41 smithi169 podman[35700]: 2024-09-19 05:59:41.844684665 +0000 UTC m=+0.016221500 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:59:42.196 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:41 smithi169 podman[35700]: 2024-09-19 05:59:41.955821963 +0000 UTC m=+0.127358779 container create 9fb5c9b079c891f9f70834ad9b4781678d68eabf7a094dca4a3835e4b04856a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T05:59:42.196 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 podman[35700]: 2024-09-19 05:59:42.1668423 +0000 UTC m=+0.338379128 container init 9fb5c9b079c891f9f70834ad9b4781678d68eabf7a094dca4a3835e4b04856a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T05:59:42.197 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 podman[35700]: 2024-09-19 05:59:42.170296014 +0000 UTC m=+0.341832833 container start 9fb5c9b079c891f9f70834ad9b4781678d68eabf7a094dca4a3835e4b04856a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:59:42.384 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:41 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:41.977+0000 7f71b544f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:59:42.384 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:42 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:42.043+0000 7f71b544f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:59:42.513 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-mon[34350]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:42.513 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-mon[34350]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:42.513 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.514 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.514 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.514 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.514 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-mgr[35719]: -- 172.21.15.169:0/768048169 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56302b4fd0e0 con 0x56302b4da800 2024-09-19T05:59:42.514 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 bash[35700]: 9fb5c9b079c891f9f70834ad9b4781678d68eabf7a094dca4a3835e4b04856a0 2024-09-19T05:59:42.514 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 systemd[1]: Started Ceph mgr.y for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T05:59:42.514 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:42.292+0000 7f075f801040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:59:42.514 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:42.352+0000 7f075f801040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:59:42.514 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:42.511+0000 7f075f801040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:59:42.681 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:42 smithi103 ceph-mon[30925]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:42.681 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:42 smithi103 ceph-mon[30925]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:42.681 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.681 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.681 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.681 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:42 smithi174 ceph-mon[34488]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:42 smithi174 ceph-mon[34488]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:42.777 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:42.580+0000 7f075f801040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:59:42.777 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:42.751+0000 7f075f801040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:59:43.073 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:42 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:42.807+0000 7f71b544f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:59:43.073 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:42 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:42.926+0000 7f71b544f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:59:43.073 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.071+0000 7f71b544f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:59:43.231 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:42 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:42.905+0000 7f075f801040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:59:43.231 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:43 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:43.229+0000 7f075f801040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:59:43.363 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.136+0000 7f71b544f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:59:43.363 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.292+0000 7f71b544f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:59:43.363 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.361+0000 7f71b544f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:59:43.487 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:43 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:43.488 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:43 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:43.291+0000 7f075f801040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:59:43.660 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:43.660 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.422+0000 7f71b544f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:59:43.660 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.589+0000 7f71b544f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:59:43.661 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.657+0000 7f71b544f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:59:43.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:43 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:43.777 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:43 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:43.485+0000 7f075f801040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:59:43.926 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.724+0000 7f71b544f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:59:43.926 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.806+0000 7f71b544f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:59:43.926 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.864+0000 7f71b544f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:59:43.926 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:43.923+0000 7f71b544f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:59:44.777 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:44.364+0000 7f075f801040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:59:44.778 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:44.430+0000 7f075f801040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:59:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3656138764' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd4c0151-c2ca-486c-b60a-50a235f0d10b"}]: dispatch 2024-09-19T05:59:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3656138764' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd4c0151-c2ca-486c-b60a-50a235f0d10b"}]': finished 2024-09-19T05:59:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:59:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:59:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:59:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:59:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:44 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1336835194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:44.954 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T05:59:44.704+0000 7f71b544f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:59:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3656138764' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd4c0151-c2ca-486c-b60a-50a235f0d10b"}]: dispatch 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3656138764' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd4c0151-c2ca-486c-b60a-50a235f0d10b"}]': finished 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:44.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:44 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1336835194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3656138764' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd4c0151-c2ca-486c-b60a-50a235f0d10b"}]: dispatch 2024-09-19T05:59:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3656138764' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd4c0151-c2ca-486c-b60a-50a235f0d10b"}]': finished 2024-09-19T05:59:44.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:59:44.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:59:44.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:59:44.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:59:44.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:44.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:44 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1336835194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:45.394 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:45.137+0000 7f075f801040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:59:45.395 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:45.252+0000 7f075f801040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:59:45.395 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:45.393+0000 7f075f801040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:59:45.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:45.529+0000 7fa386ffd640 1 -- 172.21.15.103:0/3505409085 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 14) ==== 92409+0+0 (secure 0 0 0) 0x7fa388019310 con 0x7fa390102690 2024-09-19T05:59:45.672 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:45.454+0000 7f075f801040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:59:45.672 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:45.602+0000 7f075f801040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:59:45.672 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:45.670+0000 7f075f801040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:59:45.672 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-mon[34350]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:59:45.672 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-mon[34350]: Reconfiguring daemon mgr.x on smithi103 2024-09-19T05:59:45.672 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-mon[34350]: Standby manager daemon z started 2024-09-19T05:59:45.672 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:59:45.673 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:59:45.673 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:59:45.673 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:59:45.673 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:45.951 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:45.729+0000 7f075f801040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:59:45.951 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:45.885+0000 7f075f801040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:59:45.951 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:45.949+0000 7f075f801040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:59:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:45 smithi174 ceph-mon[34488]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:59:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:45 smithi174 ceph-mon[34488]: Reconfiguring daemon mgr.x on smithi103 2024-09-19T05:59:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:45 smithi174 ceph-mon[34488]: Standby manager daemon z started 2024-09-19T05:59:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:45 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:59:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:45 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:59:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:45 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:59:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:45 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:59:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:45 smithi103 ceph-mon[30925]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:59:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:45 smithi103 ceph-mon[30925]: Reconfiguring daemon mgr.x on smithi103 2024-09-19T05:59:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:45 smithi103 ceph-mon[30925]: Standby manager daemon z started 2024-09-19T05:59:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:45 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:59:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:45 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:59:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:45 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:59:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:45 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.174:0/2326534010' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:59:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:46.215 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:46 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:46.014+0000 7f075f801040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:59:46.215 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:46 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:46.096+0000 7f075f801040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:59:46.215 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:46 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:46.154+0000 7f075f801040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:59:46.215 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:46 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:46.213+0000 7f075f801040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:59:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:46 smithi174 ceph-mon[34488]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:46 smithi174 ceph-mon[34488]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-19T05:59:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:59:46.993 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:46 smithi169 ceph-mon[34350]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:46.993 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:46 smithi169 ceph-mon[34350]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-19T05:59:46.993 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:59:46.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:46 smithi103 ceph-mon[30925]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:46.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:46 smithi103 ceph-mon[30925]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-19T05:59:46.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:59:47.277 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 05:59:46 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T05:59:46.991+0000 7f075f801040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:59:47.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:59:47.535+0000 7fa386ffd640 1 -- 172.21.15.103:0/3505409085 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7fa388022bc0 con 0x7fa390102690 2024-09-19T05:59:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:47 smithi174 ceph-mon[34488]: Standby manager daemon y started 2024-09-19T05:59:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:47 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:59:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:47 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:59:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:47 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:59:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:47 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:59:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:47 smithi103 ceph-mon[30925]: Standby manager daemon y started 2024-09-19T05:59:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:47 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:59:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:47 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:59:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:47 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:59:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:47 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:59:48.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:47 smithi169 ceph-mon[34350]: Standby manager daemon y started 2024-09-19T05:59:48.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:47 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:59:48.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:47 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:59:48.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:47 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:59:48.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:47 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.169:0/4052069271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:59:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:48 smithi103 ceph-mon[30925]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:48 smithi103 ceph-mon[30925]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T05:59:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:59:48.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:48 smithi174 ceph-mon[34488]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:48.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:48 smithi174 ceph-mon[34488]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T05:59:48.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:59:49.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:48 smithi169 ceph-mon[34350]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:49.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:48 smithi169 ceph-mon[34350]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T05:59:49.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:59:50.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:50 smithi174 ceph-mon[34488]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:50.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:50 smithi103 ceph-mon[30925]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:51.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:50 smithi169 ceph-mon[34350]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:52.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:52.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:52.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:52.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:52 smithi174 ceph-mon[34488]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:52.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:52.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:52.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:52.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:52.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:52.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:52.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:52 smithi103 ceph-mon[30925]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:52.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:52.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:52.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:52.527 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:52.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:52.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:52.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:52 smithi169 ceph-mon[34350]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:52.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:52.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:52.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T05:59:53.445 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:53 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:59:53.445 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:53 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:53.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:53 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:59:53.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:53 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:53.527 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:53 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:59:53.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:53 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:54.448 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:54 smithi169 ceph-mon[34350]: Deploying daemon osd.0 on smithi103 2024-09-19T05:59:54.449 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:54 smithi169 ceph-mon[34350]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:54.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:54 smithi174 ceph-mon[34488]: Deploying daemon osd.0 on smithi103 2024-09-19T05:59:54.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:54 smithi174 ceph-mon[34488]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:54.493 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:54 smithi103 ceph-mon[30925]: Deploying daemon osd.0 on smithi103 2024-09-19T05:59:54.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:54 smithi103 ceph-mon[30925]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:56.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:56 smithi103 ceph-mon[30925]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:56.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:56 smithi174 ceph-mon[34488]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:56.781 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:56 smithi169 ceph-mon[34350]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:58.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 05:59:58 smithi103 ceph-mon[30925]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 05:59:58 smithi169 ceph-mon[34350]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:59:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 05:59:58 smithi174 ceph-mon[34488]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:00.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:00 smithi103 ceph-mon[30925]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:00.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:00 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:00.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:00 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:00.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:00 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:00.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:00 smithi103 ceph-mon[30925]: overall HEALTH_OK 2024-09-19T06:00:00.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:00 smithi169 ceph-mon[34350]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:00.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:00 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:00.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:00 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:00.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:00 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:00.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:00 smithi169 ceph-mon[34350]: overall HEALTH_OK 2024-09-19T06:00:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:00 smithi174 ceph-mon[34488]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:00 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:00 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:00 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:00 smithi174 ceph-mon[34488]: overall HEALTH_OK 2024-09-19T06:00:02.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:02 smithi103 ceph-mon[30925]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:02.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:02.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:02.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:02.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:02.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:02.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:02 smithi169 ceph-mon[34350]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:02.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:02.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:02.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:02.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:02.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:02 smithi174 ceph-mon[34488]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:03.278 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 0 on host 'smithi103' 2024-09-19T06:00:03.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.275+0000 7fa386ffd640 1 -- 172.21.15.103:0/3505409085 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa39006a710 con 0x7fa37c0394d0 2024-09-19T06:00:03.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.278+0000 7fa397c20640 1 -- 172.21.15.103:0/3505409085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa37c0394d0 msgr2=0x7fa37c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:03.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.278+0000 7fa397c20640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa37c0394d0 0x7fa37c03b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa390101b30 tx=0x7fa38c005f90 comp rx=0 tx=0).stop 2024-09-19T06:00:03.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.278+0000 7fa397c20640 1 -- 172.21.15.103:0/3505409085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa390102690 msgr2=0x7fa3901035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:03.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.278+0000 7fa397c20640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa390102690 0x7fa3901035f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa388009fd0 tx=0x7fa38800b260 comp rx=0 tx=0).stop 2024-09-19T06:00:03.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.279+0000 7fa397c20640 1 -- 172.21.15.103:0/3505409085 shutdown_connections 2024-09-19T06:00:03.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.279+0000 7fa397c20640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa37c0394d0 0x7fa37c03b990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:03.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.279+0000 7fa397c20640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa390102690 0x7fa3901035f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:03.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.279+0000 7fa397c20640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa390101cd0 0x7fa3901030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:03.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.279+0000 7fa397c20640 1 --2- 172.21.15.103:0/3505409085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa390100ad0 0x7fa390104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:03.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.279+0000 7fa397c20640 1 -- 172.21.15.103:0/3505409085 >> 172.21.15.103:0/3505409085 conn(0x7fa3900fc280 msgr2=0x7fa39006a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:00:03.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.279+0000 7fa397c20640 1 -- 172.21.15.103:0/3505409085 shutdown_connections 2024-09-19T06:00:03.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:03.279+0000 7fa397c20640 1 -- 172.21.15.103:0/3505409085 wait complete. 2024-09-19T06:00:03.492 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:03.492 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:03.492 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:03.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:03.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:03.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:03.942 DEBUG:teuthology.orchestra.run.smithi103:osd.0> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T06:00:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:03.985 INFO:tasks.cephadm:Deploying osd.1 on smithi169 with /dev/vg_nvme/lv_4... 2024-09-19T06:00:03.985 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:00:04.243 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:00:04.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:04 smithi103 ceph-mon[30925]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:04.649 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:04 smithi169 ceph-mon[34350]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:04 smithi174 ceph-mon[34488]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:05.745 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:00:05 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0[45213]: 2024-09-19T06:00:05.556+0000 7ffbdbbb7640 -1 osd.0 0 log_to_monitors true 2024-09-19T06:00:06.562 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:00:06.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_4 2024-09-19T06:00:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:06 smithi103 ceph-mon[30925]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:06 smithi103 ceph-mon[30925]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:00:06.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:06 smithi169 ceph-mon[34350]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:06.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:06 smithi169 ceph-mon[34350]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:00:06.841 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:00:06.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:06 smithi174 ceph-mon[34488]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:06.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:06 smithi174 ceph-mon[34488]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:00:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 -- 172.21.15.169:0/161215551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c40104f90 msgr2=0x7f3c40107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 --2- 172.21.15.169:0/161215551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c40104f90 0x7f3c40107380 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009900 tx=0x7f3c2c02a410 comp rx=0 tx=0).stop 2024-09-19T06:00:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 -- 172.21.15.169:0/161215551 shutdown_connections 2024-09-19T06:00:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 --2- 172.21.15.169:0/161215551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c401078c0 0x7f3c40109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 --2- 172.21.15.169:0/161215551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c40104f90 0x7f3c40107380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 --2- 172.21.15.169:0/161215551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c40102660 0x7f3c40104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 -- 172.21.15.169:0/161215551 >> 172.21.15.169:0/161215551 conn(0x7f3c400fc280 msgr2=0x7f3c400fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:00:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 -- 172.21.15.169:0/161215551 shutdown_connections 2024-09-19T06:00:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 -- 172.21.15.169:0/161215551 wait complete. 2024-09-19T06:00:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 Processor -- start 2024-09-19T06:00:07.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.288+0000 7f3c46fb1640 1 -- start start 2024-09-19T06:00:07.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c46fb1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c40102660 0x7f3c40197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:07.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c46fb1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c40104f90 0x7f3c401983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:07.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c46fb1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c401078c0 0x7f3c4019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:07.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c46fb1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4010d6f0 con 0x7f3c401078c0 2024-09-19T06:00:07.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c46fb1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4010d570 con 0x7f3c40104f90 2024-09-19T06:00:07.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c46fb1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4010d870 con 0x7f3c40102660 2024-09-19T06:00:07.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c3ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c40104f90 0x7f3c401983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:07.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c3ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c40104f90 0x7f3c401983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:42686/0 (socket says 172.21.15.169:42686) 2024-09-19T06:00:07.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c3ffff640 1 -- 172.21.15.169:0/3865796104 learned_addr learned my addr 172.21.15.169:0/3865796104 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:00:07.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c44d4d640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c40102660 0x7f3c40197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:07.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c4554e640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c401078c0 0x7f3c4019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:07.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c3ffff640 1 -- 172.21.15.169:0/3865796104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c40102660 msgr2=0x7f3c40197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:07.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c3ffff640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c40102660 0x7f3c40197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:07.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c3ffff640 1 -- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c401078c0 msgr2=0x7f3c4019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:07.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c3ffff640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c401078c0 0x7f3c4019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:07.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c3ffff640 1 -- 172.21.15.169:0/3865796104 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4019faa0 con 0x7f3c40104f90 2024-09-19T06:00:07.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c4554e640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c401078c0 0x7f3c4019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:00:07.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c3ffff640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c40104f90 0x7f3c401983b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0314e0 tx=0x7f3c2c0042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:00:07.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.289+0000 7f3c3dffb640 1 -- 172.21.15.169:0/3865796104 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c03f030 con 0x7f3c40104f90 2024-09-19T06:00:07.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.290+0000 7f3c46fb1640 1 -- 172.21.15.169:0/3865796104 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4019fd30 con 0x7f3c40104f90 2024-09-19T06:00:07.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.290+0000 7f3c3dffb640 1 -- 172.21.15.169:0/3865796104 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c2c003cb0 con 0x7f3c40104f90 2024-09-19T06:00:07.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.290+0000 7f3c3dffb640 1 -- 172.21.15.169:0/3865796104 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c035070 con 0x7f3c40104f90 2024-09-19T06:00:07.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.290+0000 7f3c46fb1640 1 -- 172.21.15.169:0/3865796104 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c401a01b0 con 0x7f3c40104f90 2024-09-19T06:00:07.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.291+0000 7f3c46fb1640 1 -- 172.21.15.169:0/3865796104 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c400fdd70 con 0x7f3c40104f90 2024-09-19T06:00:07.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.292+0000 7f3c3dffb640 1 -- 172.21.15.169:0/3865796104 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f3c2c042030 con 0x7f3c40104f90 2024-09-19T06:00:07.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.293+0000 7f3c3dffb640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3c300a31e0 0x7f3c300a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.293+0000 7f3c3dffb640 1 -- 172.21.15.169:0/3865796104 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1361+0+0 (secure 0 0 0) 0x7f3c2c0ee290 con 0x7f3c40104f90 2024-09-19T06:00:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.293+0000 7f3c44d4d640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3c300a31e0 0x7f3c300a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.294+0000 7f3c44d4d640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3c300a31e0 0x7f3c300a56a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400bbe0 tx=0x7f3c3400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:00:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.301+0000 7f3c3dffb640 1 -- 172.21.15.169:0/3865796104 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3c2c0bcbb0 con 0x7f3c40104f90 2024-09-19T06:00:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:07.483+0000 7f3c46fb1640 1 -- 172.21.15.169:0/3865796104 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3c40062630 con 0x7f3c300a31e0 2024-09-19T06:00:07.744 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0[45213]: 2024-09-19T06:00:07.494+0000 7ffbd7317640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T06:00:07.744 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0[45213]: 2024-09-19T06:00:07.498+0000 7ffbd3951640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:00:07.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:00:07.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:00:07.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:00:07.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:07.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:07.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:07.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:07.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:07.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:00:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:00:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:00:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:07.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:07.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:07.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:07.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:07.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:08 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi103 2024-09-19T06:00:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:08 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi103 to 17088M 2024-09-19T06:00:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:08 smithi169 ceph-mon[34350]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:08 smithi169 ceph-mon[34350]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:08 smithi169 ceph-mon[34350]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:00:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:08 smithi169 ceph-mon[34350]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:00:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:08.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:08.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:08 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi103 2024-09-19T06:00:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:08 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi103 to 17088M 2024-09-19T06:00:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:08 smithi174 ceph-mon[34488]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:08 smithi174 ceph-mon[34488]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:08 smithi174 ceph-mon[34488]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:00:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:08 smithi174 ceph-mon[34488]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:00:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:08 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi103 2024-09-19T06:00:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:08 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi103 to 17088M 2024-09-19T06:00:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:08 smithi103 ceph-mon[30925]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:08 smithi103 ceph-mon[30925]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:08 smithi103 ceph-mon[30925]: from='osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:00:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:08 smithi103 ceph-mon[30925]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:00:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:08.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:09 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:00:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:09 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:00:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:09 smithi169 ceph-mon[34350]: osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] boot 2024-09-19T06:00:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:09 smithi169 ceph-mon[34350]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:00:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:09.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:09 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:00:09.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:09 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:00:09.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:09.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:09 smithi174 ceph-mon[34488]: osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] boot 2024-09-19T06:00:09.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:09 smithi174 ceph-mon[34488]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:00:09.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:09 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:00:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:09 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:00:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:09 smithi103 ceph-mon[30925]: osd.0 [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] boot 2024-09-19T06:00:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:09 smithi103 ceph-mon[30925]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:00:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:00:10.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:10 smithi169 ceph-mon[34350]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:10 smithi169 ceph-mon[34350]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:00:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:10 smithi169 ceph-mon[34350]: from='client.? 172.21.15.169:0/2604747932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5"}]: dispatch 2024-09-19T06:00:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:10 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5"}]: dispatch 2024-09-19T06:00:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:10 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5"}]': finished 2024-09-19T06:00:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:10 smithi169 ceph-mon[34350]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:00:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:10 smithi169 ceph-mon[34350]: from='client.? 172.21.15.169:0/2611964135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:10 smithi174 ceph-mon[34488]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:10 smithi174 ceph-mon[34488]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:00:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:10 smithi174 ceph-mon[34488]: from='client.? 172.21.15.169:0/2604747932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5"}]: dispatch 2024-09-19T06:00:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:10 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5"}]: dispatch 2024-09-19T06:00:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:10 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5"}]': finished 2024-09-19T06:00:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:10 smithi174 ceph-mon[34488]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:00:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:10.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:10 smithi174 ceph-mon[34488]: from='client.? 172.21.15.169:0/2611964135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:10 smithi103 ceph-mon[30925]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:00:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:10 smithi103 ceph-mon[30925]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:00:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:10 smithi103 ceph-mon[30925]: from='client.? 172.21.15.169:0/2604747932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5"}]: dispatch 2024-09-19T06:00:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:10 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5"}]: dispatch 2024-09-19T06:00:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:10 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5"}]': finished 2024-09-19T06:00:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:10 smithi103 ceph-mon[30925]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:00:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:10 smithi103 ceph-mon[30925]: from='client.? 172.21.15.169:0/2611964135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:12.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:12 smithi169 ceph-mon[34350]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:12.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:12 smithi174 ceph-mon[34488]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:12 smithi103 ceph-mon[30925]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:14.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:14 smithi169 ceph-mon[34350]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:14.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:14 smithi174 ceph-mon[34488]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:14.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:14 smithi103 ceph-mon[30925]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:16.750 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:16 smithi169 ceph-mon[34350]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:16.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:16 smithi174 ceph-mon[34488]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:16.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:16 smithi103 ceph-mon[30925]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:18.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:18 smithi169 ceph-mon[34350]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:18.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:18 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:00:18.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:18 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:18.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:18 smithi174 ceph-mon[34488]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:18.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:18 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:00:18.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:18 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:18.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:18 smithi103 ceph-mon[30925]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:18.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:18 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:00:18.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:18 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:19.713 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:19 smithi169 ceph-mon[34350]: Deploying daemon osd.1 on smithi169 2024-09-19T06:00:19.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:19 smithi174 ceph-mon[34488]: Deploying daemon osd.1 on smithi169 2024-09-19T06:00:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:19 smithi103 ceph-mon[30925]: Deploying daemon osd.1 on smithi169 2024-09-19T06:00:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:20 smithi169 ceph-mon[34350]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:20.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:20 smithi174 ceph-mon[34488]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:20.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:20 smithi103 ceph-mon[30925]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:22.875 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:22 smithi169 ceph-mon[34350]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:22 smithi174 ceph-mon[34488]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:22.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:22 smithi103 ceph-mon[30925]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:24.851 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:24 smithi169 ceph-mon[34350]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:24.852 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:24 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:24.852 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:24 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:24.852 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:24 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:24 smithi174 ceph-mon[34488]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:24 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:24 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:24 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:24.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:24 smithi103 ceph-mon[30925]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:24.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:24 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:24.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:24 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:24.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:24 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:26.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:26 smithi169 ceph-mon[34350]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:26 smithi174 ceph-mon[34488]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:26.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:26 smithi103 ceph-mon[30925]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:27.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:27 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:27.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:27 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:27.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:27 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:27.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:27 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:27.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:27 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:27.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.820+0000 7f3c3dffb640 1 -- 172.21.15.169:0/3865796104 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3c40062630 con 0x7f3c300a31e0 2024-09-19T06:00:27.823 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 1 on host 'smithi169' 2024-09-19T06:00:27.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 -- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3c300a31e0 msgr2=0x7f3c300a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:27.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3c300a31e0 0x7f3c300a56a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400bbe0 tx=0x7f3c3400b390 comp rx=0 tx=0).stop 2024-09-19T06:00:27.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 -- 172.21.15.169:0/3865796104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c40104f90 msgr2=0x7f3c401983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:27.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c40104f90 0x7f3c401983b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0314e0 tx=0x7f3c2c0042e0 comp rx=0 tx=0).stop 2024-09-19T06:00:27.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 -- 172.21.15.169:0/3865796104 shutdown_connections 2024-09-19T06:00:27.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3c300a31e0 0x7f3c300a56a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:27.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c401078c0 0x7f3c4019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:27.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c40104f90 0x7f3c401983b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:27.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 --2- 172.21.15.169:0/3865796104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c40102660 0x7f3c40197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:27.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 -- 172.21.15.169:0/3865796104 >> 172.21.15.169:0/3865796104 conn(0x7f3c400fc280 msgr2=0x7f3c40102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:00:27.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 -- 172.21.15.169:0/3865796104 shutdown_connections 2024-09-19T06:00:27.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:00:27.823+0000 7f3c46fb1640 1 -- 172.21.15.169:0/3865796104 wait complete. 2024-09-19T06:00:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:27 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:27 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:27 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:27 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:27 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:27.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:27 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:27.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:27 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:27.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:27 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:27.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:27 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:27.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:27 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:28.463 DEBUG:teuthology.orchestra.run.smithi169:osd.1> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T06:00:28.465 INFO:tasks.cephadm:Deploying osd.2 on smithi174 with /dev/vg_nvme/lv_4... 2024-09-19T06:00:28.466 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:00:28.718 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:00:28.747 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:28 smithi169 ceph-mon[34350]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:28.747 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:28 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:28.747 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:28 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:28.747 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:28 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:28.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:28 smithi174 ceph-mon[34488]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:28.838 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:28 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:28.838 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:28 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:28.838 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:28 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:28 smithi103 ceph-mon[30925]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:28 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:28 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:28 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:30.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:30 smithi169 ceph-mon[34350]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:30.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:30 smithi169 ceph-mon[34350]: from='osd.1 [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:00:30.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:30 smithi169 ceph-mon[34350]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:00:30.778 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:00:30 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1[38719]: 2024-09-19T06:00:30.392+0000 7f3851eb1640 -1 osd.1 0 log_to_monitors true 2024-09-19T06:00:30.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:30 smithi174 ceph-mon[34488]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:30.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:30 smithi174 ceph-mon[34488]: from='osd.1 [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:00:30.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:30 smithi174 ceph-mon[34488]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:00:30.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:30 smithi103 ceph-mon[30925]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:30.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:30 smithi103 ceph-mon[30925]: from='osd.1 [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:00:30.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:30 smithi103 ceph-mon[30925]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:00:31.001 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T06:00:31.027 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_4 2024-09-19T06:00:31.276 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:00:31.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.709+0000 7f328cef0640 1 -- 172.21.15.174:0/3286440038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3288102690 msgr2=0x7f3288108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:31.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.709+0000 7f328cef0640 1 --2- 172.21.15.174:0/3286440038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3288102690 0x7f3288108f20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3280009ca0 tx=0x7f328002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:00:31.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.710+0000 7f328cef0640 1 -- 172.21.15.174:0/3286440038 shutdown_connections 2024-09-19T06:00:31.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.710+0000 7f328cef0640 1 --2- 172.21.15.174:0/3286440038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3288102690 0x7f3288108f20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:31.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.710+0000 7f328cef0640 1 --2- 172.21.15.174:0/3286440038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3288101cd0 0x7f3288102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:31.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.710+0000 7f328cef0640 1 --2- 172.21.15.174:0/3286440038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288100ad0 0x7f3288100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:31.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.710+0000 7f328cef0640 1 -- 172.21.15.174:0/3286440038 >> 172.21.15.174:0/3286440038 conn(0x7f32880fc280 msgr2=0x7f32880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:00:31.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.710+0000 7f328cef0640 1 -- 172.21.15.174:0/3286440038 shutdown_connections 2024-09-19T06:00:31.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.710+0000 7f328cef0640 1 -- 172.21.15.174:0/3286440038 wait complete. 2024-09-19T06:00:31.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.710+0000 7f328cef0640 1 Processor -- start 2024-09-19T06:00:31.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.710+0000 7f328cef0640 1 -- start start 2024-09-19T06:00:31.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328cef0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3288100ad0 0x7f3288197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:31.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328cef0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288101cd0 0x7f32881982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:31.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328cef0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3288102690 0x7f328819f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:31.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328cef0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f328810c5e0 con 0x7f3288102690 2024-09-19T06:00:31.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328cef0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f328810c460 con 0x7f3288101cd0 2024-09-19T06:00:31.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328cef0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f328810c760 con 0x7f3288100ad0 2024-09-19T06:00:31.717 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328659c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3288100ad0 0x7f3288197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:31.717 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328659c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3288100ad0 0x7f3288197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:49600/0 (socket says 172.21.15.174:49600) 2024-09-19T06:00:31.717 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328659c640 1 -- 172.21.15.174:0/1547011526 learned_addr learned my addr 172.21.15.174:0/1547011526 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T06:00:31.717 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f3285d9b640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288101cd0 0x7f32881982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:31.717 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f3286d9d640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3288102690 0x7f328819f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:31.717 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328659c640 1 -- 172.21.15.174:0/1547011526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288101cd0 msgr2=0x7f32881982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:31.717 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328659c640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288101cd0 0x7f32881982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:31.717 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328659c640 1 -- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3288102690 msgr2=0x7f328819f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:31.717 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328659c640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3288102690 0x7f328819f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:31.717 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328659c640 1 -- 172.21.15.174:0/1547011526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328819f9d0 con 0x7f3288100ad0 2024-09-19T06:00:31.718 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f3286d9d640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3288102690 0x7f328819f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:00:31.718 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328659c640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3288100ad0 0x7f3288197da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f327800d950 tx=0x7f327800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:00:31.718 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f32777fe640 1 -- 172.21.15.174:0/1547011526 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278017020 con 0x7f3288100ad0 2024-09-19T06:00:31.718 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f32777fe640 1 -- 172.21.15.174:0/1547011526 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3278009c30 con 0x7f3288100ad0 2024-09-19T06:00:31.718 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328cef0640 1 -- 172.21.15.174:0/1547011526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328819fcc0 con 0x7f3288100ad0 2024-09-19T06:00:31.718 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f32777fe640 1 -- 172.21.15.174:0/1547011526 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327800f6b0 con 0x7f3288100ad0 2024-09-19T06:00:31.718 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.711+0000 7f328cef0640 1 -- 172.21.15.174:0/1547011526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32881a01b0 con 0x7f3288100ad0 2024-09-19T06:00:31.718 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.713+0000 7f328cef0640 1 -- 172.21.15.174:0/1547011526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32881a03e0 con 0x7f3288100ad0 2024-09-19T06:00:31.719 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.714+0000 7f32777fe640 1 -- 172.21.15.174:0/1547011526 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f327801a020 con 0x7f3288100ad0 2024-09-19T06:00:31.719 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.714+0000 7f32777fe640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32700a31e0 0x7f32700a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:31.720 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.714+0000 7f32777fe640 1 -- 172.21.15.174:0/1547011526 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f32780cdec0 con 0x7f3288100ad0 2024-09-19T06:00:31.720 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.714+0000 7f3285d9b640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32700a31e0 0x7f32700a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:31.720 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.715+0000 7f3285d9b640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32700a31e0 0x7f32700a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32881992c0 tx=0x7f327c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:00:31.720 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.719+0000 7f32777fe640 1 -- 172.21.15.174:0/1547011526 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3278021020 con 0x7f3288100ad0 2024-09-19T06:00:31.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:31.901+0000 7f328cef0640 1 -- 172.21.15.174:0/1547011526 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3288062630 con 0x7f32700a31e0 2024-09-19T06:00:31.903 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:00:31.903 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='osd.1 [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:00:31.904 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:31 smithi174 ceph-mon[34488]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:00:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:00:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:00:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='osd.1 [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:00:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:00:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:31.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:31.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:31.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:31.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:31.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:00:31.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:31 smithi103 ceph-mon[30925]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:00:32.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='osd.1 [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:00:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:31 smithi169 ceph-mon[34350]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:00:32.777 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1[38719]: 2024-09-19T06:00:32.421+0000 7f384d611640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T06:00:32.778 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1[38719]: 2024-09-19T06:00:32.426+0000 7f3845c43640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:00:32.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi169 2024-09-19T06:00:32.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-19T06:00:32.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-mon[34350]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:32.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:32.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:32.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:32.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:32.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:32.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:32 smithi169 ceph-mon[34350]: from='osd.1 ' entity='osd.1' 2024-09-19T06:00:32.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:32 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi169 2024-09-19T06:00:32.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:32 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-19T06:00:32.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:32 smithi103 ceph-mon[30925]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:32.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:32.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:32.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:32.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:32.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:32.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:32 smithi103 ceph-mon[30925]: from='osd.1 ' entity='osd.1' 2024-09-19T06:00:32.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:32 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi169 2024-09-19T06:00:32.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:32 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-19T06:00:32.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:32 smithi174 ceph-mon[34488]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:32.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:32.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:32.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:32.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:32.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:32.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:32 smithi174 ceph-mon[34488]: from='osd.1 ' entity='osd.1' 2024-09-19T06:00:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:33 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:00:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:33 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:00:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:33 smithi174 ceph-mon[34488]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:33 smithi174 ceph-mon[34488]: osd.1 [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] boot 2024-09-19T06:00:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:33 smithi174 ceph-mon[34488]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:00:33.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:33.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:33 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:00:33.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:33 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:00:33.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:33 smithi103 ceph-mon[30925]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:33.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:33.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:33 smithi103 ceph-mon[30925]: osd.1 [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] boot 2024-09-19T06:00:33.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:33 smithi103 ceph-mon[30925]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:00:33.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:34.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:33 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:00:34.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:33 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:00:34.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:33 smithi169 ceph-mon[34350]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:34.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:34.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:33 smithi169 ceph-mon[34350]: osd.1 [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] boot 2024-09-19T06:00:34.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:33 smithi169 ceph-mon[34350]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:00:34.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:00:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:34 smithi174 ceph-mon[34488]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:34 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/2196769721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e8e4188-7656-44b4-9064-cf52b6b5d2d1"}]: dispatch 2024-09-19T06:00:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:34 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e8e4188-7656-44b4-9064-cf52b6b5d2d1"}]: dispatch 2024-09-19T06:00:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:34 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e8e4188-7656-44b4-9064-cf52b6b5d2d1"}]': finished 2024-09-19T06:00:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:34 smithi174 ceph-mon[34488]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:00:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:34.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:34 smithi103 ceph-mon[30925]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:34.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:34 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/2196769721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e8e4188-7656-44b4-9064-cf52b6b5d2d1"}]: dispatch 2024-09-19T06:00:34.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:34 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e8e4188-7656-44b4-9064-cf52b6b5d2d1"}]: dispatch 2024-09-19T06:00:34.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:34 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e8e4188-7656-44b4-9064-cf52b6b5d2d1"}]': finished 2024-09-19T06:00:34.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:34 smithi103 ceph-mon[30925]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:00:34.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:35.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:34 smithi169 ceph-mon[34350]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:00:35.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:34 smithi169 ceph-mon[34350]: from='client.? 172.21.15.174:0/2196769721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e8e4188-7656-44b4-9064-cf52b6b5d2d1"}]: dispatch 2024-09-19T06:00:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:34 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e8e4188-7656-44b4-9064-cf52b6b5d2d1"}]: dispatch 2024-09-19T06:00:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:34 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e8e4188-7656-44b4-9064-cf52b6b5d2d1"}]': finished 2024-09-19T06:00:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:34 smithi169 ceph-mon[34350]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:00:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:35 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/544256927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:35.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:35 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/544256927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:36.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:35 smithi169 ceph-mon[34350]: from='client.? 172.21.15.174:0/544256927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:36.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:36 smithi174 ceph-mon[34488]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:36 smithi103 ceph-mon[30925]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:37.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:36 smithi169 ceph-mon[34350]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:37 smithi174 ceph-mon[34488]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:37.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:37 smithi103 ceph-mon[30925]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:38.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:37 smithi169 ceph-mon[34350]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:40.620 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:40 smithi174 ceph-mon[34488]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:40.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:40 smithi103 ceph-mon[30925]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:40.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:40 smithi169 ceph-mon[34350]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:42.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:42 smithi174 ceph-mon[34488]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:42.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:00:42.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:42.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:42 smithi103 ceph-mon[30925]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:42.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:00:42.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:42.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:42 smithi169 ceph-mon[34350]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:42.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:00:42.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:43.641 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:43 smithi174 ceph-mon[34488]: Deploying daemon osd.2 on smithi174 2024-09-19T06:00:43.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:43 smithi103 ceph-mon[30925]: Deploying daemon osd.2 on smithi174 2024-09-19T06:00:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:43 smithi169 ceph-mon[34350]: Deploying daemon osd.2 on smithi174 2024-09-19T06:00:44.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:44 smithi103 ceph-mon[30925]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:44.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:44 smithi169 ceph-mon[34350]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:44.816 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:44 smithi174 ceph-mon[34488]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:46 smithi103 ceph-mon[30925]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:46.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:46 smithi169 ceph-mon[34350]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:46.788 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:46 smithi174 ceph-mon[34488]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:48 smithi103 ceph-mon[30925]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:48.769 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:48 smithi174 ceph-mon[34488]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:48.769 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:48.769 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:48.769 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:48.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:48 smithi169 ceph-mon[34350]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:48.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:48.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:48.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:50.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:50 smithi174 ceph-mon[34488]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:50.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:50 smithi103 ceph-mon[30925]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:50.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:50 smithi169 ceph-mon[34350]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:51.546 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.544+0000 7f32777fe640 1 -- 172.21.15.174:0/1547011526 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3288062630 con 0x7f32700a31e0 2024-09-19T06:00:51.546 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 2 on host 'smithi174' 2024-09-19T06:00:51.548 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 -- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32700a31e0 msgr2=0x7f32700a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:51.548 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32700a31e0 0x7f32700a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32881992c0 tx=0x7f327c00b390 comp rx=0 tx=0).stop 2024-09-19T06:00:51.548 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 -- 172.21.15.174:0/1547011526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3288100ad0 msgr2=0x7f3288197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:51.548 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3288100ad0 0x7f3288197da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f327800d950 tx=0x7f327800de10 comp rx=0 tx=0).stop 2024-09-19T06:00:51.548 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 -- 172.21.15.174:0/1547011526 shutdown_connections 2024-09-19T06:00:51.548 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32700a31e0 0x7f32700a56a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:51.549 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3288102690 0x7f328819f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:51.549 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288101cd0 0x7f32881982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:51.549 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 --2- 172.21.15.174:0/1547011526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3288100ad0 0x7f3288197da0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:51.549 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 -- 172.21.15.174:0/1547011526 >> 172.21.15.174:0/1547011526 conn(0x7f32880fc280 msgr2=0x7f32880fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:00:51.549 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.546+0000 7f328cef0640 1 -- 172.21.15.174:0/1547011526 shutdown_connections 2024-09-19T06:00:51.549 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:00:51.547+0000 7f328cef0640 1 -- 172.21.15.174:0/1547011526 wait complete. 2024-09-19T06:00:51.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:51.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:51.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:51.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:51.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:51.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:51 smithi174 ceph-mon[34488]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:51.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:51.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:51.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:51.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:51.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:51.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:51.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:51.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:51.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:51 smithi103 ceph-mon[30925]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:51.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:51.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:51.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:52.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:52.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:52.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:52.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:52.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:52.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:51 smithi169 ceph-mon[34350]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:52.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:52.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:52.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:52.112 DEBUG:teuthology.orchestra.run.smithi174:osd.2> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T06:00:52.114 INFO:tasks.cephadm:Deploying osd.3 on smithi103 with /dev/vg_nvme/lv_3... 2024-09-19T06:00:52.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:00:52.372 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:00:54.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:54 smithi174 ceph-mon[34488]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:54.705 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:00:54 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2[39447]: 2024-09-19T06:00:54.554+0000 7fe5492b9640 -1 osd.2 0 log_to_monitors true 2024-09-19T06:00:54.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:54 smithi103 ceph-mon[30925]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:54.731 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:54 smithi169 ceph-mon[34350]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:54.926 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:00:54.956 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_3 2024-09-19T06:00:55.200 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:00:55.584 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:55 smithi103 ceph-mon[30925]: from='osd.2 [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:00:55.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:55 smithi103 ceph-mon[30925]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:00:55.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:55 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:55 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:55 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:55.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:55 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:55 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:55.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:55 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:55.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:55 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.666+0000 7f8c0655a640 1 -- 172.21.15.103:0/896675225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00107900 msgr2=0x7f8c00109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.666+0000 7f8c0655a640 1 --2- 172.21.15.103:0/896675225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00107900 0x7f8c00109d50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009ca0 tx=0x7f8bf802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.666+0000 7f8c0655a640 1 -- 172.21.15.103:0/896675225 shutdown_connections 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.666+0000 7f8c0655a640 1 --2- 172.21.15.103:0/896675225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00107900 0x7f8c00109d50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.666+0000 7f8c0655a640 1 --2- 172.21.15.103:0/896675225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00104fd0 0x7f8c001073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.666+0000 7f8c0655a640 1 --2- 172.21.15.103:0/896675225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c001026a0 0x7f8c00104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.666+0000 7f8c0655a640 1 -- 172.21.15.103:0/896675225 >> 172.21.15.103:0/896675225 conn(0x7f8c000fc2a0 msgr2=0x7f8c000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.667+0000 7f8c0655a640 1 -- 172.21.15.103:0/896675225 shutdown_connections 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.667+0000 7f8c0655a640 1 -- 172.21.15.103:0/896675225 wait complete. 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.667+0000 7f8c0655a640 1 Processor -- start 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.667+0000 7f8c0655a640 1 -- start start 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.667+0000 7f8c0655a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c001026a0 0x7f8c00102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:55.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.667+0000 7f8c0655a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00104fd0 0x7f8c00100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:55.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.667+0000 7f8c0655a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00107900 0x7f8c00100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:55.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.667+0000 7f8c0655a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0010d7d0 con 0x7f8c00107900 2024-09-19T06:00:55.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.667+0000 7f8c0655a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0010d650 con 0x7f8c00104fd0 2024-09-19T06:00:55.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.667+0000 7f8c0655a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0010d950 con 0x7f8c001026a0 2024-09-19T06:00:55.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c04af7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00107900 0x7f8c00100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:55.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c04af7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00107900 0x7f8c00100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48402/0 (socket says 172.21.15.103:48402) 2024-09-19T06:00:55.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c04af7640 1 -- 172.21.15.103:0/1100375578 learned_addr learned my addr 172.21.15.103:0/1100375578 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:00:55.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8bff7fe640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00104fd0 0x7f8c00100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:55.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8bfffff640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c001026a0 0x7f8c00102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:55.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c04af7640 1 -- 172.21.15.103:0/1100375578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c001026a0 msgr2=0x7f8c00102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c04af7640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c001026a0 0x7f8c00102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c04af7640 1 -- 172.21.15.103:0/1100375578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00104fd0 msgr2=0x7f8c00100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c04af7640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00104fd0 0x7f8c00100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c04af7640 1 -- 172.21.15.103:0/1100375578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c00101450 con 0x7f8c00107900 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8bff7fe640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00104fd0 0x7f8c00100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c04af7640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00107900 0x7f8c00100b90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8031970 tx=0x7f8bf8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/1100375578 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8004040 con 0x7f8c00107900 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/1100375578 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8bf8004690 con 0x7f8c00107900 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c0655a640 1 -- 172.21.15.103:0/1100375578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c001a1fc0 con 0x7f8c00107900 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/1100375578 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8030c60 con 0x7f8c00107900 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.668+0000 7f8c0655a640 1 -- 172.21.15.103:0/1100375578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c001a2470 con 0x7f8c00107900 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.669+0000 7f8c0655a640 1 -- 172.21.15.103:0/1100375578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c000fdd90 con 0x7f8c00107900 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.670+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/1100375578 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f8bf80041e0 con 0x7f8c00107900 2024-09-19T06:00:55.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.671+0000 7f8bfd7fa640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8be80a31b0 0x7f8be80a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:55.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.671+0000 7f8bfffff640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8be80a31b0 0x7f8be80a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:55.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.671+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/1100375578 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2445+0+0 (secure 0 0 0) 0x7f8bf80ef8a0 con 0x7f8c00107900 2024-09-19T06:00:55.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.672+0000 7f8bfffff640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8be80a31b0 0x7f8be80a5670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009890 tx=0x7f8bf0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:00:55.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.676+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/1100375578 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8bf80bdcf0 con 0x7f8c00107900 2024-09-19T06:00:55.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:55 smithi174 ceph-mon[34488]: from='osd.2 [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:00:55.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:55 smithi174 ceph-mon[34488]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:00:55.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:55 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:55 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:55 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:55.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:55 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:55 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:55.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:55 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:55.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:55 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:55 smithi169 ceph-mon[34350]: from='osd.2 [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:00:55.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:55 smithi169 ceph-mon[34350]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:00:55.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:55 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:55 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:55 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:55.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:55 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:55 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:55.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:55 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:55.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:55 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:00:55.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:00:55.853+0000 7f8c0655a640 1 -- 172.21.15.103:0/1100375578 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8c00062630 con 0x7f8be80a31b0 2024-09-19T06:00:56.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi174 2024-09-19T06:00:56.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi174 to 17088M 2024-09-19T06:00:56.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:56.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:00:56.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: from='osd.2 [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:00:56.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:00:56.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:56.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:00:56.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:56.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:56.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi174 2024-09-19T06:00:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi174 to 17088M 2024-09-19T06:00:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:00:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: from='osd.2 [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:00:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:00:56.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:56.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:00:56.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:56.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:56.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:56.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi174 2024-09-19T06:00:56.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi174 to 17088M 2024-09-19T06:00:56.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:56.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:00:56.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: from='osd.2 [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:00:56.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:00:56.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:56.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:00:56.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:56.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:56.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:57.704 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:00:57 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2[39447]: 2024-09-19T06:00:57.286+0000 7fe544a19640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T06:00:57.704 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:00:57 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2[39447]: 2024-09-19T06:00:57.293+0000 7fe53d04b640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:00:57.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:57 smithi174 ceph-mon[34488]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:57.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:57 smithi174 ceph-mon[34488]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:00:57.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:57 smithi174 ceph-mon[34488]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:00:57.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:57 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:57.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:57 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:57.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:57 smithi174 ceph-mon[34488]: from='osd.2 ' entity='osd.2' 2024-09-19T06:00:57.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:57 smithi103 ceph-mon[30925]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:57.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:57 smithi103 ceph-mon[30925]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:00:57.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:57 smithi103 ceph-mon[30925]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:00:57.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:57.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:57.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:57 smithi103 ceph-mon[30925]: from='osd.2 ' entity='osd.2' 2024-09-19T06:00:57.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:57 smithi169 ceph-mon[34350]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:57 smithi169 ceph-mon[34350]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:00:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:57 smithi169 ceph-mon[34350]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:00:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:57 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:57 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:57 smithi169 ceph-mon[34350]: from='osd.2 ' entity='osd.2' 2024-09-19T06:00:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:58 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:00:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:58 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:00:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:58 smithi103 ceph-mon[30925]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:58 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:58 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2517359510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7afabe9f-7421-423a-ba92-f2c6c9e57d18"}]: dispatch 2024-09-19T06:00:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:58 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2517359510' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7afabe9f-7421-423a-ba92-f2c6c9e57d18"}]': finished 2024-09-19T06:00:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:58 smithi103 ceph-mon[30925]: osd.2 [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] boot 2024-09-19T06:00:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:58 smithi103 ceph-mon[30925]: osdmap e17: 4 total, 3 up, 4 in 2024-09-19T06:00:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:58 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:58 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:00:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:58 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:00:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:58 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:00:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:58 smithi169 ceph-mon[34350]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:58 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:58 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2517359510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7afabe9f-7421-423a-ba92-f2c6c9e57d18"}]: dispatch 2024-09-19T06:00:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:58 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2517359510' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7afabe9f-7421-423a-ba92-f2c6c9e57d18"}]': finished 2024-09-19T06:00:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:58 smithi169 ceph-mon[34350]: osd.2 [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] boot 2024-09-19T06:00:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:58 smithi169 ceph-mon[34350]: osdmap e17: 4 total, 3 up, 4 in 2024-09-19T06:00:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:58 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:58 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:00:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:58 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:00:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:58 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:00:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:58 smithi174 ceph-mon[34488]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:00:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:58 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:58 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2517359510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7afabe9f-7421-423a-ba92-f2c6c9e57d18"}]: dispatch 2024-09-19T06:00:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:58 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2517359510' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7afabe9f-7421-423a-ba92-f2c6c9e57d18"}]': finished 2024-09-19T06:00:58.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:58 smithi174 ceph-mon[34488]: osd.2 [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] boot 2024-09-19T06:00:58.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:58 smithi174 ceph-mon[34488]: osdmap e17: 4 total, 3 up, 4 in 2024-09-19T06:00:58.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:58 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:00:58.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:58 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:00:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:59 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1384814807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:00:59 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:00:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:59 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1384814807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:00:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:01:00.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:59 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1384814807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:00.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:00:59 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:01:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:00 smithi174 ceph-mon[34488]: pgmap v74: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:00 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:01:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:00 smithi174 ceph-mon[34488]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T06:01:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:00 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:00 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:01:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:00 smithi103 ceph-mon[30925]: pgmap v74: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:00 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:01:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:00 smithi103 ceph-mon[30925]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T06:01:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:00 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:00 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:01:01.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:00 smithi169 ceph-mon[34350]: pgmap v74: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:01.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:00 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:01:01.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:00 smithi169 ceph-mon[34350]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T06:01:01.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:00 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:01.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:00 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:01:01.281 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:01:01 smithi103 sudo[50425]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:01:01.281 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:01:01 smithi103 sudo[50425]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:01.282 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:01:01 smithi103 sudo[50425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:01.282 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:01:01 smithi103 sudo[50425]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:01.695 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:01:01 smithi103 sudo[50431]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:01:01.695 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:01:01 smithi103 sudo[50431]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:01.695 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:01:01 smithi103 sudo[50431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:01.695 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:01:01 smithi103 sudo[50431]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:01.810 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:01:01 smithi169 sudo[42677]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:01:01.811 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:01:01 smithi169 sudo[42677]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:01.811 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:01:01 smithi169 sudo[42677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:01.811 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:01:01 smithi169 sudo[42677]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:01.811 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:01 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:01:01.811 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:01 smithi169 ceph-mon[34350]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T06:01:01.811 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:01 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:01.811 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:01 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:01.811 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:01 smithi169 ceph-mon[34350]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:01 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:01:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:01 smithi174 ceph-mon[34488]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T06:01:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:01 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:01 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:01 smithi174 ceph-mon[34488]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:01.972 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:01 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:01:01.972 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:01 smithi103 ceph-mon[30925]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T06:01:01.972 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:01 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:01.972 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:01 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:01.972 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:01 smithi103 ceph-mon[30925]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:02.277 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:01:01 smithi169 sudo[42695]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:01:02.278 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:01:01 smithi169 sudo[42695]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:02.278 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:01:01 smithi169 sudo[42695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:02.278 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:01:01 smithi169 sudo[42695]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:02.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:02.318+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/1100375578 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f8bf80b9c60 con 0x7f8c00107900 2024-09-19T06:01:02.337 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:01:02 smithi174 sudo[43518]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:01:02.337 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:01:02 smithi174 sudo[43518]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:02.337 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:01:02 smithi174 sudo[43518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:02.337 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:01:02 smithi174 sudo[43518]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:02.704 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:01:02 smithi174 sudo[43521]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:01:02.704 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:01:02 smithi174 sudo[43521]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:02.704 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:01:02 smithi174 sudo[43521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:02.704 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:01:02 smithi174 sudo[43521]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:02.864 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 sudo[51009]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:01:02.864 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 sudo[51009]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:02.864 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 sudo[51009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:02.864 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 sudo[51009]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:03.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:02 smithi174 ceph-mon[34488]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:01:03.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:03.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:03.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:02 smithi174 ceph-mon[34488]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:01:03.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:03.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:02 smithi174 ceph-mon[34488]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:01:03.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 sudo[43524]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:01:03.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 sudo[43524]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:03.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 sudo[43524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:03.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 sudo[43524]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:03.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 sudo[51202]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:01:03.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 sudo[51202]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:03.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 sudo[51202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:03.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 sudo[51202]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:03.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 ceph-mon[30925]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:01:03.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:03.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:03.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 ceph-mon[30925]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:01:03.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:03.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:02 smithi103 ceph-mon[30925]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:01:03.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:02 smithi169 ceph-mon[34350]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:01:03.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:03.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:03.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:02 smithi169 ceph-mon[34350]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:01:03.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:03.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:02 smithi169 ceph-mon[34350]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:01:03.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 sudo[43527]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:01:03.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 sudo[43527]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:03.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 sudo[43527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:03.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 sudo[43527]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:03.865 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 sudo[42698]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:01:03.865 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 sudo[42698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:03.865 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 sudo[42698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:03.865 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 sudo[42698]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:04.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:01:04.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:01:04.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:04.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:03 smithi174 ceph-mon[34488]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:01:04.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:01:04.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:04.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:03 smithi103 ceph-mon[30925]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:01:04.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 sudo[42701]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:01:04.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 sudo[42701]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:01:04.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 sudo[42701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:01:04.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 sudo[42701]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:01:04.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:01:04.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:01:04.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:01:04.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:01:04.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:01:04.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:01:04.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:01:04.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:01:04.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:01:04.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:01:04.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:01:04.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:01:04.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:01:04.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:04.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:03 smithi169 ceph-mon[34350]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:01:06.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:06 smithi103 ceph-mon[30925]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:06.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:06 smithi174 ceph-mon[34488]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:06.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:06 smithi169 ceph-mon[34350]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:07.601 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:01:07.601 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:07.720 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:01:07.720 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:07.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:01:07.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:08.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:08 smithi103 ceph-mon[30925]: Deploying daemon osd.3 on smithi103 2024-09-19T06:01:08.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:08 smithi103 ceph-mon[30925]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:08.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:08 smithi174 ceph-mon[34488]: Deploying daemon osd.3 on smithi103 2024-09-19T06:01:08.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:08 smithi174 ceph-mon[34488]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:08.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:08 smithi169 ceph-mon[34350]: Deploying daemon osd.3 on smithi103 2024-09-19T06:01:08.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:08 smithi169 ceph-mon[34350]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:10.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:10 smithi103 ceph-mon[30925]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T06:01:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:10 smithi169 ceph-mon[34350]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T06:01:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:10 smithi174 ceph-mon[34488]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T06:01:12.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:12 smithi103 ceph-mon[30925]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:01:12.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:12 smithi169 ceph-mon[34350]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:01:12.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:12 smithi174 ceph-mon[34488]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:01:13.694 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:13.694 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:13.694 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:13.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:13.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:13.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:13.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:13.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:13.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:14.672 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:14 smithi103 ceph-mon[30925]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:01:14.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:14 smithi169 ceph-mon[34350]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:01:14.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:14 smithi174 ceph-mon[34488]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:01:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.344+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/1100375578 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8c00062630 con 0x7f8be80a31b0 2024-09-19T06:01:16.347 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 3 on host 'smithi103' 2024-09-19T06:01:16.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 -- 172.21.15.103:0/1100375578 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8be80a31b0 msgr2=0x7f8be80a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:16.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8be80a31b0 0x7f8be80a5670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009890 tx=0x7f8bf0008040 comp rx=0 tx=0).stop 2024-09-19T06:01:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 -- 172.21.15.103:0/1100375578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00107900 msgr2=0x7f8c00100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00107900 0x7f8c00100b90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8031970 tx=0x7f8bf8003ba0 comp rx=0 tx=0).stop 2024-09-19T06:01:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 -- 172.21.15.103:0/1100375578 shutdown_connections 2024-09-19T06:01:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8be80a31b0 0x7f8be80a5670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00107900 0x7f8c00100b90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00104fd0 0x7f8c00100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 --2- 172.21.15.103:0/1100375578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c001026a0 0x7f8c00102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 -- 172.21.15.103:0/1100375578 >> 172.21.15.103:0/1100375578 conn(0x7f8c000fc2a0 msgr2=0x7f8c00103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 -- 172.21.15.103:0/1100375578 shutdown_connections 2024-09-19T06:01:16.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:01:16.347+0000 7f8c0655a640 1 -- 172.21.15.103:0/1100375578 wait complete. 2024-09-19T06:01:16.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:16 smithi103 ceph-mon[30925]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:01:16.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:16.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:16.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:16.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:16 smithi169 ceph-mon[34350]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:01:16.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:16 smithi174 ceph-mon[34488]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:01:16.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:16.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:16.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:16.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:16.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:17.085 DEBUG:teuthology.orchestra.run.smithi103:osd.3> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T06:01:17.088 INFO:tasks.cephadm:Deploying osd.4 on smithi169 with /dev/vg_nvme/lv_3... 2024-09-19T06:01:17.088 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:01:17.346 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:01:18.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:18 smithi103 ceph-mon[30925]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:01:18.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:18 smithi169 ceph-mon[34350]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:01:18.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:18 smithi174 ceph-mon[34488]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:01:19.409 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:01:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3[52039]: 2024-09-19T06:01:19.321+0000 7ffae8b5e640 -1 osd.3 0 log_to_monitors true 2024-09-19T06:01:19.505 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:01:19.531 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_3 2024-09-19T06:01:19.718 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:19 smithi103 ceph-mon[30925]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:01:19.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:19 smithi169 ceph-mon[34350]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:01:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:01:19.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:19 smithi174 ceph-mon[34488]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:01:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.196+0000 7fbd597b6640 1 -- 172.21.15.169:0/2203848476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd54101cd0 msgr2=0x7fbd54102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.196+0000 7fbd597b6640 1 --2- 172.21.15.169:0/2203848476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd54101cd0 0x7fbd54102150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009900 tx=0x7fbd4402a410 comp rx=0 tx=0).stop 2024-09-19T06:01:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.196+0000 7fbd597b6640 1 -- 172.21.15.169:0/2203848476 shutdown_connections 2024-09-19T06:01:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.196+0000 7fbd597b6640 1 --2- 172.21.15.169:0/2203848476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd54102690 0x7fbd54108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.196+0000 7fbd597b6640 1 --2- 172.21.15.169:0/2203848476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd54101cd0 0x7fbd54102150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.196+0000 7fbd597b6640 1 --2- 172.21.15.169:0/2203848476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd54100ad0 0x7fbd54100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.196+0000 7fbd597b6640 1 -- 172.21.15.169:0/2203848476 >> 172.21.15.169:0/2203848476 conn(0x7fbd540fc280 msgr2=0x7fbd540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.196+0000 7fbd597b6640 1 -- 172.21.15.169:0/2203848476 shutdown_connections 2024-09-19T06:01:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.196+0000 7fbd597b6640 1 -- 172.21.15.169:0/2203848476 wait complete. 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.196+0000 7fbd597b6640 1 Processor -- start 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd597b6640 1 -- start start 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd597b6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd54100ad0 0x7fbd54197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd597b6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd54101cd0 0x7fbd54198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd597b6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd54102690 0x7fbd5419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd597b6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5410c600 con 0x7fbd54101cd0 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd597b6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5410c480 con 0x7fbd54102690 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd597b6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5410c780 con 0x7fbd54100ad0 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd537fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd54102690 0x7fbd5419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd527fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd54101cd0 0x7fbd54198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd537fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd54102690 0x7fbd5419f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:36522/0 (socket says 172.21.15.169:36522) 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd537fe640 1 -- 172.21.15.169:0/474507413 learned_addr learned my addr 172.21.15.169:0/474507413 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:01:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd52ffd640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd54100ad0 0x7fbd54197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd537fe640 1 -- 172.21.15.169:0/474507413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd54100ad0 msgr2=0x7fbd54197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd537fe640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd54100ad0 0x7fbd54197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd537fe640 1 -- 172.21.15.169:0/474507413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd54101cd0 msgr2=0x7fbd54198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.197+0000 7fbd537fe640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd54101cd0 0x7fbd54198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.198+0000 7fbd537fe640 1 -- 172.21.15.169:0/474507413 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5419fa30 con 0x7fbd54102690 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.198+0000 7fbd527fc640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd54101cd0 0x7fbd54198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.198+0000 7fbd537fe640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd54102690 0x7fbd5419f3c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00eaa0 tx=0x7fbd4c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.198+0000 7fbd3bfff640 1 -- 172.21.15.169:0/474507413 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00cdb0 con 0x7fbd54102690 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.198+0000 7fbd3bfff640 1 -- 172.21.15.169:0/474507413 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd4c005020 con 0x7fbd54102690 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.198+0000 7fbd597b6640 1 -- 172.21.15.169:0/474507413 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5419fd20 con 0x7fbd54102690 2024-09-19T06:01:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.198+0000 7fbd3bfff640 1 -- 172.21.15.169:0/474507413 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0116d0 con 0x7fbd54102690 2024-09-19T06:01:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.198+0000 7fbd597b6640 1 -- 172.21.15.169:0/474507413 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd541a0220 con 0x7fbd54102690 2024-09-19T06:01:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.199+0000 7fbd597b6640 1 -- 172.21.15.169:0/474507413 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd541a04b0 con 0x7fbd54102690 2024-09-19T06:01:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.200+0000 7fbd3bfff640 1 -- 172.21.15.169:0/474507413 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fbd4c0051d0 con 0x7fbd54102690 2024-09-19T06:01:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.201+0000 7fbd3bfff640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd3c0a32f0 0x7fbd3c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.201+0000 7fbd3bfff640 1 -- 172.21.15.169:0/474507413 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3373+0+0 (secure 0 0 0) 0x7fbd4c0ce620 con 0x7fbd54102690 2024-09-19T06:01:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.201+0000 7fbd52ffd640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd3c0a32f0 0x7fbd3c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:20.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.202+0000 7fbd52ffd640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd3c0a32f0 0x7fbd3c0a57b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd480058c0 tx=0x7fbd4800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:20.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.209+0000 7fbd3bfff640 1 -- 172.21.15.169:0/474507413 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd4c016030 con 0x7fbd54102690 2024-09-19T06:01:20.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:20.389+0000 7fbd597b6640 1 -- 172.21.15.169:0/474507413 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbd541a0680 con 0x7fbd3c0a32f0 2024-09-19T06:01:20.744 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3[52039]: 2024-09-19T06:01:20.485+0000 7ffae42be640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T06:01:20.744 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3[52039]: 2024-09-19T06:01:20.490+0000 7ffae08f8640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:01:20.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:01:20.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:01:20.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:20.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:01:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:01:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:01:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:01:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:01:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:01:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:21 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi103 2024-09-19T06:01:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:21 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi103 to 8544M 2024-09-19T06:01:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:21 smithi103 ceph-mon[30925]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:21 smithi103 ceph-mon[30925]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:01:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:21 smithi103 ceph-mon[30925]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:01:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:21 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi103 2024-09-19T06:01:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:21 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi103 to 8544M 2024-09-19T06:01:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:21 smithi169 ceph-mon[34350]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:21 smithi169 ceph-mon[34350]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:01:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:21 smithi169 ceph-mon[34350]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:01:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:21 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi103 2024-09-19T06:01:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:21 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi103 to 8544M 2024-09-19T06:01:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:21 smithi174 ceph-mon[34488]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:21 smithi174 ceph-mon[34488]: from='osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:01:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:21 smithi174 ceph-mon[34488]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:01:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:21.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:22 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:01:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:22 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:01:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:22 smithi103 ceph-mon[30925]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:22 smithi103 ceph-mon[30925]: osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] boot 2024-09-19T06:01:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:22 smithi103 ceph-mon[30925]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T06:01:22.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:22.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:22 smithi103 ceph-mon[30925]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:01:22.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:22 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:01:22.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:22 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:01:22.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:22 smithi169 ceph-mon[34350]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:22.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:22 smithi169 ceph-mon[34350]: osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] boot 2024-09-19T06:01:22.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:22 smithi169 ceph-mon[34350]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T06:01:22.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:22 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:22.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:22 smithi169 ceph-mon[34350]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:01:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:22 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:01:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:22 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:01:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:22 smithi174 ceph-mon[34488]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:01:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:22 smithi174 ceph-mon[34488]: osd.3 [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] boot 2024-09-19T06:01:22.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:22 smithi174 ceph-mon[34488]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T06:01:22.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:01:22.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:22 smithi174 ceph-mon[34488]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:01:23.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:23 smithi169 ceph-mon[34350]: from='client.? 172.21.15.169:0/3374577166' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64f13201-dc73-4167-ba72-82b720f23503"}]: dispatch 2024-09-19T06:01:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:23 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64f13201-dc73-4167-ba72-82b720f23503"}]: dispatch 2024-09-19T06:01:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:23 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64f13201-dc73-4167-ba72-82b720f23503"}]': finished 2024-09-19T06:01:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:23 smithi169 ceph-mon[34350]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T06:01:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:23 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:23 smithi169 ceph-mon[34350]: from='client.? 172.21.15.169:0/2011917713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:23 smithi174 ceph-mon[34488]: from='client.? 172.21.15.169:0/3374577166' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64f13201-dc73-4167-ba72-82b720f23503"}]: dispatch 2024-09-19T06:01:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:23 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64f13201-dc73-4167-ba72-82b720f23503"}]: dispatch 2024-09-19T06:01:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:23 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64f13201-dc73-4167-ba72-82b720f23503"}]': finished 2024-09-19T06:01:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:23 smithi174 ceph-mon[34488]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T06:01:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:23 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:23 smithi174 ceph-mon[34488]: from='client.? 172.21.15.169:0/2011917713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:23.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:23 smithi103 ceph-mon[30925]: from='client.? 172.21.15.169:0/3374577166' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64f13201-dc73-4167-ba72-82b720f23503"}]: dispatch 2024-09-19T06:01:23.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:23 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64f13201-dc73-4167-ba72-82b720f23503"}]: dispatch 2024-09-19T06:01:23.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:23 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64f13201-dc73-4167-ba72-82b720f23503"}]': finished 2024-09-19T06:01:23.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:23 smithi103 ceph-mon[30925]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T06:01:23.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:23 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:23.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:23 smithi103 ceph-mon[30925]: from='client.? 172.21.15.169:0/2011917713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:24 smithi174 ceph-mon[34488]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:24 smithi174 ceph-mon[34488]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T06:01:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:24 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:24.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:24 smithi103 ceph-mon[30925]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:24.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:24 smithi103 ceph-mon[30925]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T06:01:24.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:24 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:25.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:24 smithi169 ceph-mon[34350]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:25.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:24 smithi169 ceph-mon[34350]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T06:01:25.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:24 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:25 smithi174 ceph-mon[34488]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:01:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:25 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:25.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:25 smithi103 ceph-mon[30925]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:01:25.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:25 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:26.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:25 smithi169 ceph-mon[34350]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:01:26.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:25 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:26 smithi174 ceph-mon[34488]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-19T06:01:26.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:26 smithi103 ceph-mon[30925]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-19T06:01:27.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:26 smithi169 ceph-mon[34350]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-19T06:01:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:28 smithi174 ceph-mon[34488]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:01:28.956 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:28 smithi169 ceph-mon[34350]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:01:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:28 smithi103 ceph-mon[30925]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:01:30.840 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:30 smithi169 ceph-mon[34350]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T06:01:30.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:30 smithi174 ceph-mon[34488]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T06:01:30.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:30 smithi103 ceph-mon[30925]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T06:01:31.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:01:31.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:31 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:31.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:31 smithi174 ceph-mon[34488]: Deploying daemon osd.4 on smithi169 2024-09-19T06:01:31.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:31 smithi174 ceph-mon[34488]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:01:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:01:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:31 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:31 smithi103 ceph-mon[30925]: Deploying daemon osd.4 on smithi169 2024-09-19T06:01:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:31 smithi103 ceph-mon[30925]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:01:32.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:31 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:01:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:31 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:31 smithi169 ceph-mon[34350]: Deploying daemon osd.4 on smithi169 2024-09-19T06:01:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:31 smithi169 ceph-mon[34350]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:01:34.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:34 smithi103 ceph-mon[30925]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:34.719 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:34 smithi169 ceph-mon[34350]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:34 smithi174 ceph-mon[34488]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:36.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:36 smithi103 ceph-mon[30925]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:36.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:36 smithi169 ceph-mon[34350]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:36.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:36 smithi174 ceph-mon[34488]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:37.740 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:37 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:37.741 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:37 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:37.741 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:37 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:37 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:37 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:37 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:37 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:37 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:37 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:38.652 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:38 smithi169 ceph-mon[34350]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:38.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:38 smithi103 ceph-mon[30925]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:38 smithi174 ceph-mon[34488]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:39.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.800+0000 7fbd3bfff640 1 -- 172.21.15.169:0/474507413 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbd541a0680 con 0x7fbd3c0a32f0 2024-09-19T06:01:39.802 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 4 on host 'smithi169' 2024-09-19T06:01:39.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 -- 172.21.15.169:0/474507413 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd3c0a32f0 msgr2=0x7fbd3c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:39.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd3c0a32f0 0x7fbd3c0a57b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd480058c0 tx=0x7fbd4800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:01:39.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 -- 172.21.15.169:0/474507413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd54102690 msgr2=0x7fbd5419f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:39.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd54102690 0x7fbd5419f3c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00eaa0 tx=0x7fbd4c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:01:39.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 -- 172.21.15.169:0/474507413 shutdown_connections 2024-09-19T06:01:39.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd3c0a32f0 0x7fbd3c0a57b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:39.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd54102690 0x7fbd5419f3c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:39.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd54101cd0 0x7fbd54198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:39.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 --2- 172.21.15.169:0/474507413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd54100ad0 0x7fbd54197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:39.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 -- 172.21.15.169:0/474507413 >> 172.21.15.169:0/474507413 conn(0x7fbd540fc280 msgr2=0x7fbd54069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:39.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 -- 172.21.15.169:0/474507413 shutdown_connections 2024-09-19T06:01:39.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:01:39.802+0000 7fbd597b6640 1 -- 172.21.15.169:0/474507413 wait complete. 2024-09-19T06:01:40.125 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.125 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.125 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:40 smithi169 ceph-mon[34350]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:40.125 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.125 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:40 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:40 smithi174 ceph-mon[34488]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:40.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:40 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.482 DEBUG:teuthology.orchestra.run.smithi169:osd.4> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T06:01:40.485 INFO:tasks.cephadm:Deploying osd.5 on smithi174 with /dev/vg_nvme/lv_3... 2024-09-19T06:01:40.486 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:01:40.493 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:40 smithi103 ceph-mon[30925]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:40.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:40 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:40.741 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:01:42.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:42 smithi169 ceph-mon[34350]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:42.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:42 smithi174 ceph-mon[34488]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:42.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:42 smithi103 ceph-mon[30925]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:43.020 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:01:42 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4[45351]: 2024-09-19T06:01:42.671+0000 7f7963f70640 -1 osd.4 0 log_to_monitors true 2024-09-19T06:01:43.118 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T06:01:43.145 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_3 2024-09-19T06:01:43.395 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:01:43.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:43 smithi174 ceph-mon[34488]: from='osd.4 [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:01:43.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:43 smithi174 ceph-mon[34488]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:01:43.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:43 smithi103 ceph-mon[30925]: from='osd.4 [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:01:43.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:43 smithi103 ceph-mon[30925]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:01:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:43 smithi169 ceph-mon[34350]: from='osd.4 [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:01:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:43 smithi169 ceph-mon[34350]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:01:43.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.861+0000 7f615bc6c640 1 -- 172.21.15.174:0/1134939877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6154102e10 msgr2=0x7f6154103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:43.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.861+0000 7f615bc6c640 1 --2- 172.21.15.174:0/1134939877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6154102e10 0x7f6154103290 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6144009900 tx=0x7f614402a410 comp rx=0 tx=0).stop 2024-09-19T06:01:43.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.861+0000 7f615bc6c640 1 -- 172.21.15.174:0/1134939877 shutdown_connections 2024-09-19T06:01:43.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.861+0000 7f615bc6c640 1 --2- 172.21.15.174:0/1134939877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61541037d0 0x7f615410a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:43.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.861+0000 7f615bc6c640 1 --2- 172.21.15.174:0/1134939877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6154102e10 0x7f6154103290 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:43.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.861+0000 7f615bc6c640 1 --2- 172.21.15.174:0/1134939877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6154101c10 0x7f6154102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:43.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.861+0000 7f615bc6c640 1 -- 172.21.15.174:0/1134939877 >> 172.21.15.174:0/1134939877 conn(0x7f61540fd3c0 msgr2=0x7f61540ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:43.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.861+0000 7f615bc6c640 1 -- 172.21.15.174:0/1134939877 shutdown_connections 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.861+0000 7f615bc6c640 1 -- 172.21.15.174:0/1134939877 wait complete. 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f615bc6c640 1 Processor -- start 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f615bc6c640 1 -- start start 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f615bc6c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6154101c10 0x7f6154197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f615bc6c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6154102e10 0x7f6154198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f615bc6c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61541037d0 0x7f615419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f615bc6c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f615410d720 con 0x7f61541037d0 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f6159a08640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6154101c10 0x7f6154197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f615bc6c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f615410d5a0 con 0x7f6154102e10 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f615bc6c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f615410d8a0 con 0x7f6154101c10 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f6159a08640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6154101c10 0x7f6154197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:51500/0 (socket says 172.21.15.174:51500) 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f6159a08640 1 -- 172.21.15.174:0/2455302077 learned_addr learned my addr 172.21.15.174:0/2455302077 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T06:01:43.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f6159207640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6154102e10 0x7f6154198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.862+0000 7f615a209640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61541037d0 0x7f615419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f6159a08640 1 -- 172.21.15.174:0/2455302077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6154102e10 msgr2=0x7f6154198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f6159a08640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6154102e10 0x7f6154198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f6159a08640 1 -- 172.21.15.174:0/2455302077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61541037d0 msgr2=0x7f615419f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f6159a08640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61541037d0 0x7f615419f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f6159a08640 1 -- 172.21.15.174:0/2455302077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615419fa70 con 0x7f6154101c10 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f6159a08640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6154101c10 0x7f6154197e40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f615000d770 tx=0x7f615000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f614affd640 1 -- 172.21.15.174:0/2455302077 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6150017070 con 0x7f6154101c10 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f614affd640 1 -- 172.21.15.174:0/2455302077 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6150009c30 con 0x7f6154101c10 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f615bc6c640 1 -- 172.21.15.174:0/2455302077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615419fd60 con 0x7f6154101c10 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f614affd640 1 -- 172.21.15.174:0/2455302077 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6150003d00 con 0x7f6154101c10 2024-09-19T06:01:43.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.863+0000 7f615bc6c640 1 -- 172.21.15.174:0/2455302077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61541a01c0 con 0x7f6154101c10 2024-09-19T06:01:43.868 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.864+0000 7f615bc6c640 1 -- 172.21.15.174:0/2455302077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61541090b0 con 0x7f6154101c10 2024-09-19T06:01:43.868 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.865+0000 7f614affd640 1 -- 172.21.15.174:0/2455302077 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f6150003ea0 con 0x7f6154101c10 2024-09-19T06:01:43.868 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.866+0000 7f614affd640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f61400a3270 0x7f61400a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:43.868 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.866+0000 7f614affd640 1 -- 172.21.15.174:0/2455302077 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3805+0+0 (secure 0 0 0) 0x7f61500ce020 con 0x7f6154101c10 2024-09-19T06:01:43.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.866+0000 7f6159207640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f61400a3270 0x7f61400a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:43.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.867+0000 7f6159207640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f61400a3270 0x7f61400a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6144006010 tx=0x7f6144000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:43.872 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:43.871+0000 7f614affd640 1 -- 172.21.15.174:0/2455302077 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6150009de0 con 0x7f6154101c10 2024-09-19T06:01:44.054 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:01:44.052+0000 7f615bc6c640 1 -- 172.21.15.174:0/2455302077 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6154062630 con 0x7f61400a3270 2024-09-19T06:01:44.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='osd.4 [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi169 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-19T06:01:44.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:44.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:44.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:44.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:44.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:44.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:44.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:44.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:44.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:44.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:01:44.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='osd.4 [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi169 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:44.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:44.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:44.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:44.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:44.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:44.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:44.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:44.777 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4[45351]: 2024-09-19T06:01:44.471+0000 7f795f6d0640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T06:01:44.778 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4[45351]: 2024-09-19T06:01:44.477+0000 7f795bd0a640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:01:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:01:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:01:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='osd.4 [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:01:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:01:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi169 2024-09-19T06:01:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:44.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:45.606 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:45 smithi174 ceph-mon[34488]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:45.606 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:45 smithi174 ceph-mon[34488]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:01:45.606 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:45 smithi174 ceph-mon[34488]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:01:45.606 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:45.606 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:45.606 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:45 smithi103 ceph-mon[30925]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:45 smithi103 ceph-mon[30925]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:01:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:45 smithi103 ceph-mon[30925]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:01:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:45.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:45 smithi169 ceph-mon[34350]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:45.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:45 smithi169 ceph-mon[34350]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:01:45.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:45 smithi169 ceph-mon[34350]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:01:45.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:45.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:45.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:01:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:01:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: osd.4 [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] boot 2024-09-19T06:01:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T06:01:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/4167073621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab67f7da-dbde-496e-9a67-cf4fc7be01a9"}]: dispatch 2024-09-19T06:01:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab67f7da-dbde-496e-9a67-cf4fc7be01a9"}]: dispatch 2024-09-19T06:01:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab67f7da-dbde-496e-9a67-cf4fc7be01a9"}]': finished 2024-09-19T06:01:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T06:01:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:01:46.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:01:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:01:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: osd.4 [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] boot 2024-09-19T06:01:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T06:01:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: from='client.? 172.21.15.174:0/4167073621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab67f7da-dbde-496e-9a67-cf4fc7be01a9"}]: dispatch 2024-09-19T06:01:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab67f7da-dbde-496e-9a67-cf4fc7be01a9"}]: dispatch 2024-09-19T06:01:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab67f7da-dbde-496e-9a67-cf4fc7be01a9"}]': finished 2024-09-19T06:01:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T06:01:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:01:46.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:01:46.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:01:46.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:01:46.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: osd.4 [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] boot 2024-09-19T06:01:46.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T06:01:46.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:01:46.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/4167073621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab67f7da-dbde-496e-9a67-cf4fc7be01a9"}]: dispatch 2024-09-19T06:01:46.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab67f7da-dbde-496e-9a67-cf4fc7be01a9"}]: dispatch 2024-09-19T06:01:46.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab67f7da-dbde-496e-9a67-cf4fc7be01a9"}]': finished 2024-09-19T06:01:46.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T06:01:46.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:01:47.782 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:47 smithi169 ceph-mon[34350]: from='client.? 172.21.15.174:0/4185935359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:47.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:47 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/4185935359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:47 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/4185935359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:48.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:48 smithi174 ceph-mon[34488]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:48 smithi103 ceph-mon[30925]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:48.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:48 smithi169 ceph-mon[34350]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:50.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:50 smithi169 ceph-mon[34350]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:50.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:50 smithi174 ceph-mon[34488]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:50.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:50 smithi103 ceph-mon[30925]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:52.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:52 smithi169 ceph-mon[34350]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:52.822 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:52 smithi174 ceph-mon[34488]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:52.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:52 smithi103 ceph-mon[30925]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:54.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:54 smithi169 ceph-mon[34350]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:54.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:54 smithi174 ceph-mon[34488]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:54.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:54 smithi103 ceph-mon[30925]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:55.808 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:55 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:01:55.808 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:55 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:55 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:01:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:55 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:55.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:55 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:01:55.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:55 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:56.743 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:56 smithi174 ceph-mon[34488]: Deploying daemon osd.5 on smithi174 2024-09-19T06:01:56.743 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:56 smithi174 ceph-mon[34488]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:56 smithi103 ceph-mon[30925]: Deploying daemon osd.5 on smithi174 2024-09-19T06:01:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:56 smithi103 ceph-mon[30925]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:57.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:56 smithi169 ceph-mon[34350]: Deploying daemon osd.5 on smithi174 2024-09-19T06:01:57.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:56 smithi169 ceph-mon[34350]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:58.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:01:58 smithi174 ceph-mon[34488]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:01:58 smithi103 ceph-mon[30925]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:01:59.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:01:58 smithi169 ceph-mon[34350]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:00.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:00 smithi174 ceph-mon[34488]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:00 smithi103 ceph-mon[30925]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:01.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:00 smithi169 ceph-mon[34350]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:01.612 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:01 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:01.612 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:01 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:01.612 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:01 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:01.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:01 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:01.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:01 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:01.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:01 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:02.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:01 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:02.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:01 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:02.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:01 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:02.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:02 smithi174 ceph-mon[34488]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:02.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:02 smithi103 ceph-mon[30925]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:03.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:02 smithi169 ceph-mon[34350]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:04.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.171+0000 7f614affd640 1 -- 172.21.15.174:0/2455302077 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6154062630 con 0x7f61400a3270 2024-09-19T06:02:04.173 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 5 on host 'smithi174' 2024-09-19T06:02:04.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.173+0000 7f615bc6c640 1 -- 172.21.15.174:0/2455302077 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f61400a3270 msgr2=0x7f61400a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:04.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.173+0000 7f615bc6c640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f61400a3270 0x7f61400a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6144006010 tx=0x7f6144000bc0 comp rx=0 tx=0).stop 2024-09-19T06:02:04.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.173+0000 7f615bc6c640 1 -- 172.21.15.174:0/2455302077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6154101c10 msgr2=0x7f6154197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:04.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.173+0000 7f615bc6c640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6154101c10 0x7f6154197e40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f615000d770 tx=0x7f615000dc30 comp rx=0 tx=0).stop 2024-09-19T06:02:04.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.173+0000 7f615bc6c640 1 -- 172.21.15.174:0/2455302077 shutdown_connections 2024-09-19T06:02:04.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.173+0000 7f615bc6c640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f61400a3270 0x7f61400a5730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:04.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.173+0000 7f615bc6c640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61541037d0 0x7f615419f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:04.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.173+0000 7f615bc6c640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6154102e10 0x7f6154198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:04.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.173+0000 7f615bc6c640 1 --2- 172.21.15.174:0/2455302077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6154101c10 0x7f6154197e40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:04.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.174+0000 7f615bc6c640 1 -- 172.21.15.174:0/2455302077 >> 172.21.15.174:0/2455302077 conn(0x7f61540fd3c0 msgr2=0x7f6154106280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:04.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.174+0000 7f615bc6c640 1 -- 172.21.15.174:0/2455302077 shutdown_connections 2024-09-19T06:02:04.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:04.174+0000 7f615bc6c640 1 -- 172.21.15.174:0/2455302077 wait complete. 2024-09-19T06:02:04.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:04 smithi103 ceph-mon[30925]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:04.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:04.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:04.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:04.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.745 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:04 smithi174 ceph-mon[34488]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:04.745 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.745 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.745 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:04.745 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:04.748 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.748 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:04.748 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.748 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.773 DEBUG:teuthology.orchestra.run.smithi174:osd.5> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T06:02:04.776 INFO:tasks.cephadm:Deploying osd.6 on smithi103 with /dev/vg_nvme/lv_2... 2024-09-19T06:02:04.776 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:02:04.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:04 smithi169 ceph-mon[34350]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:04.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:04.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:04.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:04.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:04.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:05.035 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:02:06.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:06 smithi103 ceph-mon[30925]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:06.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:06 smithi174 ceph-mon[34488]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:06.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:06 smithi169 ceph-mon[34350]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:02:07.454 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:02:07 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:02:07.155+0000 7f069ad3b640 -1 osd.5 0 log_to_monitors true 2024-09-19T06:02:07.468 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_2 2024-09-19T06:02:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:02:07.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:07 smithi103 ceph-mon[30925]: from='osd.5 [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:02:07.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:07 smithi103 ceph-mon[30925]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:02:07.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:07 smithi169 ceph-mon[34350]: from='osd.5 [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:02:07.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:07 smithi169 ceph-mon[34350]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:02:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:07 smithi174 ceph-mon[34488]: from='osd.5 [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:02:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:07 smithi174 ceph-mon[34488]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:02:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.186+0000 7f51b31aa640 1 -- 172.21.15.103:0/1166405757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ac1037e0 msgr2=0x7f51ac10a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.186+0000 7f51b31aa640 1 --2- 172.21.15.103:0/1166405757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ac1037e0 0x7f51ac10a070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009ca0 tx=0x7f51a402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 -- 172.21.15.103:0/1166405757 shutdown_connections 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 --2- 172.21.15.103:0/1166405757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ac1037e0 0x7f51ac10a070 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 --2- 172.21.15.103:0/1166405757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac102e20 0x7f51ac1032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 --2- 172.21.15.103:0/1166405757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51ac101c20 0x7f51ac102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 -- 172.21.15.103:0/1166405757 >> 172.21.15.103:0/1166405757 conn(0x7f51ac0fd3b0 msgr2=0x7f51ac0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 -- 172.21.15.103:0/1166405757 shutdown_connections 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 -- 172.21.15.103:0/1166405757 wait complete. 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 Processor -- start 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 -- start start 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac101c20 0x7f51ac075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ac102e20 0x7f51ac0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:08.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51ac1037e0 0x7f51ac074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac10d7d0 con 0x7f51ac102e20 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac10d650 con 0x7f51ac1037e0 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.187+0000 7f51b31aa640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac10d950 con 0x7f51ac101c20 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51abfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ac102e20 0x7f51ac0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51abfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ac102e20 0x7f51ac0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36252/0 (socket says 172.21.15.103:36252) 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51abfff640 1 -- 172.21.15.103:0/2828055552 learned_addr learned my addr 172.21.15.103:0/2828055552 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51b0f46640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac101c20 0x7f51ac075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51b1747640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51ac1037e0 0x7f51ac074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51abfff640 1 -- 172.21.15.103:0/2828055552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac101c20 msgr2=0x7f51ac075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51abfff640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac101c20 0x7f51ac075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51abfff640 1 -- 172.21.15.103:0/2828055552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51ac1037e0 msgr2=0x7f51ac074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:08.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51abfff640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51ac1037e0 0x7f51ac074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51abfff640 1 -- 172.21.15.103:0/2828055552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac0753e0 con 0x7f51ac102e20 2024-09-19T06:02:08.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51b1747640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51ac1037e0 0x7f51ac074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:02:08.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51abfff640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ac102e20 0x7f51ac0745e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f519800d950 tx=0x7f519800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:08.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51a9ffb640 1 -- 172.21.15.103:0/2828055552 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198017030 con 0x7f51ac102e20 2024-09-19T06:02:08.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51b31aa640 1 -- 172.21.15.103:0/2828055552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ac1a1fe0 con 0x7f51ac102e20 2024-09-19T06:02:08.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51a9ffb640 1 -- 172.21.15.103:0/2828055552 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5198004020 con 0x7f51ac102e20 2024-09-19T06:02:08.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.188+0000 7f51a9ffb640 1 -- 172.21.15.103:0/2828055552 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198005570 con 0x7f51ac102e20 2024-09-19T06:02:08.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.189+0000 7f51b31aa640 1 -- 172.21.15.103:0/2828055552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ac1a2440 con 0x7f51ac102e20 2024-09-19T06:02:08.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.190+0000 7f51b31aa640 1 -- 172.21.15.103:0/2828055552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ac108fc0 con 0x7f51ac102e20 2024-09-19T06:02:08.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.191+0000 7f51a9ffb640 1 -- 172.21.15.103:0/2828055552 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f51980041d0 con 0x7f51ac102e20 2024-09-19T06:02:08.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.192+0000 7f51a9ffb640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f519c0a3240 0x7f519c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:08.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.192+0000 7f51b0f46640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f519c0a3240 0x7f519c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:08.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.192+0000 7f51a9ffb640 1 -- 172.21.15.103:0/2828055552 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4237+0+0 (secure 0 0 0) 0x7f51980ce340 con 0x7f51ac102e20 2024-09-19T06:02:08.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.193+0000 7f51b0f46640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f519c0a3240 0x7f519c0a5700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f51ac102c80 tx=0x7f51a0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:08.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.201+0000 7f51a9ffb640 1 -- 172.21.15.103:0/2828055552 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f519800e350 con 0x7f51ac102e20 2024-09-19T06:02:08.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:08.383+0000 7f51b31aa640 1 -- 172.21.15.103:0/2828055552 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f51ac062630 con 0x7f519c0a3240 2024-09-19T06:02:08.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:08.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:02:08.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T06:02:08.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:08.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='osd.5 [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi174 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi174 to 8544M 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:08.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:08.746 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:08.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='osd.5 [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi174 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:08.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi174 to 8544M 2024-09-19T06:02:08.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:08.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:08.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:08.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:08.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:02:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T06:02:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='osd.5 [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi174 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi174 to 8544M 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:08.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:08.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:09.704 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:02:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:02:09.294+0000 7f069649b640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T06:02:09.704 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:02:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:02:09.307+0000 7f068eacd640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:02:09.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:09 smithi174 ceph-mon[34488]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:09.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:09 smithi174 ceph-mon[34488]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:02:09.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:09 smithi174 ceph-mon[34488]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T06:02:09.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:09.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:09.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:09 smithi174 ceph-mon[34488]: from='osd.5 ' entity='osd.5' 2024-09-19T06:02:09.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:09 smithi103 ceph-mon[30925]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:09.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:09 smithi103 ceph-mon[30925]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:02:09.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:09 smithi103 ceph-mon[30925]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T06:02:09.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:09.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:09.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:09 smithi103 ceph-mon[30925]: from='osd.5 ' entity='osd.5' 2024-09-19T06:02:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:09 smithi169 ceph-mon[34350]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:09 smithi169 ceph-mon[34350]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:02:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:09 smithi169 ceph-mon[34350]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T06:02:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:09.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:09 smithi169 ceph-mon[34350]: from='osd.5 ' entity='osd.5' 2024-09-19T06:02:10.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:10 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:02:10.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:10 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:02:10.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:10 smithi103 ceph-mon[30925]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:10.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:10.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:10 smithi103 ceph-mon[30925]: osd.5 [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] boot 2024-09-19T06:02:10.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:10 smithi103 ceph-mon[30925]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T06:02:10.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:10.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:10 smithi103 ceph-mon[30925]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T06:02:10.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:10 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:02:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:10 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:02:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:10 smithi169 ceph-mon[34350]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:10 smithi169 ceph-mon[34350]: osd.5 [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] boot 2024-09-19T06:02:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:10 smithi169 ceph-mon[34350]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T06:02:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:10 smithi169 ceph-mon[34350]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T06:02:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:10 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:02:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:10 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:02:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:10 smithi174 ceph-mon[34488]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:02:10.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:10.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:10 smithi174 ceph-mon[34488]: osd.5 [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] boot 2024-09-19T06:02:10.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:10 smithi174 ceph-mon[34488]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T06:02:10.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:02:10.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:10 smithi174 ceph-mon[34488]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T06:02:11.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:11 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3309081174' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "751db20c-1173-4ab2-99fd-29882790017f"}]: dispatch 2024-09-19T06:02:11.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:11 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3309081174' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "751db20c-1173-4ab2-99fd-29882790017f"}]': finished 2024-09-19T06:02:11.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:11 smithi169 ceph-mon[34350]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T06:02:11.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:11 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:11.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:11 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2113705141' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:11 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3309081174' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "751db20c-1173-4ab2-99fd-29882790017f"}]: dispatch 2024-09-19T06:02:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:11 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3309081174' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "751db20c-1173-4ab2-99fd-29882790017f"}]': finished 2024-09-19T06:02:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:11 smithi174 ceph-mon[34488]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T06:02:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:11 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:11 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2113705141' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:11 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3309081174' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "751db20c-1173-4ab2-99fd-29882790017f"}]: dispatch 2024-09-19T06:02:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:11 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3309081174' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "751db20c-1173-4ab2-99fd-29882790017f"}]': finished 2024-09-19T06:02:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:11 smithi103 ceph-mon[30925]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T06:02:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:11 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:11 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2113705141' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:12.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:12 smithi169 ceph-mon[34350]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:12.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:12 smithi169 ceph-mon[34350]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T06:02:12.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:12 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:12.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:12 smithi174 ceph-mon[34488]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:12.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:12 smithi174 ceph-mon[34488]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T06:02:12.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:12 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:12 smithi103 ceph-mon[30925]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:12 smithi103 ceph-mon[30925]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T06:02:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:12 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:14.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:13 smithi174 ceph-mon[34488]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T06:02:14.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:14.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:13 smithi174 ceph-mon[34488]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:14.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:13 smithi103 ceph-mon[30925]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T06:02:14.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:14.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:13 smithi103 ceph-mon[30925]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:14.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:13 smithi169 ceph-mon[34350]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T06:02:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:13 smithi169 ceph-mon[34350]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:16.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:16 smithi103 ceph-mon[30925]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T06:02:16.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:16 smithi169 ceph-mon[34350]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T06:02:16.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:16 smithi174 ceph-mon[34488]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T06:02:18.596 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:18 smithi103 ceph-mon[30925]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T06:02:18.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:18 smithi169 ceph-mon[34350]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T06:02:18.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:18 smithi174 ceph-mon[34488]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T06:02:19.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:19 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:02:19.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:19 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:19.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:19 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:02:19.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:19 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:19.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:19 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:02:19.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:19 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:20.666 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:20 smithi103 ceph-mon[30925]: Deploying daemon osd.6 on smithi103 2024-09-19T06:02:20.666 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:20 smithi103 ceph-mon[30925]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:02:20.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:20 smithi169 ceph-mon[34350]: Deploying daemon osd.6 on smithi103 2024-09-19T06:02:20.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:20 smithi169 ceph-mon[34350]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:02:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:20 smithi174 ceph-mon[34488]: Deploying daemon osd.6 on smithi103 2024-09-19T06:02:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:20 smithi174 ceph-mon[34488]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:02:22.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:22 smithi103 ceph-mon[30925]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T06:02:22.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:22 smithi169 ceph-mon[34350]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T06:02:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:22 smithi174 ceph-mon[34488]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T06:02:24.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:24 smithi103 ceph-mon[30925]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T06:02:24.756 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:24 smithi174 ceph-mon[34488]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T06:02:24.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:24 smithi169 ceph-mon[34350]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T06:02:25.586 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:25 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:25.586 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:25 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:25.586 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:25 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:25.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:25 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:25.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:25 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:25 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:25 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:25 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:25 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:26.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:26 smithi103 ceph-mon[30925]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:02:26.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:26 smithi169 ceph-mon[34350]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:02:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:26 smithi174 ceph-mon[34488]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:02:28.600 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:28 smithi103 ceph-mon[30925]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:28.600 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:28 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:28.600 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:28 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:28.601 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:28 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:28.601 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:28 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:28.601 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:28 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.637+0000 7f51a9ffb640 1 -- 172.21.15.103:0/2828055552 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f51ac062630 con 0x7f519c0a3240 2024-09-19T06:02:28.640 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 6 on host 'smithi103' 2024-09-19T06:02:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 -- 172.21.15.103:0/2828055552 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f519c0a3240 msgr2=0x7f519c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f519c0a3240 0x7f519c0a5700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f51ac102c80 tx=0x7f51a0009110 comp rx=0 tx=0).stop 2024-09-19T06:02:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 -- 172.21.15.103:0/2828055552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ac102e20 msgr2=0x7f51ac0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ac102e20 0x7f51ac0745e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f519800d950 tx=0x7f519800dd50 comp rx=0 tx=0).stop 2024-09-19T06:02:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 -- 172.21.15.103:0/2828055552 shutdown_connections 2024-09-19T06:02:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f519c0a3240 0x7f519c0a5700 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51ac1037e0 0x7f51ac074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ac102e20 0x7f51ac0745e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 --2- 172.21.15.103:0/2828055552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac101c20 0x7f51ac075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 -- 172.21.15.103:0/2828055552 >> 172.21.15.103:0/2828055552 conn(0x7f51ac0fd3b0 msgr2=0x7f51ac106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 -- 172.21.15.103:0/2828055552 shutdown_connections 2024-09-19T06:02:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:02:28.640+0000 7f51b31aa640 1 -- 172.21.15.103:0/2828055552 wait complete. 2024-09-19T06:02:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:28 smithi174 ceph-mon[34488]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:28 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:28 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:28 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:28 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:28 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:29.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:28 smithi169 ceph-mon[34350]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:28 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:28 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:28 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:28 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:28 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:29.238 DEBUG:teuthology.orchestra.run.smithi103:osd.6> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T06:02:29.240 INFO:tasks.cephadm:Deploying osd.7 on smithi169 with /dev/vg_nvme/lv_2... 2024-09-19T06:02:29.240 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:02:29.498 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:02:29.808 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:29 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:29.808 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:29 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:29.808 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:29 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:29.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:29 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:29.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:29 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:29.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:29 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:29.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:29 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:29.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:29 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:29.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:29 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:30.666 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:30 smithi169 ceph-mon[34350]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:30.937 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:30 smithi103 ceph-mon[30925]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:30.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:30 smithi174 ceph-mon[34488]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:31.244 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:02:30 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:02:30.933+0000 7f51c4b5f640 -1 osd.6 0 log_to_monitors true 2024-09-19T06:02:31.651 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:02:31.666 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:31 smithi169 ceph-mon[34350]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:02:31.680 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_2 2024-09-19T06:02:31.937 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:02:31.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:31 smithi174 ceph-mon[34488]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:02:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:31 smithi103 ceph-mon[30925]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:02:32.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.444+0000 7f12e2413640 1 -- 172.21.15.169:0/832779650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12dc1026d0 msgr2=0x7f12dc108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.444+0000 7f12e2413640 1 --2- 172.21.15.169:0/832779650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12dc1026d0 0x7f12dc108f60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009ca0 tx=0x7f12d402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.444+0000 7f12e2413640 1 -- 172.21.15.169:0/832779650 shutdown_connections 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.444+0000 7f12e2413640 1 --2- 172.21.15.169:0/832779650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12dc1026d0 0x7f12dc108f60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.444+0000 7f12e2413640 1 --2- 172.21.15.169:0/832779650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc101d10 0x7f12dc102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.444+0000 7f12e2413640 1 --2- 172.21.15.169:0/832779650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12dc100b10 0x7f12dc100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.444+0000 7f12e2413640 1 -- 172.21.15.169:0/832779650 >> 172.21.15.169:0/832779650 conn(0x7f12dc0fc2a0 msgr2=0x7f12dc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.444+0000 7f12e2413640 1 -- 172.21.15.169:0/832779650 shutdown_connections 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.444+0000 7f12e2413640 1 -- 172.21.15.169:0/832779650 wait complete. 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e2413640 1 Processor -- start 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e2413640 1 -- start start 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e2413640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc100b10 0x7f12dc196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:32.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e2413640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12dc101d10 0x7f12dc1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e2413640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12dc1026d0 0x7f12dc19e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e2413640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc10c620 con 0x7f12dc100b10 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e2413640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc10c4a0 con 0x7f12dc1026d0 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e2413640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc10c7a0 con 0x7f12dc101d10 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e09b0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12dc1026d0 0x7f12dc19e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e09b0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12dc1026d0 0x7f12dc19e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:58890/0 (socket says 172.21.15.169:58890) 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.445+0000 7f12e09b0640 1 -- 172.21.15.169:0/2528109006 learned_addr learned my addr 172.21.15.169:0/2528109006 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12dbfff640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc100b10 0x7f12dc196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12db7fe640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12dc101d10 0x7f12dc1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12e09b0640 1 -- 172.21.15.169:0/2528109006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12dc101d10 msgr2=0x7f12dc1971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:32.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12e09b0640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12dc101d10 0x7f12dc1971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12e09b0640 1 -- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc100b10 msgr2=0x7f12dc196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12e09b0640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc100b10 0x7f12dc196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12e09b0640 1 -- 172.21.15.169:0/2528109006 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc19e890 con 0x7f12dc1026d0 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12dbfff640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc100b10 0x7f12dc196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12db7fe640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12dc101d10 0x7f12dc1971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12e09b0640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12dc1026d0 0x7f12dc19e1f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009dc0 tx=0x7f12d4003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12d97fa640 1 -- 172.21.15.169:0/2528109006 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d404a070 con 0x7f12dc1026d0 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12e2413640 1 -- 172.21.15.169:0/2528109006 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc06a790 con 0x7f12dc1026d0 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12d97fa640 1 -- 172.21.15.169:0/2528109006 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12d4032ec0 con 0x7f12dc1026d0 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12d97fa640 1 -- 172.21.15.169:0/2528109006 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4030a80 con 0x7f12dc1026d0 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.446+0000 7f12e2413640 1 -- 172.21.15.169:0/2528109006 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc06acd0 con 0x7f12dc1026d0 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.447+0000 7f12e2413640 1 -- 172.21.15.169:0/2528109006 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12dc100f10 con 0x7f12dc1026d0 2024-09-19T06:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.448+0000 7f12d97fa640 1 -- 172.21.15.169:0/2528109006 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f12d404d070 con 0x7f12dc1026d0 2024-09-19T06:02:32.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.449+0000 7f12d97fa640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12c40a3240 0x7f12c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:32.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.449+0000 7f12d97fa640 1 -- 172.21.15.169:0/2528109006 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4669+0+0 (secure 0 0 0) 0x7f12d40f1370 con 0x7f12dc1026d0 2024-09-19T06:02:32.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.449+0000 7f12dbfff640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12c40a3240 0x7f12c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:32.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.449+0000 7f12dbfff640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12c40a3240 0x7f12c40a5700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f12dc198150 tx=0x7f12cc005dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:32.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.453+0000 7f12d97fa640 1 -- 172.21.15.169:0/2528109006 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f12d4082210 con 0x7f12dc1026d0 2024-09-19T06:02:32.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:32.629+0000 7f12e2413640 1 -- 172.21.15.169:0/2528109006 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f12dc06af30 con 0x7f12c40a3240 2024-09-19T06:02:32.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:32.957 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:32.958 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:32.958 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:32.958 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:32.958 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:32 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:32.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:32.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:02:32.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T06:02:32.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:02:32.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:32.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:32.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:32 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:33.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:33.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:33.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:33.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:33.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:33.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:32 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:33.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:02:33.421+0000 7f51c02bf640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T06:02:33.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:02:33.433+0000 7f51b88f1640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:02:33.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi103 2024-09-19T06:02:33.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi103 to 5696M 2024-09-19T06:02:33.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-mon[30925]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:33.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-mon[30925]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:02:33.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-mon[30925]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:02:33.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:33.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:33.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-mon[30925]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:33.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-mon[30925]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' 2024-09-19T06:02:33.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:33 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi103 2024-09-19T06:02:33.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:33 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi103 to 5696M 2024-09-19T06:02:33.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:33 smithi174 ceph-mon[34488]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:33.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:33 smithi174 ceph-mon[34488]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:02:33.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:33 smithi174 ceph-mon[34488]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:02:33.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:33.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:33.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:33 smithi174 ceph-mon[34488]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:33.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:33 smithi174 ceph-mon[34488]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' 2024-09-19T06:02:33.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:33.975 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:33 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi103 2024-09-19T06:02:33.975 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:33 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi103 to 5696M 2024-09-19T06:02:33.976 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:33 smithi169 ceph-mon[34350]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:33.976 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:33 smithi169 ceph-mon[34350]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:02:33.976 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:33 smithi169 ceph-mon[34350]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:02:33.976 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:33.976 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:33.976 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:33 smithi169 ceph-mon[34350]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:02:33.976 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:33 smithi169 ceph-mon[34350]: from='osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370]' entity='osd.6' 2024-09-19T06:02:33.976 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:34 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:02:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:34 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:02:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:34 smithi174 ceph-mon[34488]: osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] boot 2024-09-19T06:02:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:34 smithi174 ceph-mon[34488]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T06:02:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:34.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:34 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:02:34.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:34 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:02:34.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:34 smithi103 ceph-mon[30925]: osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] boot 2024-09-19T06:02:34.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:34 smithi103 ceph-mon[30925]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T06:02:34.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:34 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:02:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:34 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:02:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:34 smithi169 ceph-mon[34350]: osd.6 [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] boot 2024-09-19T06:02:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:34 smithi169 ceph-mon[34350]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T06:02:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:02:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:35 smithi169 ceph-mon[34350]: from='client.? 172.21.15.169:0/3788976252' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bff8a33-9e53-43f6-be75-e3d1483adc68"}]: dispatch 2024-09-19T06:02:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:35 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bff8a33-9e53-43f6-be75-e3d1483adc68"}]: dispatch 2024-09-19T06:02:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:35 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bff8a33-9e53-43f6-be75-e3d1483adc68"}]': finished 2024-09-19T06:02:35.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:35 smithi169 ceph-mon[34350]: osdmap e42: 8 total, 7 up, 8 in 2024-09-19T06:02:35.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:35 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:35.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:35 smithi169 ceph-mon[34350]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:35.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:35 smithi169 ceph-mon[34350]: from='client.? 172.21.15.169:0/3038351858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:35 smithi174 ceph-mon[34488]: from='client.? 172.21.15.169:0/3788976252' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bff8a33-9e53-43f6-be75-e3d1483adc68"}]: dispatch 2024-09-19T06:02:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:35 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bff8a33-9e53-43f6-be75-e3d1483adc68"}]: dispatch 2024-09-19T06:02:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:35 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bff8a33-9e53-43f6-be75-e3d1483adc68"}]': finished 2024-09-19T06:02:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:35 smithi174 ceph-mon[34488]: osdmap e42: 8 total, 7 up, 8 in 2024-09-19T06:02:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:35 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:35 smithi174 ceph-mon[34488]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:35 smithi174 ceph-mon[34488]: from='client.? 172.21.15.169:0/3038351858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:35.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:35 smithi103 ceph-mon[30925]: from='client.? 172.21.15.169:0/3788976252' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bff8a33-9e53-43f6-be75-e3d1483adc68"}]: dispatch 2024-09-19T06:02:35.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:35 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bff8a33-9e53-43f6-be75-e3d1483adc68"}]: dispatch 2024-09-19T06:02:35.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:35 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bff8a33-9e53-43f6-be75-e3d1483adc68"}]': finished 2024-09-19T06:02:35.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:35 smithi103 ceph-mon[30925]: osdmap e42: 8 total, 7 up, 8 in 2024-09-19T06:02:35.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:35 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:35.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:35 smithi103 ceph-mon[30925]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:35.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:35 smithi103 ceph-mon[30925]: from='client.? 172.21.15.169:0/3038351858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:37.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:36 smithi169 ceph-mon[34350]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T06:02:37.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:36 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:37.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:36 smithi174 ceph-mon[34488]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T06:02:37.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:36 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:37.493 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:36 smithi103 ceph-mon[30925]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T06:02:37.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:36 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:38.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:38 smithi169 ceph-mon[34350]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:38.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:38 smithi174 ceph-mon[34488]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:38.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:38 smithi103 ceph-mon[30925]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:40.573 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:40 smithi169 ceph-mon[34350]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:40.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:40 smithi103 ceph-mon[30925]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:40.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:40 smithi174 ceph-mon[34488]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:42.724 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:42 smithi169 ceph-mon[34350]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:42.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:42 smithi103 ceph-mon[30925]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:42.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:42 smithi174 ceph-mon[34488]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:43.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:43 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:02:43.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:43 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:43 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:02:43.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:43 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:43.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:43 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:02:43.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:43 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:44.651 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:44 smithi169 ceph-mon[34350]: Deploying daemon osd.7 on smithi169 2024-09-19T06:02:44.651 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:44 smithi169 ceph-mon[34350]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:44.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:44 smithi103 ceph-mon[30925]: Deploying daemon osd.7 on smithi169 2024-09-19T06:02:44.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:44 smithi103 ceph-mon[30925]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:44 smithi174 ceph-mon[34488]: Deploying daemon osd.7 on smithi169 2024-09-19T06:02:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:44 smithi174 ceph-mon[34488]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:46.736 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:46 smithi103 ceph-mon[30925]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:46.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:46 smithi169 ceph-mon[34350]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:46 smithi174 ceph-mon[34488]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:48.527 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:48 smithi169 ceph-mon[34350]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:48 smithi103 ceph-mon[30925]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:48.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:48 smithi174 ceph-mon[34488]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:49.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:49 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:49.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:49 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:49.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:49 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:49.764 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:49 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:49.764 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:49 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:49.764 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:49 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:49 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:49 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:49 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:50.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:50 smithi103 ceph-mon[30925]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:50.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:50 smithi169 ceph-mon[34350]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:50.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:50 smithi174 ceph-mon[34488]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:52.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:52 smithi103 ceph-mon[30925]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:52.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:52.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:52.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:52.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:52.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:52 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:52.769 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:52 smithi169 ceph-mon[34350]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:52.769 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:52.769 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:52.770 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:52.770 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:52.770 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:52 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:52.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.809+0000 7f12d97fa640 1 -- 172.21.15.169:0/2528109006 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f12dc06af30 con 0x7f12c40a3240 2024-09-19T06:02:52.811 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 7 on host 'smithi169' 2024-09-19T06:02:52.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 -- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12c40a3240 msgr2=0x7f12c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:52.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12c40a3240 0x7f12c40a5700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f12dc198150 tx=0x7f12cc005dd0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 -- 172.21.15.169:0/2528109006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12dc1026d0 msgr2=0x7f12dc19e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:52.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12dc1026d0 0x7f12dc19e1f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009dc0 tx=0x7f12d4003ba0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 -- 172.21.15.169:0/2528109006 shutdown_connections 2024-09-19T06:02:52.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12c40a3240 0x7f12c40a5700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12dc1026d0 0x7f12dc19e1f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12dc101d10 0x7f12dc1971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 --2- 172.21.15.169:0/2528109006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc100b10 0x7f12dc196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 -- 172.21.15.169:0/2528109006 >> 172.21.15.169:0/2528109006 conn(0x7f12dc0fc2a0 msgr2=0x7f12dc1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:52.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 -- 172.21.15.169:0/2528109006 shutdown_connections 2024-09-19T06:02:52.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:02:52.812+0000 7f12e2413640 1 -- 172.21.15.169:0/2528109006 wait complete. 2024-09-19T06:02:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:52 smithi174 ceph-mon[34488]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:52.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:52 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:53.401 DEBUG:teuthology.orchestra.run.smithi169:osd.7> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T06:02:53.404 INFO:tasks.cephadm:Deploying osd.8 on smithi174 with /dev/vg_nvme/lv_2... 2024-09-19T06:02:53.404 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:02:53.649 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:53 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:53.649 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:53 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:53.649 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:53 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:53.660 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:02:53.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:53 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:53.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:53 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:53.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:53 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:53.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:53 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:53.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:53 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:53.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:53 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:54.680 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:54 smithi169 ceph-mon[34350]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:54.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:54 smithi174 ceph-mon[34488]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:54.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:54 smithi103 ceph-mon[30925]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:55.500 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:02:55 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:02:55.171+0000 7f978ec61640 -1 osd.7 0 log_to_monitors true 2024-09-19T06:02:55.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:55 smithi174 ceph-mon[34488]: from='osd.7 [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:02:55.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:55 smithi174 ceph-mon[34488]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:02:55.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:55 smithi169 ceph-mon[34350]: from='osd.7 [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:02:55.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:55 smithi169 ceph-mon[34350]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:02:55.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:55 smithi103 ceph-mon[30925]: from='osd.7 [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:02:55.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:55 smithi103 ceph-mon[30925]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:02:56.079 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T06:02:56.107 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_2 2024-09-19T06:02:56.364 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:02:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:02:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='osd.7 [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:02:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T06:02:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:02:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='osd.7 [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:56.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.813+0000 7f3023a9e640 1 -- 172.21.15.174:0/2701059667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f301c107960 msgr2=0x7f301c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:56.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.813+0000 7f3023a9e640 1 --2- 172.21.15.174:0/2701059667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f301c107960 0x7f301c109d50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3014009ca0 tx=0x7f301402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:02:56.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.813+0000 7f3023a9e640 1 -- 172.21.15.174:0/2701059667 shutdown_connections 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.813+0000 7f3023a9e640 1 --2- 172.21.15.174:0/2701059667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f301c107960 0x7f301c109d50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.813+0000 7f3023a9e640 1 --2- 172.21.15.174:0/2701059667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f301c105030 0x7f301c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.813+0000 7f3023a9e640 1 --2- 172.21.15.174:0/2701059667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f301c102700 0x7f301c104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.813+0000 7f3023a9e640 1 -- 172.21.15.174:0/2701059667 >> 172.21.15.174:0/2701059667 conn(0x7f301c0fc280 msgr2=0x7f301c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.813+0000 7f3023a9e640 1 -- 172.21.15.174:0/2701059667 shutdown_connections 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.813+0000 7f3023a9e640 1 -- 172.21.15.174:0/2701059667 wait complete. 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f3023a9e640 1 Processor -- start 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f3023a9e640 1 -- start start 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f3023a9e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f301c102700 0x7f301c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f3023a9e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f301c105030 0x7f301c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:56.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f3023a9e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f301c107960 0x7f301c19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f3023a9e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f301c10d730 con 0x7f301c105030 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f3023a9e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f301c10d5b0 con 0x7f301c102700 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f3023a9e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f301c10d8b0 con 0x7f301c107960 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f302203b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f301c107960 0x7f301c19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f302203b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f301c107960 0x7f301c19f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:41946/0 (socket says 172.21.15.174:41946) 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f302183a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f301c102700 0x7f301c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f302203b640 1 -- 172.21.15.174:0/3473478202 learned_addr learned my addr 172.21.15.174:0/3473478202 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f3021039640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f301c105030 0x7f301c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f302203b640 1 -- 172.21.15.174:0/3473478202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f301c102700 msgr2=0x7f301c197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f302203b640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f301c102700 0x7f301c197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f302203b640 1 -- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f301c105030 msgr2=0x7f301c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:56.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f302203b640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f301c105030 0x7f301c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:56.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f302203b640 1 -- 172.21.15.174:0/3473478202 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301c19fa40 con 0x7f301c107960 2024-09-19T06:02:56.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.814+0000 7f3021039640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f301c105030 0x7f301c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:02:56.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.815+0000 7f302203b640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f301c107960 0x7f301c19f3d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3014031970 tx=0x7f3014003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:56.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.815+0000 7f3012ffd640 1 -- 172.21.15.174:0/3473478202 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014004040 con 0x7f301c107960 2024-09-19T06:02:56.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.815+0000 7f3023a9e640 1 -- 172.21.15.174:0/3473478202 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301c19fcd0 con 0x7f301c107960 2024-09-19T06:02:56.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.815+0000 7f3012ffd640 1 -- 172.21.15.174:0/3473478202 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3014004690 con 0x7f301c107960 2024-09-19T06:02:56.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.815+0000 7f3012ffd640 1 -- 172.21.15.174:0/3473478202 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014030c60 con 0x7f301c107960 2024-09-19T06:02:56.820 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.815+0000 7f3023a9e640 1 -- 172.21.15.174:0/3473478202 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f301c1a01c0 con 0x7f301c107960 2024-09-19T06:02:56.821 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.816+0000 7f3023a9e640 1 -- 172.21.15.174:0/3473478202 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f301c0fdd70 con 0x7f301c107960 2024-09-19T06:02:56.821 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.817+0000 7f3012ffd640 1 -- 172.21.15.174:0/3473478202 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f30140041e0 con 0x7f301c107960 2024-09-19T06:02:56.821 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.818+0000 7f3012ffd640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30080a3270 0x7f30080a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:56.821 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.818+0000 7f3012ffd640 1 -- 172.21.15.174:0/3473478202 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7f30140f0160 con 0x7f301c107960 2024-09-19T06:02:56.821 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.818+0000 7f302183a640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30080a3270 0x7f30080a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:56.821 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.819+0000 7f302183a640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30080a3270 0x7f30080a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f300c00bbe0 tx=0x7f300c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:56.824 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:56.822+0000 7f3012ffd640 1 -- 172.21.15.174:0/3473478202 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f30140bdc20 con 0x7f301c107960 2024-09-19T06:02:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:02:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='osd.7 [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:02:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T06:02:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:02:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:56.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:56.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:56.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:56.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:56.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:56.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:02:57.005 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:02:57.004+0000 7f3023a9e640 1 -- 172.21.15.174:0/3473478202 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f301c062630 con 0x7f30080a3270 2024-09-19T06:02:57.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:57 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi169 2024-09-19T06:02:57.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:57 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-19T06:02:57.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:57 smithi174 ceph-mon[34488]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:02:57.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:57 smithi174 ceph-mon[34488]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:02:57.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:57 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:57.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:57 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:57.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:57 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:57.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:57 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:57.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:57 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:57.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:57 smithi174 ceph-mon[34488]: from='osd.7 ' entity='osd.7' 2024-09-19T06:02:57.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:02:57.331+0000 7f978a3c1640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T06:02:57.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:02:57.344+0000 7f97829f3640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:02:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi169 2024-09-19T06:02:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-19T06:02:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-mon[34350]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:02:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-mon[34350]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:02:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:57.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:57.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:57.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:57.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:57 smithi169 ceph-mon[34350]: from='osd.7 ' entity='osd.7' 2024-09-19T06:02:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:57 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi169 2024-09-19T06:02:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:57 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-19T06:02:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:57 smithi103 ceph-mon[30925]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:02:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:57 smithi103 ceph-mon[30925]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:02:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:57.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:57.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:57.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:57.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:57.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:57 smithi103 ceph-mon[30925]: from='osd.7 ' entity='osd.7' 2024-09-19T06:02:58.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:58 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:02:58.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:58 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:02:58.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:58 smithi174 ceph-mon[34488]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:58.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:58 smithi174 ceph-mon[34488]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:58.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:58 smithi174 ceph-mon[34488]: osd.7 [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] boot 2024-09-19T06:02:58.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:58 smithi174 ceph-mon[34488]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T06:02:58.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:58 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:58.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:58 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:02:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:58 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:02:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:58 smithi169 ceph-mon[34350]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:58 smithi169 ceph-mon[34350]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:58 smithi169 ceph-mon[34350]: osd.7 [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] boot 2024-09-19T06:02:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:58 smithi169 ceph-mon[34350]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T06:02:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:58 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:58 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:02:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:58 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:02:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:58 smithi103 ceph-mon[30925]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:58 smithi103 ceph-mon[30925]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:02:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:58 smithi103 ceph-mon[30925]: osd.7 [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] boot 2024-09-19T06:02:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:58 smithi103 ceph-mon[30925]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T06:02:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:58 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:02:59.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:59 smithi169 ceph-mon[34350]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T06:02:59.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:59 smithi169 ceph-mon[34350]: from='client.? 172.21.15.174:0/3836183788' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2a01657-b797-40d9-9837-dd8475335c05"}]: dispatch 2024-09-19T06:02:59.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:59 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2a01657-b797-40d9-9837-dd8475335c05"}]: dispatch 2024-09-19T06:02:59.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:59 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2a01657-b797-40d9-9837-dd8475335c05"}]': finished 2024-09-19T06:02:59.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:59 smithi169 ceph-mon[34350]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T06:02:59.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:02:59 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:02:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:59 smithi174 ceph-mon[34488]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T06:02:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:59 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/3836183788' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2a01657-b797-40d9-9837-dd8475335c05"}]: dispatch 2024-09-19T06:02:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:59 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2a01657-b797-40d9-9837-dd8475335c05"}]: dispatch 2024-09-19T06:02:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:59 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2a01657-b797-40d9-9837-dd8475335c05"}]': finished 2024-09-19T06:02:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:59 smithi174 ceph-mon[34488]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T06:02:59.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:02:59 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:02:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:59 smithi103 ceph-mon[30925]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T06:02:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:59 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/3836183788' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2a01657-b797-40d9-9837-dd8475335c05"}]: dispatch 2024-09-19T06:02:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:59 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2a01657-b797-40d9-9837-dd8475335c05"}]: dispatch 2024-09-19T06:02:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:59 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2a01657-b797-40d9-9837-dd8475335c05"}]': finished 2024-09-19T06:02:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:59 smithi103 ceph-mon[30925]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T06:02:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:02:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:00 smithi174 ceph-mon[34488]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:00 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/2841658906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:00 smithi174 ceph-mon[34488]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T06:03:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:00 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:00 smithi103 ceph-mon[30925]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:00 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/2841658906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:00 smithi103 ceph-mon[30925]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T06:03:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:00 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:01.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:00 smithi169 ceph-mon[34350]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:01.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:00 smithi169 ceph-mon[34350]: from='client.? 172.21.15.174:0/2841658906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:01.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:00 smithi169 ceph-mon[34350]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T06:03:01.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:00 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:02.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:02 smithi169 ceph-mon[34350]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T06:03:02.529 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:02.529 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:02 smithi169 ceph-mon[34350]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 637 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:02.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:02 smithi174 ceph-mon[34488]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T06:03:02.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:02.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:02 smithi174 ceph-mon[34488]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 637 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:02.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:02 smithi103 ceph-mon[30925]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T06:03:02.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:02.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:02 smithi103 ceph-mon[30925]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 637 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:04.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:04 smithi103 ceph-mon[30925]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:04.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:04 smithi169 ceph-mon[34350]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:04.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:04 smithi174 ceph-mon[34488]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:06.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:06 smithi103 ceph-mon[30925]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:06.757 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:06 smithi174 ceph-mon[34488]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:06.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:06 smithi169 ceph-mon[34350]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:08.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:08 smithi174 ceph-mon[34488]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:08.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:03:08.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:08 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:08.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:08 smithi103 ceph-mon[30925]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:08.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:03:08.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:08 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:08.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:08 smithi169 ceph-mon[34350]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:08.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:03:08.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:08 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:09.733 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:09 smithi174 ceph-mon[34488]: Deploying daemon osd.8 on smithi174 2024-09-19T06:03:09.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:09 smithi103 ceph-mon[30925]: Deploying daemon osd.8 on smithi174 2024-09-19T06:03:09.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:09 smithi169 ceph-mon[34350]: Deploying daemon osd.8 on smithi174 2024-09-19T06:03:10.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:10 smithi103 ceph-mon[30925]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:10.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:10 smithi169 ceph-mon[34350]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:10.900 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:10 smithi174 ceph-mon[34488]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:12.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:12 smithi174 ceph-mon[34488]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:12.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:12 smithi103 ceph-mon[30925]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:12.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:12 smithi169 ceph-mon[34350]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:14.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:14 smithi174 ceph-mon[34488]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:14.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:14 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:14.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:14 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:14.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:14 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:14.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:14 smithi103 ceph-mon[30925]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:14.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:14 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:14.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:14 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:14.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:14 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:14.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:14 smithi169 ceph-mon[34350]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:14.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:14 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:14.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:14 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:14.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:14 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:16.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:16 smithi169 ceph-mon[34350]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:16.854 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:16 smithi174 ceph-mon[34488]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:16.901 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 8 on host 'smithi174' 2024-09-19T06:03:16.901 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.899+0000 7f3012ffd640 1 -- 172.21.15.174:0/3473478202 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f301c062630 con 0x7f30080a3270 2024-09-19T06:03:16.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 -- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30080a3270 msgr2=0x7f30080a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30080a3270 0x7f30080a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f300c00bbe0 tx=0x7f300c00b390 comp rx=0 tx=0).stop 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 -- 172.21.15.174:0/3473478202 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f301c107960 msgr2=0x7f301c19f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f301c107960 0x7f301c19f3d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3014031970 tx=0x7f3014003ba0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 -- 172.21.15.174:0/3473478202 shutdown_connections 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30080a3270 0x7f30080a5730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f301c107960 0x7f301c19f3d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f301c105030 0x7f301c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 --2- 172.21.15.174:0/3473478202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f301c102700 0x7f301c197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 -- 172.21.15.174:0/3473478202 >> 172.21.15.174:0/3473478202 conn(0x7f301c0fc280 msgr2=0x7f301c1031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 -- 172.21.15.174:0/3473478202 shutdown_connections 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:03:16.901+0000 7f3023a9e640 1 -- 172.21.15.174:0/3473478202 wait complete. 2024-09-19T06:03:16.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:16 smithi103 ceph-mon[30925]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:17.601 DEBUG:teuthology.orchestra.run.smithi174:osd.8> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T06:03:17.604 INFO:tasks.cephadm:Deploying osd.9 on smithi103 with /dev/vg_nvme/lv_1... 2024-09-19T06:03:17.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:03:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:18.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:17 smithi174 ceph-mon[34488]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:18.211 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:17 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.211 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:17 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.211 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:17 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.211 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:17 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.211 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:17 smithi103 ceph-mon[30925]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:18.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:17 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:17 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:17 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:17 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:18.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:17 smithi169 ceph-mon[34350]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:19.869 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:03:19 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:03:19.638+0000 7fcc97b22640 -1 osd.8 0 log_to_monitors true 2024-09-19T06:03:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:03:20.395 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_1 2024-09-19T06:03:20.661 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='osd.8 [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:20.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:20.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:20.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:20.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:20.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='osd.8 [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:03:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:03:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:20.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='osd.8 [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:03:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:03:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:20.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:21.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.150+0000 7f9f00377640 1 -- 172.21.15.103:0/3362990830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ef8101d00 msgr2=0x7f9ef8102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.150+0000 7f9f00377640 1 --2- 172.21.15.103:0/3362990830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ef8101d00 0x7f9ef8102180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009900 tx=0x7f9ee802a410 comp rx=0 tx=0).stop 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.150+0000 7f9f00377640 1 -- 172.21.15.103:0/3362990830 shutdown_connections 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.150+0000 7f9f00377640 1 --2- 172.21.15.103:0/3362990830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ef81026c0 0x7f9ef8108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.150+0000 7f9f00377640 1 --2- 172.21.15.103:0/3362990830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ef8101d00 0x7f9ef8102180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.150+0000 7f9f00377640 1 --2- 172.21.15.103:0/3362990830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ef8100b00 0x7f9ef8100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.150+0000 7f9f00377640 1 -- 172.21.15.103:0/3362990830 >> 172.21.15.103:0/3362990830 conn(0x7f9ef80fc270 msgr2=0x7f9ef80fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.150+0000 7f9f00377640 1 -- 172.21.15.103:0/3362990830 shutdown_connections 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.150+0000 7f9f00377640 1 -- 172.21.15.103:0/3362990830 wait complete. 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9f00377640 1 Processor -- start 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9f00377640 1 -- start start 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9f00377640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ef8100b00 0x7f9ef8197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:21.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9f00377640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ef8101d00 0x7f9ef8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9f00377640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ef81026c0 0x7f9ef819f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9f00377640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef810c630 con 0x7f9ef8101d00 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9f00377640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef810c4b0 con 0x7f9ef8100b00 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9f00377640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef810c7b0 con 0x7f9ef81026c0 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9efd912640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ef8101d00 0x7f9ef8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9efd912640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ef8101d00 0x7f9ef8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52806/0 (socket says 172.21.15.103:52806) 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9efd912640 1 -- 172.21.15.103:0/2806787724 learned_addr learned my addr 172.21.15.103:0/2806787724 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9efe113640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ef8100b00 0x7f9ef8197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.151+0000 7f9efe914640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ef81026c0 0x7f9ef819f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.152+0000 7f9efd912640 1 -- 172.21.15.103:0/2806787724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ef81026c0 msgr2=0x7f9ef819f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.152+0000 7f9efd912640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ef81026c0 0x7f9ef819f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.152+0000 7f9efd912640 1 -- 172.21.15.103:0/2806787724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ef8100b00 msgr2=0x7f9ef8197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.152+0000 7f9efd912640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ef8100b00 0x7f9ef8197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:21.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.152+0000 7f9efd912640 1 -- 172.21.15.103:0/2806787724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef819fb20 con 0x7f9ef8101d00 2024-09-19T06:03:21.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.152+0000 7f9efd912640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ef8101d00 0x7f9ef8198430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8005940 tx=0x7f9ee8031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:21.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.152+0000 7f9eef7fe640 1 -- 172.21.15.103:0/2806787724 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee803f030 con 0x7f9ef8101d00 2024-09-19T06:03:21.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.152+0000 7f9eef7fe640 1 -- 172.21.15.103:0/2806787724 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ee8003aa0 con 0x7f9ef8101d00 2024-09-19T06:03:21.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.152+0000 7f9f00377640 1 -- 172.21.15.103:0/2806787724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef819fdb0 con 0x7f9ef8101d00 2024-09-19T06:03:21.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.152+0000 7f9eef7fe640 1 -- 172.21.15.103:0/2806787724 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8035070 con 0x7f9ef8101d00 2024-09-19T06:03:21.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.153+0000 7f9f00377640 1 -- 172.21.15.103:0/2806787724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef81a0230 con 0x7f9ef8101d00 2024-09-19T06:03:21.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.154+0000 7f9f00377640 1 -- 172.21.15.103:0/2806787724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef81a0520 con 0x7f9ef8101d00 2024-09-19T06:03:21.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.154+0000 7f9eef7fe640 1 -- 172.21.15.103:0/2806787724 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f9ee8042030 con 0x7f9ef8101d00 2024-09-19T06:03:21.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.155+0000 7f9eef7fe640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9ee40a3270 0x7f9ee40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:21.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.155+0000 7f9efe113640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9ee40a3270 0x7f9ee40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:21.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.155+0000 7f9eef7fe640 1 -- 172.21.15.103:0/2806787724 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5533+0+0 (secure 0 0 0) 0x7f9ee80eec50 con 0x7f9ef8101d00 2024-09-19T06:03:21.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.155+0000 7f9efe113640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9ee40a3270 0x7f9ee40a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8101b60 tx=0x7f9ef4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:21.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.163+0000 7f9eef7fe640 1 -- 172.21.15.103:0/2806787724 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ee80f4020 con 0x7f9ef8101d00 2024-09-19T06:03:21.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:21.341+0000 7f9f00377640 1 -- 172.21.15.103:0/2806787724 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9ef806aef0 con 0x7f9ee40a3270 2024-09-19T06:03:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi174 2024-09-19T06:03:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi174 to 5696M 2024-09-19T06:03:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:03:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:03:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: from='osd.8 [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:03:21.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:21.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:03:21.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:03:21.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:03:21.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:21.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:21 smithi103 ceph-mon[30925]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:03:21.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi174 2024-09-19T06:03:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi174 to 5696M 2024-09-19T06:03:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:03:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:03:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: from='osd.8 [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:03:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:03:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:03:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:03:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:21.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:21 smithi169 ceph-mon[34350]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:03:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi174 2024-09-19T06:03:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi174 to 5696M 2024-09-19T06:03:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:03:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:03:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: from='osd.8 [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:03:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:03:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:03:21.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:03:21.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:21.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:21 smithi174 ceph-mon[34488]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:03:22.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:03:22 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:03:22.297+0000 7fcc93282640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T06:03:22.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:03:22 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:03:22.308+0000 7fcc8b8b4640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:03:22.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:22 smithi174 ceph-mon[34488]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:22.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:22 smithi174 ceph-mon[34488]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:22.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:22 smithi174 ceph-mon[34488]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:03:22.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:22.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:22.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:22 smithi174 ceph-mon[34488]: from='osd.8 ' entity='osd.8' 2024-09-19T06:03:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:22 smithi103 ceph-mon[30925]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:22 smithi103 ceph-mon[30925]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:22 smithi103 ceph-mon[30925]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:03:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:22 smithi103 ceph-mon[30925]: from='osd.8 ' entity='osd.8' 2024-09-19T06:03:22.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:22 smithi169 ceph-mon[34350]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:22.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:22 smithi169 ceph-mon[34350]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:22.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:22 smithi169 ceph-mon[34350]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:03:22.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:22 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:22.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:22 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:22.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:22 smithi169 ceph-mon[34350]: from='osd.8 ' entity='osd.8' 2024-09-19T06:03:23.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:23 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:03:23.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:23 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:03:23.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:23 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:23.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:23 smithi103 ceph-mon[30925]: osd.8 [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] boot 2024-09-19T06:03:23.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:23 smithi103 ceph-mon[30925]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T06:03:23.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:23 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:23.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:23 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:03:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:23 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:03:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:23 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:23 smithi169 ceph-mon[34350]: osd.8 [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] boot 2024-09-19T06:03:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:23 smithi169 ceph-mon[34350]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T06:03:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:23 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:23 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:03:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:23 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:03:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:23 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:23 smithi174 ceph-mon[34488]: osd.8 [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] boot 2024-09-19T06:03:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:23 smithi174 ceph-mon[34488]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T06:03:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:23 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:03:24.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:24 smithi103 ceph-mon[30925]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:24.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:24 smithi103 ceph-mon[30925]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T06:03:24.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:24 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1438096641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0c75553-c854-445a-9eed-de0409117cd9"}]: dispatch 2024-09-19T06:03:24.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:24 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1438096641' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0c75553-c854-445a-9eed-de0409117cd9"}]': finished 2024-09-19T06:03:24.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:24 smithi103 ceph-mon[30925]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T06:03:24.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:24 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:24.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:24 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/4031773090' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:24.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:24 smithi169 ceph-mon[34350]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:24 smithi169 ceph-mon[34350]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T06:03:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:24 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1438096641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0c75553-c854-445a-9eed-de0409117cd9"}]: dispatch 2024-09-19T06:03:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:24 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1438096641' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0c75553-c854-445a-9eed-de0409117cd9"}]': finished 2024-09-19T06:03:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:24 smithi169 ceph-mon[34350]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T06:03:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:24 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:24 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/4031773090' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:24.855 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:24 smithi174 ceph-mon[34488]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:03:24.856 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:24 smithi174 ceph-mon[34488]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T06:03:24.856 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:24 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1438096641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0c75553-c854-445a-9eed-de0409117cd9"}]: dispatch 2024-09-19T06:03:24.856 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:24 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1438096641' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0c75553-c854-445a-9eed-de0409117cd9"}]': finished 2024-09-19T06:03:24.856 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:24 smithi174 ceph-mon[34488]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T06:03:24.856 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:24 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:24.856 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:24 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/4031773090' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:26.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:26 smithi174 ceph-mon[34488]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T06:03:26.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:26 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:26.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:26 smithi174 ceph-mon[34488]: pgmap v186: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:26.527 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:26 smithi169 ceph-mon[34350]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T06:03:26.527 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:26 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:26.527 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:26 smithi169 ceph-mon[34350]: pgmap v186: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:26.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:26 smithi103 ceph-mon[30925]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T06:03:26.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:26 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:26.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:26 smithi103 ceph-mon[30925]: pgmap v186: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:27.527 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:27 smithi169 ceph-mon[34350]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T06:03:27.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:27 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:27.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:27 smithi174 ceph-mon[34488]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T06:03:27.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:27 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:27.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:27 smithi103 ceph-mon[30925]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T06:03:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:27 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:28.527 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:28 smithi169 ceph-mon[34350]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:28.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:28 smithi174 ceph-mon[34488]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:28.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:28 smithi103 ceph-mon[30925]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:30.621 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:30 smithi103 ceph-mon[30925]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:03:30.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:30 smithi169 ceph-mon[34350]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:03:30.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:30 smithi174 ceph-mon[34488]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:03:32.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:32 smithi103 ceph-mon[30925]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-19T06:03:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:32 smithi169 ceph-mon[34350]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-19T06:03:32.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:32 smithi174 ceph-mon[34488]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-19T06:03:33.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:03:33.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:33.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:33 smithi103 ceph-mon[30925]: Deploying daemon osd.9 on smithi103 2024-09-19T06:03:33.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:03:33.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:33.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:33 smithi169 ceph-mon[34350]: Deploying daemon osd.9 on smithi103 2024-09-19T06:03:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:03:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:33 smithi174 ceph-mon[34488]: Deploying daemon osd.9 on smithi103 2024-09-19T06:03:34.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:34 smithi103 ceph-mon[30925]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:03:34.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:34 smithi169 ceph-mon[34350]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:03:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:34 smithi174 ceph-mon[34488]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:03:36.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:36 smithi103 ceph-mon[30925]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:03:36.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:36 smithi169 ceph-mon[34350]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:03:36.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:36 smithi174 ceph-mon[34488]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:03:38.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:38 smithi169 ceph-mon[34350]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T06:03:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:38 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:38.784 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:38 smithi103 ceph-mon[30925]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T06:03:38.784 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:38.784 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:38.784 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:38 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:38 smithi174 ceph-mon[34488]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T06:03:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:38 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:40.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:40 smithi103 ceph-mon[30925]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:03:40.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:40 smithi169 ceph-mon[34350]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:03:40.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:40 smithi174 ceph-mon[34488]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:03:42.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.064+0000 7f9eef7fe640 1 -- 172.21.15.103:0/2806787724 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9ef806aef0 con 0x7f9ee40a3270 2024-09-19T06:03:42.066 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 9 on host 'smithi103' 2024-09-19T06:03:42.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 -- 172.21.15.103:0/2806787724 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9ee40a3270 msgr2=0x7f9ee40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:42.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9ee40a3270 0x7f9ee40a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8101b60 tx=0x7f9ef4005f90 comp rx=0 tx=0).stop 2024-09-19T06:03:42.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 -- 172.21.15.103:0/2806787724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ef8101d00 msgr2=0x7f9ef8198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:42.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ef8101d00 0x7f9ef8198430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8005940 tx=0x7f9ee8031a30 comp rx=0 tx=0).stop 2024-09-19T06:03:42.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 -- 172.21.15.103:0/2806787724 shutdown_connections 2024-09-19T06:03:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9ee40a3270 0x7f9ee40a5730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ef81026c0 0x7f9ef819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ef8101d00 0x7f9ef8198430 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 --2- 172.21.15.103:0/2806787724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ef8100b00 0x7f9ef8197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 -- 172.21.15.103:0/2806787724 >> 172.21.15.103:0/2806787724 conn(0x7f9ef80fc270 msgr2=0x7f9ef806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 -- 172.21.15.103:0/2806787724 shutdown_connections 2024-09-19T06:03:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:03:42.067+0000 7f9f00377640 1 -- 172.21.15.103:0/2806787724 wait complete. 2024-09-19T06:03:42.527 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:42 smithi169 ceph-mon[34350]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:42.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:42.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:42.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:42.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:42 smithi174 ceph-mon[34488]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:42.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:42.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:42.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:42 smithi103 ceph-mon[30925]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:42.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:42.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:42.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:42.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:42.749 DEBUG:teuthology.orchestra.run.smithi103:osd.9> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T06:03:42.752 INFO:tasks.cephadm:Deploying osd.10 on smithi169 with /dev/vg_nvme/lv_1... 2024-09-19T06:03:42.752 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:03:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:03:44.197 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:03:43 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:03:43.911+0000 7fa483815640 -1 osd.9 0 log_to_monitors true 2024-09-19T06:03:44.706 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:44 smithi169 ceph-mon[34350]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:44.706 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:44 smithi169 ceph-mon[34350]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:03:44.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:44 smithi103 ceph-mon[30925]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:44.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:44 smithi103 ceph-mon[30925]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:03:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:44 smithi174 ceph-mon[34488]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:44 smithi174 ceph-mon[34488]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:03:45.192 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T06:03:45.219 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_1 2024-09-19T06:03:45.474 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:03:45.506 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:03:45 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:03:45.491+0000 7fa47ef75640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T06:03:45.507 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:03:45 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:03:45.505+0000 7fa47b5af640 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:03:45.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:45 smithi103 ceph-mon[30925]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:03:45.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:45 smithi103 ceph-mon[30925]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:03:45.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:45 smithi103 ceph-mon[30925]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:03:45.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:45.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:45 smithi103 ceph-mon[30925]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:03:45.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:45 smithi103 ceph-mon[30925]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:03:45.507 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:45.756 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:45 smithi169 ceph-mon[34350]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:03:45.756 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:45 smithi169 ceph-mon[34350]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:03:45.757 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:45 smithi169 ceph-mon[34350]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:03:45.757 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:45.757 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:45 smithi169 ceph-mon[34350]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:03:45.757 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:45 smithi169 ceph-mon[34350]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:03:45.757 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:45.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 -- 172.21.15.169:0/3752939300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8fc102690 msgr2=0x7fe8fc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 --2- 172.21.15.169:0/3752939300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8fc102690 0x7fe8fc108f20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009ca0 tx=0x7fe8f402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 -- 172.21.15.169:0/3752939300 shutdown_connections 2024-09-19T06:03:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 --2- 172.21.15.169:0/3752939300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8fc102690 0x7fe8fc108f20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 --2- 172.21.15.169:0/3752939300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8fc101cd0 0x7fe8fc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 --2- 172.21.15.169:0/3752939300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8fc100ad0 0x7fe8fc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 -- 172.21.15.169:0/3752939300 >> 172.21.15.169:0/3752939300 conn(0x7fe8fc0fc280 msgr2=0x7fe8fc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 -- 172.21.15.169:0/3752939300 shutdown_connections 2024-09-19T06:03:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 -- 172.21.15.169:0/3752939300 wait complete. 2024-09-19T06:03:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 Processor -- start 2024-09-19T06:03:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.920+0000 7fe90298a640 1 -- start start 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe90298a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8fc100ad0 0x7fe8fc104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe90298a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8fc101cd0 0x7fe8fc1030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe90298a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8fc102690 0x7fe8fc1035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe90298a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc10c600 con 0x7fe8fc101cd0 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe90298a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc10c480 con 0x7fe8fc102690 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe90298a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc10c780 con 0x7fe8fc100ad0 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe900f27640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8fc102690 0x7fe8fc1035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe900f27640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8fc102690 0x7fe8fc1035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:34034/0 (socket says 172.21.15.169:34034) 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe900f27640 1 -- 172.21.15.169:0/1477654513 learned_addr learned my addr 172.21.15.169:0/1477654513 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe8fbfff640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8fc100ad0 0x7fe8fc104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe8fb7fe640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8fc101cd0 0x7fe8fc1030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe900f27640 1 -- 172.21.15.169:0/1477654513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8fc100ad0 msgr2=0x7fe8fc104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe900f27640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8fc100ad0 0x7fe8fc104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe900f27640 1 -- 172.21.15.169:0/1477654513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8fc101cd0 msgr2=0x7fe8fc1030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe900f27640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8fc101cd0 0x7fe8fc1030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe900f27640 1 -- 172.21.15.169:0/1477654513 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc103eb0 con 0x7fe8fc102690 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe900f27640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8fc102690 0x7fe8fc1035f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4031970 tx=0x7fe8f4032d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.921+0000 7fe8f97fa640 1 -- 172.21.15.169:0/1477654513 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4051070 con 0x7fe8fc102690 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.922+0000 7fe90298a640 1 -- 172.21.15.169:0/1477654513 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8fc197a40 con 0x7fe8fc102690 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.922+0000 7fe8f97fa640 1 -- 172.21.15.169:0/1477654513 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8f4041e50 con 0x7fe8fc102690 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.922+0000 7fe8f97fa640 1 -- 172.21.15.169:0/1477654513 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40046c0 con 0x7fe8fc102690 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.922+0000 7fe90298a640 1 -- 172.21.15.169:0/1477654513 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8fc197fd0 con 0x7fe8fc102690 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.923+0000 7fe90298a640 1 -- 172.21.15.169:0/1477654513 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8fc198230 con 0x7fe8fc102690 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.924+0000 7fe8f97fa640 1 -- 172.21.15.169:0/1477654513 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fe8f4054070 con 0x7fe8fc102690 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.924+0000 7fe8f97fa640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8e80a3240 0x7fe8e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.924+0000 7fe8f97fa640 1 -- 172.21.15.169:0/1477654513 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5981+0+0 (secure 0 0 0) 0x7fe8f40f7b70 con 0x7fe8fc102690 2024-09-19T06:03:45.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.925+0000 7fe8fbfff640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8e80a3240 0x7fe8e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:45.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.925+0000 7fe8fbfff640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8e80a3240 0x7fe8e80a5700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc101b30 tx=0x7fe8ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:45.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:45.929+0000 7fe8f97fa640 1 -- 172.21.15.169:0/1477654513 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8f4089210 con 0x7fe8fc102690 2024-09-19T06:03:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:45 smithi174 ceph-mon[34488]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:03:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:45 smithi174 ceph-mon[34488]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:03:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:45 smithi174 ceph-mon[34488]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-19T06:03:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:45.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:45 smithi174 ceph-mon[34488]: from='osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-19T06:03:45.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:45 smithi174 ceph-mon[34488]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:03:45.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:46.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:03:46.111+0000 7fe90298a640 1 -- 172.21.15.169:0/1477654513 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe8fc06a730 con 0x7fe8e80a3240 2024-09-19T06:03:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi103 2024-09-19T06:03:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi103 to 4272M 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:46.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi103 2024-09-19T06:03:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi103 to 4272M 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:46.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi103 2024-09-19T06:03:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi103 to 4272M 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:47.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:47 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:03:47.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:47 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:03:47.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:47 smithi169 ceph-mon[34350]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:47.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:47 smithi169 ceph-mon[34350]: osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] boot 2024-09-19T06:03:47.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:47 smithi169 ceph-mon[34350]: osdmap e60: 10 total, 10 up, 10 in 2024-09-19T06:03:47.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:47 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:47 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:03:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:47 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:03:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:47 smithi174 ceph-mon[34488]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:47 smithi174 ceph-mon[34488]: osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] boot 2024-09-19T06:03:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:47 smithi174 ceph-mon[34488]: osdmap e60: 10 total, 10 up, 10 in 2024-09-19T06:03:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:47 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:47 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:03:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:47 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:03:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:47 smithi103 ceph-mon[30925]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:47 smithi103 ceph-mon[30925]: osd.9 [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] boot 2024-09-19T06:03:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:47 smithi103 ceph-mon[30925]: osdmap e60: 10 total, 10 up, 10 in 2024-09-19T06:03:47.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:47 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:03:48.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:48 smithi169 ceph-mon[34350]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:48.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:48 smithi169 ceph-mon[34350]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T06:03:48.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:48 smithi169 ceph-mon[34350]: from='client.? 172.21.15.169:0/1784738350' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0725ebf6-d24b-4683-a82d-ac043bc775a6"}]: dispatch 2024-09-19T06:03:48.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:48 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0725ebf6-d24b-4683-a82d-ac043bc775a6"}]: dispatch 2024-09-19T06:03:48.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:48 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0725ebf6-d24b-4683-a82d-ac043bc775a6"}]': finished 2024-09-19T06:03:48.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:48 smithi169 ceph-mon[34350]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T06:03:48.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:03:48.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:48 smithi174 ceph-mon[34488]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:48.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:48 smithi174 ceph-mon[34488]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T06:03:48.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:48 smithi174 ceph-mon[34488]: from='client.? 172.21.15.169:0/1784738350' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0725ebf6-d24b-4683-a82d-ac043bc775a6"}]: dispatch 2024-09-19T06:03:48.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:48 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0725ebf6-d24b-4683-a82d-ac043bc775a6"}]: dispatch 2024-09-19T06:03:48.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:48 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0725ebf6-d24b-4683-a82d-ac043bc775a6"}]': finished 2024-09-19T06:03:48.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:48 smithi174 ceph-mon[34488]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T06:03:48.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:03:48.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:48 smithi103 ceph-mon[30925]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:03:48.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:48 smithi103 ceph-mon[30925]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T06:03:48.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:48 smithi103 ceph-mon[30925]: from='client.? 172.21.15.169:0/1784738350' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0725ebf6-d24b-4683-a82d-ac043bc775a6"}]: dispatch 2024-09-19T06:03:48.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:48 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0725ebf6-d24b-4683-a82d-ac043bc775a6"}]: dispatch 2024-09-19T06:03:48.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:48 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0725ebf6-d24b-4683-a82d-ac043bc775a6"}]': finished 2024-09-19T06:03:48.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:48 smithi103 ceph-mon[30925]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T06:03:48.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:03:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:49 smithi174 ceph-mon[34488]: from='client.? 172.21.15.169:0/1650157389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:49.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:49 smithi103 ceph-mon[30925]: from='client.? 172.21.15.169:0/1650157389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:50.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:49 smithi169 ceph-mon[34350]: from='client.? 172.21.15.169:0/1650157389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:50.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:50 smithi174 ceph-mon[34488]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:50.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:50 smithi103 ceph-mon[30925]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:51.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:50 smithi169 ceph-mon[34350]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:52 smithi174 ceph-mon[34488]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:52.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:52 smithi103 ceph-mon[30925]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:53.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:52 smithi169 ceph-mon[34350]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:54.849 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:54 smithi169 ceph-mon[34350]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:54.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:54 smithi174 ceph-mon[34488]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:54.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:54 smithi103 ceph-mon[30925]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:56.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:56 smithi169 ceph-mon[34350]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:56.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:56 smithi174 ceph-mon[34488]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:56 smithi103 ceph-mon[30925]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:57.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:57 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:03:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:57 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:57 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:03:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:57 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:03:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:58.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:58 smithi169 ceph-mon[34350]: Deploying daemon osd.10 on smithi169 2024-09-19T06:03:58.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:03:58 smithi169 ceph-mon[34350]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:58 smithi174 ceph-mon[34488]: Deploying daemon osd.10 on smithi169 2024-09-19T06:03:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:03:58 smithi174 ceph-mon[34488]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:03:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:58 smithi103 ceph-mon[30925]: Deploying daemon osd.10 on smithi169 2024-09-19T06:03:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:03:58 smithi103 ceph-mon[30925]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:00.768 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:00 smithi169 ceph-mon[34350]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:00 smithi174 ceph-mon[34488]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:00 smithi103 ceph-mon[30925]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:02.718 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:02 smithi169 ceph-mon[34350]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:02.718 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:02.718 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:02.718 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:02 smithi174 ceph-mon[34488]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:02.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:02 smithi103 ceph-mon[30925]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:02.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:02.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:02.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:04.874 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:04 smithi169 ceph-mon[34350]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:04.874 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:04.875 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:04 smithi174 ceph-mon[34488]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:04.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:04 smithi103 ceph-mon[30925]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:04.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:04.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:05.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.311+0000 7fe8f97fa640 1 -- 172.21.15.169:0/1477654513 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe8fc06a730 con 0x7fe8e80a3240 2024-09-19T06:04:05.314 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 10 on host 'smithi169' 2024-09-19T06:04:05.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 -- 172.21.15.169:0/1477654513 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8e80a3240 msgr2=0x7fe8e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:05.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8e80a3240 0x7fe8e80a5700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc101b30 tx=0x7fe8ec005f90 comp rx=0 tx=0).stop 2024-09-19T06:04:05.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 -- 172.21.15.169:0/1477654513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8fc102690 msgr2=0x7fe8fc1035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:05.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8fc102690 0x7fe8fc1035f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4031970 tx=0x7fe8f4032d80 comp rx=0 tx=0).stop 2024-09-19T06:04:05.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 -- 172.21.15.169:0/1477654513 shutdown_connections 2024-09-19T06:04:05.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8e80a3240 0x7fe8e80a5700 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:05.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8fc102690 0x7fe8fc1035f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:05.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8fc101cd0 0x7fe8fc1030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:05.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 --2- 172.21.15.169:0/1477654513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8fc100ad0 0x7fe8fc104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:05.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 -- 172.21.15.169:0/1477654513 >> 172.21.15.169:0/1477654513 conn(0x7fe8fc0fc280 msgr2=0x7fe8fc06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:05.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 -- 172.21.15.169:0/1477654513 shutdown_connections 2024-09-19T06:04:05.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T06:04:05.314+0000 7fe90298a640 1 -- 172.21.15.169:0/1477654513 wait complete. 2024-09-19T06:04:05.857 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:05 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:05.858 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:05 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:05.858 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:05 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:05.858 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:05 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:05.858 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:05 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:05.858 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:05 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:05 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:05 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:05 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:05 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:05 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:05.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:05 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:05.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:05 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:05.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:05 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:05.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:05 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:05.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:05 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:05.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:05 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:05.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:05 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:06.055 DEBUG:teuthology.orchestra.run.smithi169:osd.10> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T06:04:06.057 INFO:tasks.cephadm:Deploying osd.11 on smithi174 with /dev/vg_nvme/lv_1... 2024-09-19T06:04:06.057 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:04:06.315 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:04:06.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:06 smithi174 ceph-mon[34488]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:06.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:06 smithi169 ceph-mon[34350]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:06.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:06 smithi103 ceph-mon[30925]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:08.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:04:08 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:04:08.260+0000 7fb7bf4a7640 -1 osd.10 0 log_to_monitors true 2024-09-19T06:04:08.850 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:08 smithi174 ceph-mon[34488]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:08.850 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:08 smithi174 ceph-mon[34488]: from='osd.10 [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:04:08.850 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:08 smithi174 ceph-mon[34488]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:04:08.852 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T06:04:08.884 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_1 2024-09-19T06:04:08.925 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:08 smithi169 ceph-mon[34350]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:08.925 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:08 smithi169 ceph-mon[34350]: from='osd.10 [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:04:08.925 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:08 smithi169 ceph-mon[34350]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:04:08.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:08 smithi103 ceph-mon[30925]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:08 smithi103 ceph-mon[30925]: from='osd.10 [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:04:08.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:08 smithi103 ceph-mon[30925]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:04:09.143 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:04:09.621 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.610+0000 7f120f7b7640 1 -- 172.21.15.174:0/4274930459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12081037c0 msgr2=0x7f120810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:09.621 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.610+0000 7f120f7b7640 1 --2- 172.21.15.174:0/4274930459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12081037c0 0x7f120810a050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1200009ca0 tx=0x7f120002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.621 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.610+0000 7f120f7b7640 1 -- 172.21.15.174:0/4274930459 shutdown_connections 2024-09-19T06:04:09.621 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.610+0000 7f120f7b7640 1 --2- 172.21.15.174:0/4274930459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12081037c0 0x7f120810a050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.621 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.610+0000 7f120f7b7640 1 --2- 172.21.15.174:0/4274930459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1208102e00 0x7f1208103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.621 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.610+0000 7f120f7b7640 1 --2- 172.21.15.174:0/4274930459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1208101c00 0x7f1208102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.621 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.610+0000 7f120f7b7640 1 -- 172.21.15.174:0/4274930459 >> 172.21.15.174:0/4274930459 conn(0x7f12080fd390 msgr2=0x7f12080ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:09.621 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.610+0000 7f120f7b7640 1 -- 172.21.15.174:0/4274930459 shutdown_connections 2024-09-19T06:04:09.621 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.610+0000 7f120f7b7640 1 -- 172.21.15.174:0/4274930459 wait complete. 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120f7b7640 1 Processor -- start 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120f7b7640 1 -- start start 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120f7b7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1208101c00 0x7f1208197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120f7b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1208102e00 0x7f1208198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120f7b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12081037c0 0x7f120819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120f7b7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f120810d730 con 0x7f12081037c0 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120f7b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f120810d5b0 con 0x7f1208102e00 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120f7b7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f120810d8b0 con 0x7f1208101c00 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120d553640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1208101c00 0x7f1208197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120d553640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1208101c00 0x7f1208197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:42568/0 (socket says 172.21.15.174:42568) 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120d553640 1 -- 172.21.15.174:0/3365622951 learned_addr learned my addr 172.21.15.174:0/3365622951 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T06:04:09.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120cd52640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1208102e00 0x7f1208198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.611+0000 7f120dd54640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12081037c0 0x7f120819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f120d553640 1 -- 172.21.15.174:0/3365622951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1208102e00 msgr2=0x7f1208198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f120d553640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1208102e00 0x7f1208198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f120d553640 1 -- 172.21.15.174:0/3365622951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12081037c0 msgr2=0x7f120819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f120d553640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12081037c0 0x7f120819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f120d553640 1 -- 172.21.15.174:0/3365622951 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120819f9f0 con 0x7f1208101c00 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f120d553640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1208101c00 0x7f1208197dc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f120400e9c0 tx=0x7f120400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f11fe7fc640 1 -- 172.21.15.174:0/3365622951 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120400cd80 con 0x7f1208101c00 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f11fe7fc640 1 -- 172.21.15.174:0/3365622951 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12040035f0 con 0x7f1208101c00 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f120f7b7640 1 -- 172.21.15.174:0/3365622951 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120819fce0 con 0x7f1208101c00 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f11fe7fc640 1 -- 172.21.15.174:0/3365622951 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204010690 con 0x7f1208101c00 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.612+0000 7f120f7b7640 1 -- 172.21.15.174:0/3365622951 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12081a0170 con 0x7f1208101c00 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.613+0000 7f120f7b7640 1 -- 172.21.15.174:0/3365622951 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1208109070 con 0x7f1208101c00 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.614+0000 7f11fe7fc640 1 -- 172.21.15.174:0/3365622951 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f12040037a0 con 0x7f1208101c00 2024-09-19T06:04:09.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.615+0000 7f11fe7fc640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11f40a32f0 0x7f11f40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:09.624 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.615+0000 7f11fe7fc640 1 -- 172.21.15.174:0/3365622951 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6414+0+0 (secure 0 0 0) 0x7f12040cf780 con 0x7f1208101c00 2024-09-19T06:04:09.624 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.615+0000 7f120cd52640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11f40a32f0 0x7f11f40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:09.624 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.615+0000 7f120cd52640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11f40a32f0 0x7f11f40a57b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12081992e0 tx=0x7f11f800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:09.624 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.619+0000 7f11fe7fc640 1 -- 172.21.15.174:0/3365622951 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f120409cc10 con 0x7f1208101c00 2024-09-19T06:04:09.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:09.793+0000 7f120f7b7640 1 -- 172.21.15.174:0/3365622951 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1208062630 con 0x7f11f40a32f0 2024-09-19T06:04:09.795 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:04:09.795 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T06:04:09.795 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:09.795 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='osd.10 [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:04:09.795 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:04:09.795 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:09.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:09.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:09.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:09.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:09.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:09.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:09.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:09.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:09.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:09 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:04:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T06:04:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='osd.10 [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:04:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:04:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:09.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:09.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:09.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:09.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:09.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:09.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:09.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:09.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:09 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:10.027 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:04:09.600+0000 7fb7bac07640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T06:04:10.028 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:04:09.612+0000 7fb7b7241640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:04:10.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:04:10.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T06:04:10.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:10.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='osd.10 [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:04:10.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T06:04:10.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:10.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:10.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:10.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:10.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:10.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:10.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:10.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:10.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:10.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:09 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:10.876 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi169 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: osd.10 [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] boot 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T06:04:10.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi169 2024-09-19T06:04:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-19T06:04:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:04:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T06:04:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:10.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:10.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:10.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:10.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: osd.10 [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] boot 2024-09-19T06:04:10.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T06:04:10.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:11.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi169 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: osd.10 [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] boot 2024-09-19T06:04:11.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T06:04:11.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:04:11.840 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:11 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:04:11.840 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:11 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:04:11.840 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:11 smithi174 ceph-mon[34488]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:11.840 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:11 smithi174 ceph-mon[34488]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T06:04:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:11 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:04:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:11 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:04:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:11 smithi103 ceph-mon[30925]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:11 smithi103 ceph-mon[30925]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T06:04:12.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:11 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:04:12.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:11 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:04:12.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:11 smithi169 ceph-mon[34350]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:12.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:11 smithi169 ceph-mon[34350]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T06:04:12.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:12 smithi174 ceph-mon[34488]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:12.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:12 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/2954070442' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32e645a1-8f34-4719-a667-5279a3669279"}]: dispatch 2024-09-19T06:04:12.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:12 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32e645a1-8f34-4719-a667-5279a3669279"}]: dispatch 2024-09-19T06:04:12.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:12 smithi174 ceph-mon[34488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32e645a1-8f34-4719-a667-5279a3669279"}]': finished 2024-09-19T06:04:12.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:12 smithi174 ceph-mon[34488]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T06:04:12.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:12 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:12 smithi103 ceph-mon[30925]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:12 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/2954070442' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32e645a1-8f34-4719-a667-5279a3669279"}]: dispatch 2024-09-19T06:04:12.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:12 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32e645a1-8f34-4719-a667-5279a3669279"}]: dispatch 2024-09-19T06:04:12.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:12 smithi103 ceph-mon[30925]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32e645a1-8f34-4719-a667-5279a3669279"}]': finished 2024-09-19T06:04:12.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:12 smithi103 ceph-mon[30925]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T06:04:12.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:12 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:13.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:12 smithi169 ceph-mon[34350]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:13.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:12 smithi169 ceph-mon[34350]: from='client.? 172.21.15.174:0/2954070442' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32e645a1-8f34-4719-a667-5279a3669279"}]: dispatch 2024-09-19T06:04:13.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:12 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32e645a1-8f34-4719-a667-5279a3669279"}]: dispatch 2024-09-19T06:04:13.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:12 smithi169 ceph-mon[34350]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32e645a1-8f34-4719-a667-5279a3669279"}]': finished 2024-09-19T06:04:13.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:12 smithi169 ceph-mon[34350]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T06:04:13.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:12 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:13.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:13 smithi174 ceph-mon[34488]: from='client.? 172.21.15.174:0/3654132728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:04:13.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:13 smithi174 ceph-mon[34488]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T06:04:13.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:13 smithi103 ceph-mon[30925]: from='client.? 172.21.15.174:0/3654132728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:04:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:13 smithi103 ceph-mon[30925]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T06:04:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:14.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:13 smithi169 ceph-mon[34350]: from='client.? 172.21.15.174:0/3654132728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:04:14.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:13 smithi169 ceph-mon[34350]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T06:04:14.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:14.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:14 smithi174 ceph-mon[34488]: pgmap v222: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 150 KiB/s, 0 objects/s recovering 2024-09-19T06:04:14.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:14 smithi174 ceph-mon[34488]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T06:04:14.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:14 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:14.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:14 smithi103 ceph-mon[30925]: pgmap v222: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 150 KiB/s, 0 objects/s recovering 2024-09-19T06:04:14.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:14 smithi103 ceph-mon[30925]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T06:04:14.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:14 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:15.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:14 smithi169 ceph-mon[34350]: pgmap v222: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 150 KiB/s, 0 objects/s recovering 2024-09-19T06:04:15.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:14 smithi169 ceph-mon[34350]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T06:04:15.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:14 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:16.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:16 smithi174 ceph-mon[34488]: pgmap v224: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-19T06:04:16.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:16 smithi103 ceph-mon[30925]: pgmap v224: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-19T06:04:17.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:16 smithi169 ceph-mon[34350]: pgmap v224: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-19T06:04:18.937 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:18 smithi174 ceph-mon[34488]: pgmap v225: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:04:18.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:18 smithi103 ceph-mon[30925]: pgmap v225: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:04:19.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:18 smithi169 ceph-mon[34350]: pgmap v225: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:04:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:20 smithi174 ceph-mon[34488]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T06:04:20.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:20 smithi103 ceph-mon[30925]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T06:04:21.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:20 smithi169 ceph-mon[34350]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T06:04:21.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:04:21.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:21.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:04:21.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:22.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:04:22.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:22.889 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:22 smithi174 ceph-mon[34488]: Deploying daemon osd.11 on smithi174 2024-09-19T06:04:22.889 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:22 smithi174 ceph-mon[34488]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:22.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:22 smithi103 ceph-mon[30925]: Deploying daemon osd.11 on smithi174 2024-09-19T06:04:22.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:22 smithi103 ceph-mon[30925]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:23.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:22 smithi169 ceph-mon[34350]: Deploying daemon osd.11 on smithi174 2024-09-19T06:04:23.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:22 smithi169 ceph-mon[34350]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:24 smithi174 ceph-mon[34488]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:24.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:24 smithi103 ceph-mon[30925]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:25.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:24 smithi169 ceph-mon[34350]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:26 smithi174 ceph-mon[34488]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:26 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:26 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:26 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:26.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:26 smithi103 ceph-mon[30925]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:26.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:26 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:26.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:26 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:26.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:26 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:27.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:26 smithi169 ceph-mon[34350]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:27.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:26 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:27.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:26 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:27.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:26 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:28.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:28 smithi174 ceph-mon[34488]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:28 smithi103 ceph-mon[30925]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:29.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:28 smithi169 ceph-mon[34350]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:29.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.971+0000 7f11fe7fc640 1 -- 172.21.15.174:0/3365622951 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1208062630 con 0x7f11f40a32f0 2024-09-19T06:04:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 11 on host 'smithi174' 2024-09-19T06:04:29.975 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 -- 172.21.15.174:0/3365622951 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11f40a32f0 msgr2=0x7f11f40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:29.975 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11f40a32f0 0x7f11f40a57b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12081992e0 tx=0x7f11f800b390 comp rx=0 tx=0).stop 2024-09-19T06:04:29.975 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 -- 172.21.15.174:0/3365622951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1208101c00 msgr2=0x7f1208197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:29.975 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1208101c00 0x7f1208197dc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f120400e9c0 tx=0x7f120400ee80 comp rx=0 tx=0).stop 2024-09-19T06:04:29.975 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 -- 172.21.15.174:0/3365622951 shutdown_connections 2024-09-19T06:04:29.975 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f11f40a32f0 0x7f11f40a57b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:29.975 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12081037c0 0x7f120819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:29.976 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1208102e00 0x7f1208198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:29.976 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 --2- 172.21.15.174:0/3365622951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1208101c00 0x7f1208197dc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:29.976 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 -- 172.21.15.174:0/3365622951 >> 172.21.15.174:0/3365622951 conn(0x7f12080fd390 msgr2=0x7f1208106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:29.976 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 -- 172.21.15.174:0/3365622951 shutdown_connections 2024-09-19T06:04:29.976 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:29.973+0000 7f120f7b7640 1 -- 172.21.15.174:0/3365622951 wait complete. 2024-09-19T06:04:30.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:30 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:30 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:30 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:30.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:30 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:30.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:30 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:30 smithi103 ceph-mon[30925]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:30.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:30 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:30.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:30 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:30 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.527 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:30 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:30 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:30 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:30.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:30 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:30.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:30 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:30 smithi169 ceph-mon[34350]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:30.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:30 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:30.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:30 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.528 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:30 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.544 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:30 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.544 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:30 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.544 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:30 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:30.544 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:30 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:30.544 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:30 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.544 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:30 smithi174 ceph-mon[34488]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:30.544 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:30 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:30.544 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:30 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.544 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:30 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:30.570 DEBUG:teuthology.orchestra.run.smithi174:osd.11> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T06:04:30.572 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T06:04:30.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:04:30.833 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:31.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.269+0000 7fa68ab2f640 1 -- 172.21.15.103:0/1345887718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa684100ad0 msgr2=0x7fa684100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.269+0000 7fa68ab2f640 1 --2- 172.21.15.103:0/1345887718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa684100ad0 0x7fa684100ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa678009900 tx=0x7fa67802a410 comp rx=0 tx=0).stop 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.269+0000 7fa68ab2f640 1 -- 172.21.15.103:0/1345887718 shutdown_connections 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.269+0000 7fa68ab2f640 1 --2- 172.21.15.103:0/1345887718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa684102690 0x7fa684108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.269+0000 7fa68ab2f640 1 --2- 172.21.15.103:0/1345887718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa684101cd0 0x7fa684102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.269+0000 7fa68ab2f640 1 --2- 172.21.15.103:0/1345887718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa684100ad0 0x7fa684100ed0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.269+0000 7fa68ab2f640 1 -- 172.21.15.103:0/1345887718 >> 172.21.15.103:0/1345887718 conn(0x7fa6840fc280 msgr2=0x7fa6840fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.269+0000 7fa68ab2f640 1 -- 172.21.15.103:0/1345887718 shutdown_connections 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.269+0000 7fa68ab2f640 1 -- 172.21.15.103:0/1345887718 wait complete. 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa68ab2f640 1 Processor -- start 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa68ab2f640 1 -- start start 2024-09-19T06:04:31.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa68ab2f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa684100ad0 0x7fa68406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa68ab2f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa684101cd0 0x7fa68419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa68ab2f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa684102690 0x7fa68419f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa68ab2f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa68410c660 con 0x7fa684100ad0 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa68ab2f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa68410c4e0 con 0x7fa684101cd0 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa68ab2f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa68410c7e0 con 0x7fa684102690 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa6888cb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa684100ad0 0x7fa68406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa6888cb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa684100ad0 0x7fa68406ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55414/0 (socket says 172.21.15.103:55414) 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa6888cb640 1 -- 172.21.15.103:0/2618326981 learned_addr learned my addr 172.21.15.103:0/2618326981 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa6890cc640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa684102690 0x7fa68419f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa683fff640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa684101cd0 0x7fa68419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa6888cb640 1 -- 172.21.15.103:0/2618326981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa684102690 msgr2=0x7fa68419f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa6888cb640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa684102690 0x7fa68419f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa6888cb640 1 -- 172.21.15.103:0/2618326981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa684101cd0 msgr2=0x7fa68419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa6888cb640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa684101cd0 0x7fa68419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.270+0000 7fa6888cb640 1 -- 172.21.15.103:0/2618326981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68419fa50 con 0x7fa684100ad0 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.271+0000 7fa6888cb640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa684100ad0 0x7fa68406ab10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6780314e0 tx=0x7fa678003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.271+0000 7fa681ffb640 1 -- 172.21.15.103:0/2618326981 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67803f070 con 0x7fa684100ad0 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.271+0000 7fa68ab2f640 1 -- 172.21.15.103:0/2618326981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68419fce0 con 0x7fa684100ad0 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.271+0000 7fa681ffb640 1 -- 172.21.15.103:0/2618326981 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa678031c40 con 0x7fa684100ad0 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.271+0000 7fa681ffb640 1 -- 172.21.15.103:0/2618326981 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678035030 con 0x7fa684100ad0 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.271+0000 7fa68ab2f640 1 -- 172.21.15.103:0/2618326981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6841a01c0 con 0x7fa684100ad0 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.272+0000 7fa68ab2f640 1 -- 172.21.15.103:0/2618326981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa684107f20 con 0x7fa684100ad0 2024-09-19T06:04:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.274+0000 7fa681ffb640 1 -- 172.21.15.103:0/2618326981 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fa678042070 con 0x7fa684100ad0 2024-09-19T06:04:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.275+0000 7fa681ffb640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa6740a3240 0x7fa6740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.275+0000 7fa683fff640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa6740a3240 0x7fa6740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.275+0000 7fa681ffb640 1 -- 172.21.15.103:0/2618326981 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6809+0+0 (secure 0 0 0) 0x7fa6780f0080 con 0x7fa684100ad0 2024-09-19T06:04:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.275+0000 7fa683fff640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa6740a3240 0x7fa6740a5700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa68406a890 tx=0x7fa67000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.278+0000 7fa681ffb640 1 -- 172.21.15.103:0/2618326981 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa6780bcd30 con 0x7fa684100ad0 2024-09-19T06:04:31.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.449+0000 7fa68ab2f640 1 -- 172.21.15.103:0/2618326981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa68402d9c0 con 0x7fa684100ad0 2024-09-19T06:04:31.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.449+0000 7fa681ffb640 1 -- 172.21.15.103:0/2618326981 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7fa6780c1030 con 0x7fa684100ad0 2024-09-19T06:04:31.451 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:04:31.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 -- 172.21.15.103:0/2618326981 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa6740a3240 msgr2=0x7fa6740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:31.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa6740a3240 0x7fa6740a5700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa68406a890 tx=0x7fa67000b390 comp rx=0 tx=0).stop 2024-09-19T06:04:31.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 -- 172.21.15.103:0/2618326981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa684100ad0 msgr2=0x7fa68406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa684100ad0 0x7fa68406ab10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6780314e0 tx=0x7fa678003c10 comp rx=0 tx=0).stop 2024-09-19T06:04:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 -- 172.21.15.103:0/2618326981 shutdown_connections 2024-09-19T06:04:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa6740a3240 0x7fa6740a5700 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa684102690 0x7fa68419f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa684101cd0 0x7fa68419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 --2- 172.21.15.103:0/2618326981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa684100ad0 0x7fa68406ab10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 -- 172.21.15.103:0/2618326981 >> 172.21.15.103:0/2618326981 conn(0x7fa6840fc280 msgr2=0x7fa6841050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 -- 172.21.15.103:0/2618326981 shutdown_connections 2024-09-19T06:04:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:31.452+0000 7fa68ab2f640 1 -- 172.21.15.103:0/2618326981 wait complete. 2024-09-19T06:04:31.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:31 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2618326981' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:04:31.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:31 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2618326981' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:04:31.964 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:31 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2618326981' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:04:32.204 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726725850,"num_in_osds":12,"osd_in_since":1726725852,"num_remapped_pgs":0} 2024-09-19T06:04:32.754 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:32 smithi174 ceph-mon[34488]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:32.754 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:04:32 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:04:32.647+0000 7f0b88ccf640 -1 osd.11 0 log_to_monitors true 2024-09-19T06:04:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:32 smithi169 ceph-mon[34350]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:32.997 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:32 smithi103 ceph-mon[30925]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:33.205 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:04:33.461 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='osd.11 [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:04:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:04:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:33.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:33.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:33 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='osd.11 [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:33 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.823 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='osd.11 [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:04:33.823 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:04:33.823 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.823 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.823 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.823 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.823 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.824 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:33.824 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.824 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:33.824 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:33.824 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:33 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:33.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.900+0000 7f3d00a39640 1 -- 172.21.15.103:0/4201638042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc102e00 msgr2=0x7f3cfc103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.900+0000 7f3d00a39640 1 --2- 172.21.15.103:0/4201638042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc102e00 0x7f3cfc103280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009900 tx=0x7f3cf002a410 comp rx=0 tx=0).stop 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.900+0000 7f3d00a39640 1 -- 172.21.15.103:0/4201638042 shutdown_connections 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.900+0000 7f3d00a39640 1 --2- 172.21.15.103:0/4201638042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cfc1037c0 0x7f3cfc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.900+0000 7f3d00a39640 1 --2- 172.21.15.103:0/4201638042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc102e00 0x7f3cfc103280 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.900+0000 7f3d00a39640 1 --2- 172.21.15.103:0/4201638042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cfc101c00 0x7f3cfc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.900+0000 7f3d00a39640 1 -- 172.21.15.103:0/4201638042 >> 172.21.15.103:0/4201638042 conn(0x7f3cfc0fd390 msgr2=0x7f3cfc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.900+0000 7f3d00a39640 1 -- 172.21.15.103:0/4201638042 shutdown_connections 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.900+0000 7f3d00a39640 1 -- 172.21.15.103:0/4201638042 wait complete. 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3d00a39640 1 Processor -- start 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3d00a39640 1 -- start start 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3d00a39640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cfc101c00 0x7f3cfc197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3d00a39640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cfc102e00 0x7f3cfc198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3d00a39640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1037c0 0x7f3cfc19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3d00a39640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc10d730 con 0x7f3cfc1037c0 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3d00a39640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc10d5b0 con 0x7f3cfc101c00 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3d00a39640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc10d8b0 con 0x7f3cfc102e00 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3cfad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1037c0 0x7f3cfc19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3cfad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1037c0 0x7f3cfc19f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55428/0 (socket says 172.21.15.103:55428) 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.901+0000 7f3cfad9d640 1 -- 172.21.15.103:0/345014739 learned_addr learned my addr 172.21.15.103:0/345014739 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3cfa59c640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cfc101c00 0x7f3cfc197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3cf9d9b640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cfc102e00 0x7f3cfc198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3cfad9d640 1 -- 172.21.15.103:0/345014739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cfc102e00 msgr2=0x7f3cfc198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3cfad9d640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cfc102e00 0x7f3cfc198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3cfad9d640 1 -- 172.21.15.103:0/345014739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cfc101c00 msgr2=0x7f3cfc197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3cfad9d640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cfc101c00 0x7f3cfc197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3cfad9d640 1 -- 172.21.15.103:0/345014739 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc19fa40 con 0x7f3cfc1037c0 2024-09-19T06:04:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3cfad9d640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1037c0 0x7f3cfc19f3d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400eaa0 tx=0x7f3cf400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3ceb7fe640 1 -- 172.21.15.103:0/345014739 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf400cdb0 con 0x7f3cfc1037c0 2024-09-19T06:04:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3ceb7fe640 1 -- 172.21.15.103:0/345014739 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3cf4005020 con 0x7f3cfc1037c0 2024-09-19T06:04:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3d00a39640 1 -- 172.21.15.103:0/345014739 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cfc19fd30 con 0x7f3cfc1037c0 2024-09-19T06:04:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3ceb7fe640 1 -- 172.21.15.103:0/345014739 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40116d0 con 0x7f3cfc1037c0 2024-09-19T06:04:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.902+0000 7f3d00a39640 1 -- 172.21.15.103:0/345014739 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cfc1a0210 con 0x7f3cfc1037c0 2024-09-19T06:04:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.903+0000 7f3d00a39640 1 -- 172.21.15.103:0/345014739 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cfc1090a0 con 0x7f3cfc1037c0 2024-09-19T06:04:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.904+0000 7f3ceb7fe640 1 -- 172.21.15.103:0/345014739 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f3cf40051d0 con 0x7f3cfc1037c0 2024-09-19T06:04:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.905+0000 7f3ceb7fe640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ce40a32f0 0x7f3ce40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.905+0000 7f3cfa59c640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ce40a32f0 0x7f3ce40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.905+0000 7f3ceb7fe640 1 -- 172.21.15.103:0/345014739 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6831+0+0 (secure 0 0 0) 0x7f3cf40cf520 con 0x7f3cfc1037c0 2024-09-19T06:04:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.905+0000 7f3cfa59c640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ce40a32f0 0x7f3ce40a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc102c60 tx=0x7f3cec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:33.909+0000 7f3ceb7fe640 1 -- 172.21.15.103:0/345014739 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3cf4016030 con 0x7f3cfc1037c0 2024-09-19T06:04:34.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.076+0000 7f3d00a39640 1 -- 172.21.15.103:0/345014739 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3cfc062df0 con 0x7f3cfc1037c0 2024-09-19T06:04:34.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.077+0000 7f3ceb7fe640 1 -- 172.21.15.103:0/345014739 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f3cf409c810 con 0x7f3cfc1037c0 2024-09-19T06:04:34.078 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 -- 172.21.15.103:0/345014739 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ce40a32f0 msgr2=0x7f3ce40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ce40a32f0 0x7f3ce40a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc102c60 tx=0x7f3cec005f90 comp rx=0 tx=0).stop 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 -- 172.21.15.103:0/345014739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1037c0 msgr2=0x7f3cfc19f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1037c0 0x7f3cfc19f3d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400eaa0 tx=0x7f3cf400ef60 comp rx=0 tx=0).stop 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 -- 172.21.15.103:0/345014739 shutdown_connections 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ce40a32f0 0x7f3ce40a57b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1037c0 0x7f3cfc19f3d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cfc102e00 0x7f3cfc198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 --2- 172.21.15.103:0/345014739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cfc101c00 0x7f3cfc197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 -- 172.21.15.103:0/345014739 >> 172.21.15.103:0/345014739 conn(0x7f3cfc0fd390 msgr2=0x7f3cfc106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 -- 172.21.15.103:0/345014739 shutdown_connections 2024-09-19T06:04:34.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:34.079+0000 7f3d00a39640 1 -- 172.21.15.103:0/345014739 wait complete. 2024-09-19T06:04:34.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:34 smithi103 ceph-mon[30925]: Detected new or changed devices on smithi174 2024-09-19T06:04:34.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:34 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi174 to 4272M 2024-09-19T06:04:34.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:34 smithi103 ceph-mon[30925]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:34.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:34 smithi103 ceph-mon[30925]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:04:34.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:34 smithi103 ceph-mon[30925]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:04:34.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:34.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:34 smithi103 ceph-mon[30925]: from='osd.11 [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:04:34.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:34 smithi103 ceph-mon[30925]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:04:34.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:34 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/345014739' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:04:34.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:34 smithi169 ceph-mon[34350]: Detected new or changed devices on smithi174 2024-09-19T06:04:34.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:34 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi174 to 4272M 2024-09-19T06:04:34.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:34 smithi169 ceph-mon[34350]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:34.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:34 smithi169 ceph-mon[34350]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:04:34.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:34 smithi169 ceph-mon[34350]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:04:34.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:34.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:34 smithi169 ceph-mon[34350]: from='osd.11 [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:04:34.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:34 smithi169 ceph-mon[34350]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:04:34.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:34 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/345014739' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:04:34.804 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726725850,"num_in_osds":12,"osd_in_since":1726725852,"num_remapped_pgs":0} 2024-09-19T06:04:34.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:04:34.522+0000 7f0b8442f640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T06:04:34.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:04:34.539+0000 7f0b80a69640 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:04:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-mon[34488]: Detected new or changed devices on smithi174 2024-09-19T06:04:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi174 to 4272M 2024-09-19T06:04:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-mon[34488]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-mon[34488]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:04:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-mon[34488]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:04:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-mon[34488]: from='osd.11 [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:04:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-mon[34488]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-09-19T06:04:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:34 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/345014739' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:04:35.805 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:04:35.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:35 smithi103 ceph-mon[30925]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:04:35.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:35 smithi103 ceph-mon[30925]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:04:35.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:35 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:35.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:35 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:35.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:35 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:35 smithi174 ceph-mon[34488]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:04:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:35 smithi174 ceph-mon[34488]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:04:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:35 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:35 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:35.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:35 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:36.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:35 smithi169 ceph-mon[34350]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-19T06:04:36.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:35 smithi169 ceph-mon[34350]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:04:36.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:35 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:36.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:35 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:36.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:35 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:36.065 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.499+0000 7fb23785d640 1 -- 172.21.15.103:0/4252932905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb230101c10 msgr2=0x7fb230102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.499+0000 7fb23785d640 1 --2- 172.21.15.103:0/4252932905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb230101c10 0x7fb230102010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb220009ca0 tx=0x7fb22002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.499+0000 7fb23785d640 1 -- 172.21.15.103:0/4252932905 shutdown_connections 2024-09-19T06:04:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.499+0000 7fb23785d640 1 --2- 172.21.15.103:0/4252932905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2301037d0 0x7fb23010a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.499+0000 7fb23785d640 1 --2- 172.21.15.103:0/4252932905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb230102e10 0x7fb230103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.499+0000 7fb23785d640 1 --2- 172.21.15.103:0/4252932905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb230101c10 0x7fb230102010 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.499+0000 7fb23785d640 1 -- 172.21.15.103:0/4252932905 >> 172.21.15.103:0/4252932905 conn(0x7fb2300fd3c0 msgr2=0x7fb2300ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.499+0000 7fb23785d640 1 -- 172.21.15.103:0/4252932905 shutdown_connections 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.499+0000 7fb23785d640 1 -- 172.21.15.103:0/4252932905 wait complete. 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.499+0000 7fb23785d640 1 Processor -- start 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb23785d640 1 -- start start 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb23785d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb230101c10 0x7fb230197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb23785d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb230102e10 0x7fb230198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb23785d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2301037d0 0x7fb23019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb23785d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb23010d740 con 0x7fb230102e10 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb23785d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb23010d5c0 con 0x7fb2301037d0 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb23785d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb23010d8c0 con 0x7fb230101c10 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb234df8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb230102e10 0x7fb230198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb234df8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb230102e10 0x7fb230198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55444/0 (socket says 172.21.15.103:55444) 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb234df8640 1 -- 172.21.15.103:0/3580169608 learned_addr learned my addr 172.21.15.103:0/3580169608 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:04:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb235dfa640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2301037d0 0x7fb23019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb2355f9640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb230101c10 0x7fb230197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb234df8640 1 -- 172.21.15.103:0/3580169608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb230101c10 msgr2=0x7fb230197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb234df8640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb230101c10 0x7fb230197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb234df8640 1 -- 172.21.15.103:0/3580169608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2301037d0 msgr2=0x7fb23019f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb234df8640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2301037d0 0x7fb23019f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb234df8640 1 -- 172.21.15.103:0/3580169608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23019fa80 con 0x7fb230102e10 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb2355f9640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb230101c10 0x7fb230197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb234df8640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb230102e10 0x7fb230198390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb22400d770 tx=0x7fb22400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb22e7fc640 1 -- 172.21.15.103:0/3580169608 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224017070 con 0x7fb230102e10 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb23785d640 1 -- 172.21.15.103:0/3580169608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23019fd70 con 0x7fb230102e10 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb22e7fc640 1 -- 172.21.15.103:0/3580169608 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2240054d0 con 0x7fb230102e10 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb22e7fc640 1 -- 172.21.15.103:0/3580169608 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224004cf0 con 0x7fb230102e10 2024-09-19T06:04:36.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.500+0000 7fb23785d640 1 -- 172.21.15.103:0/3580169608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2301a0200 con 0x7fb230102e10 2024-09-19T06:04:36.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.502+0000 7fb23785d640 1 -- 172.21.15.103:0/3580169608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb230109150 con 0x7fb230102e10 2024-09-19T06:04:36.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.502+0000 7fb22e7fc640 1 -- 172.21.15.103:0/3580169608 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb224004e90 con 0x7fb230102e10 2024-09-19T06:04:36.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.503+0000 7fb22e7fc640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2180a3270 0x7fb2180a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:36.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.503+0000 7fb2355f9640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2180a3270 0x7fb2180a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:36.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.503+0000 7fb22e7fc640 1 -- 172.21.15.103:0/3580169608 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fb2240ceeb0 con 0x7fb230102e10 2024-09-19T06:04:36.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.504+0000 7fb2355f9640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2180a3270 0x7fb2180a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb220006010 tx=0x7fb220009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:36.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.507+0000 7fb22e7fc640 1 -- 172.21.15.103:0/3580169608 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb22409c070 con 0x7fb230102e10 2024-09-19T06:04:36.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.675+0000 7fb23785d640 1 -- 172.21.15.103:0/3580169608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb23002d9c0 con 0x7fb230102e10 2024-09-19T06:04:36.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.675+0000 7fb22e7fc640 1 -- 172.21.15.103:0/3580169608 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7fb22409b970 con 0x7fb230102e10 2024-09-19T06:04:36.678 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:04:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 -- 172.21.15.103:0/3580169608 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2180a3270 msgr2=0x7fb2180a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2180a3270 0x7fb2180a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb220006010 tx=0x7fb220009360 comp rx=0 tx=0).stop 2024-09-19T06:04:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 -- 172.21.15.103:0/3580169608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb230102e10 msgr2=0x7fb230198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb230102e10 0x7fb230198390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb22400d770 tx=0x7fb22400dc30 comp rx=0 tx=0).stop 2024-09-19T06:04:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 -- 172.21.15.103:0/3580169608 shutdown_connections 2024-09-19T06:04:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2180a3270 0x7fb2180a5730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2301037d0 0x7fb23019f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb230102e10 0x7fb230198390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 --2- 172.21.15.103:0/3580169608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb230101c10 0x7fb230197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 -- 172.21.15.103:0/3580169608 >> 172.21.15.103:0/3580169608 conn(0x7fb2300fd3c0 msgr2=0x7fb230106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 -- 172.21.15.103:0/3580169608 shutdown_connections 2024-09-19T06:04:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:36.678+0000 7fb23785d640 1 -- 172.21.15.103:0/3580169608 wait complete. 2024-09-19T06:04:36.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:36 smithi174 ceph-mon[34488]: purged_snaps scrub starts 2024-09-19T06:04:36.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:36 smithi174 ceph-mon[34488]: purged_snaps scrub ok 2024-09-19T06:04:36.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:36 smithi174 ceph-mon[34488]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:36.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:36 smithi174 ceph-mon[34488]: osd.11 [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] boot 2024-09-19T06:04:36.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:36 smithi174 ceph-mon[34488]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T06:04:36.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:36 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:36 smithi103 ceph-mon[30925]: purged_snaps scrub starts 2024-09-19T06:04:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:36 smithi103 ceph-mon[30925]: purged_snaps scrub ok 2024-09-19T06:04:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:36 smithi103 ceph-mon[30925]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:36 smithi103 ceph-mon[30925]: osd.11 [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] boot 2024-09-19T06:04:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:36 smithi103 ceph-mon[30925]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T06:04:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:36 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:37.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:36 smithi169 ceph-mon[34350]: purged_snaps scrub starts 2024-09-19T06:04:37.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:36 smithi169 ceph-mon[34350]: purged_snaps scrub ok 2024-09-19T06:04:37.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:36 smithi169 ceph-mon[34350]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:04:37.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:36 smithi169 ceph-mon[34350]: osd.11 [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] boot 2024-09-19T06:04:37.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:36 smithi169 ceph-mon[34350]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T06:04:37.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:36 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:04:37.302 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1726725875,"num_in_osds":12,"osd_in_since":1726725852,"num_remapped_pgs":0} 2024-09-19T06:04:37.303 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:04:37.590 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:37.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:37 smithi103 ceph-mon[30925]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T06:04:37.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:37 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3580169608' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:04:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:37 smithi174 ceph-mon[34488]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T06:04:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:37 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3580169608' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:04:38.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:37 smithi169 ceph-mon[34350]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T06:04:38.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:37 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3580169608' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:04:38.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.024+0000 7fc97fe39640 1 -- 172.21.15.103:0/2087012351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97810c170 msgr2=0x7fc97810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:38.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.024+0000 7fc97fe39640 1 --2- 172.21.15.103:0/2087012351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97810c170 0x7fc97810e610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc968009ca0 tx=0x7fc96802a950 comp rx=0 tx=0).stop 2024-09-19T06:04:38.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.024+0000 7fc97fe39640 1 -- 172.21.15.103:0/2087012351 shutdown_connections 2024-09-19T06:04:38.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.024+0000 7fc97fe39640 1 --2- 172.21.15.103:0/2087012351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97810c170 0x7fc97810e610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.024+0000 7fc97fe39640 1 --2- 172.21.15.103:0/2087012351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978103660 0x7fc97810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.024+0000 7fc97fe39640 1 --2- 172.21.15.103:0/2087012351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc978102d40 0x7fc978103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.024+0000 7fc97fe39640 1 -- 172.21.15.103:0/2087012351 >> 172.21.15.103:0/2087012351 conn(0x7fc9780fc7a0 msgr2=0x7fc9780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.024+0000 7fc97fe39640 1 -- 172.21.15.103:0/2087012351 shutdown_connections 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.024+0000 7fc97fe39640 1 -- 172.21.15.103:0/2087012351 wait complete. 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.024+0000 7fc97fe39640 1 Processor -- start 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97fe39640 1 -- start start 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97fe39640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978102d40 0x7fc978198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97fe39640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc978103660 0x7fc978198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97fe39640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97810c170 0x7fc97819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97fe39640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc978111e00 con 0x7fc97810c170 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97fe39640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc978111c80 con 0x7fc978103660 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97fe39640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc978111f80 con 0x7fc978102d40 2024-09-19T06:04:38.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97e3d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97810c170 0x7fc97819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97e3d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97810c170 0x7fc97819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55462/0 (socket says 172.21.15.103:55462) 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97e3d6640 1 -- 172.21.15.103:0/743706991 learned_addr learned my addr 172.21.15.103:0/743706991 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97d3d4640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc978103660 0x7fc978198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97dbd5640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978102d40 0x7fc978198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97e3d6640 1 -- 172.21.15.103:0/743706991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978102d40 msgr2=0x7fc978198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97e3d6640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978102d40 0x7fc978198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97e3d6640 1 -- 172.21.15.103:0/743706991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc978103660 msgr2=0x7fc978198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97e3d6640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc978103660 0x7fc978198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97e3d6640 1 -- 172.21.15.103:0/743706991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97819d2c0 con 0x7fc97810c170 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.025+0000 7fc97e3d6640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97810c170 0x7fc97819cbe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc96802ae70 tx=0x7fc96802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.026+0000 7fc976ffd640 1 -- 172.21.15.103:0/743706991 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968034040 con 0x7fc97810c170 2024-09-19T06:04:38.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.026+0000 7fc976ffd640 1 -- 172.21.15.103:0/743706991 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9680308f0 con 0x7fc97810c170 2024-09-19T06:04:38.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.026+0000 7fc97fe39640 1 -- 172.21.15.103:0/743706991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97819d550 con 0x7fc97810c170 2024-09-19T06:04:38.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.026+0000 7fc976ffd640 1 -- 172.21.15.103:0/743706991 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9680047f0 con 0x7fc97810c170 2024-09-19T06:04:38.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.026+0000 7fc97fe39640 1 -- 172.21.15.103:0/743706991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9781a4e90 con 0x7fc97810c170 2024-09-19T06:04:38.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.027+0000 7fc97fe39640 1 -- 172.21.15.103:0/743706991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc978103120 con 0x7fc97810c170 2024-09-19T06:04:38.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.028+0000 7fc976ffd640 1 -- 172.21.15.103:0/743706991 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fc968037020 con 0x7fc97810c170 2024-09-19T06:04:38.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.028+0000 7fc976ffd640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc9600a3240 0x7fc9600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:38.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.028+0000 7fc97dbd5640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc9600a3240 0x7fc9600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:38.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.028+0000 7fc976ffd640 1 -- 172.21.15.103:0/743706991 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fc9680f0530 con 0x7fc97810c170 2024-09-19T06:04:38.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.029+0000 7fc97dbd5640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc9600a3240 0x7fc9600a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc970005e10 tx=0x7fc970005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.032+0000 7fc976ffd640 1 -- 172.21.15.103:0/743706991 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9680bd6f0 con 0x7fc97810c170 2024-09-19T06:04:38.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.201+0000 7fc97fe39640 1 -- 172.21.15.103:0/743706991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9781071e0 con 0x7fc97810c170 2024-09-19T06:04:38.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.202+0000 7fc976ffd640 1 -- 172.21.15.103:0/743706991 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18540 (secure 0 0 0) 0x7fc9680bcff0 con 0x7fc97810c170 2024-09-19T06:04:38.204 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:04:38.204 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":73,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:04:36.527865+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 -- 172.21.15.103:0/743706991 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc9600a3240 msgr2=0x7fc9600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc9600a3240 0x7fc9600a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc970005e10 tx=0x7fc970005da0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 -- 172.21.15.103:0/743706991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97810c170 msgr2=0x7fc97819cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97810c170 0x7fc97819cbe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc96802ae70 tx=0x7fc96802f5d0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 -- 172.21.15.103:0/743706991 shutdown_connections 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc9600a3240 0x7fc9600a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97810c170 0x7fc97819cbe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc978103660 0x7fc978198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 --2- 172.21.15.103:0/743706991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978102d40 0x7fc978198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 -- 172.21.15.103:0/743706991 >> 172.21.15.103:0/743706991 conn(0x7fc9780fc7a0 msgr2=0x7fc9780fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 -- 172.21.15.103:0/743706991 shutdown_connections 2024-09-19T06:04:38.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:38.204+0000 7fc97fe39640 1 -- 172.21.15.103:0/743706991 wait complete. 2024-09-19T06:04:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:38 smithi174 ceph-mon[34488]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:38 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/743706991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:38.958 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:38 smithi103 ceph-mon[30925]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:38.958 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:38 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/743706991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:38.986 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:00:59.680195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:04:38.987 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T06:04:39.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:38 smithi169 ceph-mon[34350]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:39.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:38 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/743706991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:39.271 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:39.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.708+0000 7fdf5c438640 1 -- 172.21.15.103:0/2284302384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf54101420 msgr2=0x7fdf5410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:39.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.708+0000 7fdf5c438640 1 --2- 172.21.15.103:0/2284302384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf54101420 0x7fdf5410d950 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009cd0 tx=0x7fdf4c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:04:39.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.708+0000 7fdf5c438640 1 -- 172.21.15.103:0/2284302384 shutdown_connections 2024-09-19T06:04:39.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.708+0000 7fdf5c438640 1 --2- 172.21.15.103:0/2284302384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf54101420 0x7fdf5410d950 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:39.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.708+0000 7fdf5c438640 1 --2- 172.21.15.103:0/2284302384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf54100a80 0x7fdf54100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:39.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.708+0000 7fdf5c438640 1 --2- 172.21.15.103:0/2284302384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf54106a80 0x7fdf54106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:39.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.708+0000 7fdf5c438640 1 -- 172.21.15.103:0/2284302384 >> 172.21.15.103:0/2284302384 conn(0x7fdf540fc7a0 msgr2=0x7fdf540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:39.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.708+0000 7fdf5c438640 1 -- 172.21.15.103:0/2284302384 shutdown_connections 2024-09-19T06:04:39.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.708+0000 7fdf5c438640 1 -- 172.21.15.103:0/2284302384 wait complete. 2024-09-19T06:04:39.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf5c438640 1 Processor -- start 2024-09-19T06:04:39.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf5c438640 1 -- start start 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf5c438640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf54100a80 0x7fdf541972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf5c438640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf54101420 0x7fdf54197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf5c438640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf54106a80 0x7fdf5419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf5c438640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdf54110d50 con 0x7fdf54101420 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf5c438640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdf54110bd0 con 0x7fdf54106a80 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf5c438640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdf54110ed0 con 0x7fdf54100a80 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf599d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf54101420 0x7fdf54197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf599d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf54101420 0x7fdf54197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55486/0 (socket says 172.21.15.103:55486) 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf599d3640 1 -- 172.21.15.103:0/3310440477 learned_addr learned my addr 172.21.15.103:0/3310440477 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf5a1d4640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf54100a80 0x7fdf541972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf5a9d5640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf54106a80 0x7fdf5419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf599d3640 1 -- 172.21.15.103:0/3310440477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf54100a80 msgr2=0x7fdf541972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf599d3640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf54100a80 0x7fdf541972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf599d3640 1 -- 172.21.15.103:0/3310440477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf54106a80 msgr2=0x7fdf5419bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf599d3640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf54106a80 0x7fdf5419bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.709+0000 7fdf599d3640 1 -- 172.21.15.103:0/3310440477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5419c280 con 0x7fdf54101420 2024-09-19T06:04:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.710+0000 7fdf599d3640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf54101420 0x7fdf54197810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000d950 tx=0x7fdf5000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.710+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3310440477 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50017070 con 0x7fdf54101420 2024-09-19T06:04:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.710+0000 7fdf5c438640 1 -- 172.21.15.103:0/3310440477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5419c570 con 0x7fdf54101420 2024-09-19T06:04:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.710+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3310440477 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf5000de80 con 0x7fdf54101420 2024-09-19T06:04:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.710+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3310440477 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5000f620 con 0x7fdf54101420 2024-09-19T06:04:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.710+0000 7fdf5c438640 1 -- 172.21.15.103:0/3310440477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf541a3e50 con 0x7fdf54101420 2024-09-19T06:04:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.711+0000 7fdf5c438640 1 -- 172.21.15.103:0/3310440477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf54100ee0 con 0x7fdf54101420 2024-09-19T06:04:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.712+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3310440477 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fdf50009c30 con 0x7fdf54101420 2024-09-19T06:04:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.713+0000 7fdf4b7fe640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdf400a3240 0x7fdf400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.713+0000 7fdf5a1d4640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdf400a3240 0x7fdf400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:39.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.713+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3310440477 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fdf500cf0f0 con 0x7fdf54101420 2024-09-19T06:04:39.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.713+0000 7fdf5a1d4640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdf400a3240 0x7fdf400a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009990 tx=0x7fdf44009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:39.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.717+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3310440477 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdf5009c2b0 con 0x7fdf54101420 2024-09-19T06:04:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.881+0000 7fdf5c438640 1 -- 172.21.15.103:0/3310440477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf54109010 con 0x7fdf54101420 2024-09-19T06:04:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.882+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3310440477 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7fdf5009bbb0 con 0x7fdf54101420 2024-09-19T06:04:39.883 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-19T06:04:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 -- 172.21.15.103:0/3310440477 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdf400a3240 msgr2=0x7fdf400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdf400a3240 0x7fdf400a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009990 tx=0x7fdf44009110 comp rx=0 tx=0).stop 2024-09-19T06:04:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 -- 172.21.15.103:0/3310440477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf54101420 msgr2=0x7fdf54197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf54101420 0x7fdf54197810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000d950 tx=0x7fdf5000dd50 comp rx=0 tx=0).stop 2024-09-19T06:04:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 -- 172.21.15.103:0/3310440477 shutdown_connections 2024-09-19T06:04:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdf400a3240 0x7fdf400a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf54106a80 0x7fdf5419bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf54101420 0x7fdf54197810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 --2- 172.21.15.103:0/3310440477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf54100a80 0x7fdf541972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 -- 172.21.15.103:0/3310440477 >> 172.21.15.103:0/3310440477 conn(0x7fdf540fc7a0 msgr2=0x7fdf540fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 -- 172.21.15.103:0/3310440477 shutdown_connections 2024-09-19T06:04:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:39.884+0000 7fdf5c438640 1 -- 172.21.15.103:0/3310440477 wait complete. 2024-09-19T06:04:40.676 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:40 smithi103 ceph-mon[30925]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:40.676 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:40 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3310440477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:04:40.677 INFO:tasks.cephadm:Adding mds.a on smithi103 2024-09-19T06:04:40.677 INFO:tasks.cephadm:Adding mds.d on smithi103 2024-09-19T06:04:40.677 INFO:tasks.cephadm:Adding mds.g on smithi103 2024-09-19T06:04:40.677 INFO:tasks.cephadm:Adding mds.j on smithi103 2024-09-19T06:04:40.678 INFO:tasks.cephadm:Adding mds.b on smithi169 2024-09-19T06:04:40.678 INFO:tasks.cephadm:Adding mds.e on smithi169 2024-09-19T06:04:40.678 INFO:tasks.cephadm:Adding mds.h on smithi169 2024-09-19T06:04:40.678 INFO:tasks.cephadm:Adding mds.k on smithi169 2024-09-19T06:04:40.678 INFO:tasks.cephadm:Adding mds.c on smithi174 2024-09-19T06:04:40.678 INFO:tasks.cephadm:Adding mds.f on smithi174 2024-09-19T06:04:40.678 INFO:tasks.cephadm:Adding mds.i on smithi174 2024-09-19T06:04:40.678 INFO:tasks.cephadm:Adding mds.l on smithi174 2024-09-19T06:04:40.678 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l' 2024-09-19T06:04:40.941 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:04:40.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:40 smithi174 ceph-mon[34488]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:40.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:40 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3310440477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:04:41.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:40 smithi169 ceph-mon[34350]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:41.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:40 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3310440477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:04:41.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.375+0000 7fc8f1445640 1 -- 172.21.15.174:0/176302541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8ec1026c0 msgr2=0x7fc8ec104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.375+0000 7fc8f1445640 1 --2- 172.21.15.174:0/176302541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8ec1026c0 0x7fc8ec104ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009ca0 tx=0x7fc8dc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.375+0000 7fc8f1445640 1 -- 172.21.15.174:0/176302541 shutdown_connections 2024-09-19T06:04:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.375+0000 7fc8f1445640 1 --2- 172.21.15.174:0/176302541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8ec107920 0x7fc8ec109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.375+0000 7fc8f1445640 1 --2- 172.21.15.174:0/176302541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec104ff0 0x7fc8ec1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.375+0000 7fc8f1445640 1 --2- 172.21.15.174:0/176302541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8ec1026c0 0x7fc8ec104ab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.375+0000 7fc8f1445640 1 -- 172.21.15.174:0/176302541 >> 172.21.15.174:0/176302541 conn(0x7fc8ec0fc280 msgr2=0x7fc8ec0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.375+0000 7fc8f1445640 1 -- 172.21.15.174:0/176302541 shutdown_connections 2024-09-19T06:04:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.375+0000 7fc8f1445640 1 -- 172.21.15.174:0/176302541 wait complete. 2024-09-19T06:04:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8f1445640 1 Processor -- start 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8f1445640 1 -- start start 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8f1445640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec1026c0 0x7fc8ec197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8f1445640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8ec104ff0 0x7fc8ec198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8f1445640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8ec107920 0x7fc8ec19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8f1445640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec10d790 con 0x7fc8ec107920 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8f1445640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec10d610 con 0x7fc8ec1026c0 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8f1445640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec10d910 con 0x7fc8ec104ff0 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8ea7fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8ec104ff0 0x7fc8ec198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8ea7fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8ec104ff0 0x7fc8ec198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:56188/0 (socket says 172.21.15.174:56188) 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8ea7fc640 1 -- 172.21.15.174:0/3163756386 learned_addr learned my addr 172.21.15.174:0/3163756386 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8eb7fe640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8ec107920 0x7fc8ec19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.376+0000 7fc8eaffd640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec1026c0 0x7fc8ec197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8ea7fc640 1 -- 172.21.15.174:0/3163756386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec1026c0 msgr2=0x7fc8ec197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8ea7fc640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec1026c0 0x7fc8ec197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8ea7fc640 1 -- 172.21.15.174:0/3163756386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8ec107920 msgr2=0x7fc8ec19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8ea7fc640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8ec107920 0x7fc8ec19f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8ea7fc640 1 -- 172.21.15.174:0/3163756386 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ec19fa40 con 0x7fc8ec104ff0 2024-09-19T06:04:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8ea7fc640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8ec104ff0 0x7fc8ec198350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000c970 tx=0x7fc8e000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8d3fff640 1 -- 172.21.15.174:0/3163756386 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0014070 con 0x7fc8ec104ff0 2024-09-19T06:04:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8d3fff640 1 -- 172.21.15.174:0/3163756386 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8e0004440 con 0x7fc8ec104ff0 2024-09-19T06:04:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8f1445640 1 -- 172.21.15.174:0/3163756386 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8ec19fd30 con 0x7fc8ec104ff0 2024-09-19T06:04:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8d3fff640 1 -- 172.21.15.174:0/3163756386 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0003e50 con 0x7fc8ec104ff0 2024-09-19T06:04:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.377+0000 7fc8f1445640 1 -- 172.21.15.174:0/3163756386 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8ec1a0210 con 0x7fc8ec104ff0 2024-09-19T06:04:41.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.378+0000 7fc8f1445640 1 -- 172.21.15.174:0/3163756386 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8ec0fdd70 con 0x7fc8ec104ff0 2024-09-19T06:04:41.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.379+0000 7fc8d3fff640 1 -- 172.21.15.174:0/3163756386 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fc8e0017070 con 0x7fc8ec104ff0 2024-09-19T06:04:41.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.380+0000 7fc8d3fff640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc8d40a3410 0x7fc8d40a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:41.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.380+0000 7fc8d3fff640 1 -- 172.21.15.174:0/3163756386 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fc8e00cefd0 con 0x7fc8ec104ff0 2024-09-19T06:04:41.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.380+0000 7fc8eaffd640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc8d40a3410 0x7fc8d40a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:41.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.380+0000 7fc8eaffd640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc8d40a3410 0x7fc8d40a58d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc005fa0 tx=0x7fc8dc031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:41.386 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.384+0000 7fc8d3fff640 1 -- 172.21.15.174:0/3163756386 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8e001e030 con 0x7fc8ec104ff0 2024-09-19T06:04:41.562 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.560+0000 7fc8f1445640 1 -- 172.21.15.174:0/3163756386 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}) -- 0x7fc8ec062730 con 0x7fc8d40a3410 2024-09-19T06:04:41.568 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.567+0000 7fc8d3fff640 1 -- 172.21.15.174:0/3163756386 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fc8ec062730 con 0x7fc8d40a3410 2024-09-19T06:04:41.569 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mds.all update... 2024-09-19T06:04:41.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 -- 172.21.15.174:0/3163756386 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc8d40a3410 msgr2=0x7fc8d40a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:41.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc8d40a3410 0x7fc8d40a58d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc005fa0 tx=0x7fc8dc031000 comp rx=0 tx=0).stop 2024-09-19T06:04:41.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 -- 172.21.15.174:0/3163756386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8ec104ff0 msgr2=0x7fc8ec198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:41.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8ec104ff0 0x7fc8ec198350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000c970 tx=0x7fc8e000ce30 comp rx=0 tx=0).stop 2024-09-19T06:04:41.572 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 -- 172.21.15.174:0/3163756386 shutdown_connections 2024-09-19T06:04:41.572 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc8d40a3410 0x7fc8d40a58d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.572 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8ec107920 0x7fc8ec19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.572 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8ec104ff0 0x7fc8ec198350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.572 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 --2- 172.21.15.174:0/3163756386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec1026c0 0x7fc8ec197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.572 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 -- 172.21.15.174:0/3163756386 >> 172.21.15.174:0/3163756386 conn(0x7fc8ec0fc280 msgr2=0x7fc8ec102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:41.572 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 -- 172.21.15.174:0/3163756386 shutdown_connections 2024-09-19T06:04:41.572 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T06:04:41.569+0000 7fc8f1445640 1 -- 172.21.15.174:0/3163756386 wait complete. 2024-09-19T06:04:42.419 DEBUG:teuthology.orchestra.run.smithi103:mds.a> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T06:04:42.422 DEBUG:teuthology.orchestra.run.smithi103:mds.d> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T06:04:42.465 DEBUG:teuthology.orchestra.run.smithi103:mds.g> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T06:04:42.508 DEBUG:teuthology.orchestra.run.smithi103:mds.j> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T06:04:42.551 DEBUG:teuthology.orchestra.run.smithi169:mds.b> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T06:04:42.554 DEBUG:teuthology.orchestra.run.smithi169:mds.e> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T06:04:42.598 DEBUG:teuthology.orchestra.run.smithi169:mds.h> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T06:04:42.641 DEBUG:teuthology.orchestra.run.smithi169:mds.k> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T06:04:42.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:42.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:42.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: Saving service mds.all spec with placement smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-19T06:04:42.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:42.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:42.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:42.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:42.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:42.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:42.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:42.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:42.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:42 smithi174 ceph-mon[34488]: Deploying daemon mds.l on smithi174 2024-09-19T06:04:42.686 DEBUG:teuthology.orchestra.run.smithi174:mds.c> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T06:04:42.688 DEBUG:teuthology.orchestra.run.smithi174:mds.f> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T06:04:42.731 DEBUG:teuthology.orchestra.run.smithi174:mds.i> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T06:04:42.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:42.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:42.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: Saving service mds.all spec with placement smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-19T06:04:42.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:42.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:42.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:42.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:42.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:42.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:42.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:42.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:42.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:42 smithi103 ceph-mon[30925]: Deploying daemon mds.l on smithi174 2024-09-19T06:04:42.774 DEBUG:teuthology.orchestra.run.smithi174:mds.l> sudo journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T06:04:42.817 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T06:04:42.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:04:43.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: Saving service mds.all spec with placement smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:43.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:42 smithi169 ceph-mon[34350]: Deploying daemon mds.l on smithi174 2024-09-19T06:04:43.067 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:43.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2258558540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9b0102570 msgr2=0x7ff9b01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:43.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 --2- 172.21.15.103:0/2258558540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9b0102570 0x7ff9b01029b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009900 tx=0x7ff9a002a480 comp rx=0 tx=0).stop 2024-09-19T06:04:43.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2258558540 shutdown_connections 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 --2- 172.21.15.103:0/2258558540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9b0102ef0 0x7ff9b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 --2- 172.21.15.103:0/2258558540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9b0102570 0x7ff9b01029b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 --2- 172.21.15.103:0/2258558540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9b0100e20 0x7ff9b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2258558540 >> 172.21.15.103:0/2258558540 conn(0x7ff9b00fc7d0 msgr2=0x7ff9b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2258558540 shutdown_connections 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2258558540 wait complete. 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 Processor -- start 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.564+0000 7ff9b7b9d640 1 -- start start 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b7b9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9b0100e20 0x7ff9b00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b7b9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9b0102570 0x7ff9b00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b7b9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9b0102ef0 0x7ff9b00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b7b9d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b0110e30 con 0x7ff9b0102ef0 2024-09-19T06:04:43.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b7b9d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b0110cb0 con 0x7ff9b0100e20 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b7b9d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b0110fb0 con 0x7ff9b0102570 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b613a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9b0102ef0 0x7ff9b00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b613a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9b0102ef0 0x7ff9b00fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40196/0 (socket says 172.21.15.103:40196) 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b613a640 1 -- 172.21.15.103:0/2974908 learned_addr learned my addr 172.21.15.103:0/2974908 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b5138640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9b0102570 0x7ff9b00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b5939640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9b0100e20 0x7ff9b00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b613a640 1 -- 172.21.15.103:0/2974908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9b0102570 msgr2=0x7ff9b00fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b613a640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9b0102570 0x7ff9b00fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b613a640 1 -- 172.21.15.103:0/2974908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9b0100e20 msgr2=0x7ff9b00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b613a640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9b0100e20 0x7ff9b00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b613a640 1 -- 172.21.15.103:0/2974908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b01a68d0 con 0x7ff9b0102ef0 2024-09-19T06:04:43.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b613a640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9b0102ef0 0x7ff9b00fd700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800eb10 tx=0x7ff9a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:43.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9a6ffd640 1 -- 172.21.15.103:0/2974908 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8004b20 con 0x7ff9b0102ef0 2024-09-19T06:04:43.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9a6ffd640 1 -- 172.21.15.103:0/2974908 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9a8004cc0 con 0x7ff9b0102ef0 2024-09-19T06:04:43.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2974908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b01a6bc0 con 0x7ff9b0102ef0 2024-09-19T06:04:43.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.565+0000 7ff9a6ffd640 1 -- 172.21.15.103:0/2974908 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8010690 con 0x7ff9b0102ef0 2024-09-19T06:04:43.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.566+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2974908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b01a7120 con 0x7ff9b0102ef0 2024-09-19T06:04:43.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.567+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2974908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b0101200 con 0x7ff9b0102ef0 2024-09-19T06:04:43.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.568+0000 7ff9a6ffd640 1 -- 172.21.15.103:0/2974908 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7ff9a8005020 con 0x7ff9b0102ef0 2024-09-19T06:04:43.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.568+0000 7ff9a6ffd640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff99c0a32c0 0x7ff99c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:43.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.568+0000 7ff9b5939640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff99c0a32c0 0x7ff99c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:43.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.568+0000 7ff9a6ffd640 1 -- 172.21.15.103:0/2974908 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff9a80cfa40 con 0x7ff9b0102ef0 2024-09-19T06:04:43.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.569+0000 7ff9b5939640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff99c0a32c0 0x7ff99c0a5780 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac005d00 tx=0x7ff9ac00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:43.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.573+0000 7ff9a6ffd640 1 -- 172.21.15.103:0/2974908 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9a809cc00 con 0x7ff9b0102ef0 2024-09-19T06:04:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.774+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2974908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9b00fe1b0 con 0x7ff9b0102ef0 2024-09-19T06:04:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.774+0000 7ff9a6ffd640 1 -- 172.21.15.103:0/2974908 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7ff9b00fe1b0 con 0x7ff9b0102ef0 2024-09-19T06:04:43.777 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:04:43.778 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"btime":"2024-09-19T05:58:00:204409+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T06:04:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 1 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2974908 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff99c0a32c0 msgr2=0x7ff99c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff99c0a32c0 0x7ff99c0a5780 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac005d00 tx=0x7ff9ac00b410 comp rx=0 tx=0).stop 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2974908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9b0102ef0 msgr2=0x7ff9b00fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9b0102ef0 0x7ff9b00fd700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800eb10 tx=0x7ff9a800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2974908 shutdown_connections 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff99c0a32c0 0x7ff99c0a5780 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9b0102ef0 0x7ff9b00fd700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9b0102570 0x7ff9b00fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 --2- 172.21.15.103:0/2974908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9b0100e20 0x7ff9b00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2974908 >> 172.21.15.103:0/2974908 conn(0x7ff9b00fc7d0 msgr2=0x7ff9b006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2974908 shutdown_connections 2024-09-19T06:04:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:43.776+0000 7ff9b7b9d640 1 -- 172.21.15.103:0/2974908 wait complete. 2024-09-19T06:04:44.204 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:04:44 smithi174 systemd[1]: Starting Ceph mds.l for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:04:44.535 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:04:44 smithi174 podman[64404]: 2024-09-19 06:04:44.181025195 +0000 UTC m=+0.016074993 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:04:44.536 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:04:44 smithi174 podman[64404]: 2024-09-19 06:04:44.297520258 +0000 UTC m=+0.132570055 container create 34d7941af29b5d80d350095c238c3180d2b8f2e7c29c95dc149e014b6e66c68d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-19T06:04:44.536 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:04:44 smithi174 podman[64404]: 2024-09-19 06:04:44.508172097 +0000 UTC m=+0.343221896 container init 34d7941af29b5d80d350095c238c3180d2b8f2e7c29c95dc149e014b6e66c68d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-l, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T06:04:44.536 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:04:44 smithi174 podman[64404]: 2024-09-19 06:04:44.511014167 +0000 UTC m=+0.346063974 container start 34d7941af29b5d80d350095c238c3180d2b8f2e7c29c95dc149e014b6e66c68d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:04:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:44 smithi174 ceph-mon[34488]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:44 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2974908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:44 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.174:6832/1347140059,v1:172.21.15.174:6833/1347140059] up:boot 2024-09-19T06:04:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:44 smithi174 ceph-mon[34488]: fsmap 1 up:standby 2024-09-19T06:04:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:44 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:04:44.955 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:04:44 smithi174 ceph-mds[64423]: -- 172.21.15.174:0/244751757 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5627fac33860 con 0x5627fac11400 2024-09-19T06:04:44.955 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:04:44 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-l[64419]: starting mds.l at 2024-09-19T06:04:44.955 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:04:44 smithi174 bash[64404]: 34d7941af29b5d80d350095c238c3180d2b8f2e7c29c95dc149e014b6e66c68d 2024-09-19T06:04:44.955 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:04:44 smithi174 systemd[1]: Started Ceph mds.l for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:04:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:44 smithi103 ceph-mon[30925]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:44 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2974908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:44.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:44 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.174:6832/1347140059,v1:172.21.15.174:6833/1347140059] up:boot 2024-09-19T06:04:44.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:44 smithi103 ceph-mon[30925]: fsmap 1 up:standby 2024-09-19T06:04:44.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:44 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:04:45.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:44 smithi169 ceph-mon[34350]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:45.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:44 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2974908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:45.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:44 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.174:6832/1347140059,v1:172.21.15.174:6833/1347140059] up:boot 2024-09-19T06:04:45.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:44 smithi169 ceph-mon[34350]: fsmap 1 up:standby 2024-09-19T06:04:45.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:44 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:04:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:45.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:45.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:45.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:46.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:46.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:46.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:46.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:46.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:46.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:46.535 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:04:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:46.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:46 smithi103 ceph-mon[30925]: Deploying daemon mds.k on smithi169 2024-09-19T06:04:46.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:46 smithi103 ceph-mon[30925]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:46 smithi174 ceph-mon[34488]: Deploying daemon mds.k on smithi169 2024-09-19T06:04:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:46 smithi174 ceph-mon[34488]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:46.973 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:46 smithi169 ceph-mon[34350]: Deploying daemon mds.k on smithi169 2024-09-19T06:04:46.974 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:46 smithi169 ceph-mon[34350]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:46.974 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:04:46 smithi169 systemd[1]: Starting Ceph mds.k for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:04:47.276 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:04:46 smithi169 podman[63436]: 2024-09-19 06:04:46.972163592 +0000 UTC m=+0.108022796 container create 91505c6b4b346d76f21c89c457636f4c2bef0dd9488626a19d45d42498b4b0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:04:47.276 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:04:46 smithi169 podman[63436]: 2024-09-19 06:04:46.880383105 +0000 UTC m=+0.016242322 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:04:47.276 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:04:47 smithi169 podman[63436]: 2024-09-19 06:04:47.182921465 +0000 UTC m=+0.318780679 container init 91505c6b4b346d76f21c89c457636f4c2bef0dd9488626a19d45d42498b4b0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:04:47.276 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:04:47 smithi169 podman[63436]: 2024-09-19 06:04:47.18568604 +0000 UTC m=+0.321545245 container start 91505c6b4b346d76f21c89c457636f4c2bef0dd9488626a19d45d42498b4b0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:04:47.276 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:04:47 smithi169 ceph-mds[63455]: -- 172.21.15.169:0/1214705649 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55983e551860 con 0x55983e52f000 2024-09-19T06:04:47.276 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:04:47 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-k[63451]: starting mds.k at 2024-09-19T06:04:47.276 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:04:47 smithi169 bash[63436]: 91505c6b4b346d76f21c89c457636f4c2bef0dd9488626a19d45d42498b4b0ae 2024-09-19T06:04:47.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.255+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/621710118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9b8102ef0 msgr2=0x7fb9b810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.255+0000 7fb9bcc7a640 1 --2- 172.21.15.103:0/621710118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9b8102ef0 0x7fb9b810da40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009900 tx=0x7fb9a802a480 comp rx=0 tx=0).stop 2024-09-19T06:04:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.255+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/621710118 shutdown_connections 2024-09-19T06:04:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.255+0000 7fb9bcc7a640 1 --2- 172.21.15.103:0/621710118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9b8102ef0 0x7fb9b810da40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.255+0000 7fb9bcc7a640 1 --2- 172.21.15.103:0/621710118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9b8102570 0x7fb9b81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.255+0000 7fb9bcc7a640 1 --2- 172.21.15.103:0/621710118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9b8100e20 0x7fb9b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.255+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/621710118 >> 172.21.15.103:0/621710118 conn(0x7fb9b80fc7d0 msgr2=0x7fb9b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.255+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/621710118 shutdown_connections 2024-09-19T06:04:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.255+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/621710118 wait complete. 2024-09-19T06:04:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9bcc7a640 1 Processor -- start 2024-09-19T06:04:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9bcc7a640 1 -- start start 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9bcc7a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9b8100e20 0x7fb9b81971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9bcc7a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9b8102570 0x7fb9b8197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9bcc7a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9b8102ef0 0x7fb9b819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9bcc7a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b8110e30 con 0x7fb9b8100e20 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9bcc7a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b8110cb0 con 0x7fb9b8102ef0 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9bcc7a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b8110fb0 con 0x7fb9b8102570 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9b8100e20 0x7fb9b81971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9b8100e20 0x7fb9b81971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40210/0 (socket says 172.21.15.103:40210) 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b659c640 1 -- 172.21.15.103:0/2674208821 learned_addr learned my addr 172.21.15.103:0/2674208821 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b6d9d640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9b8102ef0 0x7fb9b819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b5d9b640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9b8102570 0x7fb9b8197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b659c640 1 -- 172.21.15.103:0/2674208821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9b8102570 msgr2=0x7fb9b8197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b659c640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9b8102570 0x7fb9b8197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b659c640 1 -- 172.21.15.103:0/2674208821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9b8102ef0 msgr2=0x7fb9b819bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b659c640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9b8102ef0 0x7fb9b819bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b659c640 1 -- 172.21.15.103:0/2674208821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b819c1a0 con 0x7fb9b8100e20 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.256+0000 7fb9b659c640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9b8100e20 0x7fb9b81971f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000cce0 tx=0x7fb9b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.257+0000 7fb9af7fe640 1 -- 172.21.15.103:0/2674208821 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b000f650 con 0x7fb9b8100e20 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.257+0000 7fb9af7fe640 1 -- 172.21.15.103:0/2674208821 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb9b000fca0 con 0x7fb9b8100e20 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.257+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/2674208821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b819c490 con 0x7fb9b8100e20 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.257+0000 7fb9af7fe640 1 -- 172.21.15.103:0/2674208821 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0018b90 con 0x7fb9b8100e20 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.257+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/2674208821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b8069f70 con 0x7fb9b8100e20 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.258+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/2674208821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b8101200 con 0x7fb9b8100e20 2024-09-19T06:04:47.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.259+0000 7fb9af7fe640 1 -- 172.21.15.103:0/2674208821 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb9b000f7f0 con 0x7fb9b8100e20 2024-09-19T06:04:47.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.260+0000 7fb9af7fe640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9a40a32c0 0x7fb9a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:47.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.260+0000 7fb9af7fe640 1 -- 172.21.15.103:0/2674208821 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb9b00cfba0 con 0x7fb9b8100e20 2024-09-19T06:04:47.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.260+0000 7fb9b5d9b640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9a40a32c0 0x7fb9a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:47.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.260+0000 7fb9b5d9b640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9a40a32c0 0x7fb9a40a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80fec10 tx=0x7fb9a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:47.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.263+0000 7fb9af7fe640 1 -- 172.21.15.103:0/2674208821 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb9b0014030 con 0x7fb9b8100e20 2024-09-19T06:04:47.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.472+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/2674208821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9b8198550 con 0x7fb9b8100e20 2024-09-19T06:04:47.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.472+0000 7fb9af7fe640 1 -- 172.21.15.103:0/2674208821 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fb9b009ce70 con 0x7fb9b8100e20 2024-09-19T06:04:47.475 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:04:47.475 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":2,"btime":"2024-09-19T06:04:44:539805+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:04:47.476 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 2 2024-09-19T06:04:47.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/2674208821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9a40a32c0 msgr2=0x7fb9a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:47.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9a40a32c0 0x7fb9a40a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80fec10 tx=0x7fb9a0005f90 comp rx=0 tx=0).stop 2024-09-19T06:04:47.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/2674208821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9b8100e20 msgr2=0x7fb9b81971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:47.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9b8100e20 0x7fb9b81971f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000cce0 tx=0x7fb9b000a620 comp rx=0 tx=0).stop 2024-09-19T06:04:47.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/2674208821 shutdown_connections 2024-09-19T06:04:47.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9a40a32c0 0x7fb9a40a5780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9b8102ef0 0x7fb9b819bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9b8102570 0x7fb9b8197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 --2- 172.21.15.103:0/2674208821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9b8100e20 0x7fb9b81971f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/2674208821 >> 172.21.15.103:0/2674208821 conn(0x7fb9b80fc7d0 msgr2=0x7fb9b8106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:47.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/2674208821 shutdown_connections 2024-09-19T06:04:47.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:47.475+0000 7fb9bcc7a640 1 -- 172.21.15.103:0/2674208821 wait complete. 2024-09-19T06:04:47.527 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:04:47 smithi169 systemd[1]: Started Ceph mds.k for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:04:48.602 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:48.602 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:48.602 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:48.602 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:48.602 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:48.602 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:48.602 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: Deploying daemon mds.j on smithi103 2024-09-19T06:04:48.602 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:48.602 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2674208821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:48.603 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.169:6832/4189079406,v1:172.21.15.169:6833/4189079406] up:boot 2024-09-19T06:04:48.603 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: fsmap 2 up:standby 2024-09-19T06:04:48.603 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:48 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:04:48.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:48.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:48.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: Deploying daemon mds.j on smithi103 2024-09-19T06:04:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2674208821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.169:6832/4189079406,v1:172.21.15.169:6833/4189079406] up:boot 2024-09-19T06:04:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: fsmap 2 up:standby 2024-09-19T06:04:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:48 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:04:48.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:48.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:48.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:48.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:48.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:48.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:48.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: Deploying daemon mds.j on smithi103 2024-09-19T06:04:48.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:48.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2674208821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:48.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.169:6832/4189079406,v1:172.21.15.169:6833/4189079406] up:boot 2024-09-19T06:04:48.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: fsmap 2 up:standby 2024-09-19T06:04:48.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:48 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:04:49.994 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:04:49 smithi103 systemd[1]: Starting Ceph mds.j for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:04:50.136 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:04:50.362 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:04:50 smithi103 podman[71009]: 2024-09-19 06:04:49.988363158 +0000 UTC m=+0.016148771 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:04:50.362 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:04:50 smithi103 podman[71009]: 2024-09-19 06:04:50.132081022 +0000 UTC m=+0.159866628 container create 24e6db657bdb655fc40b1d0ae1d48b67156f426548cc657bff6dae852017d465 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T06:04:50.362 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:04:50 smithi103 podman[71009]: 2024-09-19 06:04:50.359442613 +0000 UTC m=+0.387228233 container init 24e6db657bdb655fc40b1d0ae1d48b67156f426548cc657bff6dae852017d465 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T06:04:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:50.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:50 smithi103 ceph-mon[30925]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:50.701 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:04:50 smithi103 podman[71009]: 2024-09-19 06:04:50.362569238 +0000 UTC m=+0.390354857 container start 24e6db657bdb655fc40b1d0ae1d48b67156f426548cc657bff6dae852017d465 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T06:04:50.701 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:04:50 smithi103 ceph-mds[71057]: -- 172.21.15.103:0/4237508586 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56151a913860 con 0x56151a8f0800 2024-09-19T06:04:50.701 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:04:50 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-j[71042]: starting mds.j at 2024-09-19T06:04:50.701 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:04:50 smithi103 bash[71009]: 24e6db657bdb655fc40b1d0ae1d48b67156f426548cc657bff6dae852017d465 2024-09-19T06:04:50.701 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:04:50 smithi103 systemd[1]: Started Ceph mds.j for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:04:50.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:50 smithi169 ceph-mon[34350]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:50.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:50 smithi174 ceph-mon[34488]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:51.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.167+0000 7f818de15640 1 -- 172.21.15.103:0/1232546155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81881027a0 msgr2=0x7f81881067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:51.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.167+0000 7f818de15640 1 --2- 172.21.15.103:0/1232546155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81881027a0 0x7f81881067f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8170009900 tx=0x7f817002a410 comp rx=0 tx=0).stop 2024-09-19T06:04:51.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.167+0000 7f818de15640 1 -- 172.21.15.103:0/1232546155 shutdown_connections 2024-09-19T06:04:51.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.167+0000 7f818de15640 1 --2- 172.21.15.103:0/1232546155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8188106f20 0x7f818810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.167+0000 7f818de15640 1 --2- 172.21.15.103:0/1232546155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81881027a0 0x7f81881067f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.167+0000 7f818de15640 1 --2- 172.21.15.103:0/1232546155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8188101df0 0x7f81881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.167+0000 7f818de15640 1 -- 172.21.15.103:0/1232546155 >> 172.21.15.103:0/1232546155 conn(0x7f81880fd8f0 msgr2=0x7f81880ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.167+0000 7f818de15640 1 -- 172.21.15.103:0/1232546155 shutdown_connections 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.167+0000 7f818de15640 1 -- 172.21.15.103:0/1232546155 wait complete. 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f818de15640 1 Processor -- start 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f818de15640 1 -- start start 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f818de15640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8188101df0 0x7f81881984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f818de15640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81881027a0 0x7f8188198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f818de15640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8188106f20 0x7f818819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f818de15640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8188111e30 con 0x7f81881027a0 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f818de15640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8188111cb0 con 0x7f8188101df0 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f818de15640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8188111fb0 con 0x7f8188106f20 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f817ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81881027a0 0x7f8188198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f817ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81881027a0 0x7f8188198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38578/0 (socket says 172.21.15.103:38578) 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f817ffff640 1 -- 172.21.15.103:0/2271637671 learned_addr learned my addr 172.21.15.103:0/2271637671 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f8187fff640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8188106f20 0x7f818819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f81877fe640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8188101df0 0x7f81881984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f817ffff640 1 -- 172.21.15.103:0/2271637671 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8188106f20 msgr2=0x7f818819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f817ffff640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8188106f20 0x7f818819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f817ffff640 1 -- 172.21.15.103:0/2271637671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8188101df0 msgr2=0x7f81881984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f817ffff640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8188101df0 0x7f81881984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f817ffff640 1 -- 172.21.15.103:0/2271637671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818819d4a0 con 0x7f81881027a0 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.168+0000 7f81877fe640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8188101df0 0x7f81881984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.169+0000 7f817ffff640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81881027a0 0x7f8188198a30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8170005940 tx=0x7f8170004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.169+0000 7f81857fa640 1 -- 172.21.15.103:0/2271637671 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817003f030 con 0x7f81881027a0 2024-09-19T06:04:51.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.169+0000 7f818de15640 1 -- 172.21.15.103:0/2271637671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818819d730 con 0x7f81881027a0 2024-09-19T06:04:51.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.169+0000 7f81857fa640 1 -- 172.21.15.103:0/2271637671 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8170003aa0 con 0x7f81881027a0 2024-09-19T06:04:51.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.169+0000 7f81857fa640 1 -- 172.21.15.103:0/2271637671 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170035070 con 0x7f81881027a0 2024-09-19T06:04:51.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.169+0000 7f818de15640 1 -- 172.21.15.103:0/2271637671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81881a5070 con 0x7f81881027a0 2024-09-19T06:04:51.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.170+0000 7f818de15640 1 -- 172.21.15.103:0/2271637671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81881021d0 con 0x7f81881027a0 2024-09-19T06:04:51.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.171+0000 7f81857fa640 1 -- 172.21.15.103:0/2271637671 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f8170042030 con 0x7f81881027a0 2024-09-19T06:04:51.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.172+0000 7f81857fa640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f81740a3240 0x7f81740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:51.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.172+0000 7f81877fe640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f81740a3240 0x7f81740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:51.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.172+0000 7f81857fa640 1 -- 172.21.15.103:0/2271637671 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f81700efc40 con 0x7f81881027a0 2024-09-19T06:04:51.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.172+0000 7f81877fe640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f81740a3240 0x7f81740a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f81780058c0 tx=0x7f8178005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:51.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.177+0000 7f81857fa640 1 -- 172.21.15.103:0/2271637671 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81700bce00 con 0x7f81881027a0 2024-09-19T06:04:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.399+0000 7f818de15640 1 -- 172.21.15.103:0/2271637671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f818810a100 con 0x7f81881027a0 2024-09-19T06:04:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.400+0000 7f81857fa640 1 -- 172.21.15.103:0/2271637671 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3094 (secure 0 0 0) 0x7f81700bc700 con 0x7f81881027a0 2024-09-19T06:04:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:04:51.403 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":4,"btime":"2024-09-19T06:04:50:494402+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:04:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 4 2024-09-19T06:04:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 -- 172.21.15.103:0/2271637671 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f81740a3240 msgr2=0x7f81740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f81740a3240 0x7f81740a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f81780058c0 tx=0x7f8178005850 comp rx=0 tx=0).stop 2024-09-19T06:04:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 -- 172.21.15.103:0/2271637671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81881027a0 msgr2=0x7f8188198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81881027a0 0x7f8188198a30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8170005940 tx=0x7f8170004270 comp rx=0 tx=0).stop 2024-09-19T06:04:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 -- 172.21.15.103:0/2271637671 shutdown_connections 2024-09-19T06:04:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f81740a3240 0x7f81740a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8188106f20 0x7f818819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81881027a0 0x7f8188198a30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 --2- 172.21.15.103:0/2271637671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8188101df0 0x7f81881984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 -- 172.21.15.103:0/2271637671 >> 172.21.15.103:0/2271637671 conn(0x7f81880fd8f0 msgr2=0x7f81880fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 -- 172.21.15.103:0/2271637671 shutdown_connections 2024-09-19T06:04:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:51.402+0000 7f818de15640 1 -- 172.21.15.103:0/2271637671 wait complete. 2024-09-19T06:04:51.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.103:6834/1313035056,v1:172.21.15.103:6835/1313035056] up:boot 2024-09-19T06:04:51.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: fsmap 3 up:standby 2024-09-19T06:04:51.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:04:51.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:51.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:51.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:51.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:51.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:51.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:51.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: Deploying daemon mds.d on smithi103 2024-09-19T06:04:51.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:51 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2271637671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:51.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.103:6834/1313035056,v1:172.21.15.103:6835/1313035056] up:boot 2024-09-19T06:04:51.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: fsmap 3 up:standby 2024-09-19T06:04:51.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:04:51.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:51.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:51.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:51.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:51.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:51.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:51.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: Deploying daemon mds.d on smithi103 2024-09-19T06:04:51.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:51 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2271637671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:51.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.103:6834/1313035056,v1:172.21.15.103:6835/1313035056] up:boot 2024-09-19T06:04:51.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: fsmap 3 up:standby 2024-09-19T06:04:51.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:04:51.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:51.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:51.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:51.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:51.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:51.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:51.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: Deploying daemon mds.d on smithi103 2024-09-19T06:04:51.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:51 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2271637671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:52.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:52 smithi174 ceph-mon[34488]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:52.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:52 smithi103 ceph-mon[30925]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:53.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:52 smithi169 ceph-mon[34350]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:53.705 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:04:53 smithi103 systemd[1]: Starting Ceph mds.d for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:04:53.993 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:04:53 smithi103 podman[71421]: 2024-09-19 06:04:53.606042491 +0000 UTC m=+0.016466036 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:04:53.993 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:04:53 smithi103 podman[71421]: 2024-09-19 06:04:53.730758492 +0000 UTC m=+0.141182023 container create 948f79608e22df33cbe69b967450edd39c12e1f530f167d2daec8069fd7bdd2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:04:53.993 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:04:53 smithi103 podman[71421]: 2024-09-19 06:04:53.92481181 +0000 UTC m=+0.335235354 container init 948f79608e22df33cbe69b967450edd39c12e1f530f167d2daec8069fd7bdd2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T06:04:53.993 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:04:53 smithi103 podman[71421]: 2024-09-19 06:04:53.927632671 +0000 UTC m=+0.338056203 container start 948f79608e22df33cbe69b967450edd39c12e1f530f167d2daec8069fd7bdd2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:04:53.993 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:04:53 smithi103 ceph-mds[71440]: -- 172.21.15.103:0/3289056883 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c2e1ed9860 con 0x55c2e1eb7400 2024-09-19T06:04:53.994 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:04:53 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-d[71436]: starting mds.d at 2024-09-19T06:04:53.994 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:04:53 smithi103 bash[71421]: 948f79608e22df33cbe69b967450edd39c12e1f530f167d2daec8069fd7bdd2c 2024-09-19T06:04:54.244 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:04:53 smithi103 systemd[1]: Started Ceph mds.d for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:04:54.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:04:54.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:54 smithi169 ceph-mon[34350]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:54.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:54 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:54.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:54 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:54.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:54 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:54.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:54 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:54.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:54 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:54.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:54 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:54.805 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:54.926 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:54 smithi103 ceph-mon[30925]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:54.926 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:54 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:54.926 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:54 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:54.926 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:54 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:54.926 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:54 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:54.926 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:54 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:54.926 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:54 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:54.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:54 smithi174 ceph-mon[34488]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:54.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:54 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:54.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:54 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:54.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:54 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:54.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:54 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:54.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:54 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:54.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:54 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.274+0000 7f8c05a9a640 1 -- 172.21.15.103:0/1129817398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00101420 msgr2=0x7f8c0010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.274+0000 7f8c05a9a640 1 --2- 172.21.15.103:0/1129817398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00101420 0x7f8c0010d950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009cd0 tx=0x7f8bf802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.274+0000 7f8c05a9a640 1 -- 172.21.15.103:0/1129817398 shutdown_connections 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.274+0000 7f8c05a9a640 1 --2- 172.21.15.103:0/1129817398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00101420 0x7f8c0010d950 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.274+0000 7f8c05a9a640 1 --2- 172.21.15.103:0/1129817398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00100a80 0x7f8c00100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.274+0000 7f8c05a9a640 1 --2- 172.21.15.103:0/1129817398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c00106a80 0x7f8c00106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.274+0000 7f8c05a9a640 1 -- 172.21.15.103:0/1129817398 >> 172.21.15.103:0/1129817398 conn(0x7f8c000fc7a0 msgr2=0x7f8c000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.274+0000 7f8c05a9a640 1 -- 172.21.15.103:0/1129817398 shutdown_connections 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.274+0000 7f8c05a9a640 1 -- 172.21.15.103:0/1129817398 wait complete. 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8c05a9a640 1 Processor -- start 2024-09-19T06:04:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8c05a9a640 1 -- start start 2024-09-19T06:04:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8c05a9a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c00100a80 0x7f8c001991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8c05a9a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00101420 0x7f8c00199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8c05a9a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00106a80 0x7f8c001a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8c05a9a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00110d30 con 0x7f8c00106a80 2024-09-19T06:04:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8c05a9a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00110bb0 con 0x7f8c00101420 2024-09-19T06:04:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8c05a9a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00110eb0 con 0x7f8c00100a80 2024-09-19T06:04:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8bfffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00106a80 0x7f8c001a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8bfffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00106a80 0x7f8c001a4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38610/0 (socket says 172.21.15.103:38610) 2024-09-19T06:04:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8bfffff640 1 -- 172.21.15.103:0/3802180205 learned_addr learned my addr 172.21.15.103:0/3802180205 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:04:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8bff7fe640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c00100a80 0x7f8c001991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.275+0000 7f8bf7fff640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00101420 0x7f8c00199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8bfffff640 1 -- 172.21.15.103:0/3802180205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c00100a80 msgr2=0x7f8c001991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8bfffff640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c00100a80 0x7f8c001991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8bfffff640 1 -- 172.21.15.103:0/3802180205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00101420 msgr2=0x7f8c00199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8bfffff640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00101420 0x7f8c00199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8bfffff640 1 -- 172.21.15.103:0/3802180205 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c001a4780 con 0x7f8c00106a80 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8bf7fff640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00101420 0x7f8c00199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8bfffff640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00106a80 0x7f8c001a4240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8033040 tx=0x7f8bf8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/3802180205 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8004040 con 0x7f8c00106a80 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8c05a9a640 1 -- 172.21.15.103:0/3802180205 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c001a4950 con 0x7f8c00106a80 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/3802180205 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8bf8004690 con 0x7f8c00106a80 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/3802180205 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8030e10 con 0x7f8c00106a80 2024-09-19T06:04:55.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.276+0000 7f8c05a9a640 1 -- 172.21.15.103:0/3802180205 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c001a4e00 con 0x7f8c00106a80 2024-09-19T06:04:55.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.277+0000 7f8c05a9a640 1 -- 172.21.15.103:0/3802180205 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c00100ee0 con 0x7f8c00106a80 2024-09-19T06:04:55.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.279+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/3802180205 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f8bf80305a0 con 0x7f8c00106a80 2024-09-19T06:04:55.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.280+0000 7f8bfd7fa640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8bec0a3240 0x7f8bec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:55.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.280+0000 7f8bff7fe640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8bec0a3240 0x7f8bec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:55.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.280+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/3802180205 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f8bf802e030 con 0x7f8c00106a80 2024-09-19T06:04:55.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.280+0000 7f8bff7fe640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8bec0a3240 0x7f8bec0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0005fd0 tx=0x7f8bf000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:55.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.283+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/3802180205 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8bf804b060 con 0x7f8c00106a80 2024-09-19T06:04:55.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.485+0000 7f8c05a9a640 1 -- 172.21.15.103:0/3802180205 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c00108ff0 con 0x7f8c00106a80 2024-09-19T06:04:55.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.485+0000 7f8bfd7fa640 1 -- 172.21.15.103:0/3802180205 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3922 (secure 0 0 0) 0x7f8bf80bdf90 con 0x7f8c00106a80 2024-09-19T06:04:55.488 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:04:55.488 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":5,"btime":"2024-09-19T06:04:54:540212+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:04:55.488 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 5 2024-09-19T06:04:55.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 -- 172.21.15.103:0/3802180205 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8bec0a3240 msgr2=0x7f8bec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:55.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8bec0a3240 0x7f8bec0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0005fd0 tx=0x7f8bf000b390 comp rx=0 tx=0).stop 2024-09-19T06:04:55.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 -- 172.21.15.103:0/3802180205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00106a80 msgr2=0x7f8c001a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:55.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00106a80 0x7f8c001a4240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8033040 tx=0x7f8bf8003970 comp rx=0 tx=0).stop 2024-09-19T06:04:55.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 -- 172.21.15.103:0/3802180205 shutdown_connections 2024-09-19T06:04:55.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8bec0a3240 0x7f8bec0a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c00106a80 0x7f8c001a4240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c00101420 0x7f8c00199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 --2- 172.21.15.103:0/3802180205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c00100a80 0x7f8c001991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 -- 172.21.15.103:0/3802180205 >> 172.21.15.103:0/3802180205 conn(0x7f8c000fc7a0 msgr2=0x7f8c000fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:55.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 -- 172.21.15.103:0/3802180205 shutdown_connections 2024-09-19T06:04:55.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:55.488+0000 7f8c05a9a640 1 -- 172.21.15.103:0/3802180205 wait complete. 2024-09-19T06:04:55.626 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:55 smithi169 ceph-mon[34350]: Deploying daemon mds.e on smithi169 2024-09-19T06:04:55.626 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:55 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.103:6836/1090426593,v1:172.21.15.103:6837/1090426593] up:boot 2024-09-19T06:04:55.626 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:55 smithi169 ceph-mon[34350]: fsmap 4 up:standby 2024-09-19T06:04:55.626 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:55 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:04:55.627 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:55 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3802180205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:55.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:55 smithi103 ceph-mon[30925]: Deploying daemon mds.e on smithi169 2024-09-19T06:04:55.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:55 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.103:6836/1090426593,v1:172.21.15.103:6837/1090426593] up:boot 2024-09-19T06:04:55.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:55 smithi103 ceph-mon[30925]: fsmap 4 up:standby 2024-09-19T06:04:55.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:55 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:04:55.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:55 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3802180205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:55 smithi174 ceph-mon[34488]: Deploying daemon mds.e on smithi169 2024-09-19T06:04:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:55 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.103:6836/1090426593,v1:172.21.15.103:6837/1090426593] up:boot 2024-09-19T06:04:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:55 smithi174 ceph-mon[34488]: fsmap 4 up:standby 2024-09-19T06:04:55.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:55 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:04:55.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:55 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3802180205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:56.027 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:04:55 smithi169 systemd[1]: Starting Ceph mds.e for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:04:56.329 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:04:56 smithi169 podman[63746]: 2024-09-19 06:04:55.973397501 +0000 UTC m=+0.016652173 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:04:56.329 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:04:56 smithi169 podman[63746]: 2024-09-19 06:04:56.07560483 +0000 UTC m=+0.118859550 container create 1bc7a114a0685aebf8da7972925212c6def82b47af8675ebab17c57161f76cc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:04:56.329 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:04:56 smithi169 podman[63746]: 2024-09-19 06:04:56.328136896 +0000 UTC m=+0.371391569 container init 1bc7a114a0685aebf8da7972925212c6def82b47af8675ebab17c57161f76cc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:04:56.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:56 smithi169 ceph-mon[34350]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:56.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:56 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:56.778 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:04:56 smithi169 podman[63746]: 2024-09-19 06:04:56.33117907 +0000 UTC m=+0.374433747 container start 1bc7a114a0685aebf8da7972925212c6def82b47af8675ebab17c57161f76cc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T06:04:56.778 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:04:56 smithi169 ceph-mds[63766]: -- 172.21.15.169:0/3671149675 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a54a9f860 con 0x555a54a7c800 2024-09-19T06:04:56.778 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:04:56 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-e[63762]: starting mds.e at 2024-09-19T06:04:56.778 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:04:56 smithi169 bash[63746]: 1bc7a114a0685aebf8da7972925212c6def82b47af8675ebab17c57161f76cc4 2024-09-19T06:04:56.779 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:04:56 smithi169 systemd[1]: Started Ceph mds.e for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:04:56.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:56 smithi174 ceph-mon[34488]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:56.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:56.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:56.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:56.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:56.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:56.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:56 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:56 smithi103 ceph-mon[30925]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:04:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:04:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:04:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:56 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:57.857 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:57 smithi174 ceph-mon[34488]: Deploying daemon mds.f on smithi174 2024-09-19T06:04:57.857 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:57 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.169:6834/3808769732,v1:172.21.15.169:6835/3808769732] up:boot 2024-09-19T06:04:57.857 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:57 smithi174 ceph-mon[34488]: fsmap 5 up:standby 2024-09-19T06:04:57.857 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:57 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:04:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:57 smithi103 ceph-mon[30925]: Deploying daemon mds.f on smithi174 2024-09-19T06:04:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:57 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.169:6834/3808769732,v1:172.21.15.169:6835/3808769732] up:boot 2024-09-19T06:04:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:57 smithi103 ceph-mon[30925]: fsmap 5 up:standby 2024-09-19T06:04:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:57 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:04:58.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:57 smithi169 ceph-mon[34350]: Deploying daemon mds.f on smithi174 2024-09-19T06:04:58.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:57 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.169:6834/3808769732,v1:172.21.15.169:6835/3808769732] up:boot 2024-09-19T06:04:58.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:57 smithi169 ceph-mon[34350]: fsmap 5 up:standby 2024-09-19T06:04:58.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:57 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:04:58.130 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:04:58.387 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:58.454 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:04:58 smithi174 systemd[1]: Starting Ceph mds.f for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:04:58.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:58 smithi174 ceph-mon[34488]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:58.814 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:04:58 smithi174 podman[64712]: 2024-09-19 06:04:58.464975026 +0000 UTC m=+0.016319343 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:04:58.814 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:04:58 smithi174 podman[64712]: 2024-09-19 06:04:58.566686708 +0000 UTC m=+0.118031004 container create c2f352d10ca0b3eea5db9175525c60cb06dbfdfd9229c68264e6b5aaaca0f33c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T06:04:58.815 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:04:58 smithi174 podman[64712]: 2024-09-19 06:04:58.785755718 +0000 UTC m=+0.337100035 container init c2f352d10ca0b3eea5db9175525c60cb06dbfdfd9229c68264e6b5aaaca0f33c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T06:04:58.815 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:04:58 smithi174 podman[64712]: 2024-09-19 06:04:58.788589004 +0000 UTC m=+0.339933311 container start c2f352d10ca0b3eea5db9175525c60cb06dbfdfd9229c68264e6b5aaaca0f33c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T06:04:58.815 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:04:58 smithi174 ceph-mds[64733]: -- 172.21.15.174:0/4231536745 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563784a4fc20 con 0x563784a2d000 2024-09-19T06:04:58.815 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:04:58 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-f[64729]: starting mds.f at 2024-09-19T06:04:58.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:58 smithi103 ceph-mon[30925]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.823+0000 7f12b114f640 1 -- 172.21.15.103:0/1909855092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac102570 msgr2=0x7f12ac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.823+0000 7f12b114f640 1 --2- 172.21.15.103:0/1909855092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac102570 0x7f12ac1029b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009900 tx=0x7f12a002a480 comp rx=0 tx=0).stop 2024-09-19T06:04:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.823+0000 7f12b114f640 1 -- 172.21.15.103:0/1909855092 shutdown_connections 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.823+0000 7f12b114f640 1 --2- 172.21.15.103:0/1909855092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac102ef0 0x7f12ac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.823+0000 7f12b114f640 1 --2- 172.21.15.103:0/1909855092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac102570 0x7f12ac1029b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.823+0000 7f12b114f640 1 --2- 172.21.15.103:0/1909855092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ac100e20 0x7f12ac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.823+0000 7f12b114f640 1 -- 172.21.15.103:0/1909855092 >> 172.21.15.103:0/1909855092 conn(0x7f12ac0fc7d0 msgr2=0x7f12ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.823+0000 7f12b114f640 1 -- 172.21.15.103:0/1909855092 shutdown_connections 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.823+0000 7f12b114f640 1 -- 172.21.15.103:0/1909855092 wait complete. 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.824+0000 7f12b114f640 1 Processor -- start 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.824+0000 7f12b114f640 1 -- start start 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12b114f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ac100e20 0x7f12ac199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12b114f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac102570 0x7f12ac199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12b114f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac102ef0 0x7f12ac1a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12b114f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac110e30 con 0x7f12ac102ef0 2024-09-19T06:04:58.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12b114f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac110cb0 con 0x7f12ac100e20 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12b114f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac110fb0 con 0x7f12ac102570 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12ab59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac102ef0 0x7f12ac1a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12ab59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac102ef0 0x7f12ac1a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38618/0 (socket says 172.21.15.103:38618) 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12ab59e640 1 -- 172.21.15.103:0/1342766095 learned_addr learned my addr 172.21.15.103:0/1342766095 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12aad9d640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ac100e20 0x7f12ac199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12aa59c640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac102570 0x7f12ac199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12ab59e640 1 -- 172.21.15.103:0/1342766095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac102570 msgr2=0x7f12ac199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12ab59e640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac102570 0x7f12ac199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12ab59e640 1 -- 172.21.15.103:0/1342766095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ac100e20 msgr2=0x7f12ac199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12ab59e640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ac100e20 0x7f12ac199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12ab59e640 1 -- 172.21.15.103:0/1342766095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac1a47c0 con 0x7f12ac102ef0 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.825+0000 7f12ab59e640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac102ef0 0x7f12ac1a4280 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f12a400cad0 tx=0x7f12a400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:58.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.826+0000 7f1293fff640 1 -- 172.21.15.103:0/1342766095 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a400ad60 con 0x7f12ac102ef0 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.826+0000 7f12b114f640 1 -- 172.21.15.103:0/1342766095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac1a4990 con 0x7f12ac102ef0 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.826+0000 7f1293fff640 1 -- 172.21.15.103:0/1342766095 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12a4005020 con 0x7f12ac102ef0 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.826+0000 7f12b114f640 1 -- 172.21.15.103:0/1342766095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac1a4ea0 con 0x7f12ac102ef0 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.826+0000 7f1293fff640 1 -- 172.21.15.103:0/1342766095 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a400f6b0 con 0x7f12ac102ef0 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.827+0000 7f12b114f640 1 -- 172.21.15.103:0/1342766095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ac1021b0 con 0x7f12ac102ef0 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.828+0000 7f1293fff640 1 -- 172.21.15.103:0/1342766095 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f12a4004b20 con 0x7f12ac102ef0 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.828+0000 7f1293fff640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12940a3240 0x7f12940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.828+0000 7f12aad9d640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12940a3240 0x7f12940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.828+0000 7f1293fff640 1 -- 172.21.15.103:0/1342766095 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f12a40cf310 con 0x7f12ac102ef0 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.829+0000 7f12aad9d640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12940a3240 0x7f12940a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f129c00abe0 tx=0x7f129c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:58.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:58.832+0000 7f1293fff640 1 -- 172.21.15.103:0/1342766095 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f12a4014030 con 0x7f12ac102ef0 2024-09-19T06:04:59.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:58 smithi169 ceph-mon[34350]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:59.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.037+0000 7f12b114f640 1 -- 172.21.15.103:0/1342766095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12ac06a590 con 0x7f12ac102ef0 2024-09-19T06:04:59.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.037+0000 7f1293fff640 1 -- 172.21.15.103:0/1342766095 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4750 (secure 0 0 0) 0x7f12ac06a590 con 0x7f12ac102ef0 2024-09-19T06:04:59.040 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:04:59.040 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"btime":"2024-09-19T06:04:56:553170+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T06:04:59.041 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-09-19T06:04:59.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.039+0000 7f12b114f640 1 -- 172.21.15.103:0/1342766095 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12940a3240 msgr2=0x7f12940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:59.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.039+0000 7f12b114f640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12940a3240 0x7f12940a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f129c00abe0 tx=0x7f129c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.039+0000 7f12b114f640 1 -- 172.21.15.103:0/1342766095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac102ef0 msgr2=0x7f12ac1a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:59.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.039+0000 7f12b114f640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac102ef0 0x7f12ac1a4280 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f12a400cad0 tx=0x7f12a400ced0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.039+0000 7f12b114f640 1 -- 172.21.15.103:0/1342766095 shutdown_connections 2024-09-19T06:04:59.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.039+0000 7f12b114f640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f12940a3240 0x7f12940a5700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.039+0000 7f12b114f640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac102ef0 0x7f12ac1a4280 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.039+0000 7f12b114f640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac102570 0x7f12ac199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.039+0000 7f12b114f640 1 --2- 172.21.15.103:0/1342766095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ac100e20 0x7f12ac199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.039+0000 7f12b114f640 1 -- 172.21.15.103:0/1342766095 >> 172.21.15.103:0/1342766095 conn(0x7f12ac0fc7d0 msgr2=0x7f12ac106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:59.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.040+0000 7f12b114f640 1 -- 172.21.15.103:0/1342766095 shutdown_connections 2024-09-19T06:04:59.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:04:59.040+0000 7f12b114f640 1 -- 172.21.15.103:0/1342766095 wait complete. 2024-09-19T06:04:59.204 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:04:58 smithi174 bash[64712]: c2f352d10ca0b3eea5db9175525c60cb06dbfdfd9229c68264e6b5aaaca0f33c 2024-09-19T06:04:59.204 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:04:58 smithi174 systemd[1]: Started Ceph mds.f for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:05:00.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:00.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:00.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:00.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:00.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:00.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:00.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: Deploying daemon mds.c on smithi174 2024-09-19T06:05:00.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1342766095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:00.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:00.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.174:6834/588815565,v1:172.21.15.174:6835/588815565] up:boot 2024-09-19T06:05:00.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: fsmap 6 up:standby 2024-09-19T06:05:00.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:04:59 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:05:00.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:00.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:00.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:00.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:00.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:00.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:00.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: Deploying daemon mds.c on smithi174 2024-09-19T06:05:00.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1342766095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:00.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:00.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.174:6834/588815565,v1:172.21.15.174:6835/588815565] up:boot 2024-09-19T06:05:00.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: fsmap 6 up:standby 2024-09-19T06:05:00.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:04:59 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:05:00.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:00.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:00.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:00.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:00.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:00.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:00.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: Deploying daemon mds.c on smithi174 2024-09-19T06:05:00.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1342766095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:00.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:00.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.174:6834/588815565,v1:172.21.15.174:6835/588815565] up:boot 2024-09-19T06:05:00.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: fsmap 6 up:standby 2024-09-19T06:05:00.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:04:59 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:05:00.954 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:05:00 smithi174 systemd[1]: Starting Ceph mds.c for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:05:01.289 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:05:00 smithi174 podman[65016]: 2024-09-19 06:05:00.877936395 +0000 UTC m=+0.016278204 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:05:01.290 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:05:01 smithi174 podman[65016]: 2024-09-19 06:05:01.015813403 +0000 UTC m=+0.154155199 container create ddcd11b28c2d897ce160ac493f65908081329e1b1bc32bacd02cfff8917b9294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-19T06:05:01.290 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:05:01 smithi174 podman[65016]: 2024-09-19 06:05:01.288731091 +0000 UTC m=+0.427072898 container init ddcd11b28c2d897ce160ac493f65908081329e1b1bc32bacd02cfff8917b9294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T06:05:01.704 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:05:01 smithi174 podman[65016]: 2024-09-19 06:05:01.291614014 +0000 UTC m=+0.429955811 container start ddcd11b28c2d897ce160ac493f65908081329e1b1bc32bacd02cfff8917b9294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T06:05:01.704 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:05:01 smithi174 ceph-mds[65035]: -- 172.21.15.174:0/2645341909 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55734773f860 con 0x55734771d000 2024-09-19T06:05:01.704 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:05:01 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: starting mds.c at 2024-09-19T06:05:01.705 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:05:01 smithi174 bash[65016]: ddcd11b28c2d897ce160ac493f65908081329e1b1bc32bacd02cfff8917b9294 2024-09-19T06:05:01.705 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:05:01 smithi174 systemd[1]: Started Ceph mds.c for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:05:01.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:05:02.035 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:02.414 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] up:boot 2024-09-19T06:05:02.516 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: fsmap 7 up:standby 2024-09-19T06:05:02.516 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:05:02.516 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:02.516 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:02.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:02.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:02.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:02.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:02.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:02.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:02 smithi103 ceph-mon[30925]: Deploying daemon mds.h on smithi169 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] up:boot 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: fsmap 7 up:standby 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:02.518 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:02 smithi169 ceph-mon[34350]: Deploying daemon mds.h on smithi169 2024-09-19T06:05:02.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.493+0000 7fd7dc405640 1 -- 172.21.15.103:0/3562631548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d4074510 msgr2=0x7fd7d40748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:02.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.493+0000 7fd7dc405640 1 --2- 172.21.15.103:0/3562631548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d4074510 0x7fd7d40748f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009900 tx=0x7fd7c402a480 comp rx=0 tx=0).stop 2024-09-19T06:05:02.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.493+0000 7fd7dc405640 1 -- 172.21.15.103:0/3562631548 shutdown_connections 2024-09-19T06:05:02.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.493+0000 7fd7dc405640 1 --2- 172.21.15.103:0/3562631548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d410e440 0x7fd7d4110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.493+0000 7fd7dc405640 1 --2- 172.21.15.103:0/3562631548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4074e30 0x7fd7d410df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.493+0000 7fd7dc405640 1 --2- 172.21.15.103:0/3562631548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d4074510 0x7fd7d40748f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.493+0000 7fd7dc405640 1 -- 172.21.15.103:0/3562631548 >> 172.21.15.103:0/3562631548 conn(0x7fd7d40fd8c0 msgr2=0x7fd7d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:02.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.493+0000 7fd7dc405640 1 -- 172.21.15.103:0/3562631548 shutdown_connections 2024-09-19T06:05:02.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.493+0000 7fd7dc405640 1 -- 172.21.15.103:0/3562631548 wait complete. 2024-09-19T06:05:02.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7dc405640 1 Processor -- start 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7dc405640 1 -- start start 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7dc405640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4074510 0x7fd7d419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7dc405640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d4074e30 0x7fd7d419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7dc405640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d410e440 0x7fd7d419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7dc405640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d4114090 con 0x7fd7d4074e30 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7dc405640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d4113f10 con 0x7fd7d4074510 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7dc405640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d4114210 con 0x7fd7d410e440 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7d99a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d4074e30 0x7fd7d419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7d99a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d4074e30 0x7fd7d419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40462/0 (socket says 172.21.15.103:40462) 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7d99a0640 1 -- 172.21.15.103:0/333070529 learned_addr learned my addr 172.21.15.103:0/333070529 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7da1a1640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4074510 0x7fd7d419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7da9a2640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d410e440 0x7fd7d419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:02.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7d99a0640 1 -- 172.21.15.103:0/333070529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d410e440 msgr2=0x7fd7d419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7d99a0640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d410e440 0x7fd7d419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.494+0000 7fd7d99a0640 1 -- 172.21.15.103:0/333070529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4074510 msgr2=0x7fd7d419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.495+0000 7fd7d99a0640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4074510 0x7fd7d419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.495+0000 7fd7d99a0640 1 -- 172.21.15.103:0/333070529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d419f5c0 con 0x7fd7d4074e30 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.495+0000 7fd7da9a2640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d410e440 0x7fd7d419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.495+0000 7fd7da1a1640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4074510 0x7fd7d419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.495+0000 7fd7d99a0640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d4074e30 0x7fd7d419ab50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c890 tx=0x7fd7d000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.495+0000 7fd7cb7fe640 1 -- 172.21.15.103:0/333070529 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0004220 con 0x7fd7d4074e30 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.495+0000 7fd7cb7fe640 1 -- 172.21.15.103:0/333070529 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7d00043c0 con 0x7fd7d4074e30 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.495+0000 7fd7dc405640 1 -- 172.21.15.103:0/333070529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d419f8b0 con 0x7fd7d4074e30 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.495+0000 7fd7cb7fe640 1 -- 172.21.15.103:0/333070529 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0004a00 con 0x7fd7d4074e30 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.495+0000 7fd7dc405640 1 -- 172.21.15.103:0/333070529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d41a7190 con 0x7fd7d4074e30 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.496+0000 7fd7dc405640 1 -- 172.21.15.103:0/333070529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d40748f0 con 0x7fd7d4074e30 2024-09-19T06:05:02.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.497+0000 7fd7cb7fe640 1 -- 172.21.15.103:0/333070529 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fd7d0004ba0 con 0x7fd7d4074e30 2024-09-19T06:05:02.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.497+0000 7fd7cb7fe640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7c00a3240 0x7fd7c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:02.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.498+0000 7fd7da1a1640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7c00a3240 0x7fd7c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:02.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.498+0000 7fd7cb7fe640 1 -- 172.21.15.103:0/333070529 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd7d00cf1e0 con 0x7fd7d4074e30 2024-09-19T06:05:02.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.498+0000 7fd7da1a1640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7c00a3240 0x7fd7c00a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4031440 tx=0x7fd7c40095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:02.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.502+0000 7fd7cb7fe640 1 -- 172.21.15.103:0/333070529 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7d0014030 con 0x7fd7d4074e30 2024-09-19T06:05:02.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] up:boot 2024-09-19T06:05:02.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: fsmap 7 up:standby 2024-09-19T06:05:02.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:05:02.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:02.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:02.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:02.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:02.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:02.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:02.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:02.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:02 smithi174 ceph-mon[34488]: Deploying daemon mds.h on smithi169 2024-09-19T06:05:02.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.703+0000 7fd7dc405640 1 -- 172.21.15.103:0/333070529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7d402d7c0 con 0x7fd7d4074e30 2024-09-19T06:05:02.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.703+0000 7fd7cb7fe640 1 -- 172.21.15.103:0/333070529 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6403 (secure 0 0 0) 0x7fd7d009c3a0 con 0x7fd7d4074e30 2024-09-19T06:05:02.706 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:02.706 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":8,"btime":"2024-09-19T06:05:01:369859+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T06:05:02.707 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 8 2024-09-19T06:05:02.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.705+0000 7fd7dc405640 1 -- 172.21.15.103:0/333070529 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7c00a3240 msgr2=0x7fd7c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.705+0000 7fd7dc405640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7c00a3240 0x7fd7c00a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4031440 tx=0x7fd7c40095f0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.705+0000 7fd7dc405640 1 -- 172.21.15.103:0/333070529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d4074e30 msgr2=0x7fd7d419ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.705+0000 7fd7dc405640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d4074e30 0x7fd7d419ab50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c890 tx=0x7fd7d000cd50 comp rx=0 tx=0).stop 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.706+0000 7fd7dc405640 1 -- 172.21.15.103:0/333070529 shutdown_connections 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.706+0000 7fd7dc405640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7c00a3240 0x7fd7c00a5700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.706+0000 7fd7dc405640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d410e440 0x7fd7d419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.706+0000 7fd7dc405640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d4074e30 0x7fd7d419ab50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.706+0000 7fd7dc405640 1 --2- 172.21.15.103:0/333070529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4074510 0x7fd7d419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.706+0000 7fd7dc405640 1 -- 172.21.15.103:0/333070529 >> 172.21.15.103:0/333070529 conn(0x7fd7d40fd8c0 msgr2=0x7fd7d40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.706+0000 7fd7dc405640 1 -- 172.21.15.103:0/333070529 shutdown_connections 2024-09-19T06:05:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:02.706+0000 7fd7dc405640 1 -- 172.21.15.103:0/333070529 wait complete. 2024-09-19T06:05:03.278 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:05:03 smithi169 systemd[1]: Starting Ceph mds.h for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:05:03.648 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:03 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/333070529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:03.649 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:05:03 smithi169 podman[64048]: 2024-09-19 06:05:03.276432154 +0000 UTC m=+0.015890389 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:05:03.649 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:05:03 smithi169 podman[64048]: 2024-09-19 06:05:03.386656691 +0000 UTC m=+0.126114911 container create baeceb04780c478054def496fb79fb0b6f4e2ce0ddf5ce3cc5c64963c9f65a3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T06:05:03.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:03 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/333070529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:03.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:03 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/333070529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:04.027 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:05:03 smithi169 podman[64048]: 2024-09-19 06:05:03.647387281 +0000 UTC m=+0.386845501 container init baeceb04780c478054def496fb79fb0b6f4e2ce0ddf5ce3cc5c64963c9f65a3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-h, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T06:05:04.028 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:05:03 smithi169 podman[64048]: 2024-09-19 06:05:03.650450414 +0000 UTC m=+0.389908653 container start baeceb04780c478054def496fb79fb0b6f4e2ce0ddf5ce3cc5c64963c9f65a3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:05:04.028 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:05:03 smithi169 ceph-mds[64067]: -- 172.21.15.169:0/1694162717 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5563fb9cbc20 con 0x5563fb9a9400 2024-09-19T06:05:04.028 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:05:03 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-h[64063]: starting mds.h at 2024-09-19T06:05:04.028 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:05:03 smithi169 bash[64048]: baeceb04780c478054def496fb79fb0b6f4e2ce0ddf5ce3cc5c64963c9f65a3f 2024-09-19T06:05:04.028 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:05:03 smithi169 systemd[1]: Started Ceph mds.h for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:05:04.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:04 smithi169 ceph-mon[34350]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:04.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:04.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:04.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:04.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:04.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:04.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:04 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:04 smithi174 ceph-mon[34488]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:04.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:04 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:04.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:04 smithi103 ceph-mon[30925]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:04.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:04.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:04.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:04.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:04.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:04.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:04 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:05.490 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:05:05.752 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:05.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:05 smithi169 ceph-mon[34350]: Deploying daemon mds.i on smithi174 2024-09-19T06:05:05.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:05 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.169:6836/2782103866,v1:172.21.15.169:6837/2782103866] up:boot 2024-09-19T06:05:05.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:05 smithi169 ceph-mon[34350]: fsmap 8 up:standby 2024-09-19T06:05:05.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:05 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:05:05.874 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:05 smithi174 ceph-mon[34488]: Deploying daemon mds.i on smithi174 2024-09-19T06:05:05.874 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:05 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.169:6836/2782103866,v1:172.21.15.169:6837/2782103866] up:boot 2024-09-19T06:05:05.874 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:05 smithi174 ceph-mon[34488]: fsmap 8 up:standby 2024-09-19T06:05:05.874 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:05 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:05:05.874 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:05 smithi103 ceph-mon[30925]: Deploying daemon mds.i on smithi174 2024-09-19T06:05:05.874 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:05 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.169:6836/2782103866,v1:172.21.15.169:6837/2782103866] up:boot 2024-09-19T06:05:05.874 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:05 smithi103 ceph-mon[30925]: fsmap 8 up:standby 2024-09-19T06:05:05.874 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:05 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:05:05.875 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:05:05 smithi174 systemd[1]: Starting Ceph mds.i for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:05:06.142 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:05:05 smithi174 podman[65316]: 2024-09-19 06:05:05.872402142 +0000 UTC m=+0.101795987 container create 89fcc9ea8a7477c3b0722970433317c064da4aae7296385db472db370a51e9e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T06:05:06.143 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:05:05 smithi174 podman[65316]: 2024-09-19 06:05:05.786471041 +0000 UTC m=+0.015864899 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:05:06.143 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:05:06 smithi174 podman[65316]: 2024-09-19 06:05:06.049709621 +0000 UTC m=+0.279103471 container init 89fcc9ea8a7477c3b0722970433317c064da4aae7296385db472db370a51e9e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T06:05:06.143 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:05:06 smithi174 podman[65316]: 2024-09-19 06:05:06.052539635 +0000 UTC m=+0.281933490 container start 89fcc9ea8a7477c3b0722970433317c064da4aae7296385db472db370a51e9e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:05:06.143 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:05:06 smithi174 ceph-mds[65335]: -- 172.21.15.174:0/1794597297 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f2ff865860 con 0x55f2ff842800 2024-09-19T06:05:06.143 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:05:06 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i[65331]: starting mds.i at 2024-09-19T06:05:06.143 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:05:06 smithi174 bash[65316]: 89fcc9ea8a7477c3b0722970433317c064da4aae7296385db472db370a51e9e5 2024-09-19T06:05:06.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.256+0000 7fed35497640 1 -- 172.21.15.103:0/1540174160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30074e30 msgr2=0x7fed3010def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:06.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.256+0000 7fed35497640 1 --2- 172.21.15.103:0/1540174160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30074e30 0x7fed3010def0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed24009900 tx=0x7fed2402a480 comp rx=0 tx=0).stop 2024-09-19T06:05:06.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.256+0000 7fed35497640 1 -- 172.21.15.103:0/1540174160 shutdown_connections 2024-09-19T06:05:06.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.256+0000 7fed35497640 1 --2- 172.21.15.103:0/1540174160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed3010e430 0x7fed30110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:06.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.256+0000 7fed35497640 1 --2- 172.21.15.103:0/1540174160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30074e30 0x7fed3010def0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:06.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.256+0000 7fed35497640 1 --2- 172.21.15.103:0/1540174160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed30074510 0x7fed300748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:06.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.256+0000 7fed35497640 1 -- 172.21.15.103:0/1540174160 >> 172.21.15.103:0/1540174160 conn(0x7fed300fd8b0 msgr2=0x7fed300ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:06.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.256+0000 7fed35497640 1 -- 172.21.15.103:0/1540174160 shutdown_connections 2024-09-19T06:05:06.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.256+0000 7fed35497640 1 -- 172.21.15.103:0/1540174160 wait complete. 2024-09-19T06:05:06.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.257+0000 7fed35497640 1 Processor -- start 2024-09-19T06:05:06.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.257+0000 7fed35497640 1 -- start start 2024-09-19T06:05:06.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed35497640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30074510 0x7fed3019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:06.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed35497640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed30074e30 0x7fed3019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:06.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed35497640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed3010e430 0x7fed3019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:06.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed35497640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed30114050 con 0x7fed30074510 2024-09-19T06:05:06.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed35497640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fed30113ed0 con 0x7fed3010e430 2024-09-19T06:05:06.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed35497640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed301141d0 con 0x7fed30074e30 2024-09-19T06:05:06.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30074510 0x7fed3019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:06.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30074510 0x7fed3019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40488/0 (socket says 172.21.15.103:40488) 2024-09-19T06:05:06.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2effd640 1 -- 172.21.15.103:0/3538321493 learned_addr learned my addr 172.21.15.103:0/3538321493 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:06.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2e7fc640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed30074e30 0x7fed3019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:06.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2f7fe640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed3010e430 0x7fed3019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:06.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2effd640 1 -- 172.21.15.103:0/3538321493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed30074e30 msgr2=0x7fed3019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:06.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2effd640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed30074e30 0x7fed3019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:06.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2effd640 1 -- 172.21.15.103:0/3538321493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed3010e430 msgr2=0x7fed3019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:06.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2effd640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed3010e430 0x7fed3019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:06.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2effd640 1 -- 172.21.15.103:0/3538321493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3019f5b0 con 0x7fed30074510 2024-09-19T06:05:06.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2e7fc640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed30074e30 0x7fed3019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:05:06.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.258+0000 7fed2effd640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30074510 0x7fed3019a600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed2000d950 tx=0x7fed2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:06.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.259+0000 7fed17fff640 1 -- 172.21.15.103:0/3538321493 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20017070 con 0x7fed30074510 2024-09-19T06:05:06.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.259+0000 7fed35497640 1 -- 172.21.15.103:0/3538321493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3019f8a0 con 0x7fed30074510 2024-09-19T06:05:06.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.259+0000 7fed17fff640 1 -- 172.21.15.103:0/3538321493 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed20009c30 con 0x7fed30074510 2024-09-19T06:05:06.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.259+0000 7fed17fff640 1 -- 172.21.15.103:0/3538321493 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2000f620 con 0x7fed30074510 2024-09-19T06:05:06.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.259+0000 7fed35497640 1 -- 172.21.15.103:0/3538321493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed301a7180 con 0x7fed30074510 2024-09-19T06:05:06.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.260+0000 7fed35497640 1 -- 172.21.15.103:0/3538321493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed300748f0 con 0x7fed30074510 2024-09-19T06:05:06.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.261+0000 7fed17fff640 1 -- 172.21.15.103:0/3538321493 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fed200109a0 con 0x7fed30074510 2024-09-19T06:05:06.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.262+0000 7fed17fff640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fed180a3240 0x7fed180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:06.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.262+0000 7fed2e7fc640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fed180a3240 0x7fed180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:06.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.262+0000 7fed17fff640 1 -- 172.21.15.103:0/3538321493 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fed200cf010 con 0x7fed30074510 2024-09-19T06:05:06.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.262+0000 7fed2e7fc640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fed180a3240 0x7fed180a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fed24005ab0 tx=0x7fed24005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:06.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.266+0000 7fed17fff640 1 -- 172.21.15.103:0/3538321493 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed20009de0 con 0x7fed30074510 2024-09-19T06:05:06.454 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:05:06 smithi174 systemd[1]: Started Ceph mds.i for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:05:06.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.477+0000 7fed35497640 1 -- 172.21.15.103:0/3538321493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed3002d7c0 con 0x7fed30074510 2024-09-19T06:05:06.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.478+0000 7fed17fff640 1 -- 172.21.15.103:0/3538321493 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7231 (secure 0 0 0) 0x7fed2009bb80 con 0x7fed30074510 2024-09-19T06:05:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:06.480 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-09-19T06:05:04:498610+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T06:05:06.480 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-09-19T06:05:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.481+0000 7fed35497640 1 -- 172.21.15.103:0/3538321493 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fed180a3240 msgr2=0x7fed180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.481+0000 7fed35497640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fed180a3240 0x7fed180a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fed24005ab0 tx=0x7fed24005a20 comp rx=0 tx=0).stop 2024-09-19T06:05:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.481+0000 7fed35497640 1 -- 172.21.15.103:0/3538321493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30074510 msgr2=0x7fed3019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.481+0000 7fed35497640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30074510 0x7fed3019a600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed2000d950 tx=0x7fed2000de10 comp rx=0 tx=0).stop 2024-09-19T06:05:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.481+0000 7fed35497640 1 -- 172.21.15.103:0/3538321493 shutdown_connections 2024-09-19T06:05:06.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.481+0000 7fed35497640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fed180a3240 0x7fed180a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:06.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.482+0000 7fed35497640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed3010e430 0x7fed3019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:06.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.482+0000 7fed35497640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed30074e30 0x7fed3019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:06.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.482+0000 7fed35497640 1 --2- 172.21.15.103:0/3538321493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30074510 0x7fed3019a600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:06.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.482+0000 7fed35497640 1 -- 172.21.15.103:0/3538321493 >> 172.21.15.103:0/3538321493 conn(0x7fed300fd8b0 msgr2=0x7fed300ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:06.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.482+0000 7fed35497640 1 -- 172.21.15.103:0/3538321493 shutdown_connections 2024-09-19T06:05:06.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:06.482+0000 7fed35497640 1 -- 172.21.15.103:0/3538321493 wait complete. 2024-09-19T06:05:06.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:06 smithi103 ceph-mon[30925]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:06.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:06.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:06.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:06.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:06.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:06.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:06 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:06.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:06 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3538321493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:06.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:06 smithi169 ceph-mon[34350]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:06.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:06 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:06.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:06 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:06.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:06 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:06.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:06 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:06.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:06 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:06.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:06 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:06.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:06 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3538321493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:06.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:06 smithi174 ceph-mon[34488]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:06.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:06 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:06.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:06 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:06.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:06 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:06.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:06 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:06.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:06 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:06.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:06 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:06.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:06 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3538321493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:07.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:07 smithi174 ceph-mon[34488]: Deploying daemon mds.g on smithi103 2024-09-19T06:05:07.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:07 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] up:boot 2024-09-19T06:05:07.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:07 smithi174 ceph-mon[34488]: fsmap 9 up:standby 2024-09-19T06:05:07.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:07 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:05:07.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:07 smithi103 ceph-mon[30925]: Deploying daemon mds.g on smithi103 2024-09-19T06:05:07.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:07 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] up:boot 2024-09-19T06:05:07.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:07 smithi103 ceph-mon[30925]: fsmap 9 up:standby 2024-09-19T06:05:07.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:07 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:05:07.781 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:07 smithi169 ceph-mon[34350]: Deploying daemon mds.g on smithi103 2024-09-19T06:05:07.781 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:07 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] up:boot 2024-09-19T06:05:07.781 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:07 smithi169 ceph-mon[34350]: fsmap 9 up:standby 2024-09-19T06:05:07.781 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:07 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:05:08.591 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:08 smithi103 ceph-mon[30925]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:08.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:08 smithi169 ceph-mon[34350]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:08 smithi174 ceph-mon[34488]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:08.988 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:05:08 smithi103 systemd[1]: Starting Ceph mds.g for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:05:09.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:05:09.244 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:05:08 smithi103 podman[72185]: 2024-09-19 06:05:08.889096207 +0000 UTC m=+0.015882230 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:05:09.244 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:05:09 smithi103 podman[72185]: 2024-09-19 06:05:09.027695963 +0000 UTC m=+0.154481979 container create 2b7dba4064d9be9d1093e23f925827e699682f5b17787e31f1c2197e6874ca98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T06:05:09.481 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:09.603 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:05:09 smithi103 podman[72185]: 2024-09-19 06:05:09.256164853 +0000 UTC m=+0.382950882 container init 2b7dba4064d9be9d1093e23f925827e699682f5b17787e31f1c2197e6874ca98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T06:05:09.603 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:05:09 smithi103 podman[72185]: 2024-09-19 06:05:09.26102203 +0000 UTC m=+0.387808044 container start 2b7dba4064d9be9d1093e23f925827e699682f5b17787e31f1c2197e6874ca98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-g, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:05:09.603 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:05:09 smithi103 ceph-mds[72222]: -- 172.21.15.103:0/171858235 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5568493c3860 con 0x5568493a1000 2024-09-19T06:05:09.604 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:05:09 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-g[72200]: starting mds.g at 2024-09-19T06:05:09.604 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:05:09 smithi103 bash[72185]: 2b7dba4064d9be9d1093e23f925827e699682f5b17787e31f1c2197e6874ca98 2024-09-19T06:05:09.604 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:05:09 smithi103 systemd[1]: Started Ceph mds.g for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:05:10.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 -- 172.21.15.103:0/2982630592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0404101de0 msgr2=0x7f04041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 --2- 172.21.15.103:0/2982630592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0404101de0 0x7f04041021c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0400009900 tx=0x7f040002a410 comp rx=0 tx=0).stop 2024-09-19T06:05:10.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 -- 172.21.15.103:0/2982630592 shutdown_connections 2024-09-19T06:05:10.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 --2- 172.21.15.103:0/2982630592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0404106f10 0x7f040410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 --2- 172.21.15.103:0/2982630592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0404102790 0x7f04041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 --2- 172.21.15.103:0/2982630592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0404101de0 0x7f04041021c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 -- 172.21.15.103:0/2982630592 >> 172.21.15.103:0/2982630592 conn(0x7f04040fd8c0 msgr2=0x7f04040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 -- 172.21.15.103:0/2982630592 shutdown_connections 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 -- 172.21.15.103:0/2982630592 wait complete. 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 Processor -- start 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.983+0000 7f040b677640 1 -- start start 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f040b677640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0404101de0 0x7f0404198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f040b677640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0404102790 0x7f0404198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f040b677640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0404106f10 0x7f040419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f040b677640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0404111de0 con 0x7f0404106f10 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f040b677640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0404111c60 con 0x7f0404101de0 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f040b677640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0404111f60 con 0x7f0404102790 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409c14640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0404106f10 0x7f040419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409c14640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0404106f10 0x7f040419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40546/0 (socket says 172.21.15.103:40546) 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409c14640 1 -- 172.21.15.103:0/263803048 learned_addr learned my addr 172.21.15.103:0/263803048 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409413640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0404101de0 0x7f0404198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0408c12640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0404102790 0x7f0404198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409c14640 1 -- 172.21.15.103:0/263803048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0404102790 msgr2=0x7f0404198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409c14640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0404102790 0x7f0404198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409c14640 1 -- 172.21.15.103:0/263803048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0404101de0 msgr2=0x7f0404198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409c14640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0404101de0 0x7f0404198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409c14640 1 -- 172.21.15.103:0/263803048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040419d3e0 con 0x7f0404106f10 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0408c12640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0404102790 0x7f0404198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409413640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0404101de0 0x7f0404198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f0409c14640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0404106f10 0x7f040419cd00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00eaa0 tx=0x7f03fc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.984+0000 7f03fa7fc640 1 -- 172.21.15.103:0/263803048 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc00cdb0 con 0x7f0404106f10 2024-09-19T06:05:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.985+0000 7f03fa7fc640 1 -- 172.21.15.103:0/263803048 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03fc005020 con 0x7f0404106f10 2024-09-19T06:05:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.985+0000 7f03fa7fc640 1 -- 172.21.15.103:0/263803048 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0116d0 con 0x7f0404106f10 2024-09-19T06:05:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.985+0000 7f040b677640 1 -- 172.21.15.103:0/263803048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040419d6d0 con 0x7f0404106f10 2024-09-19T06:05:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.985+0000 7f040b677640 1 -- 172.21.15.103:0/263803048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04041a4fb0 con 0x7f0404106f10 2024-09-19T06:05:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.986+0000 7f040b677640 1 -- 172.21.15.103:0/263803048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04041021c0 con 0x7f0404106f10 2024-09-19T06:05:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.987+0000 7f03fa7fc640 1 -- 172.21.15.103:0/263803048 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f03fc0051d0 con 0x7f0404106f10 2024-09-19T06:05:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.987+0000 7f03fa7fc640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f03f00a3240 0x7f03f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.987+0000 7f0409413640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f03f00a3240 0x7f03f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.988+0000 7f03fa7fc640 1 -- 172.21.15.103:0/263803048 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f03fc0cfa50 con 0x7f0404106f10 2024-09-19T06:05:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.988+0000 7f0409413640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f03f00a3240 0x7f03f00a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0400031440 tx=0x7f0400005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:09.990+0000 7f03fa7fc640 1 -- 172.21.15.103:0/263803048 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03fc016030 con 0x7f0404106f10 2024-09-19T06:05:10.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.203+0000 7f040b677640 1 -- 172.21.15.103:0/263803048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0404199790 con 0x7f0404106f10 2024-09-19T06:05:10.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.204+0000 7f03fa7fc640 1 -- 172.21.15.103:0/263803048 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8887 (secure 0 0 0) 0x7f03fc09cc10 con 0x7f0404106f10 2024-09-19T06:05:10.205 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:10.205 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-19T06:05:09:524967+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:05:10.206 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 -- 172.21.15.103:0/263803048 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f03f00a3240 msgr2=0x7f03f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f03f00a3240 0x7f03f00a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0400031440 tx=0x7f0400005a20 comp rx=0 tx=0).stop 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 -- 172.21.15.103:0/263803048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0404106f10 msgr2=0x7f040419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0404106f10 0x7f040419cd00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00eaa0 tx=0x7f03fc00ef60 comp rx=0 tx=0).stop 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 -- 172.21.15.103:0/263803048 shutdown_connections 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f03f00a3240 0x7f03f00a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0404106f10 0x7f040419cd00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0404102790 0x7f0404198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 --2- 172.21.15.103:0/263803048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0404101de0 0x7f0404198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 -- 172.21.15.103:0/263803048 >> 172.21.15.103:0/263803048 conn(0x7f04040fd8c0 msgr2=0x7f04040fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 -- 172.21.15.103:0/263803048 shutdown_connections 2024-09-19T06:05:10.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:10.206+0000 7f040b677640 1 -- 172.21.15.103:0/263803048 wait complete. 2024-09-19T06:05:10.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:10.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:10.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:10.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:10.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:10.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:10.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: Deploying daemon mds.a on smithi103 2024-09-19T06:05:10.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:10.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.103:6838/208937195,v1:172.21.15.103:6839/208937195] up:boot 2024-09-19T06:05:10.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: fsmap 10 up:standby 2024-09-19T06:05:10.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:05:10.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:10 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/263803048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:10.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:10.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:10.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:10.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:10.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:10.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:10.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: Deploying daemon mds.a on smithi103 2024-09-19T06:05:10.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:10.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.103:6838/208937195,v1:172.21.15.103:6839/208937195] up:boot 2024-09-19T06:05:10.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: fsmap 10 up:standby 2024-09-19T06:05:10.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:05:10.705 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:10 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/263803048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:10.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: Deploying daemon mds.a on smithi103 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.103:6838/208937195,v1:172.21.15.103:6839/208937195] up:boot 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: fsmap 10 up:standby 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:05:10.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:10 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/263803048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:12.627 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:12 smithi103 ceph-mon[30925]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:12.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:12 smithi169 ceph-mon[34350]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:12.938 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:05:12.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:12 smithi174 ceph-mon[34488]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:13.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.680+0000 7fb962694640 1 -- 172.21.15.103:0/1337454614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb95c10c180 msgr2=0x7fb95c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:13.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.680+0000 7fb962694640 1 --2- 172.21.15.103:0/1337454614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb95c10c180 0x7fb95c10e600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb954009ca0 tx=0x7fb95402a950 comp rx=0 tx=0).stop 2024-09-19T06:05:13.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.680+0000 7fb962694640 1 -- 172.21.15.103:0/1337454614 shutdown_connections 2024-09-19T06:05:13.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.680+0000 7fb962694640 1 --2- 172.21.15.103:0/1337454614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb95c10c180 0x7fb95c10e600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:13.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.680+0000 7fb962694640 1 --2- 172.21.15.103:0/1337454614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb95c1036c0 0x7fb95c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:13.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.680+0000 7fb962694640 1 --2- 172.21.15.103:0/1337454614 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb95c102da0 0x7fb95c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:13.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.680+0000 7fb962694640 1 -- 172.21.15.103:0/1337454614 >> 172.21.15.103:0/1337454614 conn(0x7fb95c0fc7a0 msgr2=0x7fb95c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:13.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.680+0000 7fb962694640 1 -- 172.21.15.103:0/1337454614 shutdown_connections 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.680+0000 7fb962694640 1 -- 172.21.15.103:0/1337454614 wait complete. 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb962694640 1 Processor -- start 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb962694640 1 -- start start 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb962694640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb95c102da0 0x7fb95c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb962694640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb95c1036c0 0x7fb95c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb962694640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb95c10c180 0x7fb95c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb962694640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c111e50 con 0x7fb95c102da0 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb962694640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c111cd0 con 0x7fb95c1036c0 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb962694640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c111fd0 con 0x7fb95c10c180 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb95bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb95c102da0 0x7fb95c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb95bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb95c102da0 0x7fb95c198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42374/0 (socket says 172.21.15.103:42374) 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.681+0000 7fb95bfff640 1 -- 172.21.15.103:0/2049191795 learned_addr learned my addr 172.21.15.103:0/2049191795 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb960c31640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb95c10c180 0x7fb95c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb953fff640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb95c1036c0 0x7fb95c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb95bfff640 1 -- 172.21.15.103:0/2049191795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb95c10c180 msgr2=0x7fb95c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb95bfff640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb95c10c180 0x7fb95c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb95bfff640 1 -- 172.21.15.103:0/2049191795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb95c1036c0 msgr2=0x7fb95c1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb95bfff640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb95c1036c0 0x7fb95c1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb95bfff640 1 -- 172.21.15.103:0/2049191795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c19d320 con 0x7fb95c102da0 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb95bfff640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb95c102da0 0x7fb95c198370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00d950 tx=0x7fb94c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb959ffb640 1 -- 172.21.15.103:0/2049191795 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c017070 con 0x7fb95c102da0 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb962694640 1 -- 172.21.15.103:0/2049191795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95c19d610 con 0x7fb95c102da0 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb959ffb640 1 -- 172.21.15.103:0/2049191795 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb94c009c30 con 0x7fb95c102da0 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb959ffb640 1 -- 172.21.15.103:0/2049191795 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00f620 con 0x7fb95c102da0 2024-09-19T06:05:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.682+0000 7fb962694640 1 -- 172.21.15.103:0/2049191795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95c1a4ef0 con 0x7fb95c102da0 2024-09-19T06:05:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.683+0000 7fb962694640 1 -- 172.21.15.103:0/2049191795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb95c103180 con 0x7fb95c102da0 2024-09-19T06:05:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.684+0000 7fb959ffb640 1 -- 172.21.15.103:0/2049191795 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb94c0109a0 con 0x7fb95c102da0 2024-09-19T06:05:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.685+0000 7fb959ffb640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9480a32c0 0x7fb9480a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:13.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.685+0000 7fb953fff640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9480a32c0 0x7fb9480a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:13.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.685+0000 7fb959ffb640 1 -- 172.21.15.103:0/2049191795 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb94c0cf0f0 con 0x7fb95c102da0 2024-09-19T06:05:13.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.685+0000 7fb953fff640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9480a32c0 0x7fb9480a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0fee30 tx=0x7fb944008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:13.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.688+0000 7fb959ffb640 1 -- 172.21.15.103:0/2049191795 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb94c009de0 con 0x7fb95c102da0 2024-09-19T06:05:13.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.888+0000 7fb962694640 1 -- 172.21.15.103:0/2049191795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb95c107200 con 0x7fb95c102da0 2024-09-19T06:05:13.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.889+0000 7fb959ffb640 1 -- 172.21.15.103:0/2049191795 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9716 (secure 0 0 0) 0x7fb94c09c330 con 0x7fb95c102da0 2024-09-19T06:05:13.890 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:13.890 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":12,"btime":"2024-09-19T06:05:13:499970+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:05:13.890 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 12 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 -- 172.21.15.103:0/2049191795 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9480a32c0 msgr2=0x7fb9480a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9480a32c0 0x7fb9480a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0fee30 tx=0x7fb944008040 comp rx=0 tx=0).stop 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 -- 172.21.15.103:0/2049191795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb95c102da0 msgr2=0x7fb95c198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb95c102da0 0x7fb95c198370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00d950 tx=0x7fb94c00de10 comp rx=0 tx=0).stop 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 -- 172.21.15.103:0/2049191795 shutdown_connections 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9480a32c0 0x7fb9480a5780 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb95c10c180 0x7fb95c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb95c1036c0 0x7fb95c1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 --2- 172.21.15.103:0/2049191795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb95c102da0 0x7fb95c198370 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 -- 172.21.15.103:0/2049191795 >> 172.21.15.103:0/2049191795 conn(0x7fb95c0fc7a0 msgr2=0x7fb95c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 -- 172.21.15.103:0/2049191795 shutdown_connections 2024-09-19T06:05:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:13.891+0000 7fb962694640 1 -- 172.21.15.103:0/2049191795 wait complete. 2024-09-19T06:05:14.195 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: Deploying daemon mds.b on smithi169 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.103:6840/3658112833,v1:172.21.15.103:6841/3658112833] up:boot 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: fsmap 11 up:standby 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:05:14.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:13 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2049191795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:14.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:14.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:14.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:14.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:14.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:14.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:14.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: Deploying daemon mds.b on smithi169 2024-09-19T06:05:14.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:14.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.103:6840/3658112833,v1:172.21.15.103:6841/3658112833] up:boot 2024-09-19T06:05:14.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: fsmap 11 up:standby 2024-09-19T06:05:14.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:05:14.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:13 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2049191795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:14.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: Deploying daemon mds.b on smithi169 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.103:6840/3658112833,v1:172.21.15.103:6841/3658112833] up:boot 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: fsmap 11 up:standby 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:05:14.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:13 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2049191795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:15.028 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:14 smithi169 systemd[1]: Starting Ceph mds.b for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:05:15.303 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:15 smithi169 podman[64349]: 2024-09-19 06:05:15.031450903 +0000 UTC m=+0.100900846 container create 80292f349ebffe22384eb50b16be26043114df98ac612ac5780df3c86ed30909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:05:15.303 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:15 smithi169 podman[64349]: 2024-09-19 06:05:14.94638268 +0000 UTC m=+0.015832599 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:05:15.303 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:15 smithi169 podman[64349]: 2024-09-19 06:05:15.275650868 +0000 UTC m=+0.345100778 container init 80292f349ebffe22384eb50b16be26043114df98ac612ac5780df3c86ed30909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T06:05:15.304 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:15 smithi169 podman[64349]: 2024-09-19 06:05:15.278846754 +0000 UTC m=+0.348296664 container start 80292f349ebffe22384eb50b16be26043114df98ac612ac5780df3c86ed30909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T06:05:15.777 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:15 smithi169 ceph-mds[64369]: -- 172.21.15.169:0/1990467414 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5636edfe3860 con 0x5636edfc1400 2024-09-19T06:05:15.778 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b[64365]: starting mds.b at 2024-09-19T06:05:15.778 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:15 smithi169 bash[64349]: 80292f349ebffe22384eb50b16be26043114df98ac612ac5780df3c86ed30909 2024-09-19T06:05:15.778 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:15 smithi169 systemd[1]: Started Ceph mds.b for f3f6d2a8-764b-11ef-bceb-c7b262605968. 2024-09-19T06:05:16.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:16 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] up:boot 2024-09-19T06:05:16.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:16 smithi174 ceph-mon[34488]: fsmap 12 up:standby 2024-09-19T06:05:16.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:05:16.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:16 smithi174 ceph-mon[34488]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:16.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.455 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:16 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:16.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:16 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] up:boot 2024-09-19T06:05:16.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:16 smithi103 ceph-mon[30925]: fsmap 12 up:standby 2024-09-19T06:05:16.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:05:16.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:16 smithi103 ceph-mon[30925]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:16.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.495 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:16 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:16.517 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:05:16.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:16 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] up:boot 2024-09-19T06:05:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:16 smithi169 ceph-mon[34350]: fsmap 12 up:standby 2024-09-19T06:05:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:05:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:16 smithi169 ceph-mon[34350]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:16.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:16 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:16.785 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:17.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.272+0000 7fa0073df640 1 -- 172.21.15.103:0/1739167787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa00010c170 msgr2=0x7fa00010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.272+0000 7fa0073df640 1 --2- 172.21.15.103:0/1739167787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa00010c170 0x7fa00010e610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009ca0 tx=0x7f9ff802a950 comp rx=0 tx=0).stop 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.273+0000 7fa0073df640 1 -- 172.21.15.103:0/1739167787 shutdown_connections 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.273+0000 7fa0073df640 1 --2- 172.21.15.103:0/1739167787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa00010c170 0x7fa00010e610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.273+0000 7fa0073df640 1 --2- 172.21.15.103:0/1739167787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa000103660 0x7fa00010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.273+0000 7fa0073df640 1 --2- 172.21.15.103:0/1739167787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa000102d40 0x7fa000103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.273+0000 7fa0073df640 1 -- 172.21.15.103:0/1739167787 >> 172.21.15.103:0/1739167787 conn(0x7fa0000fc7a0 msgr2=0x7fa0000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.273+0000 7fa0073df640 1 -- 172.21.15.103:0/1739167787 shutdown_connections 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.273+0000 7fa0073df640 1 -- 172.21.15.103:0/1739167787 wait complete. 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.273+0000 7fa0073df640 1 Processor -- start 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.273+0000 7fa0073df640 1 -- start start 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa0073df640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa000102d40 0x7fa000198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa0073df640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa000103660 0x7fa0001988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:17.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa0073df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa00010c170 0x7fa00019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa0073df640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa000111e60 con 0x7fa00010c170 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa0073df640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa000111ce0 con 0x7fa000102d40 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa0073df640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa000111fe0 con 0x7fa000103660 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00597c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa00010c170 0x7fa00019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00597c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa00010c170 0x7fa00019cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42386/0 (socket says 172.21.15.103:42386) 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00597c640 1 -- 172.21.15.103:0/611425943 learned_addr learned my addr 172.21.15.103:0/611425943 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00517b640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa000102d40 0x7fa000198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00497a640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa000103660 0x7fa0001988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00597c640 1 -- 172.21.15.103:0/611425943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa000103660 msgr2=0x7fa0001988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00597c640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa000103660 0x7fa0001988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00597c640 1 -- 172.21.15.103:0/611425943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa000102d40 msgr2=0x7fa000198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00597c640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa000102d40 0x7fa000198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00597c640 1 -- 172.21.15.103:0/611425943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00019d330 con 0x7fa00010c170 2024-09-19T06:05:17.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa00597c640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa00010c170 0x7fa00019cc50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9ff802ae70 tx=0x7f9ff802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:17.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7f9ff67fc640 1 -- 172.21.15.103:0/611425943 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8034040 con 0x7fa00010c170 2024-09-19T06:05:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7f9ff67fc640 1 -- 172.21.15.103:0/611425943 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ff80308f0 con 0x7fa00010c170 2024-09-19T06:05:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7fa0073df640 1 -- 172.21.15.103:0/611425943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00019d5c0 con 0x7fa00010c170 2024-09-19T06:05:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.274+0000 7f9ff67fc640 1 -- 172.21.15.103:0/611425943 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8004750 con 0x7fa00010c170 2024-09-19T06:05:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.275+0000 7fa0073df640 1 -- 172.21.15.103:0/611425943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0001a4f00 con 0x7fa00010c170 2024-09-19T06:05:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.275+0000 7fa0073df640 1 -- 172.21.15.103:0/611425943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00006b070 con 0x7fa00010c170 2024-09-19T06:05:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.277+0000 7f9ff67fc640 1 -- 172.21.15.103:0/611425943 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f9ff8037020 con 0x7fa00010c170 2024-09-19T06:05:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.277+0000 7f9ff67fc640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9fec0a3240 0x7f9fec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.277+0000 7fa00517b640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9fec0a3240 0x7f9fec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.277+0000 7f9ff67fc640 1 -- 172.21.15.103:0/611425943 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f9ff80f03e0 con 0x7fa00010c170 2024-09-19T06:05:17.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.278+0000 7fa00517b640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9fec0a3240 0x7f9fec0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009990 tx=0x7f9ffc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:17.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.281+0000 7f9ff67fc640 1 -- 172.21.15.103:0/611425943 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ff80bd5a0 con 0x7fa00010c170 2024-09-19T06:05:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.528+0000 7fa0073df640 1 -- 172.21.15.103:0/611425943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0001071e0 con 0x7fa00010c170 2024-09-19T06:05:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.528+0000 7f9ff67fc640 1 -- 172.21.15.103:0/611425943 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10545 (secure 0 0 0) 0x7f9ff80bcea0 con 0x7fa00010c170 2024-09-19T06:05:17.530 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:17.530 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":13,"btime":"2024-09-19T06:05:15:357636+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T06:05:17.530 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 13 2024-09-19T06:05:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.530+0000 7fa0073df640 1 -- 172.21.15.103:0/611425943 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9fec0a3240 msgr2=0x7f9fec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.530+0000 7fa0073df640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9fec0a3240 0x7f9fec0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009990 tx=0x7f9ffc009110 comp rx=0 tx=0).stop 2024-09-19T06:05:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.530+0000 7fa0073df640 1 -- 172.21.15.103:0/611425943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa00010c170 msgr2=0x7fa00019cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.530+0000 7fa0073df640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa00010c170 0x7fa00019cc50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9ff802ae70 tx=0x7f9ff802f5d0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.530+0000 7fa0073df640 1 -- 172.21.15.103:0/611425943 shutdown_connections 2024-09-19T06:05:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.530+0000 7fa0073df640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9fec0a3240 0x7f9fec0a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.531+0000 7fa0073df640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa00010c170 0x7fa00019cc50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.531+0000 7fa0073df640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa000103660 0x7fa0001988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.531+0000 7fa0073df640 1 --2- 172.21.15.103:0/611425943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa000102d40 0x7fa000198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.531+0000 7fa0073df640 1 -- 172.21.15.103:0/611425943 >> 172.21.15.103:0/611425943 conn(0x7fa0000fc7a0 msgr2=0x7fa0000fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.531+0000 7fa0073df640 1 -- 172.21.15.103:0/611425943 shutdown_connections 2024-09-19T06:05:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:17.531+0000 7fa0073df640 1 -- 172.21.15.103:0/611425943 wait complete. 2024-09-19T06:05:18.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:17 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:17 smithi174 ceph-mon[34488]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:18.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:17 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/611425943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:18.218 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:17 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.218 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:17 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.218 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:17 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.218 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:17 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.218 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:17 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.218 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:17 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.218 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:17 smithi103 ceph-mon[30925]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:18.218 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:17 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/611425943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:18.251 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T06:05:18.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:17 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:17 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:17 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:17 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:17 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:17 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:18.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:17 smithi169 ceph-mon[34350]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:18.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:17 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/611425943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:19.148 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:19.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:18 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:19.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:18 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:19.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:18 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:19.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:18 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:19.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:18 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:19.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:18 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:19.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:18 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:19.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:18 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:19.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:18 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:19.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:18 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:19.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:18 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:19.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:18 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:19.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.628+0000 7f8e80e5e640 1 -- 172.21.15.103:0/47664246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c101de0 msgr2=0x7f8e7c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.628+0000 7f8e80e5e640 1 --2- 172.21.15.103:0/47664246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c101de0 0x7f8e7c1021c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009ca0 tx=0x7f8e6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.628+0000 7f8e80e5e640 1 -- 172.21.15.103:0/47664246 shutdown_connections 2024-09-19T06:05:19.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.628+0000 7f8e80e5e640 1 --2- 172.21.15.103:0/47664246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e7c106f10 0x7f8e7c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.628+0000 7f8e80e5e640 1 --2- 172.21.15.103:0/47664246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e7c102790 0x7f8e7c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.628+0000 7f8e80e5e640 1 --2- 172.21.15.103:0/47664246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c101de0 0x7f8e7c1021c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.629+0000 7f8e80e5e640 1 -- 172.21.15.103:0/47664246 >> 172.21.15.103:0/47664246 conn(0x7f8e7c0fd8c0 msgr2=0x7f8e7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:19.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.629+0000 7f8e80e5e640 1 -- 172.21.15.103:0/47664246 shutdown_connections 2024-09-19T06:05:19.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.629+0000 7f8e80e5e640 1 -- 172.21.15.103:0/47664246 wait complete. 2024-09-19T06:05:19.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.629+0000 7f8e80e5e640 1 Processor -- start 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.629+0000 7f8e80e5e640 1 -- start start 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.629+0000 7f8e80e5e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e7c101de0 0x7f8e7c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.629+0000 7f8e80e5e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e7c102790 0x7f8e7c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e80e5e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c106f10 0x7f8e7c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e80e5e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c111e20 con 0x7f8e7c106f10 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e80e5e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c111ca0 con 0x7f8e7c101de0 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e80e5e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c111fa0 con 0x7f8e7c102790 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e7ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c106f10 0x7f8e7c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e7ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c106f10 0x7f8e7c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42402/0 (socket says 172.21.15.103:42402) 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e7ad9d640 1 -- 172.21.15.103:0/3054540790 learned_addr learned my addr 172.21.15.103:0/3054540790 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e79d9b640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e7c102790 0x7f8e7c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e7a59c640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e7c101de0 0x7f8e7c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e7ad9d640 1 -- 172.21.15.103:0/3054540790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e7c102790 msgr2=0x7f8e7c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e7ad9d640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e7c102790 0x7f8e7c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e7ad9d640 1 -- 172.21.15.103:0/3054540790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e7c101de0 msgr2=0x7f8e7c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e7ad9d640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e7c101de0 0x7f8e7c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e7ad9d640 1 -- 172.21.15.103:0/3054540790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7c1a6820 con 0x7f8e7c106f10 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e7ad9d640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c106f10 0x7f8e7c074f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400d750 tx=0x7f8e7400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e6b7fe640 1 -- 172.21.15.103:0/3054540790 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74017070 con 0x7f8e7c106f10 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e80e5e640 1 -- 172.21.15.103:0/3054540790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7c1a6b10 con 0x7f8e7c106f10 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e6b7fe640 1 -- 172.21.15.103:0/3054540790 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e740054d0 con 0x7f8e7c106f10 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e6b7fe640 1 -- 172.21.15.103:0/3054540790 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74004c60 con 0x7f8e7c106f10 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.630+0000 7f8e80e5e640 1 -- 172.21.15.103:0/3054540790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7c1a70a0 con 0x7f8e7c106f10 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.631+0000 7f8e80e5e640 1 -- 172.21.15.103:0/3054540790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e7c1021c0 con 0x7f8e7c106f10 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.633+0000 7f8e6b7fe640 1 -- 172.21.15.103:0/3054540790 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f8e74004e00 con 0x7f8e7c106f10 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.633+0000 7f8e6b7fe640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8e640a3240 0x7f8e640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.634+0000 7f8e7a59c640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8e640a3240 0x7f8e640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.634+0000 7f8e6b7fe640 1 -- 172.21.15.103:0/3054540790 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f8e740cedb0 con 0x7f8e7c106f10 2024-09-19T06:05:19.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.634+0000 7f8e7a59c640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8e640a3240 0x7f8e640a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c000f80 tx=0x7f8e6c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:19.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.638+0000 7f8e6b7fe640 1 -- 172.21.15.103:0/3054540790 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e7409bf70 con 0x7f8e7c106f10 2024-09-19T06:05:19.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.814+0000 7f8e80e5e640 1 -- 172.21.15.103:0/3054540790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8e7c02d7c0 con 0x7f8e7c106f10 2024-09-19T06:05:19.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.815+0000 7f8e6b7fe640 1 -- 172.21.15.103:0/3054540790 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f8e7409b870 con 0x7f8e7c106f10 2024-09-19T06:05:19.817 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:19.817 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-19T06:05:19.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:05:19.817 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-19T06:05:19.817 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-19T06:05:19.817 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:05:19.817 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-19T06:05:19.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.817+0000 7f8e80e5e640 1 -- 172.21.15.103:0/3054540790 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8e640a3240 msgr2=0x7f8e640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.817+0000 7f8e80e5e640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8e640a3240 0x7f8e640a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c000f80 tx=0x7f8e6c005ef0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.817+0000 7f8e80e5e640 1 -- 172.21.15.103:0/3054540790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c106f10 msgr2=0x7f8e7c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.817+0000 7f8e80e5e640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c106f10 0x7f8e7c074f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400d750 tx=0x7f8e7400dc10 comp rx=0 tx=0).stop 2024-09-19T06:05:19.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.817+0000 7f8e80e5e640 1 -- 172.21.15.103:0/3054540790 shutdown_connections 2024-09-19T06:05:19.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.817+0000 7f8e80e5e640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f8e640a3240 0x7f8e640a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.817+0000 7f8e80e5e640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c106f10 0x7f8e7c074f70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.817+0000 7f8e80e5e640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e7c102790 0x7f8e7c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.817+0000 7f8e80e5e640 1 --2- 172.21.15.103:0/3054540790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e7c101de0 0x7f8e7c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.817+0000 7f8e80e5e640 1 -- 172.21.15.103:0/3054540790 >> 172.21.15.103:0/3054540790 conn(0x7f8e7c0fd8c0 msgr2=0x7f8e7c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.818+0000 7f8e80e5e640 1 -- 172.21.15.103:0/3054540790 shutdown_connections 2024-09-19T06:05:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:19.818+0000 7f8e80e5e640 1 -- 172.21.15.103:0/3054540790 wait complete. 2024-09-19T06:05:20.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:20 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:20 smithi103 ceph-mon[30925]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:20.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:20 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3054540790' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:05:20.497 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T06:05:20.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T06:05:20.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:20 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:20 smithi174 ceph-mon[34488]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:20.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:20 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3054540790' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:05:20.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:20 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:20 smithi169 ceph-mon[34350]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:20.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:20 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3054540790' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:05:20.778 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:21.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.205+0000 7fc3783da640 1 -- 172.21.15.103:0/1667824983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc370106a80 msgr2=0x7fc370106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.205+0000 7fc3783da640 1 --2- 172.21.15.103:0/1667824983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc370106a80 0x7fc370106e60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009930 tx=0x7fc36c02a420 comp rx=0 tx=0).stop 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.205+0000 7fc3783da640 1 -- 172.21.15.103:0/1667824983 shutdown_connections 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.205+0000 7fc3783da640 1 --2- 172.21.15.103:0/1667824983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc370101420 0x7fc37010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.205+0000 7fc3783da640 1 --2- 172.21.15.103:0/1667824983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc370100a80 0x7fc370100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.205+0000 7fc3783da640 1 --2- 172.21.15.103:0/1667824983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc370106a80 0x7fc370106e60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.205+0000 7fc3783da640 1 -- 172.21.15.103:0/1667824983 >> 172.21.15.103:0/1667824983 conn(0x7fc3700fc7a0 msgr2=0x7fc3700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.205+0000 7fc3783da640 1 -- 172.21.15.103:0/1667824983 shutdown_connections 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.205+0000 7fc3783da640 1 -- 172.21.15.103:0/1667824983 wait complete. 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc3783da640 1 Processor -- start 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc3783da640 1 -- start start 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc3783da640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc370100a80 0x7fc3701983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc3783da640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc370101420 0x7fc3701988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:21.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc3783da640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc370106a80 0x7fc37019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc3783da640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc370110cf0 con 0x7fc370106a80 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc3783da640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc370110b70 con 0x7fc370101420 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc3783da640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc370110e70 con 0x7fc370100a80 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc376977640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc370106a80 0x7fc37019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc376176640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc370100a80 0x7fc3701983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc376977640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc370106a80 0x7fc37019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47412/0 (socket says 172.21.15.103:47412) 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc376977640 1 -- 172.21.15.103:0/2385873412 learned_addr learned my addr 172.21.15.103:0/2385873412 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.206+0000 7fc375975640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc370101420 0x7fc3701988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc376977640 1 -- 172.21.15.103:0/2385873412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc370100a80 msgr2=0x7fc3701983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc376977640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc370100a80 0x7fc3701983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc376977640 1 -- 172.21.15.103:0/2385873412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc370101420 msgr2=0x7fc3701988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc376977640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc370101420 0x7fc3701988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc376977640 1 -- 172.21.15.103:0/2385873412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37019d350 con 0x7fc370106a80 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc376977640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc370106a80 0x7fc37019cc70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc368009fd0 tx=0x7fc36800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc3677fe640 1 -- 172.21.15.103:0/2385873412 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368017070 con 0x7fc370106a80 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc3677fe640 1 -- 172.21.15.103:0/2385873412 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc368003e20 con 0x7fc370106a80 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc3677fe640 1 -- 172.21.15.103:0/2385873412 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368010460 con 0x7fc370106a80 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc3783da640 1 -- 172.21.15.103:0/2385873412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37019d640 con 0x7fc370106a80 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.207+0000 7fc3783da640 1 -- 172.21.15.103:0/2385873412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3701a4f20 con 0x7fc370106a80 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.208+0000 7fc3783da640 1 -- 172.21.15.103:0/2385873412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc370100ee0 con 0x7fc370106a80 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.209+0000 7fc3677fe640 1 -- 172.21.15.103:0/2385873412 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fc368003970 con 0x7fc370106a80 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.210+0000 7fc3677fe640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc35c0a32c0 0x7fc35c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.210+0000 7fc3677fe640 1 -- 172.21.15.103:0/2385873412 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fc3680cf100 con 0x7fc370106a80 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.210+0000 7fc376176640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc35c0a32c0 0x7fc35c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.210+0000 7fc376176640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc35c0a32c0 0x7fc35c0a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009900 tx=0x7fc36c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.213+0000 7fc3677fe640 1 -- 172.21.15.103:0/2385873412 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc36809bcf0 con 0x7fc370106a80 2024-09-19T06:05:21.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.382+0000 7fc3783da640 1 -- 172.21.15.103:0/2385873412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc370199700 con 0x7fc370106a80 2024-09-19T06:05:21.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.668+0000 7fc3677fe640 1 -- 172.21.15.103:0/2385873412 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fc370199700 con 0x7fc370106a80 2024-09-19T06:05:21.670 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-09-19T06:05:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 -- 172.21.15.103:0/2385873412 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc35c0a32c0 msgr2=0x7fc35c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc35c0a32c0 0x7fc35c0a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009900 tx=0x7fc36c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 -- 172.21.15.103:0/2385873412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc370106a80 msgr2=0x7fc37019cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc370106a80 0x7fc37019cc70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc368009fd0 tx=0x7fc36800b260 comp rx=0 tx=0).stop 2024-09-19T06:05:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 -- 172.21.15.103:0/2385873412 shutdown_connections 2024-09-19T06:05:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc35c0a32c0 0x7fc35c0a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc370106a80 0x7fc37019cc70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc370101420 0x7fc3701988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 --2- 172.21.15.103:0/2385873412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc370100a80 0x7fc3701983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 -- 172.21.15.103:0/2385873412 >> 172.21.15.103:0/2385873412 conn(0x7fc3700fc7a0 msgr2=0x7fc37006aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 -- 172.21.15.103:0/2385873412 shutdown_connections 2024-09-19T06:05:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:21.670+0000 7fc3783da640 1 -- 172.21.15.103:0/2385873412 wait complete. 2024-09-19T06:05:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:21.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:21.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:21.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:21.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:21.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:21.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:21.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:21.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:05:22.451 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T06:05:22.703 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:22 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2385873412' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:05:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:22 smithi103 ceph-mon[30925]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:22 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2385873412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:05:22.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:22 smithi103 ceph-mon[30925]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T06:05:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:22 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2385873412' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:05:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:22 smithi174 ceph-mon[34488]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:22 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2385873412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:05:22.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:22 smithi174 ceph-mon[34488]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T06:05:23.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:22 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2385873412' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:05:23.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:22 smithi169 ceph-mon[34350]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:23.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:22 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2385873412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:05:23.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:22 smithi169 ceph-mon[34350]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T06:05:23.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.185+0000 7fb7a5494640 1 -- 172.21.15.103:0/414130237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7a0102ef0 msgr2=0x7fb7a010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.185+0000 7fb7a5494640 1 --2- 172.21.15.103:0/414130237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7a0102ef0 0x7fb7a010da40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb798009900 tx=0x7fb79802a480 comp rx=0 tx=0).stop 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.185+0000 7fb7a5494640 1 -- 172.21.15.103:0/414130237 shutdown_connections 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.185+0000 7fb7a5494640 1 --2- 172.21.15.103:0/414130237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7a0102ef0 0x7fb7a010da40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.185+0000 7fb7a5494640 1 --2- 172.21.15.103:0/414130237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a0102570 0x7fb7a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.185+0000 7fb7a5494640 1 --2- 172.21.15.103:0/414130237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a0100e20 0x7fb7a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.185+0000 7fb7a5494640 1 -- 172.21.15.103:0/414130237 >> 172.21.15.103:0/414130237 conn(0x7fb7a00fc7d0 msgr2=0x7fb7a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.185+0000 7fb7a5494640 1 -- 172.21.15.103:0/414130237 shutdown_connections 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.185+0000 7fb7a5494640 1 -- 172.21.15.103:0/414130237 wait complete. 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.186+0000 7fb7a5494640 1 Processor -- start 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.186+0000 7fb7a5494640 1 -- start start 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.186+0000 7fb7a5494640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7a0100e20 0x7fb7a0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.186+0000 7fb7a5494640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a0102570 0x7fb7a0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.186+0000 7fb7a5494640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a0102ef0 0x7fb7a019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.186+0000 7fb7a5494640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0111f70 con 0x7fb7a0100e20 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.186+0000 7fb7a5494640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0111df0 con 0x7fb7a0102ef0 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.186+0000 7fb7a5494640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a01120f0 con 0x7fb7a0102570 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7a0100e20 0x7fb7a0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7a0100e20 0x7fb7a0198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47436/0 (socket says 172.21.15.103:47436) 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79effd640 1 -- 172.21.15.103:0/3013961411 learned_addr learned my addr 172.21.15.103:0/3013961411 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79e7fc640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a0102570 0x7fb7a0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79effd640 1 -- 172.21.15.103:0/3013961411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a0102570 msgr2=0x7fb7a0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79effd640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a0102570 0x7fb7a0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79effd640 1 -- 172.21.15.103:0/3013961411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a0102ef0 msgr2=0x7fb7a019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79f7fe640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a0102ef0 0x7fb7a019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79effd640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a0102ef0 0x7fb7a019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79effd640 1 -- 172.21.15.103:0/3013961411 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a019d3e0 con 0x7fb7a0100e20 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79f7fe640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a0102ef0 0x7fb7a019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb79effd640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7a0100e20 0x7fb7a0198430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb79000ea80 tx=0x7fb79000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb787fff640 1 -- 172.21.15.103:0/3013961411 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79000ce40 con 0x7fb7a0100e20 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb7a5494640 1 -- 172.21.15.103:0/3013961411 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a019d6d0 con 0x7fb7a0100e20 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb787fff640 1 -- 172.21.15.103:0/3013961411 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb790005020 con 0x7fb7a0100e20 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb787fff640 1 -- 172.21.15.103:0/3013961411 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7900116d0 con 0x7fb7a0100e20 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.187+0000 7fb7a5494640 1 -- 172.21.15.103:0/3013961411 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a01a4fb0 con 0x7fb7a0100e20 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.188+0000 7fb7a5494640 1 -- 172.21.15.103:0/3013961411 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a0101200 con 0x7fb7a0100e20 2024-09-19T06:05:23.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.190+0000 7fb787fff640 1 -- 172.21.15.103:0/3013961411 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb7900051d0 con 0x7fb7a0100e20 2024-09-19T06:05:23.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.190+0000 7fb787fff640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb7880a3240 0x7fb7880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.190+0000 7fb79e7fc640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb7880a3240 0x7fb7880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.190+0000 7fb787fff640 1 -- 172.21.15.103:0/3013961411 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7497+0+0 (secure 0 0 0) 0x7fb7900cfd20 con 0x7fb7a0100e20 2024-09-19T06:05:23.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.191+0000 7fb79e7fc640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb7880a3240 0x7fb7880a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00ffdc0 tx=0x7fb794008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:23.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.194+0000 7fb787fff640 1 -- 172.21.15.103:0/3013961411 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb790016030 con 0x7fb7a0100e20 2024-09-19T06:05:23.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.363+0000 7fb7a5494640 1 -- 172.21.15.103:0/3013961411 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb7a0109090 con 0x7fb7a0100e20 2024-09-19T06:05:23.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.675+0000 7fb787fff640 1 -- 172.21.15.103:0/3013961411 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7fb79009cd70 con 0x7fb7a0100e20 2024-09-19T06:05:23.676 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 -- 172.21.15.103:0/3013961411 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb7880a3240 msgr2=0x7fb7880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb7880a3240 0x7fb7880a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00ffdc0 tx=0x7fb794008040 comp rx=0 tx=0).stop 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 -- 172.21.15.103:0/3013961411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7a0100e20 msgr2=0x7fb7a0198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7a0100e20 0x7fb7a0198430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb79000ea80 tx=0x7fb79000ef40 comp rx=0 tx=0).stop 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 -- 172.21.15.103:0/3013961411 shutdown_connections 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb7880a3240 0x7fb7880a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a0102ef0 0x7fb7a019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7a0102570 0x7fb7a0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 --2- 172.21.15.103:0/3013961411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7a0100e20 0x7fb7a0198430 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 -- 172.21.15.103:0/3013961411 >> 172.21.15.103:0/3013961411 conn(0x7fb7a00fc7d0 msgr2=0x7fb7a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 -- 172.21.15.103:0/3013961411 shutdown_connections 2024-09-19T06:05:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:23.677+0000 7fb7a5494640 1 -- 172.21.15.103:0/3013961411 wait complete. 2024-09-19T06:05:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:23 smithi174 ceph-mon[34488]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:05:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:23 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3013961411' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:05:23.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:23 smithi103 ceph-mon[30925]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:05:23.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:23 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3013961411' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:05:24.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:23 smithi169 ceph-mon[34350]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:05:24.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:23 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3013961411' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:05:24.346 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T06:05:24.592 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:24.689 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:24 smithi103 ceph-mon[30925]: pgmap v264: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:24.689 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:24 smithi103 ceph-mon[30925]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:05:24.689 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:24 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3013961411' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:05:24.689 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:24 smithi103 ceph-mon[30925]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:05:24.947 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:24 smithi169 ceph-mon[34350]: pgmap v264: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:24.947 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:24 smithi169 ceph-mon[34350]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:05:24.947 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:24 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3013961411' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:05:24.947 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:24 smithi169 ceph-mon[34350]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:05:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:24 smithi174 ceph-mon[34488]: pgmap v264: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:24 smithi174 ceph-mon[34488]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:05:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:24 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3013961411' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:05:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:24 smithi174 ceph-mon[34488]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:05:25.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.030+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/1299326555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4106f50 msgr2=0x7f7fd410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.030+0000 7f7fdc3cd640 1 --2- 172.21.15.103:0/1299326555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4106f50 0x7f7fd410eaf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009cd0 tx=0x7f7fcc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.031+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/1299326555 shutdown_connections 2024-09-19T06:05:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.031+0000 7f7fdc3cd640 1 --2- 172.21.15.103:0/1299326555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4106f50 0x7f7fd410eaf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.031+0000 7f7fdc3cd640 1 --2- 172.21.15.103:0/1299326555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4100ca0 0x7f7fd4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.031+0000 7f7fdc3cd640 1 --2- 172.21.15.103:0/1299326555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fd41002f0 0x7f7fd41006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.031+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/1299326555 >> 172.21.15.103:0/1299326555 conn(0x7f7fd4077210 msgr2=0x7f7fd40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.031+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/1299326555 shutdown_connections 2024-09-19T06:05:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.031+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/1299326555 wait complete. 2024-09-19T06:05:25.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.031+0000 7f7fdc3cd640 1 Processor -- start 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fdc3cd640 1 -- start start 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fdc3cd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd41002f0 0x7f7fd419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fdc3cd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fd4100ca0 0x7f7fd419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fdc3cd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4106f50 0x7f7fd410dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fdc3cd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4111e50 con 0x7f7fd41002f0 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fdc3cd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4111cd0 con 0x7f7fd4106f50 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fdc3cd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4111fd0 con 0x7f7fd4100ca0 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fda169640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd41002f0 0x7f7fd419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fda169640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd41002f0 0x7f7fd419f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47452/0 (socket says 172.21.15.103:47452) 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fda169640 1 -- 172.21.15.103:0/916738573 learned_addr learned my addr 172.21.15.103:0/916738573 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fda96a640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4106f50 0x7f7fd410dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fd9968640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fd4100ca0 0x7f7fd419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fda169640 1 -- 172.21.15.103:0/916738573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fd4100ca0 msgr2=0x7f7fd419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fda169640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fd4100ca0 0x7f7fd419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fda169640 1 -- 172.21.15.103:0/916738573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4106f50 msgr2=0x7f7fd410dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fda169640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4106f50 0x7f7fd410dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fda169640 1 -- 172.21.15.103:0/916738573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd410e610 con 0x7f7fd41002f0 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fd9968640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fd4100ca0 0x7f7fd419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fda169640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd41002f0 0x7f7fd419f0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000c970 tx=0x7f7fd000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.032+0000 7f7fcb7fe640 1 -- 172.21.15.103:0/916738573 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0007bb0 con 0x7f7fd41002f0 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.033+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/916738573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd410e900 con 0x7f7fd41002f0 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.033+0000 7f7fcb7fe640 1 -- 172.21.15.103:0/916738573 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fd0007d50 con 0x7f7fd41002f0 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.033+0000 7f7fcb7fe640 1 -- 172.21.15.103:0/916738573 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000f450 con 0x7f7fd41002f0 2024-09-19T06:05:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.033+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/916738573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd419ac50 con 0x7f7fd41002f0 2024-09-19T06:05:25.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.034+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/916738573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd41033b0 con 0x7f7fd41002f0 2024-09-19T06:05:25.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.036+0000 7f7fcb7fe640 1 -- 172.21.15.103:0/916738573 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f7fd0004f00 con 0x7f7fd41002f0 2024-09-19T06:05:25.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.036+0000 7f7fcb7fe640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7fc00a3240 0x7f7fc00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.036+0000 7f7fd9968640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7fc00a3240 0x7f7fc00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.036+0000 7f7fcb7fe640 1 -- 172.21.15.103:0/916738573 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7f7fd00cf8b0 con 0x7f7fd41002f0 2024-09-19T06:05:25.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.037+0000 7f7fd9968640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7fc00a3240 0x7f7fc00a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4005e00 tx=0x7f7fc4005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:25.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.040+0000 7f7fcb7fe640 1 -- 172.21.15.103:0/916738573 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7fd0014030 con 0x7f7fd41002f0 2024-09-19T06:05:25.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.241+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/916738573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7fd41006d0 con 0x7f7fd41002f0 2024-09-19T06:05:25.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.691+0000 7f7fcb7fe640 1 -- 172.21.15.103:0/916738573 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f7fd41006d0 con 0x7f7fd41002f0 2024-09-19T06:05:25.693 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T06:05:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/916738573 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7fc00a3240 msgr2=0x7f7fc00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7fc00a3240 0x7f7fc00a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4005e00 tx=0x7f7fc4005c70 comp rx=0 tx=0).stop 2024-09-19T06:05:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/916738573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd41002f0 msgr2=0x7f7fd419f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd41002f0 0x7f7fd419f0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000c970 tx=0x7f7fd000ce30 comp rx=0 tx=0).stop 2024-09-19T06:05:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/916738573 shutdown_connections 2024-09-19T06:05:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7fc00a3240 0x7f7fc00a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4106f50 0x7f7fd410dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fd4100ca0 0x7f7fd419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 --2- 172.21.15.103:0/916738573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd41002f0 0x7f7fd419f0a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/916738573 >> 172.21.15.103:0/916738573 conn(0x7f7fd4077210 msgr2=0x7f7fd4104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:25.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/916738573 shutdown_connections 2024-09-19T06:05:25.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:25.694+0000 7f7fdc3cd640 1 -- 172.21.15.103:0/916738573 wait complete. 2024-09-19T06:05:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:25 smithi174 ceph-mon[34488]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:05:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:25 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/916738573' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:05:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:25 smithi174 ceph-mon[34488]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:05:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:25 smithi174 ceph-mon[34488]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:05:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:25 smithi174 ceph-mon[34488]: pgmap v268: 97 pgs: 20 creating+peering, 14 active+clean, 63 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:25.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:25 smithi103 ceph-mon[30925]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:05:25.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:25 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/916738573' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:05:25.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:25 smithi103 ceph-mon[30925]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:05:25.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:25 smithi103 ceph-mon[30925]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:05:25.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:25 smithi103 ceph-mon[30925]: pgmap v268: 97 pgs: 20 creating+peering, 14 active+clean, 63 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:26.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:25 smithi169 ceph-mon[34350]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:05:26.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:25 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/916738573' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:05:26.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:25 smithi169 ceph-mon[34350]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:05:26.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:25 smithi169 ceph-mon[34350]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:05:26.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:25 smithi169 ceph-mon[34350]: pgmap v268: 97 pgs: 20 creating+peering, 14 active+clean, 63 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:05:26.324 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:05:26.575 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:26 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/916738573' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:05:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:26 smithi174 ceph-mon[34488]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:05:26.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:26 smithi174 ceph-mon[34488]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:05:26.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:26 smithi174 ceph-mon[34488]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T06:05:26.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:26 smithi174 ceph-mon[34488]: Cluster is now healthy 2024-09-19T06:05:26.965 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:26 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/916738573' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:05:26.966 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:26 smithi103 ceph-mon[30925]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:05:26.966 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:26 smithi103 ceph-mon[30925]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:05:26.966 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:26 smithi103 ceph-mon[30925]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T06:05:26.966 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:26 smithi103 ceph-mon[30925]: Cluster is now healthy 2024-09-19T06:05:27.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:26 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/916738573' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:05:27.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:26 smithi169 ceph-mon[34350]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:05:27.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:26 smithi169 ceph-mon[34350]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:05:27.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:26 smithi169 ceph-mon[34350]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T06:05:27.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:26 smithi169 ceph-mon[34350]: Cluster is now healthy 2024-09-19T06:05:27.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.043+0000 7fe874156640 1 -- 172.21.15.103:0/4281743539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe86c074eb0 msgr2=0x7fe86c112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:27.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.043+0000 7fe874156640 1 --2- 172.21.15.103:0/4281743539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe86c074eb0 0x7fe86c112650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009900 tx=0x7fe85c02a480 comp rx=0 tx=0).stop 2024-09-19T06:05:27.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.043+0000 7fe874156640 1 -- 172.21.15.103:0/4281743539 shutdown_connections 2024-09-19T06:05:27.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.043+0000 7fe874156640 1 --2- 172.21.15.103:0/4281743539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe86c112b90 0x7fe86c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.043+0000 7fe874156640 1 --2- 172.21.15.103:0/4281743539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe86c074eb0 0x7fe86c112650 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.043+0000 7fe874156640 1 --2- 172.21.15.103:0/4281743539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c074590 0x7fe86c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.043+0000 7fe874156640 1 -- 172.21.15.103:0/4281743539 >> 172.21.15.103:0/4281743539 conn(0x7fe86c0fd8c0 msgr2=0x7fe86c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:27.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.043+0000 7fe874156640 1 -- 172.21.15.103:0/4281743539 shutdown_connections 2024-09-19T06:05:27.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.043+0000 7fe874156640 1 -- 172.21.15.103:0/4281743539 wait complete. 2024-09-19T06:05:27.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe874156640 1 Processor -- start 2024-09-19T06:05:27.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe874156640 1 -- start start 2024-09-19T06:05:27.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe874156640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe86c074590 0x7fe86c1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe874156640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe86c074eb0 0x7fe86c1a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe874156640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c112b90 0x7fe86c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe874156640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c118470 con 0x7fe86c074590 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe874156640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c1182f0 con 0x7fe86c112b90 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe874156640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c1185f0 con 0x7fe86c074eb0 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe871ef2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe86c074590 0x7fe86c1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe871ef2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe86c074590 0x7fe86c1a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47466/0 (socket says 172.21.15.103:47466) 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe871ef2640 1 -- 172.21.15.103:0/3693661212 learned_addr learned my addr 172.21.15.103:0/3693661212 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe8716f1640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe86c074eb0 0x7fe86c1a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe8726f3640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c112b90 0x7fe86c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe871ef2640 1 -- 172.21.15.103:0/3693661212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe86c074eb0 msgr2=0x7fe86c1a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe871ef2640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe86c074eb0 0x7fe86c1a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe871ef2640 1 -- 172.21.15.103:0/3693661212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c112b90 msgr2=0x7fe86c19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe871ef2640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c112b90 0x7fe86c19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe871ef2640 1 -- 172.21.15.103:0/3693661212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c19ef90 con 0x7fe86c074590 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.044+0000 7fe8726f3640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c112b90 0x7fe86c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.045+0000 7fe871ef2640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe86c074590 0x7fe86c1a46a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe86800b4a0 tx=0x7fe86800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.045+0000 7fe862ffd640 1 -- 172.21.15.103:0/3693661212 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868014070 con 0x7fe86c074590 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.045+0000 7fe862ffd640 1 -- 172.21.15.103:0/3693661212 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe868010ac0 con 0x7fe86c074590 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.045+0000 7fe874156640 1 -- 172.21.15.103:0/3693661212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c19f280 con 0x7fe86c074590 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.045+0000 7fe862ffd640 1 -- 172.21.15.103:0/3693661212 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868017c30 con 0x7fe86c074590 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.045+0000 7fe874156640 1 -- 172.21.15.103:0/3693661212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c1ab570 con 0x7fe86c074590 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.046+0000 7fe874156640 1 -- 172.21.15.103:0/3693661212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c074970 con 0x7fe86c074590 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.047+0000 7fe862ffd640 1 -- 172.21.15.103:0/3693661212 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fe868017070 con 0x7fe86c074590 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.047+0000 7fe862ffd640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8580a3240 0x7fe8580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:27.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.048+0000 7fe8716f1640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8580a3240 0x7fe8580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:27.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.048+0000 7fe862ffd640 1 -- 172.21.15.103:0/3693661212 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fe8680cef10 con 0x7fe86c074590 2024-09-19T06:05:27.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.048+0000 7fe8716f1640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8580a3240 0x7fe8580a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe85c031440 tx=0x7fe85c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:27.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.051+0000 7fe862ffd640 1 -- 172.21.15.103:0/3693661212 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe86809bd80 con 0x7fe86c074590 2024-09-19T06:05:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.220+0000 7fe874156640 1 -- 172.21.15.103:0/3693661212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe86c19fd90 con 0x7fe86c074590 2024-09-19T06:05:27.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.222+0000 7fe862ffd640 1 -- 172.21.15.103:0/3693661212 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22351 (secure 0 0 0) 0x7fe86809b680 con 0x7fe86c074590 2024-09-19T06:05:27.223 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:27.224 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":78,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:05:25.242075+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:05:21.617020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:05:23.597579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:05:27.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 -- 172.21.15.103:0/3693661212 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8580a3240 msgr2=0x7fe8580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:27.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8580a3240 0x7fe8580a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe85c031440 tx=0x7fe85c005b50 comp rx=0 tx=0).stop 2024-09-19T06:05:27.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 -- 172.21.15.103:0/3693661212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe86c074590 msgr2=0x7fe86c1a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:27.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe86c074590 0x7fe86c1a46a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe86800b4a0 tx=0x7fe86800b960 comp rx=0 tx=0).stop 2024-09-19T06:05:27.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 -- 172.21.15.103:0/3693661212 shutdown_connections 2024-09-19T06:05:27.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fe8580a3240 0x7fe8580a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c112b90 0x7fe86c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe86c074eb0 0x7fe86c1a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 --2- 172.21.15.103:0/3693661212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe86c074590 0x7fe86c1a46a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 -- 172.21.15.103:0/3693661212 >> 172.21.15.103:0/3693661212 conn(0x7fe86c0fd8c0 msgr2=0x7fe86c0ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:27.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 -- 172.21.15.103:0/3693661212 shutdown_connections 2024-09-19T06:05:27.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:27.224+0000 7fe874156640 1 -- 172.21.15.103:0/3693661212 wait complete. 2024-09-19T06:05:27.845 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:27 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] up:active 2024-09-19T06:05:27.846 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:27 smithi103 ceph-mon[30925]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:27.846 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:27 smithi103 ceph-mon[30925]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:27.846 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:27 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3693661212' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:27.846 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:27 smithi103 ceph-mon[30925]: pgmap v269: 97 pgs: 20 creating+peering, 53 active+clean, 24 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T06:05:27.873 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:05:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:27 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] up:active 2024-09-19T06:05:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:27 smithi174 ceph-mon[34488]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:27 smithi174 ceph-mon[34488]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:27 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3693661212' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:27 smithi174 ceph-mon[34488]: pgmap v269: 97 pgs: 20 creating+peering, 53 active+clean, 24 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T06:05:28.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:27 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] up:active 2024-09-19T06:05:28.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:27 smithi169 ceph-mon[34350]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:28.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:27 smithi169 ceph-mon[34350]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:28.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:27 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3693661212' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:28.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:27 smithi169 ceph-mon[34350]: pgmap v269: 97 pgs: 20 creating+peering, 53 active+clean, 24 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T06:05:28.121 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:28.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.592+0000 7feb40534640 1 -- 172.21.15.103:0/479555717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb38101de0 msgr2=0x7feb381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:28.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.592+0000 7feb40534640 1 --2- 172.21.15.103:0/479555717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb38101de0 0x7feb381021c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009900 tx=0x7feb2c02a410 comp rx=0 tx=0).stop 2024-09-19T06:05:28.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.592+0000 7feb40534640 1 -- 172.21.15.103:0/479555717 shutdown_connections 2024-09-19T06:05:28.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.592+0000 7feb40534640 1 --2- 172.21.15.103:0/479555717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb38106f10 0x7feb3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.592+0000 7feb40534640 1 --2- 172.21.15.103:0/479555717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb38102790 0x7feb381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.592+0000 7feb40534640 1 --2- 172.21.15.103:0/479555717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb38101de0 0x7feb381021c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.592+0000 7feb40534640 1 -- 172.21.15.103:0/479555717 >> 172.21.15.103:0/479555717 conn(0x7feb380fd8c0 msgr2=0x7feb380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.592+0000 7feb40534640 1 -- 172.21.15.103:0/479555717 shutdown_connections 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.592+0000 7feb40534640 1 -- 172.21.15.103:0/479555717 wait complete. 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb40534640 1 Processor -- start 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb40534640 1 -- start start 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb40534640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb38101de0 0x7feb38198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb40534640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb38102790 0x7feb38198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb40534640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb38106f10 0x7feb3819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb40534640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feb38111e60 con 0x7feb38101de0 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb40534640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb38111ce0 con 0x7feb38106f10 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb40534640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feb38111fe0 con 0x7feb38102790 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3e2d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb38101de0 0x7feb38198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3e2d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb38101de0 0x7feb38198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47482/0 (socket says 172.21.15.103:47482) 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3e2d0640 1 -- 172.21.15.103:0/2368879 learned_addr learned my addr 172.21.15.103:0/2368879 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3dacf640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb38102790 0x7feb38198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3ead1640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb38106f10 0x7feb3819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3e2d0640 1 -- 172.21.15.103:0/2368879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb38102790 msgr2=0x7feb38198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3e2d0640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb38102790 0x7feb38198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3e2d0640 1 -- 172.21.15.103:0/2368879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb38106f10 msgr2=0x7feb3819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3e2d0640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb38106f10 0x7feb3819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3e2d0640 1 -- 172.21.15.103:0/2368879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3819d3b0 con 0x7feb38101de0 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3dacf640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb38102790 0x7feb38198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3ead1640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb38106f10 0x7feb3819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.593+0000 7feb3e2d0640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb38101de0 0x7feb38198400 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb2c005940 tx=0x7feb2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.594+0000 7feb2b7fe640 1 -- 172.21.15.103:0/2368879 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c03f030 con 0x7feb38101de0 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.594+0000 7feb40534640 1 -- 172.21.15.103:0/2368879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3819d640 con 0x7feb38101de0 2024-09-19T06:05:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.594+0000 7feb2b7fe640 1 -- 172.21.15.103:0/2368879 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb2c003aa0 con 0x7feb38101de0 2024-09-19T06:05:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.594+0000 7feb2b7fe640 1 -- 172.21.15.103:0/2368879 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c035070 con 0x7feb38101de0 2024-09-19T06:05:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.594+0000 7feb40534640 1 -- 172.21.15.103:0/2368879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb381a4f80 con 0x7feb38101de0 2024-09-19T06:05:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.595+0000 7feb40534640 1 -- 172.21.15.103:0/2368879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb381021c0 con 0x7feb38101de0 2024-09-19T06:05:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.596+0000 7feb2b7fe640 1 -- 172.21.15.103:0/2368879 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7feb2c042030 con 0x7feb38101de0 2024-09-19T06:05:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.596+0000 7feb2b7fe640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feb240a3240 0x7feb240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.596+0000 7feb2b7fe640 1 -- 172.21.15.103:0/2368879 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7feb2c0f0200 con 0x7feb38101de0 2024-09-19T06:05:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.596+0000 7feb3dacf640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feb240a3240 0x7feb240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.597+0000 7feb3dacf640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feb240a3240 0x7feb240a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb340058c0 tx=0x7feb34005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.599+0000 7feb2b7fe640 1 -- 172.21.15.103:0/2368879 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feb2c0bd070 con 0x7feb38101de0 2024-09-19T06:05:28.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.768+0000 7feb40534640 1 -- 172.21.15.103:0/2368879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb3810a0f0 con 0x7feb38101de0 2024-09-19T06:05:28.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.770+0000 7feb2b7fe640 1 -- 172.21.15.103:0/2368879 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22351 (secure 0 0 0) 0x7feb2c0bc970 con 0x7feb38101de0 2024-09-19T06:05:28.772 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:28.772 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":78,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:05:25.242075+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:05:21.617020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:05:23.597579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:05:28.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 -- 172.21.15.103:0/2368879 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feb240a3240 msgr2=0x7feb240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:28.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feb240a3240 0x7feb240a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb340058c0 tx=0x7feb34005850 comp rx=0 tx=0).stop 2024-09-19T06:05:28.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 -- 172.21.15.103:0/2368879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb38101de0 msgr2=0x7feb38198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:28.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb38101de0 0x7feb38198400 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb2c005940 tx=0x7feb2c004270 comp rx=0 tx=0).stop 2024-09-19T06:05:28.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 -- 172.21.15.103:0/2368879 shutdown_connections 2024-09-19T06:05:28.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feb240a3240 0x7feb240a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb38106f10 0x7feb3819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb38102790 0x7feb38198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 --2- 172.21.15.103:0/2368879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb38101de0 0x7feb38198400 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 -- 172.21.15.103:0/2368879 >> 172.21.15.103:0/2368879 conn(0x7feb380fd8c0 msgr2=0x7feb380fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:28.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 -- 172.21.15.103:0/2368879 shutdown_connections 2024-09-19T06:05:28.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:28.773+0000 7feb40534640 1 -- 172.21.15.103:0/2368879 wait complete. 2024-09-19T06:05:29.060 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:28 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2368879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:29.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:28 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2368879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:29.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:28 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2368879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:29.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T06:05:29.618 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:29.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:29 smithi103 ceph-mon[30925]: pgmap v270: 97 pgs: 14 creating+peering, 83 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.138+0000 7f6853310640 1 -- 172.21.15.103:0/745115969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f684c100e20 msgr2=0x7f684c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.138+0000 7f6853310640 1 --2- 172.21.15.103:0/745115969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f684c100e20 0x7f684c101200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f683c009ca0 tx=0x7f683c02a950 comp rx=0 tx=0).stop 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.138+0000 7f6853310640 1 -- 172.21.15.103:0/745115969 shutdown_connections 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.138+0000 7f6853310640 1 --2- 172.21.15.103:0/745115969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f684c102ef0 0x7f684c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.138+0000 7f6853310640 1 --2- 172.21.15.103:0/745115969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f684c102570 0x7f684c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.138+0000 7f6853310640 1 --2- 172.21.15.103:0/745115969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f684c100e20 0x7f684c101200 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.138+0000 7f6853310640 1 -- 172.21.15.103:0/745115969 >> 172.21.15.103:0/745115969 conn(0x7f684c0fc7d0 msgr2=0x7f684c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.139+0000 7f6853310640 1 -- 172.21.15.103:0/745115969 shutdown_connections 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.139+0000 7f6853310640 1 -- 172.21.15.103:0/745115969 wait complete. 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.139+0000 7f6853310640 1 Processor -- start 2024-09-19T06:05:30.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.139+0000 7f6853310640 1 -- start start 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.139+0000 7f6853310640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f684c100e20 0x7f684c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.139+0000 7f6853310640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f684c102570 0x7f684c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.139+0000 7f6853310640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f684c102ef0 0x7f684c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.139+0000 7f6853310640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f684c110e30 con 0x7f684c102ef0 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.139+0000 7f6853310640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f684c110cb0 con 0x7f684c102570 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.139+0000 7f6853310640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f684c110fb0 con 0x7f684c100e20 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68518ad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f684c102ef0 0x7f684c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68518ad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f684c102ef0 0x7f684c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34768/0 (socket says 172.21.15.103:34768) 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68518ad640 1 -- 172.21.15.103:0/2770870343 learned_addr learned my addr 172.21.15.103:0/2770870343 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68510ac640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f684c100e20 0x7f684c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68508ab640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f684c102570 0x7f684c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68518ad640 1 -- 172.21.15.103:0/2770870343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f684c100e20 msgr2=0x7f684c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68518ad640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f684c100e20 0x7f684c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68518ad640 1 -- 172.21.15.103:0/2770870343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f684c102570 msgr2=0x7f684c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68518ad640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f684c102570 0x7f684c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68518ad640 1 -- 172.21.15.103:0/2770870343 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684c19d400 con 0x7f684c102ef0 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68510ac640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f684c100e20 0x7f684c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68508ab640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f684c102570 0x7f684c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f68518ad640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f684c102ef0 0x7f684c19cd20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f684400c970 tx=0x7f684400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f684a7fc640 1 -- 172.21.15.103:0/2770870343 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844007bb0 con 0x7f684c102ef0 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f684a7fc640 1 -- 172.21.15.103:0/2770870343 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6844007d50 con 0x7f684c102ef0 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f6853310640 1 -- 172.21.15.103:0/2770870343 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684c19d6f0 con 0x7f684c102ef0 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f684a7fc640 1 -- 172.21.15.103:0/2770870343 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844004e10 con 0x7f684c102ef0 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.140+0000 7f6853310640 1 -- 172.21.15.103:0/2770870343 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684c1a4fd0 con 0x7f684c102ef0 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.141+0000 7f6853310640 1 -- 172.21.15.103:0/2770870343 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f684c101200 con 0x7f684c102ef0 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.143+0000 7f684a7fc640 1 -- 172.21.15.103:0/2770870343 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f6844005000 con 0x7f684c102ef0 2024-09-19T06:05:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.144+0000 7f684a7fc640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f68340a3240 0x7f68340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.144+0000 7f68510ac640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f68340a3240 0x7f68340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.144+0000 7f684a7fc640 1 -- 172.21.15.103:0/2770870343 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f68440cf940 con 0x7f684c102ef0 2024-09-19T06:05:30.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.144+0000 7f68510ac640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f68340a3240 0x7f68340a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f683c006010 tx=0x7f683c005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:30.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.147+0000 7f684a7fc640 1 -- 172.21.15.103:0/2770870343 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6844014030 con 0x7f684c102ef0 2024-09-19T06:05:30.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:29 smithi174 ceph-mon[34488]: pgmap v270: 97 pgs: 14 creating+peering, 83 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-19T06:05:30.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:29 smithi169 ceph-mon[34350]: pgmap v270: 97 pgs: 14 creating+peering, 83 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-19T06:05:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.347+0000 7f6853310640 1 -- 172.21.15.103:0/2770870343 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f684c1997b0 con 0x7f684c102ef0 2024-09-19T06:05:30.777 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:30 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b[64365]: 2024-09-19T06:05:30.365+0000 7f0407c6e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:05:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.835+0000 7f684a7fc640 1 -- 172.21.15.103:0/2770870343 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f684409c7b0 con 0x7f684c102ef0 2024-09-19T06:05:30.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 -- 172.21.15.103:0/2770870343 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f68340a3240 msgr2=0x7f68340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f68340a3240 0x7f68340a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f683c006010 tx=0x7f683c005f80 comp rx=0 tx=0).stop 2024-09-19T06:05:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 -- 172.21.15.103:0/2770870343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f684c102ef0 msgr2=0x7f684c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f684c102ef0 0x7f684c19cd20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f684400c970 tx=0x7f684400ce30 comp rx=0 tx=0).stop 2024-09-19T06:05:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 -- 172.21.15.103:0/2770870343 shutdown_connections 2024-09-19T06:05:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f68340a3240 0x7f68340a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f684c102ef0 0x7f684c19cd20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f684c102570 0x7f684c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 --2- 172.21.15.103:0/2770870343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f684c100e20 0x7f684c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 -- 172.21.15.103:0/2770870343 >> 172.21.15.103:0/2770870343 conn(0x7f684c0fc7d0 msgr2=0x7f684c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 -- 172.21.15.103:0/2770870343 shutdown_connections 2024-09-19T06:05:30.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:30.837+0000 7f6853310640 1 -- 172.21.15.103:0/2770870343 wait complete. 2024-09-19T06:05:31.103 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:30 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2770870343' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:05:31.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:30 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2770870343' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:05:31.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:30 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2770870343' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:05:31.468 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-19T06:05:31.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-19T06:05:31.718 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:32.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:31 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2770870343' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:05:32.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:31 smithi103 ceph-mon[30925]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:32.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:31 smithi103 ceph-mon[30925]: pgmap v271: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T06:05:32.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:31 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2770870343' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:05:32.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:31 smithi174 ceph-mon[34488]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:32.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:31 smithi174 ceph-mon[34488]: pgmap v271: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T06:05:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.206+0000 7f07ae3f3640 1 -- 172.21.15.103:0/1739946107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a8102d30 msgr2=0x7f07a8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.206+0000 7f07ae3f3640 1 --2- 172.21.15.103:0/1739946107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a8102d30 0x7f07a8103110 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0798009930 tx=0x7f079802a440 comp rx=0 tx=0).stop 2024-09-19T06:05:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.206+0000 7f07ae3f3640 1 -- 172.21.15.103:0/1739946107 shutdown_connections 2024-09-19T06:05:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.206+0000 7f07ae3f3640 1 --2- 172.21.15.103:0/1739946107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07a81082a0 0x7f07a810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.206+0000 7f07ae3f3640 1 --2- 172.21.15.103:0/1739946107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07a81036e0 0x7f07a8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.206+0000 7f07ae3f3640 1 --2- 172.21.15.103:0/1739946107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a8102d30 0x7f07a8103110 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.206+0000 7f07ae3f3640 1 -- 172.21.15.103:0/1739946107 >> 172.21.15.103:0/1739946107 conn(0x7f07a80fc7d0 msgr2=0x7f07a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.206+0000 7f07ae3f3640 1 -- 172.21.15.103:0/1739946107 shutdown_connections 2024-09-19T06:05:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.206+0000 7f07ae3f3640 1 -- 172.21.15.103:0/1739946107 wait complete. 2024-09-19T06:05:32.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.207+0000 7f07ae3f3640 1 Processor -- start 2024-09-19T06:05:32.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.207+0000 7f07ae3f3640 1 -- start start 2024-09-19T06:05:32.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.207+0000 7f07ae3f3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07a8102d30 0x7f07a8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.207+0000 7f07ae3f3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a81036e0 0x7f07a8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.207+0000 7f07ae3f3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07a81082a0 0x7f07a8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07ae3f3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8111f90 con 0x7f07a81036e0 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07ae3f3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8111e10 con 0x7f07a81082a0 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07ae3f3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8112110 con 0x7f07a8102d30 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a81036e0 0x7f07a8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a81036e0 0x7f07a8100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34788/0 (socket says 172.21.15.103:34788) 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a77fe640 1 -- 172.21.15.103:0/484634530 learned_addr learned my addr 172.21.15.103:0/484634530 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07ac990640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07a81082a0 0x7f07a8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a7fff640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07a8102d30 0x7f07a8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a77fe640 1 -- 172.21.15.103:0/484634530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07a8102d30 msgr2=0x7f07a8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a77fe640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07a8102d30 0x7f07a8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a77fe640 1 -- 172.21.15.103:0/484634530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07a81082a0 msgr2=0x7f07a8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a77fe640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07a81082a0 0x7f07a8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a77fe640 1 -- 172.21.15.103:0/484634530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a81a6a10 con 0x7f07a81036e0 2024-09-19T06:05:32.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a77fe640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a81036e0 0x7f07a8100ed0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f079c006fd0 tx=0x7f079c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:32.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a57fa640 1 -- 172.21.15.103:0/484634530 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c011830 con 0x7f07a81036e0 2024-09-19T06:05:32.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07a57fa640 1 -- 172.21.15.103:0/484634530 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f079c016070 con 0x7f07a81036e0 2024-09-19T06:05:32.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07ae3f3640 1 -- 172.21.15.103:0/484634530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a81a6d00 con 0x7f07a81036e0 2024-09-19T06:05:32.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.208+0000 7f07ae3f3640 1 -- 172.21.15.103:0/484634530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a81a71e0 con 0x7f07a81036e0 2024-09-19T06:05:32.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.209+0000 7f07a57fa640 1 -- 172.21.15.103:0/484634530 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c010df0 con 0x7f07a81036e0 2024-09-19T06:05:32.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.209+0000 7f07ae3f3640 1 -- 172.21.15.103:0/484634530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a806a850 con 0x7f07a81036e0 2024-09-19T06:05:32.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.211+0000 7f07a57fa640 1 -- 172.21.15.103:0/484634530 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f079c0119d0 con 0x7f07a81036e0 2024-09-19T06:05:32.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.211+0000 7f07a57fa640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f07900a3240 0x7f07900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.211+0000 7f07a7fff640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f07900a3240 0x7f07900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.211+0000 7f07a57fa640 1 -- 172.21.15.103:0/484634530 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f079c0cedb0 con 0x7f07a81036e0 2024-09-19T06:05:32.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.212+0000 7f07a7fff640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f07900a3240 0x7f07900a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0798009900 tx=0x7f0798000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:32.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.215+0000 7f07a57fa640 1 -- 172.21.15.103:0/484634530 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f079c09bc20 con 0x7f07a81036e0 2024-09-19T06:05:32.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:31 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2770870343' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:05:32.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:31 smithi169 ceph-mon[34350]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:32.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:31 smithi169 ceph-mon[34350]: pgmap v271: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T06:05:32.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.427+0000 7f07ae3f3640 1 -- 172.21.15.103:0/484634530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f07a810a2b0 con 0x7f07a81036e0 2024-09-19T06:05:32.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.848+0000 7f07a57fa640 1 -- 172.21.15.103:0/484634530 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f079c0cce20 con 0x7f07a81036e0 2024-09-19T06:05:32.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.851+0000 7f07ae3f3640 1 -- 172.21.15.103:0/484634530 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f07900a3240 msgr2=0x7f07900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.851+0000 7f07ae3f3640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f07900a3240 0x7f07900a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0798009900 tx=0x7f0798000bc0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.851+0000 7f07ae3f3640 1 -- 172.21.15.103:0/484634530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a81036e0 msgr2=0x7f07a8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.851+0000 7f07ae3f3640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a81036e0 0x7f07a8100ed0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f079c006fd0 tx=0x7f079c00b8e0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.851+0000 7f07ae3f3640 1 -- 172.21.15.103:0/484634530 shutdown_connections 2024-09-19T06:05:32.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.852+0000 7f07ae3f3640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f07900a3240 0x7f07900a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.852+0000 7f07ae3f3640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07a81082a0 0x7f07a8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.852+0000 7f07ae3f3640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a81036e0 0x7f07a8100ed0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.852+0000 7f07ae3f3640 1 --2- 172.21.15.103:0/484634530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07a8102d30 0x7f07a8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.852+0000 7f07ae3f3640 1 -- 172.21.15.103:0/484634530 >> 172.21.15.103:0/484634530 conn(0x7f07a80fc7d0 msgr2=0x7f07a8105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:32.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.852+0000 7f07ae3f3640 1 -- 172.21.15.103:0/484634530 shutdown_connections 2024-09-19T06:05:32.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:32.852+0000 7f07ae3f3640 1 -- 172.21.15.103:0/484634530 wait complete. 2024-09-19T06:05:33.153 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:32 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/484634530' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T06:05:33.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:32 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/484634530' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T06:05:33.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:32 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/484634530' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T06:05:33.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T06:05:33.770 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:34.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:33 smithi103 ceph-mon[30925]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:05:34.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:33 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/484634530' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T06:05:34.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:33 smithi103 ceph-mon[30925]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:05:34.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:33 smithi103 ceph-mon[30925]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:34.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:33 smithi103 ceph-mon[30925]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:05:34.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:33 smithi103 ceph-mon[30925]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:05:34.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:33 smithi103 ceph-mon[30925]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T06:05:34.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:33 smithi174 ceph-mon[34488]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:05:34.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:33 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/484634530' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T06:05:34.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:33 smithi174 ceph-mon[34488]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:05:34.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:33 smithi174 ceph-mon[34488]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:34.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:33 smithi174 ceph-mon[34488]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:05:34.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:33 smithi174 ceph-mon[34488]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:05:34.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:33 smithi174 ceph-mon[34488]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T06:05:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.222+0000 7fb1c12b5640 1 -- 172.21.15.103:0/721449514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc102790 msgr2=0x7fb1bc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.222+0000 7fb1c12b5640 1 --2- 172.21.15.103:0/721449514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc102790 0x7fb1bc1067e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009900 tx=0x7fb1b002a410 comp rx=0 tx=0).stop 2024-09-19T06:05:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.222+0000 7fb1c12b5640 1 -- 172.21.15.103:0/721449514 shutdown_connections 2024-09-19T06:05:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.222+0000 7fb1c12b5640 1 --2- 172.21.15.103:0/721449514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc106f10 0x7fb1bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.222+0000 7fb1c12b5640 1 --2- 172.21.15.103:0/721449514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc102790 0x7fb1bc1067e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.222+0000 7fb1c12b5640 1 --2- 172.21.15.103:0/721449514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1bc101de0 0x7fb1bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.222+0000 7fb1c12b5640 1 -- 172.21.15.103:0/721449514 >> 172.21.15.103:0/721449514 conn(0x7fb1bc0fd8c0 msgr2=0x7fb1bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.222+0000 7fb1c12b5640 1 -- 172.21.15.103:0/721449514 shutdown_connections 2024-09-19T06:05:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.222+0000 7fb1c12b5640 1 -- 172.21.15.103:0/721449514 wait complete. 2024-09-19T06:05:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.223+0000 7fb1c12b5640 1 Processor -- start 2024-09-19T06:05:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.223+0000 7fb1c12b5640 1 -- start start 2024-09-19T06:05:34.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1c12b5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc101de0 0x7fb1bc198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:34.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1c12b5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1bc102790 0x7fb1bc198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:34.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1c12b5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:34.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1c12b5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc111e40 con 0x7fb1bc106f10 2024-09-19T06:05:34.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1c12b5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc111cc0 con 0x7fb1bc102790 2024-09-19T06:05:34.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1c12b5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc111fc0 con 0x7fb1bc101de0 2024-09-19T06:05:34.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1bb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:34.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1bb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34810/0 (socket says 172.21.15.103:34810) 2024-09-19T06:05:34.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1bb7fe640 1 -- 172.21.15.103:0/3592680520 learned_addr learned my addr 172.21.15.103:0/3592680520 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:34.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1ba7fc640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1bc102790 0x7fb1bc198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:34.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1baffd640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc101de0 0x7fb1bc198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:34.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1bb7fe640 1 -- 172.21.15.103:0/3592680520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc101de0 msgr2=0x7fb1bc198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:34.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1bb7fe640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc101de0 0x7fb1bc198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1bb7fe640 1 -- 172.21.15.103:0/3592680520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1bc102790 msgr2=0x7fb1bc198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:34.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1bb7fe640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1bc102790 0x7fb1bc198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1bb7fe640 1 -- 172.21.15.103:0/3592680520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc19d2d0 con 0x7fb1bc106f10 2024-09-19T06:05:34.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1bb7fe640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cbf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400b970 tx=0x7fb1b400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:34.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1a3fff640 1 -- 172.21.15.103:0/3592680520 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4019070 con 0x7fb1bc106f10 2024-09-19T06:05:34.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1a3fff640 1 -- 172.21.15.103:0/3592680520 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1b4014440 con 0x7fb1bc106f10 2024-09-19T06:05:34.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1c12b5640 1 -- 172.21.15.103:0/3592680520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1bc19d5c0 con 0x7fb1bc106f10 2024-09-19T06:05:34.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.224+0000 7fb1a3fff640 1 -- 172.21.15.103:0/3592680520 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40075d0 con 0x7fb1bc106f10 2024-09-19T06:05:34.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.225+0000 7fb1c12b5640 1 -- 172.21.15.103:0/3592680520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1bc1a4ea0 con 0x7fb1bc106f10 2024-09-19T06:05:34.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.226+0000 7fb1c12b5640 1 -- 172.21.15.103:0/3592680520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1bc1021c0 con 0x7fb1bc106f10 2024-09-19T06:05:34.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.227+0000 7fb1a3fff640 1 -- 172.21.15.103:0/3592680520 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb1b401c070 con 0x7fb1bc106f10 2024-09-19T06:05:34.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.227+0000 7fb1a3fff640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb1a40a3240 0x7fb1a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:34.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.227+0000 7fb1baffd640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb1a40a3240 0x7fb1a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:34.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.227+0000 7fb1a3fff640 1 -- 172.21.15.103:0/3592680520 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fb1b40cecd0 con 0x7fb1bc106f10 2024-09-19T06:05:34.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.228+0000 7fb1baffd640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb1a40a3240 0x7fb1a40a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00abe0 tx=0x7fb1ac00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:34.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.232+0000 7fb1a3fff640 1 -- 172.21.15.103:0/3592680520 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1b409b4f0 con 0x7fb1bc106f10 2024-09-19T06:05:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:33 smithi169 ceph-mon[34350]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:05:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:33 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/484634530' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T06:05:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:33 smithi169 ceph-mon[34350]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:05:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:33 smithi169 ceph-mon[34350]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:05:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:33 smithi169 ceph-mon[34350]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:05:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:33 smithi169 ceph-mon[34350]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:05:34.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:33 smithi169 ceph-mon[34350]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T06:05:34.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.436+0000 7fb1c12b5640 1 -- 172.21.15.103:0/3592680520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fb1bc10a150 con 0x7fb1bc106f10 2024-09-19T06:05:34.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.868+0000 7fb1a3fff640 1 -- 172.21.15.103:0/3592680520 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fb1b409f7f0 con 0x7fb1bc106f10 2024-09-19T06:05:34.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.871+0000 7fb1c12b5640 1 -- 172.21.15.103:0/3592680520 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb1a40a3240 msgr2=0x7fb1a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:34.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.871+0000 7fb1c12b5640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb1a40a3240 0x7fb1a40a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00abe0 tx=0x7fb1ac00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.871+0000 7fb1c12b5640 1 -- 172.21.15.103:0/3592680520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc106f10 msgr2=0x7fb1bc19cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:34.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.871+0000 7fb1c12b5640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cbf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400b970 tx=0x7fb1b400bd70 comp rx=0 tx=0).stop 2024-09-19T06:05:34.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.872+0000 7fb1c12b5640 1 -- 172.21.15.103:0/3592680520 shutdown_connections 2024-09-19T06:05:34.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.872+0000 7fb1c12b5640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb1a40a3240 0x7fb1a40a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.872+0000 7fb1c12b5640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cbf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.872+0000 7fb1c12b5640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1bc102790 0x7fb1bc198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.872+0000 7fb1c12b5640 1 --2- 172.21.15.103:0/3592680520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc101de0 0x7fb1bc198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.872+0000 7fb1c12b5640 1 -- 172.21.15.103:0/3592680520 >> 172.21.15.103:0/3592680520 conn(0x7fb1bc0fd8c0 msgr2=0x7fb1bc0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:34.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.872+0000 7fb1c12b5640 1 -- 172.21.15.103:0/3592680520 shutdown_connections 2024-09-19T06:05:34.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:34.872+0000 7fb1c12b5640 1 -- 172.21.15.103:0/3592680520 wait complete. 2024-09-19T06:05:35.186 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:34 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] up:active 2024-09-19T06:05:35.186 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:34 smithi103 ceph-mon[30925]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:05:35.187 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:34 smithi103 ceph-mon[30925]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:05:35.187 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:34 smithi103 ceph-mon[30925]: Cluster is now healthy 2024-09-19T06:05:35.187 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:34 smithi103 ceph-mon[30925]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:05:35.187 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:34 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T06:05:35.187 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:34 smithi103 ceph-mon[30925]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T06:05:35.187 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:34 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3592680520' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:05:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:34 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] up:active 2024-09-19T06:05:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:34 smithi174 ceph-mon[34488]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:05:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:34 smithi174 ceph-mon[34488]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:05:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:34 smithi174 ceph-mon[34488]: Cluster is now healthy 2024-09-19T06:05:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:34 smithi174 ceph-mon[34488]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:05:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:34 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T06:05:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:34 smithi174 ceph-mon[34488]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T06:05:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:34 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3592680520' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:05:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:34 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] up:active 2024-09-19T06:05:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:34 smithi169 ceph-mon[34350]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:05:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:34 smithi169 ceph-mon[34350]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:05:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:34 smithi169 ceph-mon[34350]: Cluster is now healthy 2024-09-19T06:05:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:34 smithi169 ceph-mon[34350]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:05:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:34 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T06:05:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:34 smithi169 ceph-mon[34350]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T06:05:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:34 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3592680520' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:05:35.489 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T06:05:35.677 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:35 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b[64365]: 2024-09-19T06:05:35.366+0000 7f0407c6e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T06:05:35.677 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:05:35 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b[64365]: 2024-09-19T06:05:35.366+0000 7f0407c6e640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T06:05:35.737 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:36.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:35 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3592680520' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:05:36.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:35 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] up:active 2024-09-19T06:05:36.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:35 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-19T06:05:36.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:35 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:05:36.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:35 smithi169 ceph-mon[34350]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-09-19T06:05:36.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:35 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3592680520' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:05:36.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:35 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] up:active 2024-09-19T06:05:36.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:35 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-19T06:05:36.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:35 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:05:36.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:35 smithi103 ceph-mon[30925]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-09-19T06:05:36.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:35 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3592680520' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:05:36.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:35 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] up:active 2024-09-19T06:05:36.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:35 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-19T06:05:36.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:35 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:05:36.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:35 smithi174 ceph-mon[34488]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-09-19T06:05:36.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.221+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3340351427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b9c100e20 msgr2=0x7f5b9c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:36.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.221+0000 7f5ba2bbd640 1 --2- 172.21.15.103:0/3340351427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b9c100e20 0x7f5b9c101200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009ca0 tx=0x7f5b8c02a950 comp rx=0 tx=0).stop 2024-09-19T06:05:36.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.221+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3340351427 shutdown_connections 2024-09-19T06:05:36.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.221+0000 7f5ba2bbd640 1 --2- 172.21.15.103:0/3340351427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b9c102ef0 0x7f5b9c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.221+0000 7f5ba2bbd640 1 --2- 172.21.15.103:0/3340351427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b9c102570 0x7f5b9c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.221+0000 7f5ba2bbd640 1 --2- 172.21.15.103:0/3340351427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b9c100e20 0x7f5b9c101200 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.221+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3340351427 >> 172.21.15.103:0/3340351427 conn(0x7f5b9c0fc7d0 msgr2=0x7f5b9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:36.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.221+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3340351427 shutdown_connections 2024-09-19T06:05:36.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.221+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3340351427 wait complete. 2024-09-19T06:05:36.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.221+0000 7f5ba2bbd640 1 Processor -- start 2024-09-19T06:05:36.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba2bbd640 1 -- start start 2024-09-19T06:05:36.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba2bbd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b9c100e20 0x7f5b9c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba2bbd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b9c102570 0x7f5b9c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba2bbd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b9c102ef0 0x7f5b9c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba2bbd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c110e00 con 0x7f5b9c102ef0 2024-09-19T06:05:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba2bbd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c110c80 con 0x7f5b9c102570 2024-09-19T06:05:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba2bbd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c110f80 con 0x7f5b9c100e20 2024-09-19T06:05:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba0959640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b9c100e20 0x7f5b9c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba115a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b9c102ef0 0x7f5b9c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba0959640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b9c100e20 0x7f5b9c1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:35980/0 (socket says 172.21.15.103:35980) 2024-09-19T06:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba0959640 1 -- 172.21.15.103:0/3773297748 learned_addr learned my addr 172.21.15.103:0/3773297748 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5b9bfff640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b9c102570 0x7f5b9c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba115a640 1 -- 172.21.15.103:0/3773297748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b9c100e20 msgr2=0x7f5b9c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba115a640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b9c100e20 0x7f5b9c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba115a640 1 -- 172.21.15.103:0/3773297748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b9c102570 msgr2=0x7f5b9c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba115a640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b9c102570 0x7f5b9c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba115a640 1 -- 172.21.15.103:0/3773297748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c19d380 con 0x7f5b9c102ef0 2024-09-19T06:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.222+0000 7f5ba0959640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b9c100e20 0x7f5b9c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.223+0000 7f5ba115a640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b9c102ef0 0x7f5b9c19cca0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400d680 tx=0x7f5b9400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.223+0000 7f5b99ffb640 1 -- 172.21.15.103:0/3773297748 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94017070 con 0x7f5b9c102ef0 2024-09-19T06:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.223+0000 7f5b99ffb640 1 -- 172.21.15.103:0/3773297748 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b940047a0 con 0x7f5b9c102ef0 2024-09-19T06:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.223+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3773297748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9c19d670 con 0x7f5b9c102ef0 2024-09-19T06:05:36.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.223+0000 7f5b99ffb640 1 -- 172.21.15.103:0/3773297748 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94009c10 con 0x7f5b9c102ef0 2024-09-19T06:05:36.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.223+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3773297748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9c1a4f50 con 0x7f5b9c102ef0 2024-09-19T06:05:36.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.224+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3773297748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b9c101200 con 0x7f5b9c102ef0 2024-09-19T06:05:36.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.225+0000 7f5b99ffb640 1 -- 172.21.15.103:0/3773297748 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f5b94004950 con 0x7f5b9c102ef0 2024-09-19T06:05:36.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.225+0000 7f5b99ffb640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5b880a32c0 0x7f5b880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:36.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.226+0000 7f5ba0959640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5b880a32c0 0x7f5b880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:36.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.226+0000 7f5b99ffb640 1 -- 172.21.15.103:0/3773297748 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f5b940ceea0 con 0x7f5b9c102ef0 2024-09-19T06:05:36.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.226+0000 7f5ba0959640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5b880a32c0 0x7f5b880a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009a60 tx=0x7f5b8c005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:36.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.230+0000 7f5b99ffb640 1 -- 172.21.15.103:0/3773297748 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b9409bd10 con 0x7f5b9c102ef0 2024-09-19T06:05:36.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.429+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3773297748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f5b9c10a0a0 con 0x7f5b9c102ef0 2024-09-19T06:05:36.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.884+0000 7f5b99ffb640 1 -- 172.21.15.103:0/3773297748 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f5b9409b610 con 0x7f5b9c102ef0 2024-09-19T06:05:36.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3773297748 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5b880a32c0 msgr2=0x7f5b880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:36.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5b880a32c0 0x7f5b880a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009a60 tx=0x7f5b8c005c50 comp rx=0 tx=0).stop 2024-09-19T06:05:36.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3773297748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b9c102ef0 msgr2=0x7f5b9c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:36.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b9c102ef0 0x7f5b9c19cca0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400d680 tx=0x7f5b9400da80 comp rx=0 tx=0).stop 2024-09-19T06:05:36.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3773297748 shutdown_connections 2024-09-19T06:05:36.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5b880a32c0 0x7f5b880a5780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b9c102ef0 0x7f5b9c19cca0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b9c102570 0x7f5b9c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 --2- 172.21.15.103:0/3773297748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b9c100e20 0x7f5b9c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3773297748 >> 172.21.15.103:0/3773297748 conn(0x7f5b9c0fc7d0 msgr2=0x7f5b9c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:36.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3773297748 shutdown_connections 2024-09-19T06:05:36.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:36.887+0000 7f5ba2bbd640 1 -- 172.21.15.103:0/3773297748 wait complete. 2024-09-19T06:05:37.157 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:36 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3773297748' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:05:37.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:36 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3773297748' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:05:37.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:36 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3773297748' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:05:37.582 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-19T06:05:37.583 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T06:05:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:38.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:37 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3773297748' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:05:38.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:37 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:05:38.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:37 smithi174 ceph-mon[34488]: pgmap v274: 97 pgs: 97 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-19T06:05:38.208 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:37 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3773297748' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:05:38.208 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:37 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:05:38.208 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:37 smithi103 ceph-mon[30925]: pgmap v274: 97 pgs: 97 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-19T06:05:38.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:37 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3773297748' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:05:38.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:37 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:05:38.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:37 smithi169 ceph-mon[34350]: pgmap v274: 97 pgs: 97 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-19T06:05:38.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.289+0000 7fc092a9e640 1 -- 172.21.15.103:0/2126051141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08c102d40 msgr2=0x7fc08c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.289+0000 7fc092a9e640 1 --2- 172.21.15.103:0/2126051141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08c102d40 0x7fc08c103120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009900 tx=0x7fc07c02a480 comp rx=0 tx=0).stop 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.289+0000 7fc092a9e640 1 -- 172.21.15.103:0/2126051141 shutdown_connections 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.289+0000 7fc092a9e640 1 --2- 172.21.15.103:0/2126051141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc08c10c170 0x7fc08c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.289+0000 7fc092a9e640 1 --2- 172.21.15.103:0/2126051141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc08c103660 0x7fc08c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.289+0000 7fc092a9e640 1 --2- 172.21.15.103:0/2126051141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08c102d40 0x7fc08c103120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.289+0000 7fc092a9e640 1 -- 172.21.15.103:0/2126051141 >> 172.21.15.103:0/2126051141 conn(0x7fc08c0fc7a0 msgr2=0x7fc08c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.289+0000 7fc092a9e640 1 -- 172.21.15.103:0/2126051141 shutdown_connections 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.289+0000 7fc092a9e640 1 -- 172.21.15.103:0/2126051141 wait complete. 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.290+0000 7fc092a9e640 1 Processor -- start 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.290+0000 7fc092a9e640 1 -- start start 2024-09-19T06:05:38.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.290+0000 7fc092a9e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08c102d40 0x7fc08c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.290+0000 7fc092a9e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc08c103660 0x7fc08c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.290+0000 7fc092a9e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc08c10c170 0x7fc08c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.290+0000 7fc092a9e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c111ee0 con 0x7fc08c102d40 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.290+0000 7fc092a9e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c111d60 con 0x7fc08c10c170 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.290+0000 7fc092a9e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c112060 con 0x7fc08c103660 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.290+0000 7fc09083a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08c102d40 0x7fc08c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.290+0000 7fc09083a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08c102d40 0x7fc08c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34848/0 (socket says 172.21.15.103:34848) 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc09083a640 1 -- 172.21.15.103:0/1857124725 learned_addr learned my addr 172.21.15.103:0/1857124725 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc08bfff640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc08c103660 0x7fc08c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc09083a640 1 -- 172.21.15.103:0/1857124725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc08c103660 msgr2=0x7fc08c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:38.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc09083a640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc08c103660 0x7fc08c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc09083a640 1 -- 172.21.15.103:0/1857124725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc08c10c170 msgr2=0x7fc08c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc09083a640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc08c10c170 0x7fc08c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc09083a640 1 -- 172.21.15.103:0/1857124725 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c19d490 con 0x7fc08c102d40 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc09083a640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08c102d40 0x7fc08c1984e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc07c006010 tx=0x7fc07c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc089ffb640 1 -- 172.21.15.103:0/1857124725 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c03f030 con 0x7fc08c102d40 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc089ffb640 1 -- 172.21.15.103:0/1857124725 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc07c0035f0 con 0x7fc08c102d40 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc092a9e640 1 -- 172.21.15.103:0/1857124725 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c19d720 con 0x7fc08c102d40 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc089ffb640 1 -- 172.21.15.103:0/1857124725 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c035070 con 0x7fc08c102d40 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.291+0000 7fc092a9e640 1 -- 172.21.15.103:0/1857124725 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c1a5060 con 0x7fc08c102d40 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.292+0000 7fc092a9e640 1 -- 172.21.15.103:0/1857124725 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08c06b070 con 0x7fc08c102d40 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.294+0000 7fc089ffb640 1 -- 172.21.15.103:0/1857124725 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fc07c003b10 con 0x7fc08c102d40 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.295+0000 7fc089ffb640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc0740a3240 0x7fc0740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:38.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.295+0000 7fc089ffb640 1 -- 172.21.15.103:0/1857124725 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fc07c0f0550 con 0x7fc08c102d40 2024-09-19T06:05:38.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.295+0000 7fc08bfff640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc0740a3240 0x7fc0740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:38.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.295+0000 7fc08bfff640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc0740a3240 0x7fc0740a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0fee70 tx=0x7fc080009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:38.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.298+0000 7fc089ffb640 1 -- 172.21.15.103:0/1857124725 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc07c0bd3c0 con 0x7fc08c102d40 2024-09-19T06:05:38.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.488+0000 7fc092a9e640 1 -- 172.21.15.103:0/1857124725 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc08c107250 con 0x7fc0740a3240 2024-09-19T06:05:38.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.509+0000 7fc089ffb640 1 -- 172.21.15.103:0/1857124725 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc080009650 con 0x7fc0740a3240 2024-09-19T06:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 -- 172.21.15.103:0/1857124725 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc0740a3240 msgr2=0x7fc0740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc0740a3240 0x7fc0740a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0fee70 tx=0x7fc080009060 comp rx=0 tx=0).stop 2024-09-19T06:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 -- 172.21.15.103:0/1857124725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08c102d40 msgr2=0x7fc08c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08c102d40 0x7fc08c1984e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc07c006010 tx=0x7fc07c004270 comp rx=0 tx=0).stop 2024-09-19T06:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 -- 172.21.15.103:0/1857124725 shutdown_connections 2024-09-19T06:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc0740a3240 0x7fc0740a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc08c10c170 0x7fc08c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc08c103660 0x7fc08c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 --2- 172.21.15.103:0/1857124725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08c102d40 0x7fc08c1984e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:38.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 -- 172.21.15.103:0/1857124725 >> 172.21.15.103:0/1857124725 conn(0x7fc08c0fc7a0 msgr2=0x7fc08c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:38.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 -- 172.21.15.103:0/1857124725 shutdown_connections 2024-09-19T06:05:38.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:38.511+0000 7fc092a9e640 1 -- 172.21.15.103:0/1857124725 wait complete. 2024-09-19T06:05:38.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:05:38 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:05:38.493+0000 7fe303bf5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:05:38.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:05:38 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:05:38.493+0000 7fe303bf5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:05:38.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:05:38 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:05:38.493+0000 7fe303bf5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:05:38.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:05:38 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:05:38.493+0000 7fe303bf5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:05:38.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:05:38 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:05:38.493+0000 7fe303bf5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:05:39.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:38 smithi103 ceph-mon[30925]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:39.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T06:05:39.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:38 smithi174 ceph-mon[34488]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:39.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:38 smithi169 ceph-mon[34350]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.865+0000 7fa8d1027640 1 -- 172.21.15.103:0/569001099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc101470 msgr2=0x7fa8cc101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.865+0000 7fa8d1027640 1 --2- 172.21.15.103:0/569001099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc101470 0x7fa8cc101850 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009ca0 tx=0x7fa8bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.865+0000 7fa8d1027640 1 -- 172.21.15.103:0/569001099 shutdown_connections 2024-09-19T06:05:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.865+0000 7fa8d1027640 1 --2- 172.21.15.103:0/569001099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8cc105de0 0x7fa8cc10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.865+0000 7fa8d1027640 1 --2- 172.21.15.103:0/569001099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8cc101e20 0x7fa8cc1056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.865+0000 7fa8d1027640 1 --2- 172.21.15.103:0/569001099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc101470 0x7fa8cc101850 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.865+0000 7fa8d1027640 1 -- 172.21.15.103:0/569001099 >> 172.21.15.103:0/569001099 conn(0x7fa8cc077230 msgr2=0x7fa8cc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.865+0000 7fa8d1027640 1 -- 172.21.15.103:0/569001099 shutdown_connections 2024-09-19T06:05:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.865+0000 7fa8d1027640 1 -- 172.21.15.103:0/569001099 wait complete. 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.866+0000 7fa8d1027640 1 Processor -- start 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.866+0000 7fa8d1027640 1 -- start start 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8d1027640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc101470 0x7fa8cc196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8d1027640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8cc101e20 0x7fa8cc197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8d1027640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8cc105de0 0x7fa8cc197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8d1027640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc110d30 con 0x7fa8cc101470 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8d1027640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc110bb0 con 0x7fa8cc101e20 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8d1027640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc110eb0 con 0x7fa8cc105de0 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc101470 0x7fa8cc196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc101470 0x7fa8cc196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34890/0 (socket says 172.21.15.103:34890) 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cad9d640 1 -- 172.21.15.103:0/2637136460 learned_addr learned my addr 172.21.15.103:0/2637136460 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8ca59c640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8cc101e20 0x7fa8cc197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cb59e640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8cc105de0 0x7fa8cc197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cad9d640 1 -- 172.21.15.103:0/2637136460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8cc105de0 msgr2=0x7fa8cc197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cad9d640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8cc105de0 0x7fa8cc197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cad9d640 1 -- 172.21.15.103:0/2637136460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8cc101e20 msgr2=0x7fa8cc197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cad9d640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8cc101e20 0x7fa8cc197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cad9d640 1 -- 172.21.15.103:0/2637136460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8cc1a6840 con 0x7fa8cc101470 2024-09-19T06:05:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cb59e640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8cc105de0 0x7fa8cc197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.867+0000 7fa8cad9d640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc101470 0x7fa8cc196fd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc02ade0 tx=0x7fa8bc032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.868+0000 7fa8b3fff640 1 -- 172.21.15.103:0/2637136460 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc003cf0 con 0x7fa8cc101470 2024-09-19T06:05:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.868+0000 7fa8b3fff640 1 -- 172.21.15.103:0/2637136460 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8bc0044f0 con 0x7fa8cc101470 2024-09-19T06:05:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.868+0000 7fa8d1027640 1 -- 172.21.15.103:0/2637136460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8cc1a6ad0 con 0x7fa8cc101470 2024-09-19T06:05:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.868+0000 7fa8b3fff640 1 -- 172.21.15.103:0/2637136460 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc030bd0 con 0x7fa8cc101470 2024-09-19T06:05:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.868+0000 7fa8d1027640 1 -- 172.21.15.103:0/2637136460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8cc1a7010 con 0x7fa8cc101470 2024-09-19T06:05:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.869+0000 7fa8d1027640 1 -- 172.21.15.103:0/2637136460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8cc101850 con 0x7fa8cc101470 2024-09-19T06:05:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.870+0000 7fa8b3fff640 1 -- 172.21.15.103:0/2637136460 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fa8bc004040 con 0x7fa8cc101470 2024-09-19T06:05:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.870+0000 7fa8b3fff640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa8b40a3240 0x7fa8b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.870+0000 7fa8ca59c640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa8b40a3240 0x7fa8b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.870+0000 7fa8b3fff640 1 -- 172.21.15.103:0/2637136460 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fa8bc0f0d10 con 0x7fa8cc101470 2024-09-19T06:05:39.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.871+0000 7fa8ca59c640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa8b40a3240 0x7fa8b40a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc199130 tx=0x7fa8c0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:39.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.874+0000 7fa8b3fff640 1 -- 172.21.15.103:0/2637136460 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8bc0bdb80 con 0x7fa8cc101470 2024-09-19T06:05:39.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:39.908+0000 7fa8b3fff640 1 -- 172.21.15.103:0/2637136460 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fa8bc0f7080 con 0x7fa8cc101470 2024-09-19T06:05:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.071+0000 7fa8d1027640 1 -- 172.21.15.103:0/2637136460 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa8cc062630 con 0x7fa8b40a3240 2024-09-19T06:05:40.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.099+0000 7fa8b3fff640 1 -- 172.21.15.103:0/2637136460 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa8cc062630 con 0x7fa8b40a3240 2024-09-19T06:05:40.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.101+0000 7fa8d1027640 1 -- 172.21.15.103:0/2637136460 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa8b40a3240 msgr2=0x7fa8b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:40.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.101+0000 7fa8d1027640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa8b40a3240 0x7fa8b40a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc199130 tx=0x7fa8c0009110 comp rx=0 tx=0).stop 2024-09-19T06:05:40.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.101+0000 7fa8d1027640 1 -- 172.21.15.103:0/2637136460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc101470 msgr2=0x7fa8cc196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.101+0000 7fa8d1027640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc101470 0x7fa8cc196fd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc02ade0 tx=0x7fa8bc032ff0 comp rx=0 tx=0).stop 2024-09-19T06:05:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.101+0000 7fa8d1027640 1 -- 172.21.15.103:0/2637136460 shutdown_connections 2024-09-19T06:05:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.101+0000 7fa8d1027640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa8b40a3240 0x7fa8b40a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.101+0000 7fa8d1027640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8cc105de0 0x7fa8cc197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.101+0000 7fa8d1027640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8cc101e20 0x7fa8cc197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.101+0000 7fa8d1027640 1 --2- 172.21.15.103:0/2637136460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc101470 0x7fa8cc196fd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.101+0000 7fa8d1027640 1 -- 172.21.15.103:0/2637136460 >> 172.21.15.103:0/2637136460 conn(0x7fa8cc077230 msgr2=0x7fa8cc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.102+0000 7fa8d1027640 1 -- 172.21.15.103:0/2637136460 shutdown_connections 2024-09-19T06:05:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:40.102+0000 7fa8d1027640 1 -- 172.21.15.103:0/2637136460 wait complete. 2024-09-19T06:05:40.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:39 smithi174 ceph-mon[34488]: pgmap v275: 97 pgs: 97 active+clean; 582 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-19T06:05:40.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:39 smithi103 ceph-mon[30925]: pgmap v275: 97 pgs: 97 active+clean; 582 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-19T06:05:40.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:39 smithi169 ceph-mon[34350]: pgmap v275: 97 pgs: 97 active+clean; 582 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-19T06:05:40.725 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T06:05:40.973 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:41.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:40 smithi174 ceph-mon[34488]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T06:05:41.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:40 smithi174 ceph-mon[34488]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:41.216 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:40 smithi103 ceph-mon[30925]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T06:05:41.216 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:40 smithi103 ceph-mon[30925]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:41.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:40 smithi169 ceph-mon[34350]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T06:05:41.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:40 smithi169 ceph-mon[34350]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:41.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 -- 172.21.15.103:0/654488718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c102570 msgr2=0x7fa06c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:41.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 --2- 172.21.15.103:0/654488718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c102570 0x7fa06c1029b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa060009900 tx=0x7fa06002a480 comp rx=0 tx=0).stop 2024-09-19T06:05:41.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 -- 172.21.15.103:0/654488718 shutdown_connections 2024-09-19T06:05:41.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 --2- 172.21.15.103:0/654488718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa06c102ef0 0x7fa06c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 --2- 172.21.15.103:0/654488718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c102570 0x7fa06c1029b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 --2- 172.21.15.103:0/654488718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa06c100e20 0x7fa06c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 -- 172.21.15.103:0/654488718 >> 172.21.15.103:0/654488718 conn(0x7fa06c0fc7d0 msgr2=0x7fa06c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:41.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 -- 172.21.15.103:0/654488718 shutdown_connections 2024-09-19T06:05:41.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 -- 172.21.15.103:0/654488718 wait complete. 2024-09-19T06:05:41.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 Processor -- start 2024-09-19T06:05:41.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.449+0000 7fa074481640 1 -- start start 2024-09-19T06:05:41.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa074481640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c100e20 0x7fa06c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:41.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa074481640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa06c102570 0x7fa06c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:41.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa074481640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa06c102ef0 0x7fa06c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:41.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa074481640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c111f80 con 0x7fa06c100e20 2024-09-19T06:05:41.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa074481640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c111e00 con 0x7fa06c102570 2024-09-19T06:05:41.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa074481640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c112100 con 0x7fa06c102ef0 2024-09-19T06:05:41.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa07221d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c100e20 0x7fa06c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:41.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa07221d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c100e20 0x7fa06c198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36134/0 (socket says 172.21.15.103:36134) 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa07221d640 1 -- 172.21.15.103:0/174699988 learned_addr learned my addr 172.21.15.103:0/174699988 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa071a1c640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa06c102570 0x7fa06c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa072a1e640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa06c102ef0 0x7fa06c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa07221d640 1 -- 172.21.15.103:0/174699988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa06c102ef0 msgr2=0x7fa06c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa07221d640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa06c102ef0 0x7fa06c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa07221d640 1 -- 172.21.15.103:0/174699988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa06c102570 msgr2=0x7fa06c1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa07221d640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa06c102570 0x7fa06c1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa07221d640 1 -- 172.21.15.103:0/174699988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c19d330 con 0x7fa06c100e20 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa072a1e640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa06c102ef0 0x7fa06c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa07221d640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c100e20 0x7fa06c198380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00db80 tx=0x7fa05c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:41.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa06b7fe640 1 -- 172.21.15.103:0/174699988 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c017070 con 0x7fa06c100e20 2024-09-19T06:05:41.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa074481640 1 -- 172.21.15.103:0/174699988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06c19d620 con 0x7fa06c100e20 2024-09-19T06:05:41.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa06b7fe640 1 -- 172.21.15.103:0/174699988 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa05c003b70 con 0x7fa06c100e20 2024-09-19T06:05:41.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa06b7fe640 1 -- 172.21.15.103:0/174699988 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0104c0 con 0x7fa06c100e20 2024-09-19T06:05:41.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.450+0000 7fa074481640 1 -- 172.21.15.103:0/174699988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06c1a4f00 con 0x7fa06c100e20 2024-09-19T06:05:41.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.451+0000 7fa074481640 1 -- 172.21.15.103:0/174699988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa06c101200 con 0x7fa06c100e20 2024-09-19T06:05:41.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.452+0000 7fa06b7fe640 1 -- 172.21.15.103:0/174699988 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fa05c004020 con 0x7fa06c100e20 2024-09-19T06:05:41.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.453+0000 7fa06b7fe640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa0540a32d0 0x7fa0540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:41.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.453+0000 7fa071a1c640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa0540a32d0 0x7fa0540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:41.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.453+0000 7fa06b7fe640 1 -- 172.21.15.103:0/174699988 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fa05c0cfb30 con 0x7fa06c100e20 2024-09-19T06:05:41.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.454+0000 7fa071a1c640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa0540a32d0 0x7fa0540a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa060000c00 tx=0x7fa060005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:41.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.458+0000 7fa06b7fe640 1 -- 172.21.15.103:0/174699988 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa05c09c7a0 con 0x7fa06c100e20 2024-09-19T06:05:41.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.653+0000 7fa074481640 1 -- 172.21.15.103:0/174699988 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fa06c106fb0 con 0x7fa0540a32d0 2024-09-19T06:05:41.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.658+0000 7fa06b7fe640 1 -- 172.21.15.103:0/174699988 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa06c106fb0 con 0x7fa0540a32d0 2024-09-19T06:05:41.660 INFO:teuthology.orchestra.run.smithi103.stdout:/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071 2024-09-19T06:05:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 -- 172.21.15.103:0/174699988 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa0540a32d0 msgr2=0x7fa0540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa0540a32d0 0x7fa0540a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa060000c00 tx=0x7fa060005e80 comp rx=0 tx=0).stop 2024-09-19T06:05:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 -- 172.21.15.103:0/174699988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c100e20 msgr2=0x7fa06c198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c100e20 0x7fa06c198380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00db80 tx=0x7fa05c00b630 comp rx=0 tx=0).stop 2024-09-19T06:05:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 -- 172.21.15.103:0/174699988 shutdown_connections 2024-09-19T06:05:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa0540a32d0 0x7fa0540a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa06c102ef0 0x7fa06c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa06c102570 0x7fa06c1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 --2- 172.21.15.103:0/174699988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c100e20 0x7fa06c198380 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 -- 172.21.15.103:0/174699988 >> 172.21.15.103:0/174699988 conn(0x7fa06c0fc7d0 msgr2=0x7fa06c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 -- 172.21.15.103:0/174699988 shutdown_connections 2024-09-19T06:05:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:41.660+0000 7fa074481640 1 -- 172.21.15.103:0/174699988 wait complete. 2024-09-19T06:05:41.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:41 smithi103 ceph-mon[30925]: pgmap v276: 97 pgs: 97 active+clean; 606 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-09-19T06:05:41.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:41 smithi103 ceph-mon[30925]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:42.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:41 smithi174 ceph-mon[34488]: pgmap v276: 97 pgs: 97 active+clean; 606 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-09-19T06:05:42.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:41 smithi174 ceph-mon[34488]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:42.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:41 smithi169 ceph-mon[34350]: pgmap v276: 97 pgs: 97 active+clean; 606 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-09-19T06:05:42.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:41 smithi169 ceph-mon[34350]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:42.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T06:05:42.623 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:43.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.123+0000 7f398ac38640 1 -- 172.21.15.103:0/4253794644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3984100a70 msgr2=0x7f398410ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:43.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.123+0000 7f398ac38640 1 --2- 172.21.15.103:0/4253794644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3984100a70 0x7f398410ea60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f397c009ca0 tx=0x7f397c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.123+0000 7f398ac38640 1 -- 172.21.15.103:0/4253794644 shutdown_connections 2024-09-19T06:05:43.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.123+0000 7f398ac38640 1 --2- 172.21.15.103:0/4253794644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3984100a70 0x7f398410ea60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.123+0000 7f398ac38640 1 --2- 172.21.15.103:0/4253794644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39841000d0 0x7f3984100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.123+0000 7f398ac38640 1 --2- 172.21.15.103:0/4253794644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3984106ba0 0x7f3984106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.123+0000 7f398ac38640 1 -- 172.21.15.103:0/4253794644 >> 172.21.15.103:0/4253794644 conn(0x7f3984077210 msgr2=0x7f39840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:43.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.123+0000 7f398ac38640 1 -- 172.21.15.103:0/4253794644 shutdown_connections 2024-09-19T06:05:43.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.123+0000 7f398ac38640 1 -- 172.21.15.103:0/4253794644 wait complete. 2024-09-19T06:05:43.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f398ac38640 1 Processor -- start 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f398ac38640 1 -- start start 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f398ac38640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39841000d0 0x7f39841012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f398ac38640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3984100a70 0x7f39841017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f398ac38640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3984106ba0 0x7f3984101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f398ac38640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3984111fe0 con 0x7f3984106ba0 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f398ac38640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3984111e60 con 0x7f3984100a70 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f398ac38640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3984112160 con 0x7f39841000d0 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39891d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3984106ba0 0x7f3984101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39891d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3984106ba0 0x7f3984101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36138/0 (socket says 172.21.15.103:36138) 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39891d5640 1 -- 172.21.15.103:0/3143621429 learned_addr learned my addr 172.21.15.103:0/3143621429 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39889d4640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39841000d0 0x7f39841012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:43.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39891d5640 1 -- 172.21.15.103:0/3143621429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39841000d0 msgr2=0x7f39841012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39891d5640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39841000d0 0x7f39841012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39891d5640 1 -- 172.21.15.103:0/3143621429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3984100a70 msgr2=0x7f39841017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f3983fff640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3984100a70 0x7f39841017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39891d5640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3984100a70 0x7f39841017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39891d5640 1 -- 172.21.15.103:0/3143621429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39841a6a00 con 0x7f3984106ba0 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39889d4640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39841000d0 0x7f39841012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.124+0000 7f39891d5640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3984106ba0 0x7f3984101d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f397c009dc0 tx=0x7f397c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.125+0000 7f3981ffb640 1 -- 172.21.15.103:0/3143621429 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c004040 con 0x7f3984106ba0 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.125+0000 7f3981ffb640 1 -- 172.21.15.103:0/3143621429 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f397c004690 con 0x7f3984106ba0 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.125+0000 7f398ac38640 1 -- 172.21.15.103:0/3143621429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39841a6c90 con 0x7f3984106ba0 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.125+0000 7f3981ffb640 1 -- 172.21.15.103:0/3143621429 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c02f4c0 con 0x7f3984106ba0 2024-09-19T06:05:43.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.125+0000 7f398ac38640 1 -- 172.21.15.103:0/3143621429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39841a7220 con 0x7f3984106ba0 2024-09-19T06:05:43.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.126+0000 7f398ac38640 1 -- 172.21.15.103:0/3143621429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3984100530 con 0x7f3984106ba0 2024-09-19T06:05:43.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.127+0000 7f3981ffb640 1 -- 172.21.15.103:0/3143621429 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f397c0305c0 con 0x7f3984106ba0 2024-09-19T06:05:43.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.128+0000 7f3981ffb640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f39740a3350 0x7f39740a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:43.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.128+0000 7f39889d4640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f39740a3350 0x7f39740a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:43.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.128+0000 7f3981ffb640 1 -- 172.21.15.103:0/3143621429 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f397c0f11c0 con 0x7f3984106ba0 2024-09-19T06:05:43.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.128+0000 7f39889d4640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f39740a3350 0x7f39740a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3978006fd0 tx=0x7f3978008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:43.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.132+0000 7f3981ffb640 1 -- 172.21.15.103:0/3143621429 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f397c0be040 con 0x7f3984106ba0 2024-09-19T06:05:43.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.323+0000 7f398ac38640 1 -- 172.21.15.103:0/3143621429 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3984062630 con 0x7f39740a3350 2024-09-19T06:05:43.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.347+0000 7f3981ffb640 1 -- 172.21.15.103:0/3143621429 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3984062630 con 0x7f39740a3350 2024-09-19T06:05:43.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 -- 172.21.15.103:0/3143621429 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f39740a3350 msgr2=0x7f39740a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:43.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f39740a3350 0x7f39740a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3978006fd0 tx=0x7f3978008040 comp rx=0 tx=0).stop 2024-09-19T06:05:43.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 -- 172.21.15.103:0/3143621429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3984106ba0 msgr2=0x7f3984101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:43.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3984106ba0 0x7f3984101d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f397c009dc0 tx=0x7f397c003ba0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 -- 172.21.15.103:0/3143621429 shutdown_connections 2024-09-19T06:05:43.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f39740a3350 0x7f39740a5810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3984106ba0 0x7f3984101d30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3984100a70 0x7f39841017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 --2- 172.21.15.103:0/3143621429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39841000d0 0x7f39841012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 -- 172.21.15.103:0/3143621429 >> 172.21.15.103:0/3143621429 conn(0x7f3984077210 msgr2=0x7f3984104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:43.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 -- 172.21.15.103:0/3143621429 shutdown_connections 2024-09-19T06:05:43.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:43.349+0000 7f398ac38640 1 -- 172.21.15.103:0/3143621429 wait complete. 2024-09-19T06:05:43.992 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T06:05:44.239 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:44.658 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:44 smithi103 ceph-mon[30925]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:44.658 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:44 smithi103 ceph-mon[30925]: pgmap v277: 97 pgs: 97 active+clean; 606 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T06:05:44.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 -- 172.21.15.103:0/746184677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc10c170 msgr2=0x7faafc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 --2- 172.21.15.103:0/746184677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc10c170 0x7faafc10e610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faaf4009ca0 tx=0x7faaf402a950 comp rx=0 tx=0).stop 2024-09-19T06:05:44.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 -- 172.21.15.103:0/746184677 shutdown_connections 2024-09-19T06:05:44.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 --2- 172.21.15.103:0/746184677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc10c170 0x7faafc10e610 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 --2- 172.21.15.103:0/746184677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faafc103660 0x7faafc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 --2- 172.21.15.103:0/746184677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faafc102d40 0x7faafc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 -- 172.21.15.103:0/746184677 >> 172.21.15.103:0/746184677 conn(0x7faafc0fc7a0 msgr2=0x7faafc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 -- 172.21.15.103:0/746184677 shutdown_connections 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 -- 172.21.15.103:0/746184677 wait complete. 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 Processor -- start 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.739+0000 7fab020fc640 1 -- start start 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7fab020fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faafc102d40 0x7faafc1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7fab020fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faafc103660 0x7faafc100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7fab020fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc10c170 0x7faafc101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7fab020fc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faafc111e20 con 0x7faafc10c170 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7fab020fc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faafc111ca0 con 0x7faafc103660 2024-09-19T06:05:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7fab020fc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faafc111fa0 con 0x7faafc102d40 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc10c170 0x7faafc101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc10c170 0x7faafc101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36150/0 (socket says 172.21.15.103:36150) 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafbfff640 1 -- 172.21.15.103:0/4267065663 learned_addr learned my addr 172.21.15.103:0/4267065663 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faaf2ffd640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faafc103660 0x7faafc100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafb7fe640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faafc102d40 0x7faafc1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafbfff640 1 -- 172.21.15.103:0/4267065663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faafc102d40 msgr2=0x7faafc1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafbfff640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faafc102d40 0x7faafc1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafbfff640 1 -- 172.21.15.103:0/4267065663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faafc103660 msgr2=0x7faafc100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafbfff640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faafc103660 0x7faafc100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafbfff640 1 -- 172.21.15.103:0/4267065663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc1a67c0 con 0x7faafc10c170 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafb7fe640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faafc102d40 0x7faafc1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.740+0000 7faafbfff640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc10c170 0x7faafc101420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faaf402ae70 tx=0x7faaf402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:44.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.741+0000 7faaf97fa640 1 -- 172.21.15.103:0/4267065663 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4034040 con 0x7faafc10c170 2024-09-19T06:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.741+0000 7fab020fc640 1 -- 172.21.15.103:0/4267065663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faafc1a6a50 con 0x7faafc10c170 2024-09-19T06:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.741+0000 7faaf97fa640 1 -- 172.21.15.103:0/4267065663 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faaf40308f0 con 0x7faafc10c170 2024-09-19T06:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.741+0000 7faaf97fa640 1 -- 172.21.15.103:0/4267065663 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf40047f0 con 0x7faafc10c170 2024-09-19T06:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.741+0000 7fab020fc640 1 -- 172.21.15.103:0/4267065663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faafc1a6f30 con 0x7faafc10c170 2024-09-19T06:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.742+0000 7fab020fc640 1 -- 172.21.15.103:0/4267065663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faafc103120 con 0x7faafc10c170 2024-09-19T06:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.743+0000 7faaf97fa640 1 -- 172.21.15.103:0/4267065663 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7faaf4037020 con 0x7faafc10c170 2024-09-19T06:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.743+0000 7faaf97fa640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faae80a32d0 0x7faae80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.744+0000 7faafb7fe640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faae80a32d0 0x7faae80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.744+0000 7faaf97fa640 1 -- 172.21.15.103:0/4267065663 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7faaf40f07d0 con 0x7faafc10c170 2024-09-19T06:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.744+0000 7faafb7fe640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faae80a32d0 0x7faae80a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faaec0058c0 tx=0x7faaec005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:44.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.747+0000 7faaf97fa640 1 -- 172.21.15.103:0/4267065663 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faaf40bd650 con 0x7faafc10c170 2024-09-19T06:05:44.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:44 smithi169 ceph-mon[34350]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:44.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:44 smithi169 ceph-mon[34350]: pgmap v277: 97 pgs: 97 active+clean; 606 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T06:05:44.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.942+0000 7fab020fc640 1 -- 172.21.15.103:0/4267065663 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7faafc062630 con 0x7faae80a32d0 2024-09-19T06:05:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.947+0000 7faaf97fa640 1 -- 172.21.15.103:0/4267065663 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7faafc062630 con 0x7faae80a32d0 2024-09-19T06:05:44.949 INFO:teuthology.orchestra.run.smithi103.stdout:/volumes/qa/sv_1/d75958be-1c7e-418b-bb05-92d2cc9c4bd3 2024-09-19T06:05:44.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 -- 172.21.15.103:0/4267065663 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faae80a32d0 msgr2=0x7faae80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faae80a32d0 0x7faae80a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faaec0058c0 tx=0x7faaec005850 comp rx=0 tx=0).stop 2024-09-19T06:05:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 -- 172.21.15.103:0/4267065663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc10c170 msgr2=0x7faafc101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc10c170 0x7faafc101420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faaf402ae70 tx=0x7faaf402f5d0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 -- 172.21.15.103:0/4267065663 shutdown_connections 2024-09-19T06:05:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faae80a32d0 0x7faae80a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc10c170 0x7faafc101420 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faafc103660 0x7faafc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 --2- 172.21.15.103:0/4267065663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faafc102d40 0x7faafc1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 -- 172.21.15.103:0/4267065663 >> 172.21.15.103:0/4267065663 conn(0x7faafc0fc7a0 msgr2=0x7faafc0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 -- 172.21.15.103:0/4267065663 shutdown_connections 2024-09-19T06:05:44.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:44.949+0000 7fab020fc640 1 -- 172.21.15.103:0/4267065663 wait complete. 2024-09-19T06:05:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:44 smithi174 ceph-mon[34488]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:44.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:44 smithi174 ceph-mon[34488]: pgmap v277: 97 pgs: 97 active+clean; 606 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T06:05:45.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T06:05:45.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T06:05:45.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T06:05:45.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T06:05:45.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-19T06:05:45.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-19T06:05:45.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:45 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T06:05:45.648 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:05:45.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T06:05:45.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T06:05:45.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T06:05:45.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T06:05:45.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-19T06:05:45.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-19T06:05:45.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:45 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T06:05:45.892 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T06:05:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T06:05:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T06:05:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T06:05:45.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-19T06:05:45.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-19T06:05:45.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:45 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T06:05:46.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.326+0000 7f1b70720640 1 -- 172.21.15.103:0/498164936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b68102ef0 msgr2=0x7f1b6810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.326+0000 7f1b70720640 1 --2- 172.21.15.103:0/498164936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b68102ef0 0x7f1b6810da40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009900 tx=0x7f1b5802a480 comp rx=0 tx=0).stop 2024-09-19T06:05:46.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.326+0000 7f1b70720640 1 -- 172.21.15.103:0/498164936 shutdown_connections 2024-09-19T06:05:46.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.326+0000 7f1b70720640 1 --2- 172.21.15.103:0/498164936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b68102ef0 0x7f1b6810da40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.326+0000 7f1b70720640 1 --2- 172.21.15.103:0/498164936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b68102570 0x7f1b681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.326+0000 7f1b70720640 1 --2- 172.21.15.103:0/498164936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b68100e20 0x7f1b68101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.326+0000 7f1b70720640 1 -- 172.21.15.103:0/498164936 >> 172.21.15.103:0/498164936 conn(0x7f1b680fc7d0 msgr2=0x7f1b680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.326+0000 7f1b70720640 1 -- 172.21.15.103:0/498164936 shutdown_connections 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.326+0000 7f1b70720640 1 -- 172.21.15.103:0/498164936 wait complete. 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b70720640 1 Processor -- start 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b70720640 1 -- start start 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b70720640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b68100e20 0x7f1b68198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b70720640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b68102570 0x7f1b681988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b70720640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b68102ef0 0x7f1b6819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b70720640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68110e30 con 0x7f1b68102570 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b70720640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68110cb0 con 0x7f1b68100e20 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b70720640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68110fb0 con 0x7f1b68102ef0 2024-09-19T06:05:46.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b6dcbb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b68102570 0x7f1b681988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b6dcbb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b68102570 0x7f1b681988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36170/0 (socket says 172.21.15.103:36170) 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b6dcbb640 1 -- 172.21.15.103:0/2468916684 learned_addr learned my addr 172.21.15.103:0/2468916684 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b6e4bc640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b68100e20 0x7f1b68198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b6ecbd640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b68102ef0 0x7f1b6819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b6dcbb640 1 -- 172.21.15.103:0/2468916684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b68102ef0 msgr2=0x7f1b6819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b6dcbb640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b68102ef0 0x7f1b6819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b6dcbb640 1 -- 172.21.15.103:0/2468916684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b68100e20 msgr2=0x7f1b68198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b6dcbb640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b68100e20 0x7f1b68198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.327+0000 7f1b6dcbb640 1 -- 172.21.15.103:0/2468916684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6819d330 con 0x7f1b68102570 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.328+0000 7f1b6dcbb640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b68102570 0x7f1b681988c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00db80 tx=0x7f1b5c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.328+0000 7f1b677fe640 1 -- 172.21.15.103:0/2468916684 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c017070 con 0x7f1b68102570 2024-09-19T06:05:46.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.328+0000 7f1b677fe640 1 -- 172.21.15.103:0/2468916684 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b5c003b70 con 0x7f1b68102570 2024-09-19T06:05:46.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.328+0000 7f1b677fe640 1 -- 172.21.15.103:0/2468916684 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0104c0 con 0x7f1b68102570 2024-09-19T06:05:46.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.328+0000 7f1b70720640 1 -- 172.21.15.103:0/2468916684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6819d620 con 0x7f1b68102570 2024-09-19T06:05:46.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.328+0000 7f1b70720640 1 -- 172.21.15.103:0/2468916684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b681a4f00 con 0x7f1b68102570 2024-09-19T06:05:46.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.329+0000 7f1b70720640 1 -- 172.21.15.103:0/2468916684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b68101200 con 0x7f1b68102570 2024-09-19T06:05:46.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.330+0000 7f1b677fe640 1 -- 172.21.15.103:0/2468916684 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f1b5c004020 con 0x7f1b68102570 2024-09-19T06:05:46.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.331+0000 7f1b677fe640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1b500a3350 0x7f1b500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.331+0000 7f1b6e4bc640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1b500a3350 0x7f1b500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:46.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.331+0000 7f1b677fe640 1 -- 172.21.15.103:0/2468916684 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8182+0+0 (secure 0 0 0) 0x7f1b5c0cfb50 con 0x7f1b68102570 2024-09-19T06:05:46.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.331+0000 7f1b6e4bc640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1b500a3350 0x7f1b500a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b60005fd0 tx=0x7f1b60005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:46.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.335+0000 7f1b677fe640 1 -- 172.21.15.103:0/2468916684 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b5c0212a0 con 0x7f1b68102570 2024-09-19T06:05:46.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.544+0000 7f1b70720640 1 -- 172.21.15.103:0/2468916684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b6810a0a0 con 0x7f1b68102570 2024-09-19T06:05:46.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.545+0000 7f1b677fe640 1 -- 172.21.15.103:0/2468916684 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11933 (secure 0 0 0) 0x7f1b5c09c740 con 0x7f1b68102570 2024-09-19T06:05:46.548 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:46.548 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"btime":"2024-09-19T06:05:36:880542+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:05:36.431382+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24463,24475,24488]},"id":1}]} 2024-09-19T06:05:46.549 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 24 2024-09-19T06:05:46.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.547+0000 7f1b70720640 1 -- 172.21.15.103:0/2468916684 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1b500a3350 msgr2=0x7f1b500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1b500a3350 0x7f1b500a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b60005fd0 tx=0x7f1b60005850 comp rx=0 tx=0).stop 2024-09-19T06:05:46.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 -- 172.21.15.103:0/2468916684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b68102570 msgr2=0x7f1b681988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b68102570 0x7f1b681988c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00db80 tx=0x7f1b5c00b630 comp rx=0 tx=0).stop 2024-09-19T06:05:46.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 -- 172.21.15.103:0/2468916684 shutdown_connections 2024-09-19T06:05:46.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1b500a3350 0x7f1b500a5810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b68102ef0 0x7f1b6819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b68102570 0x7f1b681988c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 --2- 172.21.15.103:0/2468916684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b68100e20 0x7f1b68198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 -- 172.21.15.103:0/2468916684 >> 172.21.15.103:0/2468916684 conn(0x7f1b680fc7d0 msgr2=0x7f1b6806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:46.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 -- 172.21.15.103:0/2468916684 shutdown_connections 2024-09-19T06:05:46.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:46.548+0000 7f1b70720640 1 -- 172.21.15.103:0/2468916684 wait complete. 2024-09-19T06:05:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:46 smithi103 ceph-mon[30925]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:46 smithi103 ceph-mon[30925]: pgmap v278: 97 pgs: 97 active+clean; 606 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T06:05:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T06:05:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T06:05:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T06:05:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T06:05:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-19T06:05:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-19T06:05:46.584 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:46 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T06:05:46.584 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:46 smithi103 ceph-mon[30925]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:05:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:46 smithi169 ceph-mon[34350]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:46 smithi169 ceph-mon[34350]: pgmap v278: 97 pgs: 97 active+clean; 606 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T06:05:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T06:05:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T06:05:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T06:05:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T06:05:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-19T06:05:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-19T06:05:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:46 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T06:05:46.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:46 smithi169 ceph-mon[34350]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:05:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:46 smithi174 ceph-mon[34488]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:46 smithi174 ceph-mon[34488]: pgmap v278: 97 pgs: 97 active+clean; 606 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T06:05:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T06:05:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T06:05:46.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T06:05:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T06:05:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-19T06:05:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-19T06:05:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:46 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T06:05:46.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:46 smithi174 ceph-mon[34488]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:05:47.262 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:05:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:47.821 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:47 smithi103 ceph-mon[30925]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:05:47.822 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:47 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2468916684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:47 smithi174 ceph-mon[34488]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:05:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:47 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2468916684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:48.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:47 smithi169 ceph-mon[34350]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:05:48.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:47 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2468916684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.043+0000 7f32fd868640 1 -- 172.21.15.103:0/792861666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8101240 msgr2=0x7f32f8101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.043+0000 7f32fd868640 1 --2- 172.21.15.103:0/792861666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8101240 0x7f32f8101680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009900 tx=0x7f32e802a410 comp rx=0 tx=0).stop 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.043+0000 7f32fd868640 1 -- 172.21.15.103:0/792861666 shutdown_connections 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.043+0000 7f32fd868640 1 --2- 172.21.15.103:0/792861666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f8101bc0 0x7f32f810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.043+0000 7f32fd868640 1 --2- 172.21.15.103:0/792861666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8101240 0x7f32f8101680 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.043+0000 7f32fd868640 1 --2- 172.21.15.103:0/792861666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32f8105a90 0x7f32f8105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.043+0000 7f32fd868640 1 -- 172.21.15.103:0/792861666 >> 172.21.15.103:0/792861666 conn(0x7f32f8077210 msgr2=0x7f32f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.043+0000 7f32fd868640 1 -- 172.21.15.103:0/792861666 shutdown_connections 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.043+0000 7f32fd868640 1 -- 172.21.15.103:0/792861666 wait complete. 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.044+0000 7f32fd868640 1 Processor -- start 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.044+0000 7f32fd868640 1 -- start start 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.044+0000 7f32fd868640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f8101240 0x7f32f8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.044+0000 7f32fd868640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8101bc0 0x7f32f8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.044+0000 7f32fd868640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32f8105a90 0x7f32f819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.044+0000 7f32fd868640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8110ee0 con 0x7f32f8101bc0 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.044+0000 7f32fd868640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8110d60 con 0x7f32f8101240 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.044+0000 7f32fd868640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8111060 con 0x7f32f8105a90 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32f67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8101bc0 0x7f32f8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32f67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8101bc0 0x7f32f8198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36184/0 (socket says 172.21.15.103:36184) 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32f67fc640 1 -- 172.21.15.103:0/2180869101 learned_addr learned my addr 172.21.15.103:0/2180869101 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32f6ffd640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f8101240 0x7f32f8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32f67fc640 1 -- 172.21.15.103:0/2180869101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32f8105a90 msgr2=0x7f32f819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32f67fc640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32f8105a90 0x7f32f819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32f67fc640 1 -- 172.21.15.103:0/2180869101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f8101240 msgr2=0x7f32f8198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32f67fc640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f8101240 0x7f32f8198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32f67fc640 1 -- 172.21.15.103:0/2180869101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f819d4c0 con 0x7f32f8101bc0 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32f67fc640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8101bc0 0x7f32f8198a50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32e8006010 tx=0x7f32e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32fc866640 1 -- 172.21.15.103:0/2180869101 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e803f070 con 0x7f32f8101bc0 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32fc866640 1 -- 172.21.15.103:0/2180869101 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f32e8003aa0 con 0x7f32f8101bc0 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32fd868640 1 -- 172.21.15.103:0/2180869101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f819d750 con 0x7f32f8101bc0 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32fc866640 1 -- 172.21.15.103:0/2180869101 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8035030 con 0x7f32f8101bc0 2024-09-19T06:05:48.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.045+0000 7f32fd868640 1 -- 172.21.15.103:0/2180869101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f81a5090 con 0x7f32f8101bc0 2024-09-19T06:05:48.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.046+0000 7f32fd868640 1 -- 172.21.15.103:0/2180869101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f8101680 con 0x7f32f8101bc0 2024-09-19T06:05:48.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.047+0000 7f32fc866640 1 -- 172.21.15.103:0/2180869101 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f32e8042070 con 0x7f32f8101bc0 2024-09-19T06:05:48.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.048+0000 7f32fc866640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32e00a3350 0x7f32e00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.048+0000 7f32f6ffd640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32e00a3350 0x7f32e00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.048+0000 7f32fc866640 1 -- 172.21.15.103:0/2180869101 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f32e80f0490 con 0x7f32f8101bc0 2024-09-19T06:05:48.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.048+0000 7f32f6ffd640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32e00a3350 0x7f32e00a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009f20 tx=0x7f32ec0094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:48.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.052+0000 7f32fc866640 1 -- 172.21.15.103:0/2180869101 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f32e80bd080 con 0x7f32f8101bc0 2024-09-19T06:05:48.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.219+0000 7f32fd868640 1 -- 172.21.15.103:0/2180869101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32f81a5260 con 0x7f32f8101bc0 2024-09-19T06:05:48.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.221+0000 7f32fc866640 1 -- 172.21.15.103:0/2180869101 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22681 (secure 0 0 0) 0x7f32e80bc980 con 0x7f32f8101bc0 2024-09-19T06:05:48.223 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:48.224 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:05:46.513696+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:05:21.617020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:05:23.597579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 -- 172.21.15.103:0/2180869101 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32e00a3350 msgr2=0x7f32e00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32e00a3350 0x7f32e00a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009f20 tx=0x7f32ec0094f0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 -- 172.21.15.103:0/2180869101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8101bc0 msgr2=0x7f32f8198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8101bc0 0x7f32f8198a50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32e8006010 tx=0x7f32e80042f0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 -- 172.21.15.103:0/2180869101 shutdown_connections 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f32e00a3350 0x7f32e00a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32f8105a90 0x7f32f819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8101bc0 0x7f32f8198a50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 --2- 172.21.15.103:0/2180869101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f8101240 0x7f32f8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 -- 172.21.15.103:0/2180869101 >> 172.21.15.103:0/2180869101 conn(0x7f32f8077210 msgr2=0x7f32f81042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 -- 172.21.15.103:0/2180869101 shutdown_connections 2024-09-19T06:05:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:48.223+0000 7f32fd868640 1 -- 172.21.15.103:0/2180869101 wait complete. 2024-09-19T06:05:48.837 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:48 smithi103 ceph-mon[30925]: pgmap v281: 97 pgs: 1 active+recovery_wait+degraded, 1 activating, 2 peering, 1 active+recovering, 92 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.0 KiB/s wr, 10 op/s; 1/189 objects degraded (0.529%); 4/189 objects misplaced (2.116%) 2024-09-19T06:05:48.837 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:48 smithi103 ceph-mon[30925]: Health check failed: Degraded data redundancy: 1/189 objects degraded (0.529%), 1 pg degraded (PG_DEGRADED) 2024-09-19T06:05:48.837 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:48 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2180869101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:48.868 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:05:48.868 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:05:48.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:48 smithi174 ceph-mon[34488]: pgmap v281: 97 pgs: 1 active+recovery_wait+degraded, 1 activating, 2 peering, 1 active+recovering, 92 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.0 KiB/s wr, 10 op/s; 1/189 objects degraded (0.529%); 4/189 objects misplaced (2.116%) 2024-09-19T06:05:48.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:48 smithi174 ceph-mon[34488]: Health check failed: Degraded data redundancy: 1/189 objects degraded (0.529%), 1 pg degraded (PG_DEGRADED) 2024-09-19T06:05:48.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:48 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2180869101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:49.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:48 smithi169 ceph-mon[34350]: pgmap v281: 97 pgs: 1 active+recovery_wait+degraded, 1 activating, 2 peering, 1 active+recovering, 92 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.0 KiB/s wr, 10 op/s; 1/189 objects degraded (0.529%); 4/189 objects misplaced (2.116%) 2024-09-19T06:05:49.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:48 smithi169 ceph-mon[34350]: Health check failed: Degraded data redundancy: 1/189 objects degraded (0.529%), 1 pg degraded (PG_DEGRADED) 2024-09-19T06:05:49.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:48 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2180869101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:49.118 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 -- 172.21.15.103:0/3550403387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80a4100a80 msgr2=0x7f80a4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 --2- 172.21.15.103:0/3550403387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80a4100a80 0x7f80a4100ee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8098009cd0 tx=0x7f809802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 -- 172.21.15.103:0/3550403387 shutdown_connections 2024-09-19T06:05:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 --2- 172.21.15.103:0/3550403387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80a4101420 0x7f80a410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 --2- 172.21.15.103:0/3550403387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80a4100a80 0x7f80a4100ee0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 --2- 172.21.15.103:0/3550403387 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80a4106a80 0x7f80a4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 -- 172.21.15.103:0/3550403387 >> 172.21.15.103:0/3550403387 conn(0x7f80a40fc7a0 msgr2=0x7f80a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 -- 172.21.15.103:0/3550403387 shutdown_connections 2024-09-19T06:05:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 -- 172.21.15.103:0/3550403387 wait complete. 2024-09-19T06:05:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 Processor -- start 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.560+0000 7f80abff3640 1 -- start start 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80abff3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80a4100a80 0x7f80a4197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80abff3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80a4101420 0x7f80a4197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80abff3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80a4106a80 0x7f80a419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80abff3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4110dd0 con 0x7f80a4106a80 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80abff3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4110c50 con 0x7f80a4100a80 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80abff3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4110f50 con 0x7f80a4101420 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80aa590640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80a4106a80 0x7f80a419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80aa590640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80a4106a80 0x7f80a419bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36202/0 (socket says 172.21.15.103:36202) 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80aa590640 1 -- 172.21.15.103:0/3138392854 learned_addr learned my addr 172.21.15.103:0/3138392854 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80a9d8f640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80a4100a80 0x7f80a4197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80a958e640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80a4101420 0x7f80a4197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80aa590640 1 -- 172.21.15.103:0/3138392854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80a4101420 msgr2=0x7f80a4197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80aa590640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80a4101420 0x7f80a4197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80aa590640 1 -- 172.21.15.103:0/3138392854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80a4100a80 msgr2=0x7f80a4197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80aa590640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80a4100a80 0x7f80a4197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80aa590640 1 -- 172.21.15.103:0/3138392854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a419c3e0 con 0x7f80a4106a80 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80a9d8f640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80a4100a80 0x7f80a4197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80a958e640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80a4101420 0x7f80a4197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80aa590640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80a4106a80 0x7f80a419bd00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f809400d960 tx=0x7f809400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80a2ffd640 1 -- 172.21.15.103:0/3138392854 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809401b070 con 0x7f80a4106a80 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80abff3640 1 -- 172.21.15.103:0/3138392854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a419c6d0 con 0x7f80a4106a80 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80a2ffd640 1 -- 172.21.15.103:0/3138392854 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f809400ed60 con 0x7f80a4106a80 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80a2ffd640 1 -- 172.21.15.103:0/3138392854 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8094014700 con 0x7f80a4106a80 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.561+0000 7f80abff3640 1 -- 172.21.15.103:0/3138392854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a406a790 con 0x7f80a4106a80 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.562+0000 7f80abff3640 1 -- 172.21.15.103:0/3138392854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a41021c0 con 0x7f80a4106a80 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.563+0000 7f80a2ffd640 1 -- 172.21.15.103:0/3138392854 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f809401e070 con 0x7f80a4106a80 2024-09-19T06:05:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.564+0000 7f80a2ffd640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f808c0a32d0 0x7f808c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.564+0000 7f80a9d8f640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f808c0a32d0 0x7f808c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.564+0000 7f80a2ffd640 1 -- 172.21.15.103:0/3138392854 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f80940d1140 con 0x7f80a4106a80 2024-09-19T06:05:49.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.564+0000 7f80a9d8f640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f808c0a32d0 0x7f808c0a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f809c009930 tx=0x7f809c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:49.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.568+0000 7f80a2ffd640 1 -- 172.21.15.103:0/3138392854 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f809409de40 con 0x7f80a4106a80 2024-09-19T06:05:49.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.735+0000 7f80abff3640 1 -- 172.21.15.103:0/3138392854 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80a406b280 con 0x7f808c0a32d0 2024-09-19T06:05:49.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.742+0000 7f80a2ffd640 1 -- 172.21.15.103:0/3138392854 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258637 (secure 0 0 0) 0x7f80a406b280 con 0x7f808c0a32d0 2024-09-19T06:05:49.747 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:49.748 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T06:05:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 -- 172.21.15.103:0/3138392854 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f808c0a32d0 msgr2=0x7f808c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f808c0a32d0 0x7f808c0a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f809c009930 tx=0x7f809c008040 comp rx=0 tx=0).stop 2024-09-19T06:05:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 -- 172.21.15.103:0/3138392854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80a4106a80 msgr2=0x7f80a419bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80a4106a80 0x7f80a419bd00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f809400d960 tx=0x7f809400de20 comp rx=0 tx=0).stop 2024-09-19T06:05:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 -- 172.21.15.103:0/3138392854 shutdown_connections 2024-09-19T06:05:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f808c0a32d0 0x7f808c0a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80a4106a80 0x7f80a419bd00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80a4101420 0x7f80a4197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 --2- 172.21.15.103:0/3138392854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80a4100a80 0x7f80a4197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 -- 172.21.15.103:0/3138392854 >> 172.21.15.103:0/3138392854 conn(0x7f80a40fc7a0 msgr2=0x7f80a40fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:49.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 -- 172.21.15.103:0/3138392854 shutdown_connections 2024-09-19T06:05:49.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:49.746+0000 7f80abff3640 1 -- 172.21.15.103:0/3138392854 wait complete. 2024-09-19T06:05:50.542 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-19T06:05:49.455683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644324,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":5,"num_objects_missing":5,"num_objects_degraded":1,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":225,"num_read_kb":211,"num_write":334,"num_write_kb":3035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361472,"kb_used_data":12176,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580352,"statfs":{"total":1151940427776,"available":1151570280448,"internally_reserved":0,"allocated":12468224,"data_stored":6958413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23282,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":5,"num_objects_missing":5,"num_objects_degraded":1,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":48,"num_write":19,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002052"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518052+0000","last_change":"2024-09-19T06:05:24.703290+0000","last_active":"2024-09-19T06:05:46.518052+0000","last_peered":"2024-09-19T06:05:46.518052+0000","last_clean":"2024-09-19T06:05:46.518052+0000","last_became_active":"2024-09-19T06:05:24.702343+0000","last_became_peered":"2024-09-19T06:05:24.702343+0000","last_unstale":"2024-09-19T06:05:46.518052+0000","last_undegraded":"2024-09-19T06:05:46.518052+0000","last_fullsized":"2024-09-19T06:05:46.518052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.594004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595886+0000","last_change":"2024-09-19T06:05:24.700363+0000","last_active":"2024-09-19T06:05:25.595886+0000","last_peered":"2024-09-19T06:05:25.595886+0000","last_clean":"2024-09-19T06:05:25.595886+0000","last_became_active":"2024-09-19T06:05:24.700066+0000","last_became_peered":"2024-09-19T06:05:24.700066+0000","last_unstale":"2024-09-19T06:05:25.595886+0000","last_undegraded":"2024-09-19T06:05:25.595886+0000","last_fullsized":"2024-09-19T06:05:25.595886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:26.094195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595896+0000","last_change":"2024-09-19T06:05:24.702458+0000","last_active":"2024-09-19T06:05:25.595896+0000","last_peered":"2024-09-19T06:05:25.595896+0000","last_clean":"2024-09-19T06:05:25.595896+0000","last_became_active":"2024-09-19T06:05:24.702029+0000","last_became_peered":"2024-09-19T06:05:24.702029+0000","last_unstale":"2024-09-19T06:05:25.595896+0000","last_undegraded":"2024-09-19T06:05:25.595896+0000","last_fullsized":"2024-09-19T06:05:25.595896+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519250+0000","last_change":"2024-09-19T06:05:24.699402+0000","last_active":"2024-09-19T06:05:45.519250+0000","last_peered":"2024-09-19T06:05:45.519250+0000","last_clean":"2024-09-19T06:05:45.519250+0000","last_became_active":"2024-09-19T06:05:24.698191+0000","last_became_peered":"2024-09-19T06:05:24.698191+0000","last_unstale":"2024-09-19T06:05:45.519250+0000","last_undegraded":"2024-09-19T06:05:45.519250+0000","last_fullsized":"2024-09-19T06:05:45.519250+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.056347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520337+0000","last_change":"2024-09-19T06:05:24.699821+0000","last_active":"2024-09-19T06:05:46.520337+0000","last_peered":"2024-09-19T06:05:46.520337+0000","last_clean":"2024-09-19T06:05:46.520337+0000","last_became_active":"2024-09-19T06:05:24.699493+0000","last_became_peered":"2024-09-19T06:05:24.699493+0000","last_unstale":"2024-09-19T06:05:46.520337+0000","last_undegraded":"2024-09-19T06:05:46.520337+0000","last_fullsized":"2024-09-19T06:05:46.520337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:34.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521371+0000","last_change":"2024-09-19T06:05:24.697821+0000","last_active":"2024-09-19T06:05:45.521371+0000","last_peered":"2024-09-19T06:05:45.521371+0000","last_clean":"2024-09-19T06:05:45.521371+0000","last_became_active":"2024-09-19T06:05:24.697495+0000","last_became_peered":"2024-09-19T06:05:24.697495+0000","last_unstale":"2024-09-19T06:05:45.521371+0000","last_undegraded":"2024-09-19T06:05:45.521371+0000","last_fullsized":"2024-09-19T06:05:45.521371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:03.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902318+0000","last_change":"2024-09-19T06:05:24.704610+0000","last_active":"2024-09-19T06:05:46.902318+0000","last_peered":"2024-09-19T06:05:46.902318+0000","last_clean":"2024-09-19T06:05:46.902318+0000","last_became_active":"2024-09-19T06:05:24.704288+0000","last_became_peered":"2024-09-19T06:05:24.704288+0000","last_unstale":"2024-09-19T06:05:46.902318+0000","last_undegraded":"2024-09-19T06:05:46.902318+0000","last_fullsized":"2024-09-19T06:05:46.902318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.530553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520054+0000","last_change":"2024-09-19T06:05:24.693662+0000","last_active":"2024-09-19T06:05:45.520054+0000","last_peered":"2024-09-19T06:05:45.520054+0000","last_clean":"2024-09-19T06:05:45.520054+0000","last_became_active":"2024-09-19T06:05:24.693327+0000","last_became_peered":"2024-09-19T06:05:24.693327+0000","last_unstale":"2024-09-19T06:05:45.520054+0000","last_undegraded":"2024-09-19T06:05:45.520054+0000","last_fullsized":"2024-09-19T06:05:45.520054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:39.646907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961884+0000","last_change":"2024-09-19T06:05:24.702552+0000","last_active":"2024-09-19T06:05:46.961884+0000","last_peered":"2024-09-19T06:05:46.961884+0000","last_clean":"2024-09-19T06:05:46.961884+0000","last_became_active":"2024-09-19T06:05:24.701090+0000","last_became_peered":"2024-09-19T06:05:24.701090+0000","last_unstale":"2024-09-19T06:05:46.961884+0000","last_undegraded":"2024-09-19T06:05:46.961884+0000","last_fullsized":"2024-09-19T06:05:46.961884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:44.361368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-19T06:05:25.699026+0000","last_change":"2024-09-19T06:05:45.521702+0000","last_active":"2024-09-19T06:05:45.521702+0000","last_peered":"2024-09-19T06:05:25.699026+0000","last_clean":"2024-09-19T06:05:25.699026+0000","last_became_active":"2024-09-19T06:05:24.703032+0000","last_became_peered":"2024-09-19T06:05:24.703032+0000","last_unstale":"2024-09-19T06:05:25.699026+0000","last_undegraded":"2024-09-19T06:05:25.699026+0000","last_fullsized":"2024-09-19T06:05:25.699026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902755+0000","last_change":"2024-09-19T06:05:24.703118+0000","last_active":"2024-09-19T06:05:46.902755+0000","last_peered":"2024-09-19T06:05:46.902755+0000","last_clean":"2024-09-19T06:05:46.902755+0000","last_became_active":"2024-09-19T06:05:24.702561+0000","last_became_peered":"2024-09-19T06:05:24.702561+0000","last_unstale":"2024-09-19T06:05:46.902755+0000","last_undegraded":"2024-09-19T06:05:46.902755+0000","last_fullsized":"2024-09-19T06:05:46.902755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:51.063256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519359+0000","last_change":"2024-09-19T06:05:24.698704+0000","last_active":"2024-09-19T06:05:45.519359+0000","last_peered":"2024-09-19T06:05:45.519359+0000","last_clean":"2024-09-19T06:05:45.519359+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:45.519359+0000","last_undegraded":"2024-09-19T06:05:45.519359+0000","last_fullsized":"2024-09-19T06:05:45.519359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:35.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285518+0000","last_change":"2024-09-19T06:05:24.696236+0000","last_active":"2024-09-19T06:05:25.285518+0000","last_peered":"2024-09-19T06:05:25.285518+0000","last_clean":"2024-09-19T06:05:25.285518+0000","last_became_active":"2024-09-19T06:05:24.695952+0000","last_became_peered":"2024-09-19T06:05:24.695952+0000","last_unstale":"2024-09-19T06:05:25.285518+0000","last_undegraded":"2024-09-19T06:05:25.285518+0000","last_fullsized":"2024-09-19T06:05:25.285518+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:17.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595644+0000","last_change":"2024-09-19T06:05:24.699962+0000","last_active":"2024-09-19T06:05:25.595644+0000","last_peered":"2024-09-19T06:05:25.595644+0000","last_clean":"2024-09-19T06:05:25.595644+0000","last_became_active":"2024-09-19T06:05:24.699625+0000","last_became_peered":"2024-09-19T06:05:24.699625+0000","last_unstale":"2024-09-19T06:05:25.595644+0000","last_undegraded":"2024-09-19T06:05:25.595644+0000","last_fullsized":"2024-09-19T06:05:25.595644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:34.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595653+0000","last_change":"2024-09-19T06:05:24.701310+0000","last_active":"2024-09-19T06:05:25.595653+0000","last_peered":"2024-09-19T06:05:25.595653+0000","last_clean":"2024-09-19T06:05:25.595653+0000","last_became_active":"2024-09-19T06:05:24.701032+0000","last_became_peered":"2024-09-19T06:05:24.701032+0000","last_unstale":"2024-09-19T06:05:25.595653+0000","last_undegraded":"2024-09-19T06:05:25.595653+0000","last_fullsized":"2024-09-19T06:05:25.595653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:29.557533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961314+0000","last_change":"2024-09-19T06:05:24.699803+0000","last_active":"2024-09-19T06:05:46.961314+0000","last_peered":"2024-09-19T06:05:46.961314+0000","last_clean":"2024-09-19T06:05:46.961314+0000","last_became_active":"2024-09-19T06:05:24.699506+0000","last_became_peered":"2024-09-19T06:05:24.699506+0000","last_unstale":"2024-09-19T06:05:46.961314+0000","last_undegraded":"2024-09-19T06:05:46.961314+0000","last_fullsized":"2024-09-19T06:05:46.961314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:32.669231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518157+0000","last_change":"2024-09-19T06:05:24.703805+0000","last_active":"2024-09-19T06:05:46.518157+0000","last_peered":"2024-09-19T06:05:46.518157+0000","last_clean":"2024-09-19T06:05:46.518157+0000","last_became_active":"2024-09-19T06:05:24.702728+0000","last_became_peered":"2024-09-19T06:05:24.702728+0000","last_unstale":"2024-09-19T06:05:46.518157+0000","last_undegraded":"2024-09-19T06:05:46.518157+0000","last_fullsized":"2024-09-19T06:05:46.518157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:20.807530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518737+0000","last_change":"2024-09-19T06:05:24.691055+0000","last_active":"2024-09-19T06:05:46.518737+0000","last_peered":"2024-09-19T06:05:46.518737+0000","last_clean":"2024-09-19T06:05:46.518737+0000","last_became_active":"2024-09-19T06:05:24.690165+0000","last_became_peered":"2024-09-19T06:05:24.690165+0000","last_unstale":"2024-09-19T06:05:46.518737+0000","last_undegraded":"2024-09-19T06:05:46.518737+0000","last_fullsized":"2024-09-19T06:05:46.518737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:48.656335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521695+0000","last_change":"2024-09-19T06:05:24.697955+0000","last_active":"2024-09-19T06:05:46.521695+0000","last_peered":"2024-09-19T06:05:46.521695+0000","last_clean":"2024-09-19T06:05:46.521695+0000","last_became_active":"2024-09-19T06:05:24.697598+0000","last_became_peered":"2024-09-19T06:05:24.697598+0000","last_unstale":"2024-09-19T06:05:46.521695+0000","last_undegraded":"2024-09-19T06:05:46.521695+0000","last_fullsized":"2024-09-19T06:05:46.521695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.458647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517664+0000","last_change":"2024-09-19T06:05:24.705110+0000","last_active":"2024-09-19T06:05:46.517664+0000","last_peered":"2024-09-19T06:05:46.517664+0000","last_clean":"2024-09-19T06:05:46.517664+0000","last_became_active":"2024-09-19T06:05:24.704783+0000","last_became_peered":"2024-09-19T06:05:24.704783+0000","last_unstale":"2024-09-19T06:05:46.517664+0000","last_undegraded":"2024-09-19T06:05:46.517664+0000","last_fullsized":"2024-09-19T06:05:46.517664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:43.092969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285592+0000","last_change":"2024-09-19T06:05:24.693845+0000","last_active":"2024-09-19T06:05:25.285592+0000","last_peered":"2024-09-19T06:05:25.285592+0000","last_clean":"2024-09-19T06:05:25.285592+0000","last_became_active":"2024-09-19T06:05:24.693385+0000","last_became_peered":"2024-09-19T06:05:24.693385+0000","last_unstale":"2024-09-19T06:05:25.285592+0000","last_undegraded":"2024-09-19T06:05:25.285592+0000","last_fullsized":"2024-09-19T06:05:25.285592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:05.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961617+0000","last_change":"2024-09-19T06:05:24.697903+0000","last_active":"2024-09-19T06:05:46.961617+0000","last_peered":"2024-09-19T06:05:46.961617+0000","last_clean":"2024-09-19T06:05:46.961617+0000","last_became_active":"2024-09-19T06:05:24.697566+0000","last_became_peered":"2024-09-19T06:05:24.697566+0000","last_unstale":"2024-09-19T06:05:46.961617+0000","last_undegraded":"2024-09-19T06:05:46.961617+0000","last_fullsized":"2024-09-19T06:05:46.961617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:10.340401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.518978+0000","last_change":"2024-09-19T06:05:24.696888+0000","last_active":"2024-09-19T06:05:45.518978+0000","last_peered":"2024-09-19T06:05:45.518978+0000","last_clean":"2024-09-19T06:05:45.518978+0000","last_became_active":"2024-09-19T06:05:24.696554+0000","last_became_peered":"2024-09-19T06:05:24.696554+0000","last_unstale":"2024-09-19T06:05:45.518978+0000","last_undegraded":"2024-09-19T06:05:45.518978+0000","last_fullsized":"2024-09-19T06:05:45.518978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516097+0000","last_change":"2024-09-19T06:05:24.692443+0000","last_active":"2024-09-19T06:05:45.516097+0000","last_peered":"2024-09-19T06:05:45.516097+0000","last_clean":"2024-09-19T06:05:45.516097+0000","last_became_active":"2024-09-19T06:05:24.690555+0000","last_became_peered":"2024-09-19T06:05:24.690555+0000","last_unstale":"2024-09-19T06:05:45.516097+0000","last_undegraded":"2024-09-19T06:05:45.516097+0000","last_fullsized":"2024-09-19T06:05:45.516097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:29.340744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520428+0000","last_change":"2024-09-19T06:05:24.699379+0000","last_active":"2024-09-19T06:05:45.520428+0000","last_peered":"2024-09-19T06:05:45.520428+0000","last_clean":"2024-09-19T06:05:45.520428+0000","last_became_active":"2024-09-19T06:05:24.699056+0000","last_became_peered":"2024-09-19T06:05:24.699056+0000","last_unstale":"2024-09-19T06:05:45.520428+0000","last_undegraded":"2024-09-19T06:05:45.520428+0000","last_fullsized":"2024-09-19T06:05:45.520428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:30.337080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521950+0000","last_change":"2024-09-19T06:05:24.698672+0000","last_active":"2024-09-19T06:05:46.521950+0000","last_peered":"2024-09-19T06:05:46.521950+0000","last_clean":"2024-09-19T06:05:46.521950+0000","last_became_active":"2024-09-19T06:05:24.698229+0000","last_became_peered":"2024-09-19T06:05:24.698229+0000","last_unstale":"2024-09-19T06:05:46.521950+0000","last_undegraded":"2024-09-19T06:05:46.521950+0000","last_fullsized":"2024-09-19T06:05:46.521950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.082538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517858+0000","last_change":"2024-09-19T06:05:24.707830+0000","last_active":"2024-09-19T06:05:46.517858+0000","last_peered":"2024-09-19T06:05:46.517858+0000","last_clean":"2024-09-19T06:05:46.517858+0000","last_became_active":"2024-09-19T06:05:24.707478+0000","last_became_peered":"2024-09-19T06:05:24.707478+0000","last_unstale":"2024-09-19T06:05:46.517858+0000","last_undegraded":"2024-09-19T06:05:46.517858+0000","last_fullsized":"2024-09-19T06:05:46.517858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:33.484877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285361+0000","last_change":"2024-09-19T06:05:24.697232+0000","last_active":"2024-09-19T06:05:25.285361+0000","last_peered":"2024-09-19T06:05:25.285361+0000","last_clean":"2024-09-19T06:05:25.285361+0000","last_became_active":"2024-09-19T06:05:24.696727+0000","last_became_peered":"2024-09-19T06:05:24.696727+0000","last_unstale":"2024-09-19T06:05:25.285361+0000","last_undegraded":"2024-09-19T06:05:25.285361+0000","last_fullsized":"2024-09-19T06:05:25.285361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:36.168493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595803+0000","last_change":"2024-09-19T06:05:24.695489+0000","last_active":"2024-09-19T06:05:25.595803+0000","last_peered":"2024-09-19T06:05:25.595803+0000","last_clean":"2024-09-19T06:05:25.595803+0000","last_became_active":"2024-09-19T06:05:24.695012+0000","last_became_peered":"2024-09-19T06:05:24.695012+0000","last_unstale":"2024-09-19T06:05:25.595803+0000","last_undegraded":"2024-09-19T06:05:25.595803+0000","last_fullsized":"2024-09-19T06:05:25.595803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:41.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522199+0000","last_change":"2024-09-19T06:05:24.697294+0000","last_active":"2024-09-19T06:05:46.522199+0000","last_peered":"2024-09-19T06:05:46.522199+0000","last_clean":"2024-09-19T06:05:46.522199+0000","last_became_active":"2024-09-19T06:05:24.696563+0000","last_became_peered":"2024-09-19T06:05:24.696563+0000","last_unstale":"2024-09-19T06:05:46.522199+0000","last_undegraded":"2024-09-19T06:05:46.522199+0000","last_fullsized":"2024-09-19T06:05:46.522199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:41.861120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520918+0000","last_change":"2024-09-19T06:05:24.702710+0000","last_active":"2024-09-19T06:05:46.520918+0000","last_peered":"2024-09-19T06:05:46.520918+0000","last_clean":"2024-09-19T06:05:46.520918+0000","last_became_active":"2024-09-19T06:05:24.702039+0000","last_became_peered":"2024-09-19T06:05:24.702039+0000","last_unstale":"2024-09-19T06:05:46.520918+0000","last_undegraded":"2024-09-19T06:05:46.520918+0000","last_fullsized":"2024-09-19T06:05:46.520918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:23.831807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517416+0000","last_change":"2024-09-19T06:05:24.707671+0000","last_active":"2024-09-19T06:05:46.517416+0000","last_peered":"2024-09-19T06:05:46.517416+0000","last_clean":"2024-09-19T06:05:46.517416+0000","last_became_active":"2024-09-19T06:05:24.707325+0000","last_became_peered":"2024-09-19T06:05:24.707325+0000","last_unstale":"2024-09-19T06:05:46.517416+0000","last_undegraded":"2024-09-19T06:05:46.517416+0000","last_fullsized":"2024-09-19T06:05:46.517416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:32.149103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520934+0000","last_change":"2024-09-19T06:05:24.704875+0000","last_active":"2024-09-19T06:05:46.520934+0000","last_peered":"2024-09-19T06:05:46.520934+0000","last_clean":"2024-09-19T06:05:46.520934+0000","last_became_active":"2024-09-19T06:05:24.704501+0000","last_became_peered":"2024-09-19T06:05:24.704501+0000","last_unstale":"2024-09-19T06:05:46.520934+0000","last_undegraded":"2024-09-19T06:05:46.520934+0000","last_fullsized":"2024-09-19T06:05:46.520934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516956+0000","last_change":"2024-09-19T06:05:22.687857+0000","last_active":"2024-09-19T06:05:45.516956+0000","last_peered":"2024-09-19T06:05:45.516956+0000","last_clean":"2024-09-19T06:05:45.516956+0000","last_became_active":"2024-09-19T06:05:22.687573+0000","last_became_peered":"2024-09-19T06:05:22.687573+0000","last_unstale":"2024-09-19T06:05:45.516956+0000","last_undegraded":"2024-09-19T06:05:45.516956+0000","last_fullsized":"2024-09-19T06:05:45.516956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:31.972444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-19T06:05:25.699836+0000","last_change":"2024-09-19T06:05:45.517288+0000","last_active":"2024-09-19T06:05:45.517288+0000","last_peered":"2024-09-19T06:05:25.699836+0000","last_clean":"2024-09-19T06:05:25.699836+0000","last_became_active":"2024-09-19T06:05:24.693533+0000","last_became_peered":"2024-09-19T06:05:24.693533+0000","last_unstale":"2024-09-19T06:05:25.699836+0000","last_undegraded":"2024-09-19T06:05:25.699836+0000","last_fullsized":"2024-09-19T06:05:25.699836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521438+0000","last_change":"2024-09-19T06:05:22.680500+0000","last_active":"2024-09-19T06:05:45.521438+0000","last_peered":"2024-09-19T06:05:45.521438+0000","last_clean":"2024-09-19T06:05:45.521438+0000","last_became_active":"2024-09-19T06:05:22.679947+0000","last_became_peered":"2024-09-19T06:05:22.679947+0000","last_unstale":"2024-09-19T06:05:45.521438+0000","last_undegraded":"2024-09-19T06:05:45.521438+0000","last_fullsized":"2024-09-19T06:05:45.521438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:34.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:33.874859+0000","last_change":"2024-09-19T06:05:22.680962+0000","last_active":"2024-09-19T06:05:33.874859+0000","last_peered":"2024-09-19T06:05:33.874859+0000","last_clean":"2024-09-19T06:05:33.874859+0000","last_became_active":"2024-09-19T06:05:22.680662+0000","last_became_peered":"2024-09-19T06:05:22.680662+0000","last_unstale":"2024-09-19T06:05:33.874859+0000","last_undegraded":"2024-09-19T06:05:33.874859+0000","last_fullsized":"2024-09-19T06:05:33.874859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.296422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519895+0000","last_change":"2024-09-19T06:05:24.695214+0000","last_active":"2024-09-19T06:05:45.519895+0000","last_peered":"2024-09-19T06:05:45.519895+0000","last_clean":"2024-09-19T06:05:45.519895+0000","last_became_active":"2024-09-19T06:05:24.694930+0000","last_became_peered":"2024-09-19T06:05:24.694930+0000","last_unstale":"2024-09-19T06:05:45.519895+0000","last_undegraded":"2024-09-19T06:05:45.519895+0000","last_fullsized":"2024-09-19T06:05:45.519895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:51.382934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516314+0000","last_change":"2024-09-19T06:05:22.684504+0000","last_active":"2024-09-19T06:05:45.516314+0000","last_peered":"2024-09-19T06:05:45.516314+0000","last_clean":"2024-09-19T06:05:45.516314+0000","last_became_active":"2024-09-19T06:05:22.684169+0000","last_became_peered":"2024-09-19T06:05:22.684169+0000","last_unstale":"2024-09-19T06:05:45.516314+0000","last_undegraded":"2024-09-19T06:05:45.516314+0000","last_fullsized":"2024-09-19T06:05:45.516314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:29.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518059+0000","last_change":"2024-09-19T06:05:24.693056+0000","last_active":"2024-09-19T06:05:46.518059+0000","last_peered":"2024-09-19T06:05:46.518059+0000","last_clean":"2024-09-19T06:05:46.518059+0000","last_became_active":"2024-09-19T06:05:24.692544+0000","last_became_peered":"2024-09-19T06:05:24.692544+0000","last_unstale":"2024-09-19T06:05:46.518059+0000","last_undegraded":"2024-09-19T06:05:46.518059+0000","last_fullsized":"2024-09-19T06:05:46.518059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:45.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521794+0000","last_change":"2024-09-19T06:05:22.682854+0000","last_active":"2024-09-19T06:05:45.521794+0000","last_peered":"2024-09-19T06:05:45.521794+0000","last_clean":"2024-09-19T06:05:45.521794+0000","last_became_active":"2024-09-19T06:05:22.682406+0000","last_became_peered":"2024-09-19T06:05:22.682406+0000","last_unstale":"2024-09-19T06:05:45.521794+0000","last_undegraded":"2024-09-19T06:05:45.521794+0000","last_fullsized":"2024-09-19T06:05:45.521794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.206144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961915+0000","last_change":"2024-09-19T06:05:24.699408+0000","last_active":"2024-09-19T06:05:46.961915+0000","last_peered":"2024-09-19T06:05:46.961915+0000","last_clean":"2024-09-19T06:05:46.961915+0000","last_became_active":"2024-09-19T06:05:24.699106+0000","last_became_peered":"2024-09-19T06:05:24.699106+0000","last_unstale":"2024-09-19T06:05:46.961915+0000","last_undegraded":"2024-09-19T06:05:46.961915+0000","last_fullsized":"2024-09-19T06:05:46.961915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:37.487458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902210+0000","last_change":"2024-09-19T06:05:22.686106+0000","last_active":"2024-09-19T06:05:46.902210+0000","last_peered":"2024-09-19T06:05:46.902210+0000","last_clean":"2024-09-19T06:05:46.902210+0000","last_became_active":"2024-09-19T06:05:22.685763+0000","last_became_peered":"2024-09-19T06:05:22.685763+0000","last_unstale":"2024-09-19T06:05:46.902210+0000","last_undegraded":"2024-09-19T06:05:46.902210+0000","last_fullsized":"2024-09-19T06:05:46.902210+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:57.889128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.596069+0000","last_change":"2024-09-19T06:05:24.701859+0000","last_active":"2024-09-19T06:05:25.596069+0000","last_peered":"2024-09-19T06:05:25.596069+0000","last_clean":"2024-09-19T06:05:25.596069+0000","last_became_active":"2024-09-19T06:05:24.701247+0000","last_became_peered":"2024-09-19T06:05:24.701247+0000","last_unstale":"2024-09-19T06:05:25.596069+0000","last_undegraded":"2024-09-19T06:05:25.596069+0000","last_fullsized":"2024-09-19T06:05:25.596069+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:45.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516490+0000","last_change":"2024-09-19T06:05:23.060545+0000","last_active":"2024-09-19T06:05:45.516490+0000","last_peered":"2024-09-19T06:05:45.516490+0000","last_clean":"2024-09-19T06:05:45.516490+0000","last_became_active":"2024-09-19T06:05:23.060187+0000","last_became_peered":"2024-09-19T06:05:23.060187+0000","last_unstale":"2024-09-19T06:05:45.516490+0000","last_undegraded":"2024-09-19T06:05:45.516490+0000","last_fullsized":"2024-09-19T06:05:45.516490+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.604284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961566+0000","last_change":"2024-09-19T06:05:24.702535+0000","last_active":"2024-09-19T06:05:46.961566+0000","last_peered":"2024-09-19T06:05:46.961566+0000","last_clean":"2024-09-19T06:05:46.961566+0000","last_became_active":"2024-09-19T06:05:24.701616+0000","last_became_peered":"2024-09-19T06:05:24.701616+0000","last_unstale":"2024-09-19T06:05:46.961566+0000","last_undegraded":"2024-09-19T06:05:46.961566+0000","last_fullsized":"2024-09-19T06:05:46.961566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:43.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'25","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521595+0000","last_change":"2024-09-19T06:05:22.685460+0000","last_active":"2024-09-19T06:05:45.521595+0000","last_peered":"2024-09-19T06:05:45.521595+0000","last_clean":"2024-09-19T06:05:45.521595+0000","last_became_active":"2024-09-19T06:05:22.685086+0000","last_became_peered":"2024-09-19T06:05:22.685086+0000","last_unstale":"2024-09-19T06:05:45.521595+0000","last_undegraded":"2024-09-19T06:05:45.521595+0000","last_fullsized":"2024-09-19T06:05:45.521595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:10.373783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":53,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520872+0000","last_change":"2024-09-19T06:05:24.700431+0000","last_active":"2024-09-19T06:05:46.520872+0000","last_peered":"2024-09-19T06:05:46.520872+0000","last_clean":"2024-09-19T06:05:46.520872+0000","last_became_active":"2024-09-19T06:05:24.700092+0000","last_became_peered":"2024-09-19T06:05:24.700092+0000","last_unstale":"2024-09-19T06:05:46.520872+0000","last_undegraded":"2024-09-19T06:05:46.520872+0000","last_fullsized":"2024-09-19T06:05:46.520872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:17.208392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":10,"reported_epoch":80,"state":"active+recovering","last_fresh":"2024-09-19T06:05:46.524417+0000","last_change":"2024-09-19T06:05:46.525009+0000","last_active":"2024-09-19T06:05:46.524417+0000","last_peered":"2024-09-19T06:05:46.524417+0000","last_clean":"2024-09-19T06:05:34.883165+0000","last_became_active":"2024-09-19T06:05:46.521700+0000","last_became_peered":"2024-09-19T06:05:46.521700+0000","last_unstale":"2024-09-19T06:05:46.524417+0000","last_undegraded":"2024-09-19T06:05:46.517686+0000","last_fullsized":"2024-09-19T06:05:46.524417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":4,"num_objects_missing":4,"num_objects_degraded":0,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":["2","3","10"],"object_location_counts":[{"shards":"2,3,10","objects":4}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285120+0000","last_change":"2024-09-19T06:05:24.699149+0000","last_active":"2024-09-19T06:05:25.285120+0000","last_peered":"2024-09-19T06:05:25.285120+0000","last_clean":"2024-09-19T06:05:25.285120+0000","last_became_active":"2024-09-19T06:05:24.698846+0000","last_became_peered":"2024-09-19T06:05:24.698846+0000","last_unstale":"2024-09-19T06:05:25.285120+0000","last_undegraded":"2024-09-19T06:05:25.285120+0000","last_fullsized":"2024-09-19T06:05:25.285120+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:19.416169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516218+0000","last_change":"2024-09-19T06:05:22.682157+0000","last_active":"2024-09-19T06:05:45.516218+0000","last_peered":"2024-09-19T06:05:45.516218+0000","last_clean":"2024-09-19T06:05:45.516218+0000","last_became_active":"2024-09-19T06:05:22.681816+0000","last_became_peered":"2024-09-19T06:05:22.681816+0000","last_unstale":"2024-09-19T06:05:45.516218+0000","last_undegraded":"2024-09-19T06:05:45.516218+0000","last_fullsized":"2024-09-19T06:05:45.516218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:05.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902542+0000","last_change":"2024-09-19T06:05:24.699233+0000","last_active":"2024-09-19T06:05:46.902542+0000","last_peered":"2024-09-19T06:05:46.902542+0000","last_clean":"2024-09-19T06:05:46.902542+0000","last_became_active":"2024-09-19T06:05:24.698918+0000","last_became_peered":"2024-09-19T06:05:24.698918+0000","last_unstale":"2024-09-19T06:05:46.902542+0000","last_undegraded":"2024-09-19T06:05:46.902542+0000","last_fullsized":"2024-09-19T06:05:46.902542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519280+0000","last_change":"2024-09-19T06:05:22.682161+0000","last_active":"2024-09-19T06:05:45.519280+0000","last_peered":"2024-09-19T06:05:45.519280+0000","last_clean":"2024-09-19T06:05:45.519280+0000","last_became_active":"2024-09-19T06:05:22.681805+0000","last_became_peered":"2024-09-19T06:05:22.681805+0000","last_unstale":"2024-09-19T06:05:45.519280+0000","last_undegraded":"2024-09-19T06:05:45.519280+0000","last_fullsized":"2024-09-19T06:05:45.519280+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:27.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902474+0000","last_change":"2024-09-19T06:05:24.703668+0000","last_active":"2024-09-19T06:05:46.902474+0000","last_peered":"2024-09-19T06:05:46.902474+0000","last_clean":"2024-09-19T06:05:46.902474+0000","last_became_active":"2024-09-19T06:05:24.703342+0000","last_became_peered":"2024-09-19T06:05:24.703342+0000","last_unstale":"2024-09-19T06:05:46.902474+0000","last_undegraded":"2024-09-19T06:05:46.902474+0000","last_fullsized":"2024-09-19T06:05:46.902474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:30.399187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520049+0000","last_change":"2024-09-19T06:05:23.060458+0000","last_active":"2024-09-19T06:05:46.520049+0000","last_peered":"2024-09-19T06:05:46.520049+0000","last_clean":"2024-09-19T06:05:46.520049+0000","last_became_active":"2024-09-19T06:05:23.060098+0000","last_became_peered":"2024-09-19T06:05:23.060098+0000","last_unstale":"2024-09-19T06:05:46.520049+0000","last_undegraded":"2024-09-19T06:05:46.520049+0000","last_fullsized":"2024-09-19T06:05:46.520049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:58.800162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516140+0000","last_change":"2024-09-19T06:05:24.699832+0000","last_active":"2024-09-19T06:05:45.516140+0000","last_peered":"2024-09-19T06:05:45.516140+0000","last_clean":"2024-09-19T06:05:45.516140+0000","last_became_active":"2024-09-19T06:05:24.697600+0000","last_became_peered":"2024-09-19T06:05:24.697600+0000","last_unstale":"2024-09-19T06:05:45.516140+0000","last_undegraded":"2024-09-19T06:05:45.516140+0000","last_fullsized":"2024-09-19T06:05:45.516140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:15.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521202+0000","last_change":"2024-09-19T06:05:22.682962+0000","last_active":"2024-09-19T06:05:46.521202+0000","last_peered":"2024-09-19T06:05:46.521202+0000","last_clean":"2024-09-19T06:05:46.521202+0000","last_became_active":"2024-09-19T06:05:22.682573+0000","last_became_peered":"2024-09-19T06:05:22.682573+0000","last_unstale":"2024-09-19T06:05:46.521202+0000","last_undegraded":"2024-09-19T06:05:46.521202+0000","last_fullsized":"2024-09-19T06:05:46.521202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:31.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"activating","last_fresh":"2024-09-19T06:05:46.518241+0000","last_change":"2024-09-19T06:05:46.518241+0000","last_active":"2024-09-19T06:05:45.519007+0000","last_peered":"2024-09-19T06:05:26.522832+0000","last_clean":"2024-09-19T06:05:26.522832+0000","last_became_active":"2024-09-19T06:05:24.707289+0000","last_became_peered":"2024-09-19T06:05:24.707289+0000","last_unstale":"2024-09-19T06:05:46.518241+0000","last_undegraded":"2024-09-19T06:05:46.518241+0000","last_fullsized":"2024-09-19T06:05:46.518241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":["11","4","5","9"],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.699063+0000","last_change":"2024-09-19T06:05:22.684007+0000","last_active":"2024-09-19T06:05:25.699063+0000","last_peered":"2024-09-19T06:05:25.699063+0000","last_clean":"2024-09-19T06:05:25.699063+0000","last_became_active":"2024-09-19T06:05:22.683606+0000","last_became_peered":"2024-09-19T06:05:22.683606+0000","last_unstale":"2024-09-19T06:05:25.699063+0000","last_undegraded":"2024-09-19T06:05:25.699063+0000","last_fullsized":"2024-09-19T06:05:25.699063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:29.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902839+0000","last_change":"2024-09-19T06:05:24.698057+0000","last_active":"2024-09-19T06:05:46.902839+0000","last_peered":"2024-09-19T06:05:46.902839+0000","last_clean":"2024-09-19T06:05:46.902839+0000","last_became_active":"2024-09-19T06:05:24.697604+0000","last_became_peered":"2024-09-19T06:05:24.697604+0000","last_unstale":"2024-09-19T06:05:46.902839+0000","last_undegraded":"2024-09-19T06:05:46.902839+0000","last_fullsized":"2024-09-19T06:05:46.902839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:33.246096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516675+0000","last_change":"2024-09-19T06:05:22.680641+0000","last_active":"2024-09-19T06:05:45.516675+0000","last_peered":"2024-09-19T06:05:45.516675+0000","last_clean":"2024-09-19T06:05:45.516675+0000","last_became_active":"2024-09-19T06:05:22.680282+0000","last_became_peered":"2024-09-19T06:05:22.680282+0000","last_unstale":"2024-09-19T06:05:45.516675+0000","last_undegraded":"2024-09-19T06:05:45.516675+0000","last_fullsized":"2024-09-19T06:05:45.516675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:07.171581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902552+0000","last_change":"2024-09-19T06:05:24.705525+0000","last_active":"2024-09-19T06:05:46.902552+0000","last_peered":"2024-09-19T06:05:46.902552+0000","last_clean":"2024-09-19T06:05:46.902552+0000","last_became_active":"2024-09-19T06:05:24.705226+0000","last_became_peered":"2024-09-19T06:05:24.705226+0000","last_unstale":"2024-09-19T06:05:46.902552+0000","last_undegraded":"2024-09-19T06:05:46.902552+0000","last_fullsized":"2024-09-19T06:05:46.902552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:51.020525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522657+0000","last_change":"2024-09-19T06:05:23.060628+0000","last_active":"2024-09-19T06:05:46.522657+0000","last_peered":"2024-09-19T06:05:46.522657+0000","last_clean":"2024-09-19T06:05:46.522657+0000","last_became_active":"2024-09-19T06:05:23.060066+0000","last_became_peered":"2024-09-19T06:05:23.060066+0000","last_unstale":"2024-09-19T06:05:46.522657+0000","last_undegraded":"2024-09-19T06:05:46.522657+0000","last_fullsized":"2024-09-19T06:05:46.522657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:55.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902770+0000","last_change":"2024-09-19T06:05:24.701994+0000","last_active":"2024-09-19T06:05:46.902770+0000","last_peered":"2024-09-19T06:05:46.902770+0000","last_clean":"2024-09-19T06:05:46.902770+0000","last_became_active":"2024-09-19T06:05:24.701648+0000","last_became_peered":"2024-09-19T06:05:24.701648+0000","last_unstale":"2024-09-19T06:05:46.902770+0000","last_undegraded":"2024-09-19T06:05:46.902770+0000","last_fullsized":"2024-09-19T06:05:46.902770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:16.475339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902639+0000","last_change":"2024-09-19T06:04:14.186274+0000","last_active":"2024-09-19T06:05:46.902639+0000","last_peered":"2024-09-19T06:05:46.902639+0000","last_clean":"2024-09-19T06:05:46.902639+0000","last_became_active":"2024-09-19T06:04:14.185907+0000","last_became_peered":"2024-09-19T06:04:14.185907+0000","last_unstale":"2024-09-19T06:05:46.902639+0000","last_undegraded":"2024-09-19T06:05:46.902639+0000","last_fullsized":"2024-09-19T06:05:46.902639+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_clean_scrub_stamp":"2024-09-19T06:00:59.680614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:01.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519562+0000","last_change":"2024-09-19T06:05:22.682242+0000","last_active":"2024-09-19T06:05:45.519562+0000","last_peered":"2024-09-19T06:05:45.519562+0000","last_clean":"2024-09-19T06:05:45.519562+0000","last_became_active":"2024-09-19T06:05:22.681896+0000","last_became_peered":"2024-09-19T06:05:22.681896+0000","last_unstale":"2024-09-19T06:05:45.519562+0000","last_undegraded":"2024-09-19T06:05:45.519562+0000","last_fullsized":"2024-09-19T06:05:45.519562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.119422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.962902+0000","last_change":"2024-09-19T06:05:46.962541+0000","last_active":"2024-09-19T06:05:46.962902+0000","last_peered":"2024-09-19T06:05:46.962902+0000","last_clean":"2024-09-19T06:05:46.962902+0000","last_became_active":"2024-09-19T06:05:46.962261+0000","last_became_peered":"2024-09-19T06:05:46.962261+0000","last_unstale":"2024-09-19T06:05:46.962902+0000","last_undegraded":"2024-09-19T06:05:46.962902+0000","last_fullsized":"2024-09-19T06:05:46.962902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:36.355129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902052+0000","last_change":"2024-09-19T06:05:22.685809+0000","last_active":"2024-09-19T06:05:46.902052+0000","last_peered":"2024-09-19T06:05:46.902052+0000","last_clean":"2024-09-19T06:05:46.902052+0000","last_became_active":"2024-09-19T06:05:22.685466+0000","last_became_peered":"2024-09-19T06:05:22.685466+0000","last_unstale":"2024-09-19T06:05:46.902052+0000","last_undegraded":"2024-09-19T06:05:46.902052+0000","last_fullsized":"2024-09-19T06:05:46.902052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:43.793845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285079+0000","last_change":"2024-09-19T06:05:24.701105+0000","last_active":"2024-09-19T06:05:25.285079+0000","last_peered":"2024-09-19T06:05:25.285079+0000","last_clean":"2024-09-19T06:05:25.285079+0000","last_became_active":"2024-09-19T06:05:24.700825+0000","last_became_peered":"2024-09-19T06:05:24.700825+0000","last_unstale":"2024-09-19T06:05:25.285079+0000","last_undegraded":"2024-09-19T06:05:25.285079+0000","last_fullsized":"2024-09-19T06:05:25.285079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:35.707437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:42.896472+0000","last_change":"2024-09-19T06:05:23.059587+0000","last_active":"2024-09-19T06:05:42.896472+0000","last_peered":"2024-09-19T06:05:42.896472+0000","last_clean":"2024-09-19T06:05:42.896472+0000","last_became_active":"2024-09-19T06:05:23.059248+0000","last_became_peered":"2024-09-19T06:05:23.059248+0000","last_unstale":"2024-09-19T06:05:42.896472+0000","last_undegraded":"2024-09-19T06:05:42.896472+0000","last_fullsized":"2024-09-19T06:05:42.896472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:25.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516178+0000","last_change":"2024-09-19T06:05:24.701610+0000","last_active":"2024-09-19T06:05:45.516178+0000","last_peered":"2024-09-19T06:05:45.516178+0000","last_clean":"2024-09-19T06:05:45.516178+0000","last_became_active":"2024-09-19T06:05:24.697296+0000","last_became_peered":"2024-09-19T06:05:24.697296+0000","last_unstale":"2024-09-19T06:05:45.516178+0000","last_undegraded":"2024-09-19T06:05:45.516178+0000","last_fullsized":"2024-09-19T06:05:45.516178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:52.256284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902512+0000","last_change":"2024-09-19T06:05:22.684818+0000","last_active":"2024-09-19T06:05:46.902512+0000","last_peered":"2024-09-19T06:05:46.902512+0000","last_clean":"2024-09-19T06:05:46.902512+0000","last_became_active":"2024-09-19T06:05:22.684211+0000","last_became_peered":"2024-09-19T06:05:22.684211+0000","last_unstale":"2024-09-19T06:05:46.902512+0000","last_undegraded":"2024-09-19T06:05:46.902512+0000","last_fullsized":"2024-09-19T06:05:46.902512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:50.711805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521594+0000","last_change":"2024-09-19T06:05:24.702992+0000","last_active":"2024-09-19T06:05:45.521594+0000","last_peered":"2024-09-19T06:05:45.521594+0000","last_clean":"2024-09-19T06:05:45.521594+0000","last_became_active":"2024-09-19T06:05:24.702643+0000","last_became_peered":"2024-09-19T06:05:24.702643+0000","last_unstale":"2024-09-19T06:05:45.521594+0000","last_undegraded":"2024-09-19T06:05:45.521594+0000","last_fullsized":"2024-09-19T06:05:45.521594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:40.651861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518397+0000","last_change":"2024-09-19T06:05:23.060444+0000","last_active":"2024-09-19T06:05:46.518397+0000","last_peered":"2024-09-19T06:05:46.518397+0000","last_clean":"2024-09-19T06:05:46.518397+0000","last_became_active":"2024-09-19T06:05:23.059879+0000","last_became_peered":"2024-09-19T06:05:23.059879+0000","last_unstale":"2024-09-19T06:05:46.518397+0000","last_undegraded":"2024-09-19T06:05:46.518397+0000","last_fullsized":"2024-09-19T06:05:46.518397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:39.013096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521614+0000","last_change":"2024-09-19T06:05:24.694892+0000","last_active":"2024-09-19T06:05:45.521614+0000","last_peered":"2024-09-19T06:05:45.521614+0000","last_clean":"2024-09-19T06:05:45.521614+0000","last_became_active":"2024-09-19T06:05:24.694534+0000","last_became_peered":"2024-09-19T06:05:24.694534+0000","last_unstale":"2024-09-19T06:05:45.521614+0000","last_undegraded":"2024-09-19T06:05:45.521614+0000","last_fullsized":"2024-09-19T06:05:45.521614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:50.633035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521062+0000","last_change":"2024-09-19T06:05:23.060597+0000","last_active":"2024-09-19T06:05:46.521062+0000","last_peered":"2024-09-19T06:05:46.521062+0000","last_clean":"2024-09-19T06:05:46.521062+0000","last_became_active":"2024-09-19T06:05:23.060235+0000","last_became_peered":"2024-09-19T06:05:23.060235+0000","last_unstale":"2024-09-19T06:05:46.521062+0000","last_undegraded":"2024-09-19T06:05:46.521062+0000","last_fullsized":"2024-09-19T06:05:46.521062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:54.517780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285380+0000","last_change":"2024-09-19T06:05:24.698131+0000","last_active":"2024-09-19T06:05:25.285380+0000","last_peered":"2024-09-19T06:05:25.285380+0000","last_clean":"2024-09-19T06:05:25.285380+0000","last_became_active":"2024-09-19T06:05:24.697784+0000","last_became_peered":"2024-09-19T06:05:24.697784+0000","last_unstale":"2024-09-19T06:05:25.285380+0000","last_undegraded":"2024-09-19T06:05:25.285380+0000","last_fullsized":"2024-09-19T06:05:25.285380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:49.563908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519139+0000","last_change":"2024-09-19T06:05:22.679532+0000","last_active":"2024-09-19T06:05:46.519139+0000","last_peered":"2024-09-19T06:05:46.519139+0000","last_clean":"2024-09-19T06:05:46.519139+0000","last_became_active":"2024-09-19T06:05:22.679156+0000","last_became_peered":"2024-09-19T06:05:22.679156+0000","last_unstale":"2024-09-19T06:05:46.519139+0000","last_undegraded":"2024-09-19T06:05:46.519139+0000","last_fullsized":"2024-09-19T06:05:46.519139+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:31.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520541+0000","last_change":"2024-09-19T06:05:24.698383+0000","last_active":"2024-09-19T06:05:45.520541+0000","last_peered":"2024-09-19T06:05:45.520541+0000","last_clean":"2024-09-19T06:05:45.520541+0000","last_became_active":"2024-09-19T06:05:24.698044+0000","last_became_peered":"2024-09-19T06:05:24.698044+0000","last_unstale":"2024-09-19T06:05:45.520541+0000","last_undegraded":"2024-09-19T06:05:45.520541+0000","last_fullsized":"2024-09-19T06:05:45.520541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:53.388847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519548+0000","last_change":"2024-09-19T06:05:22.684799+0000","last_active":"2024-09-19T06:05:45.519548+0000","last_peered":"2024-09-19T06:05:45.519548+0000","last_clean":"2024-09-19T06:05:45.519548+0000","last_became_active":"2024-09-19T06:05:22.684376+0000","last_became_peered":"2024-09-19T06:05:22.684376+0000","last_unstale":"2024-09-19T06:05:45.519548+0000","last_undegraded":"2024-09-19T06:05:45.519548+0000","last_fullsized":"2024-09-19T06:05:45.519548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.124960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595940+0000","last_change":"2024-09-19T06:05:24.693751+0000","last_active":"2024-09-19T06:05:25.595940+0000","last_peered":"2024-09-19T06:05:25.595940+0000","last_clean":"2024-09-19T06:05:25.595940+0000","last_became_active":"2024-09-19T06:05:24.693442+0000","last_became_peered":"2024-09-19T06:05:24.693442+0000","last_unstale":"2024-09-19T06:05:25.595940+0000","last_undegraded":"2024-09-19T06:05:25.595940+0000","last_fullsized":"2024-09-19T06:05:25.595940+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:46.491860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961568+0000","last_change":"2024-09-19T06:05:23.060522+0000","last_active":"2024-09-19T06:05:46.961568+0000","last_peered":"2024-09-19T06:05:46.961568+0000","last_clean":"2024-09-19T06:05:46.961568+0000","last_became_active":"2024-09-19T06:05:23.060170+0000","last_became_peered":"2024-09-19T06:05:23.060170+0000","last_unstale":"2024-09-19T06:05:46.961568+0000","last_undegraded":"2024-09-19T06:05:46.961568+0000","last_fullsized":"2024-09-19T06:05:46.961568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:54.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520186+0000","last_change":"2024-09-19T06:05:24.701242+0000","last_active":"2024-09-19T06:05:46.520186+0000","last_peered":"2024-09-19T06:05:46.520186+0000","last_clean":"2024-09-19T06:05:46.520186+0000","last_became_active":"2024-09-19T06:05:24.700813+0000","last_became_peered":"2024-09-19T06:05:24.700813+0000","last_unstale":"2024-09-19T06:05:46.520186+0000","last_undegraded":"2024-09-19T06:05:46.520186+0000","last_fullsized":"2024-09-19T06:05:46.520186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:42.706448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519153+0000","last_change":"2024-09-19T06:05:22.677502+0000","last_active":"2024-09-19T06:05:45.519153+0000","last_peered":"2024-09-19T06:05:45.519153+0000","last_clean":"2024-09-19T06:05:45.519153+0000","last_became_active":"2024-09-19T06:05:22.677082+0000","last_became_peered":"2024-09-19T06:05:22.677082+0000","last_unstale":"2024-09-19T06:05:45.519153+0000","last_undegraded":"2024-09-19T06:05:45.519153+0000","last_fullsized":"2024-09-19T06:05:45.519153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:30.991778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517459+0000","last_change":"2024-09-19T06:05:24.703155+0000","last_active":"2024-09-19T06:05:46.517459+0000","last_peered":"2024-09-19T06:05:46.517459+0000","last_clean":"2024-09-19T06:05:46.517459+0000","last_became_active":"2024-09-19T06:05:24.702570+0000","last_became_peered":"2024-09-19T06:05:24.702570+0000","last_unstale":"2024-09-19T06:05:46.517459+0000","last_undegraded":"2024-09-19T06:05:46.517459+0000","last_fullsized":"2024-09-19T06:05:46.517459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:36.016886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":9,"reported_epoch":80,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-19T06:05:46.523692+0000","last_change":"2024-09-19T06:05:46.523692+0000","last_active":"2024-09-19T06:05:46.523692+0000","last_peered":"2024-09-19T06:05:46.523692+0000","last_clean":"2024-09-19T06:05:33.863678+0000","last_became_active":"2024-09-19T06:05:46.523271+0000","last_became_peered":"2024-09-19T06:05:46.523271+0000","last_unstale":"2024-09-19T06:05:46.523692+0000","last_undegraded":"2024-09-19T06:05:46.517640+0000","last_fullsized":"2024-09-19T06:05:46.523692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":1,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":["2","3","8"],"object_location_counts":[{"shards":"2,3,8","objects":1}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521497+0000","last_change":"2024-09-19T06:05:24.694476+0000","last_active":"2024-09-19T06:05:45.521497+0000","last_peered":"2024-09-19T06:05:45.521497+0000","last_clean":"2024-09-19T06:05:45.521497+0000","last_became_active":"2024-09-19T06:05:24.694147+0000","last_became_peered":"2024-09-19T06:05:24.694147+0000","last_unstale":"2024-09-19T06:05:45.521497+0000","last_undegraded":"2024-09-19T06:05:45.521497+0000","last_fullsized":"2024-09-19T06:05:45.521497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:48.830522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520434+0000","last_change":"2024-09-19T06:05:22.687422+0000","last_active":"2024-09-19T06:05:46.520434+0000","last_peered":"2024-09-19T06:05:46.520434+0000","last_clean":"2024-09-19T06:05:46.520434+0000","last_became_active":"2024-09-19T06:05:22.686950+0000","last_became_peered":"2024-09-19T06:05:22.686950+0000","last_unstale":"2024-09-19T06:05:46.520434+0000","last_undegraded":"2024-09-19T06:05:46.520434+0000","last_fullsized":"2024-09-19T06:05:46.520434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:49.279769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902432+0000","last_change":"2024-09-19T06:05:24.695701+0000","last_active":"2024-09-19T06:05:46.902432+0000","last_peered":"2024-09-19T06:05:46.902432+0000","last_clean":"2024-09-19T06:05:46.902432+0000","last_became_active":"2024-09-19T06:05:24.695341+0000","last_became_peered":"2024-09-19T06:05:24.695341+0000","last_unstale":"2024-09-19T06:05:46.902432+0000","last_undegraded":"2024-09-19T06:05:46.902432+0000","last_fullsized":"2024-09-19T06:05:46.902432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:52.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516455+0000","last_change":"2024-09-19T06:05:24.703456+0000","last_active":"2024-09-19T06:05:45.516455+0000","last_peered":"2024-09-19T06:05:45.516455+0000","last_clean":"2024-09-19T06:05:45.516455+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:45.516455+0000","last_undegraded":"2024-09-19T06:05:45.516455+0000","last_fullsized":"2024-09-19T06:05:45.516455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:15.159843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520802+0000","last_change":"2024-09-19T06:05:22.683833+0000","last_active":"2024-09-19T06:05:46.520802+0000","last_peered":"2024-09-19T06:05:46.520802+0000","last_clean":"2024-09-19T06:05:46.520802+0000","last_became_active":"2024-09-19T06:05:22.683439+0000","last_became_peered":"2024-09-19T06:05:22.683439+0000","last_unstale":"2024-09-19T06:05:46.520802+0000","last_undegraded":"2024-09-19T06:05:46.520802+0000","last_fullsized":"2024-09-19T06:05:46.520802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:52.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961492+0000","last_change":"2024-09-19T06:05:24.695905+0000","last_active":"2024-09-19T06:05:46.961492+0000","last_peered":"2024-09-19T06:05:46.961492+0000","last_clean":"2024-09-19T06:05:46.961492+0000","last_became_active":"2024-09-19T06:05:24.695570+0000","last_became_peered":"2024-09-19T06:05:24.695570+0000","last_unstale":"2024-09-19T06:05:46.961492+0000","last_undegraded":"2024-09-19T06:05:46.961492+0000","last_fullsized":"2024-09-19T06:05:46.961492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:00.167126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520961+0000","last_change":"2024-09-19T06:05:22.686853+0000","last_active":"2024-09-19T06:05:46.520961+0000","last_peered":"2024-09-19T06:05:46.520961+0000","last_clean":"2024-09-19T06:05:46.520961+0000","last_became_active":"2024-09-19T06:05:22.686143+0000","last_became_peered":"2024-09-19T06:05:22.686143+0000","last_unstale":"2024-09-19T06:05:46.520961+0000","last_undegraded":"2024-09-19T06:05:46.520961+0000","last_fullsized":"2024-09-19T06:05:46.520961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:30.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.596034+0000","last_change":"2024-09-19T06:05:24.702420+0000","last_active":"2024-09-19T06:05:25.596034+0000","last_peered":"2024-09-19T06:05:25.596034+0000","last_clean":"2024-09-19T06:05:25.596034+0000","last_became_active":"2024-09-19T06:05:24.702140+0000","last_became_peered":"2024-09-19T06:05:24.702140+0000","last_unstale":"2024-09-19T06:05:25.596034+0000","last_undegraded":"2024-09-19T06:05:25.596034+0000","last_fullsized":"2024-09-19T06:05:25.596034+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:27.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520502+0000","last_change":"2024-09-19T06:05:23.059638+0000","last_active":"2024-09-19T06:05:45.520502+0000","last_peered":"2024-09-19T06:05:45.520502+0000","last_clean":"2024-09-19T06:05:45.520502+0000","last_became_active":"2024-09-19T06:05:23.059273+0000","last_became_peered":"2024-09-19T06:05:23.059273+0000","last_unstale":"2024-09-19T06:05:45.520502+0000","last_undegraded":"2024-09-19T06:05:45.520502+0000","last_fullsized":"2024-09-19T06:05:45.520502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:56.981598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519791+0000","last_change":"2024-09-19T06:05:24.703608+0000","last_active":"2024-09-19T06:05:45.519791+0000","last_peered":"2024-09-19T06:05:45.519791+0000","last_clean":"2024-09-19T06:05:45.519791+0000","last_became_active":"2024-09-19T06:05:24.703300+0000","last_became_peered":"2024-09-19T06:05:24.703300+0000","last_unstale":"2024-09-19T06:05:45.519791+0000","last_undegraded":"2024-09-19T06:05:45.519791+0000","last_fullsized":"2024-09-19T06:05:45.519791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.063545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518702+0000","last_change":"2024-09-19T06:05:22.679379+0000","last_active":"2024-09-19T06:05:46.518702+0000","last_peered":"2024-09-19T06:05:46.518702+0000","last_clean":"2024-09-19T06:05:46.518702+0000","last_became_active":"2024-09-19T06:05:22.679091+0000","last_became_peered":"2024-09-19T06:05:22.679091+0000","last_unstale":"2024-09-19T06:05:46.518702+0000","last_undegraded":"2024-09-19T06:05:46.518702+0000","last_fullsized":"2024-09-19T06:05:46.518702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53722,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":5,"num_objects_missing":5,"num_objects_degraded":1,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":89,"num_read_kb":92,"num_write":151,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":161132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645329,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":419478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874261,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1043439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037787,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":888832,"data_stored":428136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":428056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32640,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712512,"statfs":{"total":95995035648,"available":95961612288,"internally_reserved":0,"allocated":1482752,"data_stored":1019595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659177,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":410518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32620,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712532,"statfs":{"total":95995035648,"available":95961632768,"internally_reserved":0,"allocated":1470464,"data_stored":1002272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":419540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":419414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444092,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":478746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":477430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":411789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":51428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":51690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:05:50.547 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:05:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:50.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:50 smithi103 ceph-mon[30925]: pgmap v282: 97 pgs: 1 active+recovery_wait+degraded, 1 activating, 2 peering, 1 active+recovering, 92 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.9 KiB/s wr, 6 op/s; 1/192 objects degraded (0.521%); 4/192 objects misplaced (2.083%) 2024-09-19T06:05:50.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:50 smithi174 ceph-mon[34488]: pgmap v282: 97 pgs: 1 active+recovery_wait+degraded, 1 activating, 2 peering, 1 active+recovering, 92 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.9 KiB/s wr, 6 op/s; 1/192 objects degraded (0.521%); 4/192 objects misplaced (2.083%) 2024-09-19T06:05:51.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:50 smithi169 ceph-mon[34350]: pgmap v282: 97 pgs: 1 active+recovery_wait+degraded, 1 activating, 2 peering, 1 active+recovering, 92 active+clean; 629 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.9 KiB/s wr, 6 op/s; 1/192 objects degraded (0.521%); 4/192 objects misplaced (2.083%) 2024-09-19T06:05:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.234+0000 7f6360df3640 1 -- 172.21.15.103:0/2041779623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635c103650 msgr2=0x7f635c10bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.234+0000 7f6360df3640 1 --2- 172.21.15.103:0/2041779623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635c103650 0x7f635c10bb40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6344009900 tx=0x7f634402a480 comp rx=0 tx=0).stop 2024-09-19T06:05:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.234+0000 7f6360df3640 1 -- 172.21.15.103:0/2041779623 shutdown_connections 2024-09-19T06:05:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.235+0000 7f6360df3640 1 --2- 172.21.15.103:0/2041779623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f635c10c160 0x7f635c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.235+0000 7f6360df3640 1 --2- 172.21.15.103:0/2041779623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635c103650 0x7f635c10bb40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.235+0000 7f6360df3640 1 --2- 172.21.15.103:0/2041779623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f635c102d30 0x7f635c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.235+0000 7f6360df3640 1 -- 172.21.15.103:0/2041779623 >> 172.21.15.103:0/2041779623 conn(0x7f635c0fc790 msgr2=0x7f635c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.235+0000 7f6360df3640 1 -- 172.21.15.103:0/2041779623 shutdown_connections 2024-09-19T06:05:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.235+0000 7f6360df3640 1 -- 172.21.15.103:0/2041779623 wait complete. 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.235+0000 7f6360df3640 1 Processor -- start 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f6360df3640 1 -- start start 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f6360df3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f635c102d30 0x7f635c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f6360df3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f635c103650 0x7f635c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f6360df3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635c10c160 0x7f635c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f6360df3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f635c111ed0 con 0x7f635c10c160 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f6360df3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f635c111d50 con 0x7f635c102d30 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f6360df3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f635c112050 con 0x7f635c103650 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f635ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635c10c160 0x7f635c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f635ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635c10c160 0x7f635c19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60466/0 (socket says 172.21.15.103:60466) 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f635a59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f635c102d30 0x7f635c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f635ad9d640 1 -- 172.21.15.103:0/2769675717 learned_addr learned my addr 172.21.15.103:0/2769675717 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f6353fff640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f635c103650 0x7f635c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f635ad9d640 1 -- 172.21.15.103:0/2769675717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f635c103650 msgr2=0x7f635c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f635ad9d640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f635c103650 0x7f635c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f635ad9d640 1 -- 172.21.15.103:0/2769675717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f635c102d30 msgr2=0x7f635c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f635ad9d640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f635c102d30 0x7f635c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f635ad9d640 1 -- 172.21.15.103:0/2769675717 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c19d4e0 con 0x7f635c10c160 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.236+0000 7f635ad9d640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635c10c160 0x7f635c19ce00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f635400b970 tx=0x7f635400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.237+0000 7f63537fe640 1 -- 172.21.15.103:0/2769675717 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354019070 con 0x7f635c10c160 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.237+0000 7f6360df3640 1 -- 172.21.15.103:0/2769675717 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635c19d7d0 con 0x7f635c10c160 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.237+0000 7f63537fe640 1 -- 172.21.15.103:0/2769675717 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6354014440 con 0x7f635c10c160 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.237+0000 7f63537fe640 1 -- 172.21.15.103:0/2769675717 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63540075d0 con 0x7f635c10c160 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.237+0000 7f6360df3640 1 -- 172.21.15.103:0/2769675717 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635c1a50b0 con 0x7f635c10c160 2024-09-19T06:05:51.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.238+0000 7f6360df3640 1 -- 172.21.15.103:0/2769675717 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635c103190 con 0x7f635c10c160 2024-09-19T06:05:51.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.240+0000 7f63537fe640 1 -- 172.21.15.103:0/2769675717 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f635401c070 con 0x7f635c10c160 2024-09-19T06:05:51.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.240+0000 7f63537fe640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f63480a32d0 0x7f63480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.240+0000 7f635a59c640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f63480a32d0 0x7f63480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.240+0000 7f63537fe640 1 -- 172.21.15.103:0/2769675717 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f63540cef20 con 0x7f635c10c160 2024-09-19T06:05:51.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.241+0000 7f635a59c640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f63480a32d0 0x7f63480a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f634c009990 tx=0x7f634c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:51.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.244+0000 7f63537fe640 1 -- 172.21.15.103:0/2769675717 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f635409bc20 con 0x7f635c10c160 2024-09-19T06:05:51.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.408+0000 7f6360df3640 1 -- 172.21.15.103:0/2769675717 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f635c107240 con 0x7f63480a32d0 2024-09-19T06:05:51.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.414+0000 7f63537fe640 1 -- 172.21.15.103:0/2769675717 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258637 (secure 0 0 0) 0x7f634c00e850 con 0x7f63480a32d0 2024-09-19T06:05:51.419 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:51.420 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T06:05:51.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 -- 172.21.15.103:0/2769675717 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f63480a32d0 msgr2=0x7f63480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f63480a32d0 0x7f63480a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f634c009990 tx=0x7f634c009110 comp rx=0 tx=0).stop 2024-09-19T06:05:51.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 -- 172.21.15.103:0/2769675717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635c10c160 msgr2=0x7f635c19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635c10c160 0x7f635c19ce00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f635400b970 tx=0x7f635400bd70 comp rx=0 tx=0).stop 2024-09-19T06:05:51.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 -- 172.21.15.103:0/2769675717 shutdown_connections 2024-09-19T06:05:51.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f63480a32d0 0x7f63480a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635c10c160 0x7f635c19ce00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f635c103650 0x7f635c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 --2- 172.21.15.103:0/2769675717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f635c102d30 0x7f635c198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 -- 172.21.15.103:0/2769675717 >> 172.21.15.103:0/2769675717 conn(0x7f635c0fc790 msgr2=0x7f635c0fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:51.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 -- 172.21.15.103:0/2769675717 shutdown_connections 2024-09-19T06:05:51.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:51.418+0000 7f6360df3640 1 -- 172.21.15.103:0/2769675717 wait complete. 2024-09-19T06:05:51.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:51 smithi103 ceph-mon[30925]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:51.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:51 smithi174 ceph-mon[34488]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:52.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:51 smithi169 ceph-mon[34350]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:52.184 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-19T06:05:49.455683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644324,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":5,"num_objects_missing":5,"num_objects_degraded":1,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":225,"num_read_kb":211,"num_write":334,"num_write_kb":3035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361472,"kb_used_data":12176,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580352,"statfs":{"total":1151940427776,"available":1151570280448,"internally_reserved":0,"allocated":12468224,"data_stored":6958413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23282,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":5,"num_objects_missing":5,"num_objects_degraded":1,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":48,"num_write":19,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002052"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518052+0000","last_change":"2024-09-19T06:05:24.703290+0000","last_active":"2024-09-19T06:05:46.518052+0000","last_peered":"2024-09-19T06:05:46.518052+0000","last_clean":"2024-09-19T06:05:46.518052+0000","last_became_active":"2024-09-19T06:05:24.702343+0000","last_became_peered":"2024-09-19T06:05:24.702343+0000","last_unstale":"2024-09-19T06:05:46.518052+0000","last_undegraded":"2024-09-19T06:05:46.518052+0000","last_fullsized":"2024-09-19T06:05:46.518052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.594004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595886+0000","last_change":"2024-09-19T06:05:24.700363+0000","last_active":"2024-09-19T06:05:25.595886+0000","last_peered":"2024-09-19T06:05:25.595886+0000","last_clean":"2024-09-19T06:05:25.595886+0000","last_became_active":"2024-09-19T06:05:24.700066+0000","last_became_peered":"2024-09-19T06:05:24.700066+0000","last_unstale":"2024-09-19T06:05:25.595886+0000","last_undegraded":"2024-09-19T06:05:25.595886+0000","last_fullsized":"2024-09-19T06:05:25.595886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:26.094195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595896+0000","last_change":"2024-09-19T06:05:24.702458+0000","last_active":"2024-09-19T06:05:25.595896+0000","last_peered":"2024-09-19T06:05:25.595896+0000","last_clean":"2024-09-19T06:05:25.595896+0000","last_became_active":"2024-09-19T06:05:24.702029+0000","last_became_peered":"2024-09-19T06:05:24.702029+0000","last_unstale":"2024-09-19T06:05:25.595896+0000","last_undegraded":"2024-09-19T06:05:25.595896+0000","last_fullsized":"2024-09-19T06:05:25.595896+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519250+0000","last_change":"2024-09-19T06:05:24.699402+0000","last_active":"2024-09-19T06:05:45.519250+0000","last_peered":"2024-09-19T06:05:45.519250+0000","last_clean":"2024-09-19T06:05:45.519250+0000","last_became_active":"2024-09-19T06:05:24.698191+0000","last_became_peered":"2024-09-19T06:05:24.698191+0000","last_unstale":"2024-09-19T06:05:45.519250+0000","last_undegraded":"2024-09-19T06:05:45.519250+0000","last_fullsized":"2024-09-19T06:05:45.519250+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.056347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520337+0000","last_change":"2024-09-19T06:05:24.699821+0000","last_active":"2024-09-19T06:05:46.520337+0000","last_peered":"2024-09-19T06:05:46.520337+0000","last_clean":"2024-09-19T06:05:46.520337+0000","last_became_active":"2024-09-19T06:05:24.699493+0000","last_became_peered":"2024-09-19T06:05:24.699493+0000","last_unstale":"2024-09-19T06:05:46.520337+0000","last_undegraded":"2024-09-19T06:05:46.520337+0000","last_fullsized":"2024-09-19T06:05:46.520337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:34.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521371+0000","last_change":"2024-09-19T06:05:24.697821+0000","last_active":"2024-09-19T06:05:45.521371+0000","last_peered":"2024-09-19T06:05:45.521371+0000","last_clean":"2024-09-19T06:05:45.521371+0000","last_became_active":"2024-09-19T06:05:24.697495+0000","last_became_peered":"2024-09-19T06:05:24.697495+0000","last_unstale":"2024-09-19T06:05:45.521371+0000","last_undegraded":"2024-09-19T06:05:45.521371+0000","last_fullsized":"2024-09-19T06:05:45.521371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:03.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902318+0000","last_change":"2024-09-19T06:05:24.704610+0000","last_active":"2024-09-19T06:05:46.902318+0000","last_peered":"2024-09-19T06:05:46.902318+0000","last_clean":"2024-09-19T06:05:46.902318+0000","last_became_active":"2024-09-19T06:05:24.704288+0000","last_became_peered":"2024-09-19T06:05:24.704288+0000","last_unstale":"2024-09-19T06:05:46.902318+0000","last_undegraded":"2024-09-19T06:05:46.902318+0000","last_fullsized":"2024-09-19T06:05:46.902318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.530553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520054+0000","last_change":"2024-09-19T06:05:24.693662+0000","last_active":"2024-09-19T06:05:45.520054+0000","last_peered":"2024-09-19T06:05:45.520054+0000","last_clean":"2024-09-19T06:05:45.520054+0000","last_became_active":"2024-09-19T06:05:24.693327+0000","last_became_peered":"2024-09-19T06:05:24.693327+0000","last_unstale":"2024-09-19T06:05:45.520054+0000","last_undegraded":"2024-09-19T06:05:45.520054+0000","last_fullsized":"2024-09-19T06:05:45.520054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:39.646907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961884+0000","last_change":"2024-09-19T06:05:24.702552+0000","last_active":"2024-09-19T06:05:46.961884+0000","last_peered":"2024-09-19T06:05:46.961884+0000","last_clean":"2024-09-19T06:05:46.961884+0000","last_became_active":"2024-09-19T06:05:24.701090+0000","last_became_peered":"2024-09-19T06:05:24.701090+0000","last_unstale":"2024-09-19T06:05:46.961884+0000","last_undegraded":"2024-09-19T06:05:46.961884+0000","last_fullsized":"2024-09-19T06:05:46.961884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:44.361368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-19T06:05:25.699026+0000","last_change":"2024-09-19T06:05:45.521702+0000","last_active":"2024-09-19T06:05:45.521702+0000","last_peered":"2024-09-19T06:05:25.699026+0000","last_clean":"2024-09-19T06:05:25.699026+0000","last_became_active":"2024-09-19T06:05:24.703032+0000","last_became_peered":"2024-09-19T06:05:24.703032+0000","last_unstale":"2024-09-19T06:05:25.699026+0000","last_undegraded":"2024-09-19T06:05:25.699026+0000","last_fullsized":"2024-09-19T06:05:25.699026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902755+0000","last_change":"2024-09-19T06:05:24.703118+0000","last_active":"2024-09-19T06:05:46.902755+0000","last_peered":"2024-09-19T06:05:46.902755+0000","last_clean":"2024-09-19T06:05:46.902755+0000","last_became_active":"2024-09-19T06:05:24.702561+0000","last_became_peered":"2024-09-19T06:05:24.702561+0000","last_unstale":"2024-09-19T06:05:46.902755+0000","last_undegraded":"2024-09-19T06:05:46.902755+0000","last_fullsized":"2024-09-19T06:05:46.902755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:51.063256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519359+0000","last_change":"2024-09-19T06:05:24.698704+0000","last_active":"2024-09-19T06:05:45.519359+0000","last_peered":"2024-09-19T06:05:45.519359+0000","last_clean":"2024-09-19T06:05:45.519359+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:45.519359+0000","last_undegraded":"2024-09-19T06:05:45.519359+0000","last_fullsized":"2024-09-19T06:05:45.519359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:35.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285518+0000","last_change":"2024-09-19T06:05:24.696236+0000","last_active":"2024-09-19T06:05:25.285518+0000","last_peered":"2024-09-19T06:05:25.285518+0000","last_clean":"2024-09-19T06:05:25.285518+0000","last_became_active":"2024-09-19T06:05:24.695952+0000","last_became_peered":"2024-09-19T06:05:24.695952+0000","last_unstale":"2024-09-19T06:05:25.285518+0000","last_undegraded":"2024-09-19T06:05:25.285518+0000","last_fullsized":"2024-09-19T06:05:25.285518+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:17.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595644+0000","last_change":"2024-09-19T06:05:24.699962+0000","last_active":"2024-09-19T06:05:25.595644+0000","last_peered":"2024-09-19T06:05:25.595644+0000","last_clean":"2024-09-19T06:05:25.595644+0000","last_became_active":"2024-09-19T06:05:24.699625+0000","last_became_peered":"2024-09-19T06:05:24.699625+0000","last_unstale":"2024-09-19T06:05:25.595644+0000","last_undegraded":"2024-09-19T06:05:25.595644+0000","last_fullsized":"2024-09-19T06:05:25.595644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:34.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595653+0000","last_change":"2024-09-19T06:05:24.701310+0000","last_active":"2024-09-19T06:05:25.595653+0000","last_peered":"2024-09-19T06:05:25.595653+0000","last_clean":"2024-09-19T06:05:25.595653+0000","last_became_active":"2024-09-19T06:05:24.701032+0000","last_became_peered":"2024-09-19T06:05:24.701032+0000","last_unstale":"2024-09-19T06:05:25.595653+0000","last_undegraded":"2024-09-19T06:05:25.595653+0000","last_fullsized":"2024-09-19T06:05:25.595653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:29.557533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961314+0000","last_change":"2024-09-19T06:05:24.699803+0000","last_active":"2024-09-19T06:05:46.961314+0000","last_peered":"2024-09-19T06:05:46.961314+0000","last_clean":"2024-09-19T06:05:46.961314+0000","last_became_active":"2024-09-19T06:05:24.699506+0000","last_became_peered":"2024-09-19T06:05:24.699506+0000","last_unstale":"2024-09-19T06:05:46.961314+0000","last_undegraded":"2024-09-19T06:05:46.961314+0000","last_fullsized":"2024-09-19T06:05:46.961314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:32.669231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518157+0000","last_change":"2024-09-19T06:05:24.703805+0000","last_active":"2024-09-19T06:05:46.518157+0000","last_peered":"2024-09-19T06:05:46.518157+0000","last_clean":"2024-09-19T06:05:46.518157+0000","last_became_active":"2024-09-19T06:05:24.702728+0000","last_became_peered":"2024-09-19T06:05:24.702728+0000","last_unstale":"2024-09-19T06:05:46.518157+0000","last_undegraded":"2024-09-19T06:05:46.518157+0000","last_fullsized":"2024-09-19T06:05:46.518157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:20.807530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518737+0000","last_change":"2024-09-19T06:05:24.691055+0000","last_active":"2024-09-19T06:05:46.518737+0000","last_peered":"2024-09-19T06:05:46.518737+0000","last_clean":"2024-09-19T06:05:46.518737+0000","last_became_active":"2024-09-19T06:05:24.690165+0000","last_became_peered":"2024-09-19T06:05:24.690165+0000","last_unstale":"2024-09-19T06:05:46.518737+0000","last_undegraded":"2024-09-19T06:05:46.518737+0000","last_fullsized":"2024-09-19T06:05:46.518737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:48.656335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521695+0000","last_change":"2024-09-19T06:05:24.697955+0000","last_active":"2024-09-19T06:05:46.521695+0000","last_peered":"2024-09-19T06:05:46.521695+0000","last_clean":"2024-09-19T06:05:46.521695+0000","last_became_active":"2024-09-19T06:05:24.697598+0000","last_became_peered":"2024-09-19T06:05:24.697598+0000","last_unstale":"2024-09-19T06:05:46.521695+0000","last_undegraded":"2024-09-19T06:05:46.521695+0000","last_fullsized":"2024-09-19T06:05:46.521695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.458647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517664+0000","last_change":"2024-09-19T06:05:24.705110+0000","last_active":"2024-09-19T06:05:46.517664+0000","last_peered":"2024-09-19T06:05:46.517664+0000","last_clean":"2024-09-19T06:05:46.517664+0000","last_became_active":"2024-09-19T06:05:24.704783+0000","last_became_peered":"2024-09-19T06:05:24.704783+0000","last_unstale":"2024-09-19T06:05:46.517664+0000","last_undegraded":"2024-09-19T06:05:46.517664+0000","last_fullsized":"2024-09-19T06:05:46.517664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:43.092969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285592+0000","last_change":"2024-09-19T06:05:24.693845+0000","last_active":"2024-09-19T06:05:25.285592+0000","last_peered":"2024-09-19T06:05:25.285592+0000","last_clean":"2024-09-19T06:05:25.285592+0000","last_became_active":"2024-09-19T06:05:24.693385+0000","last_became_peered":"2024-09-19T06:05:24.693385+0000","last_unstale":"2024-09-19T06:05:25.285592+0000","last_undegraded":"2024-09-19T06:05:25.285592+0000","last_fullsized":"2024-09-19T06:05:25.285592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:05.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961617+0000","last_change":"2024-09-19T06:05:24.697903+0000","last_active":"2024-09-19T06:05:46.961617+0000","last_peered":"2024-09-19T06:05:46.961617+0000","last_clean":"2024-09-19T06:05:46.961617+0000","last_became_active":"2024-09-19T06:05:24.697566+0000","last_became_peered":"2024-09-19T06:05:24.697566+0000","last_unstale":"2024-09-19T06:05:46.961617+0000","last_undegraded":"2024-09-19T06:05:46.961617+0000","last_fullsized":"2024-09-19T06:05:46.961617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:10.340401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.518978+0000","last_change":"2024-09-19T06:05:24.696888+0000","last_active":"2024-09-19T06:05:45.518978+0000","last_peered":"2024-09-19T06:05:45.518978+0000","last_clean":"2024-09-19T06:05:45.518978+0000","last_became_active":"2024-09-19T06:05:24.696554+0000","last_became_peered":"2024-09-19T06:05:24.696554+0000","last_unstale":"2024-09-19T06:05:45.518978+0000","last_undegraded":"2024-09-19T06:05:45.518978+0000","last_fullsized":"2024-09-19T06:05:45.518978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516097+0000","last_change":"2024-09-19T06:05:24.692443+0000","last_active":"2024-09-19T06:05:45.516097+0000","last_peered":"2024-09-19T06:05:45.516097+0000","last_clean":"2024-09-19T06:05:45.516097+0000","last_became_active":"2024-09-19T06:05:24.690555+0000","last_became_peered":"2024-09-19T06:05:24.690555+0000","last_unstale":"2024-09-19T06:05:45.516097+0000","last_undegraded":"2024-09-19T06:05:45.516097+0000","last_fullsized":"2024-09-19T06:05:45.516097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:29.340744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520428+0000","last_change":"2024-09-19T06:05:24.699379+0000","last_active":"2024-09-19T06:05:45.520428+0000","last_peered":"2024-09-19T06:05:45.520428+0000","last_clean":"2024-09-19T06:05:45.520428+0000","last_became_active":"2024-09-19T06:05:24.699056+0000","last_became_peered":"2024-09-19T06:05:24.699056+0000","last_unstale":"2024-09-19T06:05:45.520428+0000","last_undegraded":"2024-09-19T06:05:45.520428+0000","last_fullsized":"2024-09-19T06:05:45.520428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:30.337080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521950+0000","last_change":"2024-09-19T06:05:24.698672+0000","last_active":"2024-09-19T06:05:46.521950+0000","last_peered":"2024-09-19T06:05:46.521950+0000","last_clean":"2024-09-19T06:05:46.521950+0000","last_became_active":"2024-09-19T06:05:24.698229+0000","last_became_peered":"2024-09-19T06:05:24.698229+0000","last_unstale":"2024-09-19T06:05:46.521950+0000","last_undegraded":"2024-09-19T06:05:46.521950+0000","last_fullsized":"2024-09-19T06:05:46.521950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.082538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517858+0000","last_change":"2024-09-19T06:05:24.707830+0000","last_active":"2024-09-19T06:05:46.517858+0000","last_peered":"2024-09-19T06:05:46.517858+0000","last_clean":"2024-09-19T06:05:46.517858+0000","last_became_active":"2024-09-19T06:05:24.707478+0000","last_became_peered":"2024-09-19T06:05:24.707478+0000","last_unstale":"2024-09-19T06:05:46.517858+0000","last_undegraded":"2024-09-19T06:05:46.517858+0000","last_fullsized":"2024-09-19T06:05:46.517858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:33.484877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285361+0000","last_change":"2024-09-19T06:05:24.697232+0000","last_active":"2024-09-19T06:05:25.285361+0000","last_peered":"2024-09-19T06:05:25.285361+0000","last_clean":"2024-09-19T06:05:25.285361+0000","last_became_active":"2024-09-19T06:05:24.696727+0000","last_became_peered":"2024-09-19T06:05:24.696727+0000","last_unstale":"2024-09-19T06:05:25.285361+0000","last_undegraded":"2024-09-19T06:05:25.285361+0000","last_fullsized":"2024-09-19T06:05:25.285361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:36.168493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595803+0000","last_change":"2024-09-19T06:05:24.695489+0000","last_active":"2024-09-19T06:05:25.595803+0000","last_peered":"2024-09-19T06:05:25.595803+0000","last_clean":"2024-09-19T06:05:25.595803+0000","last_became_active":"2024-09-19T06:05:24.695012+0000","last_became_peered":"2024-09-19T06:05:24.695012+0000","last_unstale":"2024-09-19T06:05:25.595803+0000","last_undegraded":"2024-09-19T06:05:25.595803+0000","last_fullsized":"2024-09-19T06:05:25.595803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:41.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522199+0000","last_change":"2024-09-19T06:05:24.697294+0000","last_active":"2024-09-19T06:05:46.522199+0000","last_peered":"2024-09-19T06:05:46.522199+0000","last_clean":"2024-09-19T06:05:46.522199+0000","last_became_active":"2024-09-19T06:05:24.696563+0000","last_became_peered":"2024-09-19T06:05:24.696563+0000","last_unstale":"2024-09-19T06:05:46.522199+0000","last_undegraded":"2024-09-19T06:05:46.522199+0000","last_fullsized":"2024-09-19T06:05:46.522199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:41.861120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520918+0000","last_change":"2024-09-19T06:05:24.702710+0000","last_active":"2024-09-19T06:05:46.520918+0000","last_peered":"2024-09-19T06:05:46.520918+0000","last_clean":"2024-09-19T06:05:46.520918+0000","last_became_active":"2024-09-19T06:05:24.702039+0000","last_became_peered":"2024-09-19T06:05:24.702039+0000","last_unstale":"2024-09-19T06:05:46.520918+0000","last_undegraded":"2024-09-19T06:05:46.520918+0000","last_fullsized":"2024-09-19T06:05:46.520918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:23.831807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517416+0000","last_change":"2024-09-19T06:05:24.707671+0000","last_active":"2024-09-19T06:05:46.517416+0000","last_peered":"2024-09-19T06:05:46.517416+0000","last_clean":"2024-09-19T06:05:46.517416+0000","last_became_active":"2024-09-19T06:05:24.707325+0000","last_became_peered":"2024-09-19T06:05:24.707325+0000","last_unstale":"2024-09-19T06:05:46.517416+0000","last_undegraded":"2024-09-19T06:05:46.517416+0000","last_fullsized":"2024-09-19T06:05:46.517416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:32.149103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520934+0000","last_change":"2024-09-19T06:05:24.704875+0000","last_active":"2024-09-19T06:05:46.520934+0000","last_peered":"2024-09-19T06:05:46.520934+0000","last_clean":"2024-09-19T06:05:46.520934+0000","last_became_active":"2024-09-19T06:05:24.704501+0000","last_became_peered":"2024-09-19T06:05:24.704501+0000","last_unstale":"2024-09-19T06:05:46.520934+0000","last_undegraded":"2024-09-19T06:05:46.520934+0000","last_fullsized":"2024-09-19T06:05:46.520934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516956+0000","last_change":"2024-09-19T06:05:22.687857+0000","last_active":"2024-09-19T06:05:45.516956+0000","last_peered":"2024-09-19T06:05:45.516956+0000","last_clean":"2024-09-19T06:05:45.516956+0000","last_became_active":"2024-09-19T06:05:22.687573+0000","last_became_peered":"2024-09-19T06:05:22.687573+0000","last_unstale":"2024-09-19T06:05:45.516956+0000","last_undegraded":"2024-09-19T06:05:45.516956+0000","last_fullsized":"2024-09-19T06:05:45.516956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:31.972444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-19T06:05:25.699836+0000","last_change":"2024-09-19T06:05:45.517288+0000","last_active":"2024-09-19T06:05:45.517288+0000","last_peered":"2024-09-19T06:05:25.699836+0000","last_clean":"2024-09-19T06:05:25.699836+0000","last_became_active":"2024-09-19T06:05:24.693533+0000","last_became_peered":"2024-09-19T06:05:24.693533+0000","last_unstale":"2024-09-19T06:05:25.699836+0000","last_undegraded":"2024-09-19T06:05:25.699836+0000","last_fullsized":"2024-09-19T06:05:25.699836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521438+0000","last_change":"2024-09-19T06:05:22.680500+0000","last_active":"2024-09-19T06:05:45.521438+0000","last_peered":"2024-09-19T06:05:45.521438+0000","last_clean":"2024-09-19T06:05:45.521438+0000","last_became_active":"2024-09-19T06:05:22.679947+0000","last_became_peered":"2024-09-19T06:05:22.679947+0000","last_unstale":"2024-09-19T06:05:45.521438+0000","last_undegraded":"2024-09-19T06:05:45.521438+0000","last_fullsized":"2024-09-19T06:05:45.521438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:34.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:33.874859+0000","last_change":"2024-09-19T06:05:22.680962+0000","last_active":"2024-09-19T06:05:33.874859+0000","last_peered":"2024-09-19T06:05:33.874859+0000","last_clean":"2024-09-19T06:05:33.874859+0000","last_became_active":"2024-09-19T06:05:22.680662+0000","last_became_peered":"2024-09-19T06:05:22.680662+0000","last_unstale":"2024-09-19T06:05:33.874859+0000","last_undegraded":"2024-09-19T06:05:33.874859+0000","last_fullsized":"2024-09-19T06:05:33.874859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.296422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519895+0000","last_change":"2024-09-19T06:05:24.695214+0000","last_active":"2024-09-19T06:05:45.519895+0000","last_peered":"2024-09-19T06:05:45.519895+0000","last_clean":"2024-09-19T06:05:45.519895+0000","last_became_active":"2024-09-19T06:05:24.694930+0000","last_became_peered":"2024-09-19T06:05:24.694930+0000","last_unstale":"2024-09-19T06:05:45.519895+0000","last_undegraded":"2024-09-19T06:05:45.519895+0000","last_fullsized":"2024-09-19T06:05:45.519895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:51.382934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516314+0000","last_change":"2024-09-19T06:05:22.684504+0000","last_active":"2024-09-19T06:05:45.516314+0000","last_peered":"2024-09-19T06:05:45.516314+0000","last_clean":"2024-09-19T06:05:45.516314+0000","last_became_active":"2024-09-19T06:05:22.684169+0000","last_became_peered":"2024-09-19T06:05:22.684169+0000","last_unstale":"2024-09-19T06:05:45.516314+0000","last_undegraded":"2024-09-19T06:05:45.516314+0000","last_fullsized":"2024-09-19T06:05:45.516314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:29.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518059+0000","last_change":"2024-09-19T06:05:24.693056+0000","last_active":"2024-09-19T06:05:46.518059+0000","last_peered":"2024-09-19T06:05:46.518059+0000","last_clean":"2024-09-19T06:05:46.518059+0000","last_became_active":"2024-09-19T06:05:24.692544+0000","last_became_peered":"2024-09-19T06:05:24.692544+0000","last_unstale":"2024-09-19T06:05:46.518059+0000","last_undegraded":"2024-09-19T06:05:46.518059+0000","last_fullsized":"2024-09-19T06:05:46.518059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:45.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521794+0000","last_change":"2024-09-19T06:05:22.682854+0000","last_active":"2024-09-19T06:05:45.521794+0000","last_peered":"2024-09-19T06:05:45.521794+0000","last_clean":"2024-09-19T06:05:45.521794+0000","last_became_active":"2024-09-19T06:05:22.682406+0000","last_became_peered":"2024-09-19T06:05:22.682406+0000","last_unstale":"2024-09-19T06:05:45.521794+0000","last_undegraded":"2024-09-19T06:05:45.521794+0000","last_fullsized":"2024-09-19T06:05:45.521794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.206144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961915+0000","last_change":"2024-09-19T06:05:24.699408+0000","last_active":"2024-09-19T06:05:46.961915+0000","last_peered":"2024-09-19T06:05:46.961915+0000","last_clean":"2024-09-19T06:05:46.961915+0000","last_became_active":"2024-09-19T06:05:24.699106+0000","last_became_peered":"2024-09-19T06:05:24.699106+0000","last_unstale":"2024-09-19T06:05:46.961915+0000","last_undegraded":"2024-09-19T06:05:46.961915+0000","last_fullsized":"2024-09-19T06:05:46.961915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:37.487458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902210+0000","last_change":"2024-09-19T06:05:22.686106+0000","last_active":"2024-09-19T06:05:46.902210+0000","last_peered":"2024-09-19T06:05:46.902210+0000","last_clean":"2024-09-19T06:05:46.902210+0000","last_became_active":"2024-09-19T06:05:22.685763+0000","last_became_peered":"2024-09-19T06:05:22.685763+0000","last_unstale":"2024-09-19T06:05:46.902210+0000","last_undegraded":"2024-09-19T06:05:46.902210+0000","last_fullsized":"2024-09-19T06:05:46.902210+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:57.889128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.596069+0000","last_change":"2024-09-19T06:05:24.701859+0000","last_active":"2024-09-19T06:05:25.596069+0000","last_peered":"2024-09-19T06:05:25.596069+0000","last_clean":"2024-09-19T06:05:25.596069+0000","last_became_active":"2024-09-19T06:05:24.701247+0000","last_became_peered":"2024-09-19T06:05:24.701247+0000","last_unstale":"2024-09-19T06:05:25.596069+0000","last_undegraded":"2024-09-19T06:05:25.596069+0000","last_fullsized":"2024-09-19T06:05:25.596069+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:45.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516490+0000","last_change":"2024-09-19T06:05:23.060545+0000","last_active":"2024-09-19T06:05:45.516490+0000","last_peered":"2024-09-19T06:05:45.516490+0000","last_clean":"2024-09-19T06:05:45.516490+0000","last_became_active":"2024-09-19T06:05:23.060187+0000","last_became_peered":"2024-09-19T06:05:23.060187+0000","last_unstale":"2024-09-19T06:05:45.516490+0000","last_undegraded":"2024-09-19T06:05:45.516490+0000","last_fullsized":"2024-09-19T06:05:45.516490+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.604284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961566+0000","last_change":"2024-09-19T06:05:24.702535+0000","last_active":"2024-09-19T06:05:46.961566+0000","last_peered":"2024-09-19T06:05:46.961566+0000","last_clean":"2024-09-19T06:05:46.961566+0000","last_became_active":"2024-09-19T06:05:24.701616+0000","last_became_peered":"2024-09-19T06:05:24.701616+0000","last_unstale":"2024-09-19T06:05:46.961566+0000","last_undegraded":"2024-09-19T06:05:46.961566+0000","last_fullsized":"2024-09-19T06:05:46.961566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:43.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'25","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521595+0000","last_change":"2024-09-19T06:05:22.685460+0000","last_active":"2024-09-19T06:05:45.521595+0000","last_peered":"2024-09-19T06:05:45.521595+0000","last_clean":"2024-09-19T06:05:45.521595+0000","last_became_active":"2024-09-19T06:05:22.685086+0000","last_became_peered":"2024-09-19T06:05:22.685086+0000","last_unstale":"2024-09-19T06:05:45.521595+0000","last_undegraded":"2024-09-19T06:05:45.521595+0000","last_fullsized":"2024-09-19T06:05:45.521595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:10.373783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":53,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520872+0000","last_change":"2024-09-19T06:05:24.700431+0000","last_active":"2024-09-19T06:05:46.520872+0000","last_peered":"2024-09-19T06:05:46.520872+0000","last_clean":"2024-09-19T06:05:46.520872+0000","last_became_active":"2024-09-19T06:05:24.700092+0000","last_became_peered":"2024-09-19T06:05:24.700092+0000","last_unstale":"2024-09-19T06:05:46.520872+0000","last_undegraded":"2024-09-19T06:05:46.520872+0000","last_fullsized":"2024-09-19T06:05:46.520872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:17.208392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":10,"reported_epoch":80,"state":"active+recovering","last_fresh":"2024-09-19T06:05:46.524417+0000","last_change":"2024-09-19T06:05:46.525009+0000","last_active":"2024-09-19T06:05:46.524417+0000","last_peered":"2024-09-19T06:05:46.524417+0000","last_clean":"2024-09-19T06:05:34.883165+0000","last_became_active":"2024-09-19T06:05:46.521700+0000","last_became_peered":"2024-09-19T06:05:46.521700+0000","last_unstale":"2024-09-19T06:05:46.524417+0000","last_undegraded":"2024-09-19T06:05:46.517686+0000","last_fullsized":"2024-09-19T06:05:46.524417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":4,"num_objects_missing":4,"num_objects_degraded":0,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":["2","3","10"],"object_location_counts":[{"shards":"2,3,10","objects":4}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285120+0000","last_change":"2024-09-19T06:05:24.699149+0000","last_active":"2024-09-19T06:05:25.285120+0000","last_peered":"2024-09-19T06:05:25.285120+0000","last_clean":"2024-09-19T06:05:25.285120+0000","last_became_active":"2024-09-19T06:05:24.698846+0000","last_became_peered":"2024-09-19T06:05:24.698846+0000","last_unstale":"2024-09-19T06:05:25.285120+0000","last_undegraded":"2024-09-19T06:05:25.285120+0000","last_fullsized":"2024-09-19T06:05:25.285120+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:19.416169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516218+0000","last_change":"2024-09-19T06:05:22.682157+0000","last_active":"2024-09-19T06:05:45.516218+0000","last_peered":"2024-09-19T06:05:45.516218+0000","last_clean":"2024-09-19T06:05:45.516218+0000","last_became_active":"2024-09-19T06:05:22.681816+0000","last_became_peered":"2024-09-19T06:05:22.681816+0000","last_unstale":"2024-09-19T06:05:45.516218+0000","last_undegraded":"2024-09-19T06:05:45.516218+0000","last_fullsized":"2024-09-19T06:05:45.516218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:05.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902542+0000","last_change":"2024-09-19T06:05:24.699233+0000","last_active":"2024-09-19T06:05:46.902542+0000","last_peered":"2024-09-19T06:05:46.902542+0000","last_clean":"2024-09-19T06:05:46.902542+0000","last_became_active":"2024-09-19T06:05:24.698918+0000","last_became_peered":"2024-09-19T06:05:24.698918+0000","last_unstale":"2024-09-19T06:05:46.902542+0000","last_undegraded":"2024-09-19T06:05:46.902542+0000","last_fullsized":"2024-09-19T06:05:46.902542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519280+0000","last_change":"2024-09-19T06:05:22.682161+0000","last_active":"2024-09-19T06:05:45.519280+0000","last_peered":"2024-09-19T06:05:45.519280+0000","last_clean":"2024-09-19T06:05:45.519280+0000","last_became_active":"2024-09-19T06:05:22.681805+0000","last_became_peered":"2024-09-19T06:05:22.681805+0000","last_unstale":"2024-09-19T06:05:45.519280+0000","last_undegraded":"2024-09-19T06:05:45.519280+0000","last_fullsized":"2024-09-19T06:05:45.519280+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:27.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902474+0000","last_change":"2024-09-19T06:05:24.703668+0000","last_active":"2024-09-19T06:05:46.902474+0000","last_peered":"2024-09-19T06:05:46.902474+0000","last_clean":"2024-09-19T06:05:46.902474+0000","last_became_active":"2024-09-19T06:05:24.703342+0000","last_became_peered":"2024-09-19T06:05:24.703342+0000","last_unstale":"2024-09-19T06:05:46.902474+0000","last_undegraded":"2024-09-19T06:05:46.902474+0000","last_fullsized":"2024-09-19T06:05:46.902474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:30.399187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520049+0000","last_change":"2024-09-19T06:05:23.060458+0000","last_active":"2024-09-19T06:05:46.520049+0000","last_peered":"2024-09-19T06:05:46.520049+0000","last_clean":"2024-09-19T06:05:46.520049+0000","last_became_active":"2024-09-19T06:05:23.060098+0000","last_became_peered":"2024-09-19T06:05:23.060098+0000","last_unstale":"2024-09-19T06:05:46.520049+0000","last_undegraded":"2024-09-19T06:05:46.520049+0000","last_fullsized":"2024-09-19T06:05:46.520049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:58.800162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516140+0000","last_change":"2024-09-19T06:05:24.699832+0000","last_active":"2024-09-19T06:05:45.516140+0000","last_peered":"2024-09-19T06:05:45.516140+0000","last_clean":"2024-09-19T06:05:45.516140+0000","last_became_active":"2024-09-19T06:05:24.697600+0000","last_became_peered":"2024-09-19T06:05:24.697600+0000","last_unstale":"2024-09-19T06:05:45.516140+0000","last_undegraded":"2024-09-19T06:05:45.516140+0000","last_fullsized":"2024-09-19T06:05:45.516140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:15.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521202+0000","last_change":"2024-09-19T06:05:22.682962+0000","last_active":"2024-09-19T06:05:46.521202+0000","last_peered":"2024-09-19T06:05:46.521202+0000","last_clean":"2024-09-19T06:05:46.521202+0000","last_became_active":"2024-09-19T06:05:22.682573+0000","last_became_peered":"2024-09-19T06:05:22.682573+0000","last_unstale":"2024-09-19T06:05:46.521202+0000","last_undegraded":"2024-09-19T06:05:46.521202+0000","last_fullsized":"2024-09-19T06:05:46.521202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:31.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"activating","last_fresh":"2024-09-19T06:05:46.518241+0000","last_change":"2024-09-19T06:05:46.518241+0000","last_active":"2024-09-19T06:05:45.519007+0000","last_peered":"2024-09-19T06:05:26.522832+0000","last_clean":"2024-09-19T06:05:26.522832+0000","last_became_active":"2024-09-19T06:05:24.707289+0000","last_became_peered":"2024-09-19T06:05:24.707289+0000","last_unstale":"2024-09-19T06:05:46.518241+0000","last_undegraded":"2024-09-19T06:05:46.518241+0000","last_fullsized":"2024-09-19T06:05:46.518241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":["11","4","5","9"],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.699063+0000","last_change":"2024-09-19T06:05:22.684007+0000","last_active":"2024-09-19T06:05:25.699063+0000","last_peered":"2024-09-19T06:05:25.699063+0000","last_clean":"2024-09-19T06:05:25.699063+0000","last_became_active":"2024-09-19T06:05:22.683606+0000","last_became_peered":"2024-09-19T06:05:22.683606+0000","last_unstale":"2024-09-19T06:05:25.699063+0000","last_undegraded":"2024-09-19T06:05:25.699063+0000","last_fullsized":"2024-09-19T06:05:25.699063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:29.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902839+0000","last_change":"2024-09-19T06:05:24.698057+0000","last_active":"2024-09-19T06:05:46.902839+0000","last_peered":"2024-09-19T06:05:46.902839+0000","last_clean":"2024-09-19T06:05:46.902839+0000","last_became_active":"2024-09-19T06:05:24.697604+0000","last_became_peered":"2024-09-19T06:05:24.697604+0000","last_unstale":"2024-09-19T06:05:46.902839+0000","last_undegraded":"2024-09-19T06:05:46.902839+0000","last_fullsized":"2024-09-19T06:05:46.902839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:33.246096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516675+0000","last_change":"2024-09-19T06:05:22.680641+0000","last_active":"2024-09-19T06:05:45.516675+0000","last_peered":"2024-09-19T06:05:45.516675+0000","last_clean":"2024-09-19T06:05:45.516675+0000","last_became_active":"2024-09-19T06:05:22.680282+0000","last_became_peered":"2024-09-19T06:05:22.680282+0000","last_unstale":"2024-09-19T06:05:45.516675+0000","last_undegraded":"2024-09-19T06:05:45.516675+0000","last_fullsized":"2024-09-19T06:05:45.516675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:07.171581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902552+0000","last_change":"2024-09-19T06:05:24.705525+0000","last_active":"2024-09-19T06:05:46.902552+0000","last_peered":"2024-09-19T06:05:46.902552+0000","last_clean":"2024-09-19T06:05:46.902552+0000","last_became_active":"2024-09-19T06:05:24.705226+0000","last_became_peered":"2024-09-19T06:05:24.705226+0000","last_unstale":"2024-09-19T06:05:46.902552+0000","last_undegraded":"2024-09-19T06:05:46.902552+0000","last_fullsized":"2024-09-19T06:05:46.902552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:51.020525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522657+0000","last_change":"2024-09-19T06:05:23.060628+0000","last_active":"2024-09-19T06:05:46.522657+0000","last_peered":"2024-09-19T06:05:46.522657+0000","last_clean":"2024-09-19T06:05:46.522657+0000","last_became_active":"2024-09-19T06:05:23.060066+0000","last_became_peered":"2024-09-19T06:05:23.060066+0000","last_unstale":"2024-09-19T06:05:46.522657+0000","last_undegraded":"2024-09-19T06:05:46.522657+0000","last_fullsized":"2024-09-19T06:05:46.522657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:55.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902770+0000","last_change":"2024-09-19T06:05:24.701994+0000","last_active":"2024-09-19T06:05:46.902770+0000","last_peered":"2024-09-19T06:05:46.902770+0000","last_clean":"2024-09-19T06:05:46.902770+0000","last_became_active":"2024-09-19T06:05:24.701648+0000","last_became_peered":"2024-09-19T06:05:24.701648+0000","last_unstale":"2024-09-19T06:05:46.902770+0000","last_undegraded":"2024-09-19T06:05:46.902770+0000","last_fullsized":"2024-09-19T06:05:46.902770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:16.475339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902639+0000","last_change":"2024-09-19T06:04:14.186274+0000","last_active":"2024-09-19T06:05:46.902639+0000","last_peered":"2024-09-19T06:05:46.902639+0000","last_clean":"2024-09-19T06:05:46.902639+0000","last_became_active":"2024-09-19T06:04:14.185907+0000","last_became_peered":"2024-09-19T06:04:14.185907+0000","last_unstale":"2024-09-19T06:05:46.902639+0000","last_undegraded":"2024-09-19T06:05:46.902639+0000","last_fullsized":"2024-09-19T06:05:46.902639+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_clean_scrub_stamp":"2024-09-19T06:00:59.680614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:01.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519562+0000","last_change":"2024-09-19T06:05:22.682242+0000","last_active":"2024-09-19T06:05:45.519562+0000","last_peered":"2024-09-19T06:05:45.519562+0000","last_clean":"2024-09-19T06:05:45.519562+0000","last_became_active":"2024-09-19T06:05:22.681896+0000","last_became_peered":"2024-09-19T06:05:22.681896+0000","last_unstale":"2024-09-19T06:05:45.519562+0000","last_undegraded":"2024-09-19T06:05:45.519562+0000","last_fullsized":"2024-09-19T06:05:45.519562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.119422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.962902+0000","last_change":"2024-09-19T06:05:46.962541+0000","last_active":"2024-09-19T06:05:46.962902+0000","last_peered":"2024-09-19T06:05:46.962902+0000","last_clean":"2024-09-19T06:05:46.962902+0000","last_became_active":"2024-09-19T06:05:46.962261+0000","last_became_peered":"2024-09-19T06:05:46.962261+0000","last_unstale":"2024-09-19T06:05:46.962902+0000","last_undegraded":"2024-09-19T06:05:46.962902+0000","last_fullsized":"2024-09-19T06:05:46.962902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:36.355129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902052+0000","last_change":"2024-09-19T06:05:22.685809+0000","last_active":"2024-09-19T06:05:46.902052+0000","last_peered":"2024-09-19T06:05:46.902052+0000","last_clean":"2024-09-19T06:05:46.902052+0000","last_became_active":"2024-09-19T06:05:22.685466+0000","last_became_peered":"2024-09-19T06:05:22.685466+0000","last_unstale":"2024-09-19T06:05:46.902052+0000","last_undegraded":"2024-09-19T06:05:46.902052+0000","last_fullsized":"2024-09-19T06:05:46.902052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:43.793845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285079+0000","last_change":"2024-09-19T06:05:24.701105+0000","last_active":"2024-09-19T06:05:25.285079+0000","last_peered":"2024-09-19T06:05:25.285079+0000","last_clean":"2024-09-19T06:05:25.285079+0000","last_became_active":"2024-09-19T06:05:24.700825+0000","last_became_peered":"2024-09-19T06:05:24.700825+0000","last_unstale":"2024-09-19T06:05:25.285079+0000","last_undegraded":"2024-09-19T06:05:25.285079+0000","last_fullsized":"2024-09-19T06:05:25.285079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:35.707437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:42.896472+0000","last_change":"2024-09-19T06:05:23.059587+0000","last_active":"2024-09-19T06:05:42.896472+0000","last_peered":"2024-09-19T06:05:42.896472+0000","last_clean":"2024-09-19T06:05:42.896472+0000","last_became_active":"2024-09-19T06:05:23.059248+0000","last_became_peered":"2024-09-19T06:05:23.059248+0000","last_unstale":"2024-09-19T06:05:42.896472+0000","last_undegraded":"2024-09-19T06:05:42.896472+0000","last_fullsized":"2024-09-19T06:05:42.896472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:25.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516178+0000","last_change":"2024-09-19T06:05:24.701610+0000","last_active":"2024-09-19T06:05:45.516178+0000","last_peered":"2024-09-19T06:05:45.516178+0000","last_clean":"2024-09-19T06:05:45.516178+0000","last_became_active":"2024-09-19T06:05:24.697296+0000","last_became_peered":"2024-09-19T06:05:24.697296+0000","last_unstale":"2024-09-19T06:05:45.516178+0000","last_undegraded":"2024-09-19T06:05:45.516178+0000","last_fullsized":"2024-09-19T06:05:45.516178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:52.256284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902512+0000","last_change":"2024-09-19T06:05:22.684818+0000","last_active":"2024-09-19T06:05:46.902512+0000","last_peered":"2024-09-19T06:05:46.902512+0000","last_clean":"2024-09-19T06:05:46.902512+0000","last_became_active":"2024-09-19T06:05:22.684211+0000","last_became_peered":"2024-09-19T06:05:22.684211+0000","last_unstale":"2024-09-19T06:05:46.902512+0000","last_undegraded":"2024-09-19T06:05:46.902512+0000","last_fullsized":"2024-09-19T06:05:46.902512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:50.711805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521594+0000","last_change":"2024-09-19T06:05:24.702992+0000","last_active":"2024-09-19T06:05:45.521594+0000","last_peered":"2024-09-19T06:05:45.521594+0000","last_clean":"2024-09-19T06:05:45.521594+0000","last_became_active":"2024-09-19T06:05:24.702643+0000","last_became_peered":"2024-09-19T06:05:24.702643+0000","last_unstale":"2024-09-19T06:05:45.521594+0000","last_undegraded":"2024-09-19T06:05:45.521594+0000","last_fullsized":"2024-09-19T06:05:45.521594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:40.651861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518397+0000","last_change":"2024-09-19T06:05:23.060444+0000","last_active":"2024-09-19T06:05:46.518397+0000","last_peered":"2024-09-19T06:05:46.518397+0000","last_clean":"2024-09-19T06:05:46.518397+0000","last_became_active":"2024-09-19T06:05:23.059879+0000","last_became_peered":"2024-09-19T06:05:23.059879+0000","last_unstale":"2024-09-19T06:05:46.518397+0000","last_undegraded":"2024-09-19T06:05:46.518397+0000","last_fullsized":"2024-09-19T06:05:46.518397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:39.013096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521614+0000","last_change":"2024-09-19T06:05:24.694892+0000","last_active":"2024-09-19T06:05:45.521614+0000","last_peered":"2024-09-19T06:05:45.521614+0000","last_clean":"2024-09-19T06:05:45.521614+0000","last_became_active":"2024-09-19T06:05:24.694534+0000","last_became_peered":"2024-09-19T06:05:24.694534+0000","last_unstale":"2024-09-19T06:05:45.521614+0000","last_undegraded":"2024-09-19T06:05:45.521614+0000","last_fullsized":"2024-09-19T06:05:45.521614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:50.633035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521062+0000","last_change":"2024-09-19T06:05:23.060597+0000","last_active":"2024-09-19T06:05:46.521062+0000","last_peered":"2024-09-19T06:05:46.521062+0000","last_clean":"2024-09-19T06:05:46.521062+0000","last_became_active":"2024-09-19T06:05:23.060235+0000","last_became_peered":"2024-09-19T06:05:23.060235+0000","last_unstale":"2024-09-19T06:05:46.521062+0000","last_undegraded":"2024-09-19T06:05:46.521062+0000","last_fullsized":"2024-09-19T06:05:46.521062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:54.517780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.285380+0000","last_change":"2024-09-19T06:05:24.698131+0000","last_active":"2024-09-19T06:05:25.285380+0000","last_peered":"2024-09-19T06:05:25.285380+0000","last_clean":"2024-09-19T06:05:25.285380+0000","last_became_active":"2024-09-19T06:05:24.697784+0000","last_became_peered":"2024-09-19T06:05:24.697784+0000","last_unstale":"2024-09-19T06:05:25.285380+0000","last_undegraded":"2024-09-19T06:05:25.285380+0000","last_fullsized":"2024-09-19T06:05:25.285380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:49.563908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519139+0000","last_change":"2024-09-19T06:05:22.679532+0000","last_active":"2024-09-19T06:05:46.519139+0000","last_peered":"2024-09-19T06:05:46.519139+0000","last_clean":"2024-09-19T06:05:46.519139+0000","last_became_active":"2024-09-19T06:05:22.679156+0000","last_became_peered":"2024-09-19T06:05:22.679156+0000","last_unstale":"2024-09-19T06:05:46.519139+0000","last_undegraded":"2024-09-19T06:05:46.519139+0000","last_fullsized":"2024-09-19T06:05:46.519139+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:31.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520541+0000","last_change":"2024-09-19T06:05:24.698383+0000","last_active":"2024-09-19T06:05:45.520541+0000","last_peered":"2024-09-19T06:05:45.520541+0000","last_clean":"2024-09-19T06:05:45.520541+0000","last_became_active":"2024-09-19T06:05:24.698044+0000","last_became_peered":"2024-09-19T06:05:24.698044+0000","last_unstale":"2024-09-19T06:05:45.520541+0000","last_undegraded":"2024-09-19T06:05:45.520541+0000","last_fullsized":"2024-09-19T06:05:45.520541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:53.388847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519548+0000","last_change":"2024-09-19T06:05:22.684799+0000","last_active":"2024-09-19T06:05:45.519548+0000","last_peered":"2024-09-19T06:05:45.519548+0000","last_clean":"2024-09-19T06:05:45.519548+0000","last_became_active":"2024-09-19T06:05:22.684376+0000","last_became_peered":"2024-09-19T06:05:22.684376+0000","last_unstale":"2024-09-19T06:05:45.519548+0000","last_undegraded":"2024-09-19T06:05:45.519548+0000","last_fullsized":"2024-09-19T06:05:45.519548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.124960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.595940+0000","last_change":"2024-09-19T06:05:24.693751+0000","last_active":"2024-09-19T06:05:25.595940+0000","last_peered":"2024-09-19T06:05:25.595940+0000","last_clean":"2024-09-19T06:05:25.595940+0000","last_became_active":"2024-09-19T06:05:24.693442+0000","last_became_peered":"2024-09-19T06:05:24.693442+0000","last_unstale":"2024-09-19T06:05:25.595940+0000","last_undegraded":"2024-09-19T06:05:25.595940+0000","last_fullsized":"2024-09-19T06:05:25.595940+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:46.491860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961568+0000","last_change":"2024-09-19T06:05:23.060522+0000","last_active":"2024-09-19T06:05:46.961568+0000","last_peered":"2024-09-19T06:05:46.961568+0000","last_clean":"2024-09-19T06:05:46.961568+0000","last_became_active":"2024-09-19T06:05:23.060170+0000","last_became_peered":"2024-09-19T06:05:23.060170+0000","last_unstale":"2024-09-19T06:05:46.961568+0000","last_undegraded":"2024-09-19T06:05:46.961568+0000","last_fullsized":"2024-09-19T06:05:46.961568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:54.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520186+0000","last_change":"2024-09-19T06:05:24.701242+0000","last_active":"2024-09-19T06:05:46.520186+0000","last_peered":"2024-09-19T06:05:46.520186+0000","last_clean":"2024-09-19T06:05:46.520186+0000","last_became_active":"2024-09-19T06:05:24.700813+0000","last_became_peered":"2024-09-19T06:05:24.700813+0000","last_unstale":"2024-09-19T06:05:46.520186+0000","last_undegraded":"2024-09-19T06:05:46.520186+0000","last_fullsized":"2024-09-19T06:05:46.520186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:42.706448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519153+0000","last_change":"2024-09-19T06:05:22.677502+0000","last_active":"2024-09-19T06:05:45.519153+0000","last_peered":"2024-09-19T06:05:45.519153+0000","last_clean":"2024-09-19T06:05:45.519153+0000","last_became_active":"2024-09-19T06:05:22.677082+0000","last_became_peered":"2024-09-19T06:05:22.677082+0000","last_unstale":"2024-09-19T06:05:45.519153+0000","last_undegraded":"2024-09-19T06:05:45.519153+0000","last_fullsized":"2024-09-19T06:05:45.519153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:30.991778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517459+0000","last_change":"2024-09-19T06:05:24.703155+0000","last_active":"2024-09-19T06:05:46.517459+0000","last_peered":"2024-09-19T06:05:46.517459+0000","last_clean":"2024-09-19T06:05:46.517459+0000","last_became_active":"2024-09-19T06:05:24.702570+0000","last_became_peered":"2024-09-19T06:05:24.702570+0000","last_unstale":"2024-09-19T06:05:46.517459+0000","last_undegraded":"2024-09-19T06:05:46.517459+0000","last_fullsized":"2024-09-19T06:05:46.517459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:36.016886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":9,"reported_epoch":80,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-19T06:05:46.523692+0000","last_change":"2024-09-19T06:05:46.523692+0000","last_active":"2024-09-19T06:05:46.523692+0000","last_peered":"2024-09-19T06:05:46.523692+0000","last_clean":"2024-09-19T06:05:33.863678+0000","last_became_active":"2024-09-19T06:05:46.523271+0000","last_became_peered":"2024-09-19T06:05:46.523271+0000","last_unstale":"2024-09-19T06:05:46.523692+0000","last_undegraded":"2024-09-19T06:05:46.517640+0000","last_fullsized":"2024-09-19T06:05:46.523692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":1,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":["2","3","8"],"object_location_counts":[{"shards":"2,3,8","objects":1}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521497+0000","last_change":"2024-09-19T06:05:24.694476+0000","last_active":"2024-09-19T06:05:45.521497+0000","last_peered":"2024-09-19T06:05:45.521497+0000","last_clean":"2024-09-19T06:05:45.521497+0000","last_became_active":"2024-09-19T06:05:24.694147+0000","last_became_peered":"2024-09-19T06:05:24.694147+0000","last_unstale":"2024-09-19T06:05:45.521497+0000","last_undegraded":"2024-09-19T06:05:45.521497+0000","last_fullsized":"2024-09-19T06:05:45.521497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:48.830522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520434+0000","last_change":"2024-09-19T06:05:22.687422+0000","last_active":"2024-09-19T06:05:46.520434+0000","last_peered":"2024-09-19T06:05:46.520434+0000","last_clean":"2024-09-19T06:05:46.520434+0000","last_became_active":"2024-09-19T06:05:22.686950+0000","last_became_peered":"2024-09-19T06:05:22.686950+0000","last_unstale":"2024-09-19T06:05:46.520434+0000","last_undegraded":"2024-09-19T06:05:46.520434+0000","last_fullsized":"2024-09-19T06:05:46.520434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:49.279769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902432+0000","last_change":"2024-09-19T06:05:24.695701+0000","last_active":"2024-09-19T06:05:46.902432+0000","last_peered":"2024-09-19T06:05:46.902432+0000","last_clean":"2024-09-19T06:05:46.902432+0000","last_became_active":"2024-09-19T06:05:24.695341+0000","last_became_peered":"2024-09-19T06:05:24.695341+0000","last_unstale":"2024-09-19T06:05:46.902432+0000","last_undegraded":"2024-09-19T06:05:46.902432+0000","last_fullsized":"2024-09-19T06:05:46.902432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:52.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.516455+0000","last_change":"2024-09-19T06:05:24.703456+0000","last_active":"2024-09-19T06:05:45.516455+0000","last_peered":"2024-09-19T06:05:45.516455+0000","last_clean":"2024-09-19T06:05:45.516455+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:45.516455+0000","last_undegraded":"2024-09-19T06:05:45.516455+0000","last_fullsized":"2024-09-19T06:05:45.516455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:15.159843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520802+0000","last_change":"2024-09-19T06:05:22.683833+0000","last_active":"2024-09-19T06:05:46.520802+0000","last_peered":"2024-09-19T06:05:46.520802+0000","last_clean":"2024-09-19T06:05:46.520802+0000","last_became_active":"2024-09-19T06:05:22.683439+0000","last_became_peered":"2024-09-19T06:05:22.683439+0000","last_unstale":"2024-09-19T06:05:46.520802+0000","last_undegraded":"2024-09-19T06:05:46.520802+0000","last_fullsized":"2024-09-19T06:05:46.520802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:52.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961492+0000","last_change":"2024-09-19T06:05:24.695905+0000","last_active":"2024-09-19T06:05:46.961492+0000","last_peered":"2024-09-19T06:05:46.961492+0000","last_clean":"2024-09-19T06:05:46.961492+0000","last_became_active":"2024-09-19T06:05:24.695570+0000","last_became_peered":"2024-09-19T06:05:24.695570+0000","last_unstale":"2024-09-19T06:05:46.961492+0000","last_undegraded":"2024-09-19T06:05:46.961492+0000","last_fullsized":"2024-09-19T06:05:46.961492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:00.167126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520961+0000","last_change":"2024-09-19T06:05:22.686853+0000","last_active":"2024-09-19T06:05:46.520961+0000","last_peered":"2024-09-19T06:05:46.520961+0000","last_clean":"2024-09-19T06:05:46.520961+0000","last_became_active":"2024-09-19T06:05:22.686143+0000","last_became_peered":"2024-09-19T06:05:22.686143+0000","last_unstale":"2024-09-19T06:05:46.520961+0000","last_undegraded":"2024-09-19T06:05:46.520961+0000","last_fullsized":"2024-09-19T06:05:46.520961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:30.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-19T06:05:25.596034+0000","last_change":"2024-09-19T06:05:24.702420+0000","last_active":"2024-09-19T06:05:25.596034+0000","last_peered":"2024-09-19T06:05:25.596034+0000","last_clean":"2024-09-19T06:05:25.596034+0000","last_became_active":"2024-09-19T06:05:24.702140+0000","last_became_peered":"2024-09-19T06:05:24.702140+0000","last_unstale":"2024-09-19T06:05:25.596034+0000","last_undegraded":"2024-09-19T06:05:25.596034+0000","last_fullsized":"2024-09-19T06:05:25.596034+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:27.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520502+0000","last_change":"2024-09-19T06:05:23.059638+0000","last_active":"2024-09-19T06:05:45.520502+0000","last_peered":"2024-09-19T06:05:45.520502+0000","last_clean":"2024-09-19T06:05:45.520502+0000","last_became_active":"2024-09-19T06:05:23.059273+0000","last_became_peered":"2024-09-19T06:05:23.059273+0000","last_unstale":"2024-09-19T06:05:45.520502+0000","last_undegraded":"2024-09-19T06:05:45.520502+0000","last_fullsized":"2024-09-19T06:05:45.520502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:56.981598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519791+0000","last_change":"2024-09-19T06:05:24.703608+0000","last_active":"2024-09-19T06:05:45.519791+0000","last_peered":"2024-09-19T06:05:45.519791+0000","last_clean":"2024-09-19T06:05:45.519791+0000","last_became_active":"2024-09-19T06:05:24.703300+0000","last_became_peered":"2024-09-19T06:05:24.703300+0000","last_unstale":"2024-09-19T06:05:45.519791+0000","last_undegraded":"2024-09-19T06:05:45.519791+0000","last_fullsized":"2024-09-19T06:05:45.519791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.063545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518702+0000","last_change":"2024-09-19T06:05:22.679379+0000","last_active":"2024-09-19T06:05:46.518702+0000","last_peered":"2024-09-19T06:05:46.518702+0000","last_clean":"2024-09-19T06:05:46.518702+0000","last_became_active":"2024-09-19T06:05:22.679091+0000","last_became_peered":"2024-09-19T06:05:22.679091+0000","last_unstale":"2024-09-19T06:05:46.518702+0000","last_undegraded":"2024-09-19T06:05:46.518702+0000","last_fullsized":"2024-09-19T06:05:46.518702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53722,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":5,"num_objects_missing":5,"num_objects_degraded":1,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":89,"num_read_kb":92,"num_write":151,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":161132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645329,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":419478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874261,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1043439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037787,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":888832,"data_stored":428136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":428056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32640,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712512,"statfs":{"total":95995035648,"available":95961612288,"internally_reserved":0,"allocated":1482752,"data_stored":1019595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659177,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":410518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32620,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712532,"statfs":{"total":95995035648,"available":95961632768,"internally_reserved":0,"allocated":1470464,"data_stored":1002272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":419540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":419414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444092,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":478746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":477430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":411789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":51428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":51690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:05:52.188 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:05:52.437 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:52.817 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:52 smithi103 ceph-mon[30925]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:52.817 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:52 smithi103 ceph-mon[30925]: pgmap v283: 97 pgs: 1 active+recovery_wait+degraded, 1 activating, 1 active+recovering, 94 active+clean; 633 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 1/192 objects degraded (0.521%); 4/192 objects misplaced (2.083%) 2024-09-19T06:05:52.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.895+0000 7fd7762ff640 1 -- 172.21.15.103:0/3882975275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd770102790 msgr2=0x7fd7701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.895+0000 7fd7762ff640 1 --2- 172.21.15.103:0/3882975275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd770102790 0x7fd7701067e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd764009900 tx=0x7fd76402a410 comp rx=0 tx=0).stop 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.895+0000 7fd7762ff640 1 -- 172.21.15.103:0/3882975275 shutdown_connections 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.895+0000 7fd7762ff640 1 --2- 172.21.15.103:0/3882975275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd770106f10 0x7fd77010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.895+0000 7fd7762ff640 1 --2- 172.21.15.103:0/3882975275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd770102790 0x7fd7701067e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.895+0000 7fd7762ff640 1 --2- 172.21.15.103:0/3882975275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd770101de0 0x7fd7701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.895+0000 7fd7762ff640 1 -- 172.21.15.103:0/3882975275 >> 172.21.15.103:0/3882975275 conn(0x7fd7700fd8c0 msgr2=0x7fd7700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.895+0000 7fd7762ff640 1 -- 172.21.15.103:0/3882975275 shutdown_connections 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.895+0000 7fd7762ff640 1 -- 172.21.15.103:0/3882975275 wait complete. 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.895+0000 7fd7762ff640 1 Processor -- start 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd7762ff640 1 -- start start 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd7762ff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd770101de0 0x7fd7701982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd7762ff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd770102790 0x7fd770198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd7762ff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd770106f10 0x7fd77019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd7762ff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd770111de0 con 0x7fd770101de0 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd7762ff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd770111c60 con 0x7fd770102790 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd7762ff640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd770111f60 con 0x7fd770106f10 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd76ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd770101de0 0x7fd7701982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd76ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd770101de0 0x7fd7701982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60488/0 (socket says 172.21.15.103:60488) 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd76ffff640 1 -- 172.21.15.103:0/875406510 learned_addr learned my addr 172.21.15.103:0/875406510 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd77489c640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd770106f10 0x7fd77019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd76f7fe640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd770102790 0x7fd770198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd76ffff640 1 -- 172.21.15.103:0/875406510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd770106f10 msgr2=0x7fd77019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd76ffff640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd770106f10 0x7fd77019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd76ffff640 1 -- 172.21.15.103:0/875406510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd770102790 msgr2=0x7fd770198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd76ffff640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd770102790 0x7fd770198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd76ffff640 1 -- 172.21.15.103:0/875406510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77019d290 con 0x7fd770101de0 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd77489c640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd770106f10 0x7fd77019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.896+0000 7fd76ffff640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd770101de0 0x7fd7701982e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd76000c920 tx=0x7fd76000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.897+0000 7fd76d7fa640 1 -- 172.21.15.103:0/875406510 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760007c70 con 0x7fd770101de0 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.897+0000 7fd76d7fa640 1 -- 172.21.15.103:0/875406510 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd760007e10 con 0x7fd770101de0 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.897+0000 7fd7762ff640 1 -- 172.21.15.103:0/875406510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77019d580 con 0x7fd770101de0 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.897+0000 7fd76d7fa640 1 -- 172.21.15.103:0/875406510 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760018820 con 0x7fd770101de0 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.897+0000 7fd7762ff640 1 -- 172.21.15.103:0/875406510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7701a4e60 con 0x7fd770101de0 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.898+0000 7fd7762ff640 1 -- 172.21.15.103:0/875406510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7701021c0 con 0x7fd770101de0 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.899+0000 7fd76d7fa640 1 -- 172.21.15.103:0/875406510 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd7600189c0 con 0x7fd770101de0 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.899+0000 7fd76d7fa640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7580a32d0 0x7fd7580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.899+0000 7fd76f7fe640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7580a32d0 0x7fd7580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:52.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.899+0000 7fd76d7fa640 1 -- 172.21.15.103:0/875406510 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd7600cff10 con 0x7fd770101de0 2024-09-19T06:05:52.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.900+0000 7fd76f7fe640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7580a32d0 0x7fd7580a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd764031440 tx=0x7fd7640095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:52.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:52.902+0000 7fd76d7fa640 1 -- 172.21.15.103:0/875406510 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd760014030 con 0x7fd770101de0 2024-09-19T06:05:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:52 smithi174 ceph-mon[34488]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:52 smithi174 ceph-mon[34488]: pgmap v283: 97 pgs: 1 active+recovery_wait+degraded, 1 activating, 1 active+recovering, 94 active+clean; 633 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 1/192 objects degraded (0.521%); 4/192 objects misplaced (2.083%) 2024-09-19T06:05:53.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:52 smithi169 ceph-mon[34350]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:53.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:52 smithi169 ceph-mon[34350]: pgmap v283: 97 pgs: 1 active+recovery_wait+degraded, 1 activating, 1 active+recovering, 94 active+clean; 633 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 1/192 objects degraded (0.521%); 4/192 objects misplaced (2.083%) 2024-09-19T06:05:53.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.067+0000 7fd7762ff640 1 -- 172.21.15.103:0/875406510 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd770062630 con 0x7fd7580a32d0 2024-09-19T06:05:53.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.074+0000 7fd76d7fa640 1 -- 172.21.15.103:0/875406510 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258714 (secure 0 0 0) 0x7fd770062630 con 0x7fd7580a32d0 2024-09-19T06:05:53.078 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:53.079 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T06:05:53.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 -- 172.21.15.103:0/875406510 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7580a32d0 msgr2=0x7fd7580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:53.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7580a32d0 0x7fd7580a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd764031440 tx=0x7fd7640095f0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 -- 172.21.15.103:0/875406510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd770101de0 msgr2=0x7fd7701982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:53.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd770101de0 0x7fd7701982e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd76000c920 tx=0x7fd76000cde0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 -- 172.21.15.103:0/875406510 shutdown_connections 2024-09-19T06:05:53.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd7580a32d0 0x7fd7580a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd770106f10 0x7fd77019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd770102790 0x7fd770198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 --2- 172.21.15.103:0/875406510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd770101de0 0x7fd7701982e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 -- 172.21.15.103:0/875406510 >> 172.21.15.103:0/875406510 conn(0x7fd7700fd8c0 msgr2=0x7fd7700fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:53.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 -- 172.21.15.103:0/875406510 shutdown_connections 2024-09-19T06:05:53.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:53.078+0000 7fd7762ff640 1 -- 172.21.15.103:0/875406510 wait complete. 2024-09-19T06:05:53.856 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:53 smithi103 ceph-mon[30925]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2024-09-19T06:05:53.856 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:53 smithi103 ceph-mon[30925]: Cluster is now healthy 2024-09-19T06:05:53.890 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-19T06:05:51.456145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648581,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":5,"num_objects_missing":5,"num_objects_degraded":1,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":251,"num_read_kb":235,"num_write":335,"num_write_kb":3040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361604,"kb_used_data":12288,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580220,"statfs":{"total":1151940427776,"available":1151570145280,"internally_reserved":0,"allocated":12582912,"data_stored":7039745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27539,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":5,"num_objects_missing":5,"num_objects_degraded":1,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":72,"num_write":16,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002042"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518052+0000","last_change":"2024-09-19T06:05:24.703290+0000","last_active":"2024-09-19T06:05:46.518052+0000","last_peered":"2024-09-19T06:05:46.518052+0000","last_clean":"2024-09-19T06:05:46.518052+0000","last_became_active":"2024-09-19T06:05:24.702343+0000","last_became_peered":"2024-09-19T06:05:24.702343+0000","last_unstale":"2024-09-19T06:05:46.518052+0000","last_undegraded":"2024-09-19T06:05:46.518052+0000","last_fullsized":"2024-09-19T06:05:46.518052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.594004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519636+0000","last_change":"2024-09-19T06:05:24.700363+0000","last_active":"2024-09-19T06:05:46.519636+0000","last_peered":"2024-09-19T06:05:46.519636+0000","last_clean":"2024-09-19T06:05:46.519636+0000","last_became_active":"2024-09-19T06:05:24.700066+0000","last_became_peered":"2024-09-19T06:05:24.700066+0000","last_unstale":"2024-09-19T06:05:46.519636+0000","last_undegraded":"2024-09-19T06:05:46.519636+0000","last_fullsized":"2024-09-19T06:05:46.519636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:26.094195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519554+0000","last_change":"2024-09-19T06:05:24.702458+0000","last_active":"2024-09-19T06:05:46.519554+0000","last_peered":"2024-09-19T06:05:46.519554+0000","last_clean":"2024-09-19T06:05:46.519554+0000","last_became_active":"2024-09-19T06:05:24.702029+0000","last_became_peered":"2024-09-19T06:05:24.702029+0000","last_unstale":"2024-09-19T06:05:46.519554+0000","last_undegraded":"2024-09-19T06:05:46.519554+0000","last_fullsized":"2024-09-19T06:05:46.519554+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519250+0000","last_change":"2024-09-19T06:05:24.699402+0000","last_active":"2024-09-19T06:05:45.519250+0000","last_peered":"2024-09-19T06:05:45.519250+0000","last_clean":"2024-09-19T06:05:45.519250+0000","last_became_active":"2024-09-19T06:05:24.698191+0000","last_became_peered":"2024-09-19T06:05:24.698191+0000","last_unstale":"2024-09-19T06:05:45.519250+0000","last_undegraded":"2024-09-19T06:05:45.519250+0000","last_fullsized":"2024-09-19T06:05:45.519250+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.056347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520337+0000","last_change":"2024-09-19T06:05:24.699821+0000","last_active":"2024-09-19T06:05:46.520337+0000","last_peered":"2024-09-19T06:05:46.520337+0000","last_clean":"2024-09-19T06:05:46.520337+0000","last_became_active":"2024-09-19T06:05:24.699493+0000","last_became_peered":"2024-09-19T06:05:24.699493+0000","last_unstale":"2024-09-19T06:05:46.520337+0000","last_undegraded":"2024-09-19T06:05:46.520337+0000","last_fullsized":"2024-09-19T06:05:46.520337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:34.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517699+0000","last_change":"2024-09-19T06:05:24.697821+0000","last_active":"2024-09-19T06:05:46.517699+0000","last_peered":"2024-09-19T06:05:46.517699+0000","last_clean":"2024-09-19T06:05:46.517699+0000","last_became_active":"2024-09-19T06:05:24.697495+0000","last_became_peered":"2024-09-19T06:05:24.697495+0000","last_unstale":"2024-09-19T06:05:46.517699+0000","last_undegraded":"2024-09-19T06:05:46.517699+0000","last_fullsized":"2024-09-19T06:05:46.517699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:03.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902318+0000","last_change":"2024-09-19T06:05:24.704610+0000","last_active":"2024-09-19T06:05:46.902318+0000","last_peered":"2024-09-19T06:05:46.902318+0000","last_clean":"2024-09-19T06:05:46.902318+0000","last_became_active":"2024-09-19T06:05:24.704288+0000","last_became_peered":"2024-09-19T06:05:24.704288+0000","last_unstale":"2024-09-19T06:05:46.902318+0000","last_undegraded":"2024-09-19T06:05:46.902318+0000","last_fullsized":"2024-09-19T06:05:46.902318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.530553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520054+0000","last_change":"2024-09-19T06:05:24.693662+0000","last_active":"2024-09-19T06:05:45.520054+0000","last_peered":"2024-09-19T06:05:45.520054+0000","last_clean":"2024-09-19T06:05:45.520054+0000","last_became_active":"2024-09-19T06:05:24.693327+0000","last_became_peered":"2024-09-19T06:05:24.693327+0000","last_unstale":"2024-09-19T06:05:45.520054+0000","last_undegraded":"2024-09-19T06:05:45.520054+0000","last_fullsized":"2024-09-19T06:05:45.520054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:39.646907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961884+0000","last_change":"2024-09-19T06:05:24.702552+0000","last_active":"2024-09-19T06:05:46.961884+0000","last_peered":"2024-09-19T06:05:46.961884+0000","last_clean":"2024-09-19T06:05:46.961884+0000","last_became_active":"2024-09-19T06:05:24.701090+0000","last_became_peered":"2024-09-19T06:05:24.701090+0000","last_unstale":"2024-09-19T06:05:46.961884+0000","last_undegraded":"2024-09-19T06:05:46.961884+0000","last_fullsized":"2024-09-19T06:05:46.961884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:44.361368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.524330+0000","last_change":"2024-09-19T06:05:46.524330+0000","last_active":"2024-09-19T06:05:46.524330+0000","last_peered":"2024-09-19T06:05:46.524330+0000","last_clean":"2024-09-19T06:05:46.524330+0000","last_became_active":"2024-09-19T06:05:46.523934+0000","last_became_peered":"2024-09-19T06:05:46.523934+0000","last_unstale":"2024-09-19T06:05:46.524330+0000","last_undegraded":"2024-09-19T06:05:46.524330+0000","last_fullsized":"2024-09-19T06:05:46.524330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:11:12.301698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902755+0000","last_change":"2024-09-19T06:05:24.703118+0000","last_active":"2024-09-19T06:05:46.902755+0000","last_peered":"2024-09-19T06:05:46.902755+0000","last_clean":"2024-09-19T06:05:46.902755+0000","last_became_active":"2024-09-19T06:05:24.702561+0000","last_became_peered":"2024-09-19T06:05:24.702561+0000","last_unstale":"2024-09-19T06:05:46.902755+0000","last_undegraded":"2024-09-19T06:05:46.902755+0000","last_fullsized":"2024-09-19T06:05:46.902755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:51.063256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519359+0000","last_change":"2024-09-19T06:05:24.698704+0000","last_active":"2024-09-19T06:05:45.519359+0000","last_peered":"2024-09-19T06:05:45.519359+0000","last_clean":"2024-09-19T06:05:45.519359+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:45.519359+0000","last_undegraded":"2024-09-19T06:05:45.519359+0000","last_fullsized":"2024-09-19T06:05:45.519359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:35.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903589+0000","last_change":"2024-09-19T06:05:24.696236+0000","last_active":"2024-09-19T06:05:46.903589+0000","last_peered":"2024-09-19T06:05:46.903589+0000","last_clean":"2024-09-19T06:05:46.903589+0000","last_became_active":"2024-09-19T06:05:24.695952+0000","last_became_peered":"2024-09-19T06:05:24.695952+0000","last_unstale":"2024-09-19T06:05:46.903589+0000","last_undegraded":"2024-09-19T06:05:46.903589+0000","last_fullsized":"2024-09-19T06:05:46.903589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:17.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519455+0000","last_change":"2024-09-19T06:05:24.699962+0000","last_active":"2024-09-19T06:05:46.519455+0000","last_peered":"2024-09-19T06:05:46.519455+0000","last_clean":"2024-09-19T06:05:46.519455+0000","last_became_active":"2024-09-19T06:05:24.699625+0000","last_became_peered":"2024-09-19T06:05:24.699625+0000","last_unstale":"2024-09-19T06:05:46.519455+0000","last_undegraded":"2024-09-19T06:05:46.519455+0000","last_fullsized":"2024-09-19T06:05:46.519455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:34.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519460+0000","last_change":"2024-09-19T06:05:24.701310+0000","last_active":"2024-09-19T06:05:46.519460+0000","last_peered":"2024-09-19T06:05:46.519460+0000","last_clean":"2024-09-19T06:05:46.519460+0000","last_became_active":"2024-09-19T06:05:24.701032+0000","last_became_peered":"2024-09-19T06:05:24.701032+0000","last_unstale":"2024-09-19T06:05:46.519460+0000","last_undegraded":"2024-09-19T06:05:46.519460+0000","last_fullsized":"2024-09-19T06:05:46.519460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:29.557533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961314+0000","last_change":"2024-09-19T06:05:24.699803+0000","last_active":"2024-09-19T06:05:46.961314+0000","last_peered":"2024-09-19T06:05:46.961314+0000","last_clean":"2024-09-19T06:05:46.961314+0000","last_became_active":"2024-09-19T06:05:24.699506+0000","last_became_peered":"2024-09-19T06:05:24.699506+0000","last_unstale":"2024-09-19T06:05:46.961314+0000","last_undegraded":"2024-09-19T06:05:46.961314+0000","last_fullsized":"2024-09-19T06:05:46.961314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:32.669231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518157+0000","last_change":"2024-09-19T06:05:24.703805+0000","last_active":"2024-09-19T06:05:46.518157+0000","last_peered":"2024-09-19T06:05:46.518157+0000","last_clean":"2024-09-19T06:05:46.518157+0000","last_became_active":"2024-09-19T06:05:24.702728+0000","last_became_peered":"2024-09-19T06:05:24.702728+0000","last_unstale":"2024-09-19T06:05:46.518157+0000","last_undegraded":"2024-09-19T06:05:46.518157+0000","last_fullsized":"2024-09-19T06:05:46.518157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:20.807530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518737+0000","last_change":"2024-09-19T06:05:24.691055+0000","last_active":"2024-09-19T06:05:46.518737+0000","last_peered":"2024-09-19T06:05:46.518737+0000","last_clean":"2024-09-19T06:05:46.518737+0000","last_became_active":"2024-09-19T06:05:24.690165+0000","last_became_peered":"2024-09-19T06:05:24.690165+0000","last_unstale":"2024-09-19T06:05:46.518737+0000","last_undegraded":"2024-09-19T06:05:46.518737+0000","last_fullsized":"2024-09-19T06:05:46.518737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:48.656335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521695+0000","last_change":"2024-09-19T06:05:24.697955+0000","last_active":"2024-09-19T06:05:46.521695+0000","last_peered":"2024-09-19T06:05:46.521695+0000","last_clean":"2024-09-19T06:05:46.521695+0000","last_became_active":"2024-09-19T06:05:24.697598+0000","last_became_peered":"2024-09-19T06:05:24.697598+0000","last_unstale":"2024-09-19T06:05:46.521695+0000","last_undegraded":"2024-09-19T06:05:46.521695+0000","last_fullsized":"2024-09-19T06:05:46.521695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.458647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517664+0000","last_change":"2024-09-19T06:05:24.705110+0000","last_active":"2024-09-19T06:05:46.517664+0000","last_peered":"2024-09-19T06:05:46.517664+0000","last_clean":"2024-09-19T06:05:46.517664+0000","last_became_active":"2024-09-19T06:05:24.704783+0000","last_became_peered":"2024-09-19T06:05:24.704783+0000","last_unstale":"2024-09-19T06:05:46.517664+0000","last_undegraded":"2024-09-19T06:05:46.517664+0000","last_fullsized":"2024-09-19T06:05:46.517664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:43.092969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903641+0000","last_change":"2024-09-19T06:05:24.693845+0000","last_active":"2024-09-19T06:05:46.903641+0000","last_peered":"2024-09-19T06:05:46.903641+0000","last_clean":"2024-09-19T06:05:46.903641+0000","last_became_active":"2024-09-19T06:05:24.693385+0000","last_became_peered":"2024-09-19T06:05:24.693385+0000","last_unstale":"2024-09-19T06:05:46.903641+0000","last_undegraded":"2024-09-19T06:05:46.903641+0000","last_fullsized":"2024-09-19T06:05:46.903641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:05.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961617+0000","last_change":"2024-09-19T06:05:24.697903+0000","last_active":"2024-09-19T06:05:46.961617+0000","last_peered":"2024-09-19T06:05:46.961617+0000","last_clean":"2024-09-19T06:05:46.961617+0000","last_became_active":"2024-09-19T06:05:24.697566+0000","last_became_peered":"2024-09-19T06:05:24.697566+0000","last_unstale":"2024-09-19T06:05:46.961617+0000","last_undegraded":"2024-09-19T06:05:46.961617+0000","last_fullsized":"2024-09-19T06:05:46.961617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:10.340401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.518978+0000","last_change":"2024-09-19T06:05:24.696888+0000","last_active":"2024-09-19T06:05:45.518978+0000","last_peered":"2024-09-19T06:05:45.518978+0000","last_clean":"2024-09-19T06:05:45.518978+0000","last_became_active":"2024-09-19T06:05:24.696554+0000","last_became_peered":"2024-09-19T06:05:24.696554+0000","last_unstale":"2024-09-19T06:05:45.518978+0000","last_undegraded":"2024-09-19T06:05:45.518978+0000","last_fullsized":"2024-09-19T06:05:45.518978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520726+0000","last_change":"2024-09-19T06:05:24.692443+0000","last_active":"2024-09-19T06:05:46.520726+0000","last_peered":"2024-09-19T06:05:46.520726+0000","last_clean":"2024-09-19T06:05:46.520726+0000","last_became_active":"2024-09-19T06:05:24.690555+0000","last_became_peered":"2024-09-19T06:05:24.690555+0000","last_unstale":"2024-09-19T06:05:46.520726+0000","last_undegraded":"2024-09-19T06:05:46.520726+0000","last_fullsized":"2024-09-19T06:05:46.520726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:29.340744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520428+0000","last_change":"2024-09-19T06:05:24.699379+0000","last_active":"2024-09-19T06:05:45.520428+0000","last_peered":"2024-09-19T06:05:45.520428+0000","last_clean":"2024-09-19T06:05:45.520428+0000","last_became_active":"2024-09-19T06:05:24.699056+0000","last_became_peered":"2024-09-19T06:05:24.699056+0000","last_unstale":"2024-09-19T06:05:45.520428+0000","last_undegraded":"2024-09-19T06:05:45.520428+0000","last_fullsized":"2024-09-19T06:05:45.520428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:30.337080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521950+0000","last_change":"2024-09-19T06:05:24.698672+0000","last_active":"2024-09-19T06:05:46.521950+0000","last_peered":"2024-09-19T06:05:46.521950+0000","last_clean":"2024-09-19T06:05:46.521950+0000","last_became_active":"2024-09-19T06:05:24.698229+0000","last_became_peered":"2024-09-19T06:05:24.698229+0000","last_unstale":"2024-09-19T06:05:46.521950+0000","last_undegraded":"2024-09-19T06:05:46.521950+0000","last_fullsized":"2024-09-19T06:05:46.521950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.082538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517858+0000","last_change":"2024-09-19T06:05:24.707830+0000","last_active":"2024-09-19T06:05:46.517858+0000","last_peered":"2024-09-19T06:05:46.517858+0000","last_clean":"2024-09-19T06:05:46.517858+0000","last_became_active":"2024-09-19T06:05:24.707478+0000","last_became_peered":"2024-09-19T06:05:24.707478+0000","last_unstale":"2024-09-19T06:05:46.517858+0000","last_undegraded":"2024-09-19T06:05:46.517858+0000","last_fullsized":"2024-09-19T06:05:46.517858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:33.484877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903437+0000","last_change":"2024-09-19T06:05:24.697232+0000","last_active":"2024-09-19T06:05:46.903437+0000","last_peered":"2024-09-19T06:05:46.903437+0000","last_clean":"2024-09-19T06:05:46.903437+0000","last_became_active":"2024-09-19T06:05:24.696727+0000","last_became_peered":"2024-09-19T06:05:24.696727+0000","last_unstale":"2024-09-19T06:05:46.903437+0000","last_undegraded":"2024-09-19T06:05:46.903437+0000","last_fullsized":"2024-09-19T06:05:46.903437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:36.168493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519637+0000","last_change":"2024-09-19T06:05:24.695489+0000","last_active":"2024-09-19T06:05:46.519637+0000","last_peered":"2024-09-19T06:05:46.519637+0000","last_clean":"2024-09-19T06:05:46.519637+0000","last_became_active":"2024-09-19T06:05:24.695012+0000","last_became_peered":"2024-09-19T06:05:24.695012+0000","last_unstale":"2024-09-19T06:05:46.519637+0000","last_undegraded":"2024-09-19T06:05:46.519637+0000","last_fullsized":"2024-09-19T06:05:46.519637+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:41.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522199+0000","last_change":"2024-09-19T06:05:24.697294+0000","last_active":"2024-09-19T06:05:46.522199+0000","last_peered":"2024-09-19T06:05:46.522199+0000","last_clean":"2024-09-19T06:05:46.522199+0000","last_became_active":"2024-09-19T06:05:24.696563+0000","last_became_peered":"2024-09-19T06:05:24.696563+0000","last_unstale":"2024-09-19T06:05:46.522199+0000","last_undegraded":"2024-09-19T06:05:46.522199+0000","last_fullsized":"2024-09-19T06:05:46.522199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:41.861120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520918+0000","last_change":"2024-09-19T06:05:24.702710+0000","last_active":"2024-09-19T06:05:46.520918+0000","last_peered":"2024-09-19T06:05:46.520918+0000","last_clean":"2024-09-19T06:05:46.520918+0000","last_became_active":"2024-09-19T06:05:24.702039+0000","last_became_peered":"2024-09-19T06:05:24.702039+0000","last_unstale":"2024-09-19T06:05:46.520918+0000","last_undegraded":"2024-09-19T06:05:46.520918+0000","last_fullsized":"2024-09-19T06:05:46.520918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:23.831807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517416+0000","last_change":"2024-09-19T06:05:24.707671+0000","last_active":"2024-09-19T06:05:46.517416+0000","last_peered":"2024-09-19T06:05:46.517416+0000","last_clean":"2024-09-19T06:05:46.517416+0000","last_became_active":"2024-09-19T06:05:24.707325+0000","last_became_peered":"2024-09-19T06:05:24.707325+0000","last_unstale":"2024-09-19T06:05:46.517416+0000","last_undegraded":"2024-09-19T06:05:46.517416+0000","last_fullsized":"2024-09-19T06:05:46.517416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:32.149103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520934+0000","last_change":"2024-09-19T06:05:24.704875+0000","last_active":"2024-09-19T06:05:46.520934+0000","last_peered":"2024-09-19T06:05:46.520934+0000","last_clean":"2024-09-19T06:05:46.520934+0000","last_became_active":"2024-09-19T06:05:24.704501+0000","last_became_peered":"2024-09-19T06:05:24.704501+0000","last_unstale":"2024-09-19T06:05:46.520934+0000","last_undegraded":"2024-09-19T06:05:46.520934+0000","last_fullsized":"2024-09-19T06:05:46.520934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:48.905457+0000","last_change":"2024-09-19T06:05:22.687857+0000","last_active":"2024-09-19T06:05:48.905457+0000","last_peered":"2024-09-19T06:05:48.905457+0000","last_clean":"2024-09-19T06:05:48.905457+0000","last_became_active":"2024-09-19T06:05:22.687573+0000","last_became_peered":"2024-09-19T06:05:22.687573+0000","last_unstale":"2024-09-19T06:05:48.905457+0000","last_undegraded":"2024-09-19T06:05:48.905457+0000","last_fullsized":"2024-09-19T06:05:48.905457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:31.972444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.904521+0000","last_change":"2024-09-19T06:05:46.904521+0000","last_active":"2024-09-19T06:05:46.904521+0000","last_peered":"2024-09-19T06:05:46.904521+0000","last_clean":"2024-09-19T06:05:46.904521+0000","last_became_active":"2024-09-19T06:05:46.904146+0000","last_became_peered":"2024-09-19T06:05:46.904146+0000","last_unstale":"2024-09-19T06:05:46.904521+0000","last_undegraded":"2024-09-19T06:05:46.904521+0000","last_fullsized":"2024-09-19T06:05:46.904521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:48.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517810+0000","last_change":"2024-09-19T06:05:22.680500+0000","last_active":"2024-09-19T06:05:46.517810+0000","last_peered":"2024-09-19T06:05:46.517810+0000","last_clean":"2024-09-19T06:05:46.517810+0000","last_became_active":"2024-09-19T06:05:22.679947+0000","last_became_peered":"2024-09-19T06:05:22.679947+0000","last_unstale":"2024-09-19T06:05:46.517810+0000","last_undegraded":"2024-09-19T06:05:46.517810+0000","last_fullsized":"2024-09-19T06:05:46.517810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:34.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902704+0000","last_change":"2024-09-19T06:05:22.680962+0000","last_active":"2024-09-19T06:05:46.902704+0000","last_peered":"2024-09-19T06:05:46.902704+0000","last_clean":"2024-09-19T06:05:46.902704+0000","last_became_active":"2024-09-19T06:05:22.680662+0000","last_became_peered":"2024-09-19T06:05:22.680662+0000","last_unstale":"2024-09-19T06:05:46.902704+0000","last_undegraded":"2024-09-19T06:05:46.902704+0000","last_fullsized":"2024-09-19T06:05:46.902704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.296422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519895+0000","last_change":"2024-09-19T06:05:24.695214+0000","last_active":"2024-09-19T06:05:45.519895+0000","last_peered":"2024-09-19T06:05:45.519895+0000","last_clean":"2024-09-19T06:05:45.519895+0000","last_became_active":"2024-09-19T06:05:24.694930+0000","last_became_peered":"2024-09-19T06:05:24.694930+0000","last_unstale":"2024-09-19T06:05:45.519895+0000","last_undegraded":"2024-09-19T06:05:45.519895+0000","last_fullsized":"2024-09-19T06:05:45.519895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:51.382934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520982+0000","last_change":"2024-09-19T06:05:22.684504+0000","last_active":"2024-09-19T06:05:46.520982+0000","last_peered":"2024-09-19T06:05:46.520982+0000","last_clean":"2024-09-19T06:05:46.520982+0000","last_became_active":"2024-09-19T06:05:22.684169+0000","last_became_peered":"2024-09-19T06:05:22.684169+0000","last_unstale":"2024-09-19T06:05:46.520982+0000","last_undegraded":"2024-09-19T06:05:46.520982+0000","last_fullsized":"2024-09-19T06:05:46.520982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:29.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518059+0000","last_change":"2024-09-19T06:05:24.693056+0000","last_active":"2024-09-19T06:05:46.518059+0000","last_peered":"2024-09-19T06:05:46.518059+0000","last_clean":"2024-09-19T06:05:46.518059+0000","last_became_active":"2024-09-19T06:05:24.692544+0000","last_became_peered":"2024-09-19T06:05:24.692544+0000","last_unstale":"2024-09-19T06:05:46.518059+0000","last_undegraded":"2024-09-19T06:05:46.518059+0000","last_fullsized":"2024-09-19T06:05:46.518059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:45.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:48.904828+0000","last_change":"2024-09-19T06:05:22.682854+0000","last_active":"2024-09-19T06:05:48.904828+0000","last_peered":"2024-09-19T06:05:48.904828+0000","last_clean":"2024-09-19T06:05:48.904828+0000","last_became_active":"2024-09-19T06:05:22.682406+0000","last_became_peered":"2024-09-19T06:05:22.682406+0000","last_unstale":"2024-09-19T06:05:48.904828+0000","last_undegraded":"2024-09-19T06:05:48.904828+0000","last_fullsized":"2024-09-19T06:05:48.904828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.206144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961915+0000","last_change":"2024-09-19T06:05:24.699408+0000","last_active":"2024-09-19T06:05:46.961915+0000","last_peered":"2024-09-19T06:05:46.961915+0000","last_clean":"2024-09-19T06:05:46.961915+0000","last_became_active":"2024-09-19T06:05:24.699106+0000","last_became_peered":"2024-09-19T06:05:24.699106+0000","last_unstale":"2024-09-19T06:05:46.961915+0000","last_undegraded":"2024-09-19T06:05:46.961915+0000","last_fullsized":"2024-09-19T06:05:46.961915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:37.487458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902210+0000","last_change":"2024-09-19T06:05:22.686106+0000","last_active":"2024-09-19T06:05:46.902210+0000","last_peered":"2024-09-19T06:05:46.902210+0000","last_clean":"2024-09-19T06:05:46.902210+0000","last_became_active":"2024-09-19T06:05:22.685763+0000","last_became_peered":"2024-09-19T06:05:22.685763+0000","last_unstale":"2024-09-19T06:05:46.902210+0000","last_undegraded":"2024-09-19T06:05:46.902210+0000","last_fullsized":"2024-09-19T06:05:46.902210+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:57.889128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.524038+0000","last_change":"2024-09-19T06:05:46.524038+0000","last_active":"2024-09-19T06:05:46.524038+0000","last_peered":"2024-09-19T06:05:46.524038+0000","last_clean":"2024-09-19T06:05:46.524038+0000","last_became_active":"2024-09-19T06:05:46.523746+0000","last_became_peered":"2024-09-19T06:05:46.523746+0000","last_unstale":"2024-09-19T06:05:46.524038+0000","last_undegraded":"2024-09-19T06:05:46.524038+0000","last_fullsized":"2024-09-19T06:05:46.524038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:17.361840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519825+0000","last_change":"2024-09-19T06:05:23.060545+0000","last_active":"2024-09-19T06:05:46.519825+0000","last_peered":"2024-09-19T06:05:46.519825+0000","last_clean":"2024-09-19T06:05:46.519825+0000","last_became_active":"2024-09-19T06:05:23.060187+0000","last_became_peered":"2024-09-19T06:05:23.060187+0000","last_unstale":"2024-09-19T06:05:46.519825+0000","last_undegraded":"2024-09-19T06:05:46.519825+0000","last_fullsized":"2024-09-19T06:05:46.519825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.604284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961566+0000","last_change":"2024-09-19T06:05:24.702535+0000","last_active":"2024-09-19T06:05:46.961566+0000","last_peered":"2024-09-19T06:05:46.961566+0000","last_clean":"2024-09-19T06:05:46.961566+0000","last_became_active":"2024-09-19T06:05:24.701616+0000","last_became_peered":"2024-09-19T06:05:24.701616+0000","last_unstale":"2024-09-19T06:05:46.961566+0000","last_undegraded":"2024-09-19T06:05:46.961566+0000","last_fullsized":"2024-09-19T06:05:46.961566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:43.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'26","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:49.907015+0000","last_change":"2024-09-19T06:05:22.685460+0000","last_active":"2024-09-19T06:05:49.907015+0000","last_peered":"2024-09-19T06:05:49.907015+0000","last_clean":"2024-09-19T06:05:49.907015+0000","last_became_active":"2024-09-19T06:05:22.685086+0000","last_became_peered":"2024-09-19T06:05:22.685086+0000","last_unstale":"2024-09-19T06:05:49.907015+0000","last_undegraded":"2024-09-19T06:05:49.907015+0000","last_fullsized":"2024-09-19T06:05:49.907015+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:10.373783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54369,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":67,"num_write":27,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520872+0000","last_change":"2024-09-19T06:05:24.700431+0000","last_active":"2024-09-19T06:05:46.520872+0000","last_peered":"2024-09-19T06:05:46.520872+0000","last_clean":"2024-09-19T06:05:46.520872+0000","last_became_active":"2024-09-19T06:05:24.700092+0000","last_became_peered":"2024-09-19T06:05:24.700092+0000","last_unstale":"2024-09-19T06:05:46.520872+0000","last_undegraded":"2024-09-19T06:05:46.520872+0000","last_fullsized":"2024-09-19T06:05:46.520872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:17.208392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":10,"reported_epoch":80,"state":"active+recovering","last_fresh":"2024-09-19T06:05:46.524417+0000","last_change":"2024-09-19T06:05:46.525009+0000","last_active":"2024-09-19T06:05:46.524417+0000","last_peered":"2024-09-19T06:05:46.524417+0000","last_clean":"2024-09-19T06:05:34.883165+0000","last_became_active":"2024-09-19T06:05:46.521700+0000","last_became_peered":"2024-09-19T06:05:46.521700+0000","last_unstale":"2024-09-19T06:05:46.524417+0000","last_undegraded":"2024-09-19T06:05:46.517686+0000","last_fullsized":"2024-09-19T06:05:46.524417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":4,"num_objects_missing":4,"num_objects_degraded":0,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":["2","3","10"],"object_location_counts":[{"shards":"2,3,10","objects":4}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903307+0000","last_change":"2024-09-19T06:05:24.699149+0000","last_active":"2024-09-19T06:05:46.903307+0000","last_peered":"2024-09-19T06:05:46.903307+0000","last_clean":"2024-09-19T06:05:46.903307+0000","last_became_active":"2024-09-19T06:05:24.698846+0000","last_became_peered":"2024-09-19T06:05:24.698846+0000","last_unstale":"2024-09-19T06:05:46.903307+0000","last_undegraded":"2024-09-19T06:05:46.903307+0000","last_fullsized":"2024-09-19T06:05:46.903307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:19.416169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519763+0000","last_change":"2024-09-19T06:05:22.682157+0000","last_active":"2024-09-19T06:05:46.519763+0000","last_peered":"2024-09-19T06:05:46.519763+0000","last_clean":"2024-09-19T06:05:46.519763+0000","last_became_active":"2024-09-19T06:05:22.681816+0000","last_became_peered":"2024-09-19T06:05:22.681816+0000","last_unstale":"2024-09-19T06:05:46.519763+0000","last_undegraded":"2024-09-19T06:05:46.519763+0000","last_fullsized":"2024-09-19T06:05:46.519763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:05.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902542+0000","last_change":"2024-09-19T06:05:24.699233+0000","last_active":"2024-09-19T06:05:46.902542+0000","last_peered":"2024-09-19T06:05:46.902542+0000","last_clean":"2024-09-19T06:05:46.902542+0000","last_became_active":"2024-09-19T06:05:24.698918+0000","last_became_peered":"2024-09-19T06:05:24.698918+0000","last_unstale":"2024-09-19T06:05:46.902542+0000","last_undegraded":"2024-09-19T06:05:46.902542+0000","last_fullsized":"2024-09-19T06:05:46.902542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519280+0000","last_change":"2024-09-19T06:05:22.682161+0000","last_active":"2024-09-19T06:05:45.519280+0000","last_peered":"2024-09-19T06:05:45.519280+0000","last_clean":"2024-09-19T06:05:45.519280+0000","last_became_active":"2024-09-19T06:05:22.681805+0000","last_became_peered":"2024-09-19T06:05:22.681805+0000","last_unstale":"2024-09-19T06:05:45.519280+0000","last_undegraded":"2024-09-19T06:05:45.519280+0000","last_fullsized":"2024-09-19T06:05:45.519280+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:27.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902474+0000","last_change":"2024-09-19T06:05:24.703668+0000","last_active":"2024-09-19T06:05:46.902474+0000","last_peered":"2024-09-19T06:05:46.902474+0000","last_clean":"2024-09-19T06:05:46.902474+0000","last_became_active":"2024-09-19T06:05:24.703342+0000","last_became_peered":"2024-09-19T06:05:24.703342+0000","last_unstale":"2024-09-19T06:05:46.902474+0000","last_undegraded":"2024-09-19T06:05:46.902474+0000","last_fullsized":"2024-09-19T06:05:46.902474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:30.399187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520049+0000","last_change":"2024-09-19T06:05:23.060458+0000","last_active":"2024-09-19T06:05:46.520049+0000","last_peered":"2024-09-19T06:05:46.520049+0000","last_clean":"2024-09-19T06:05:46.520049+0000","last_became_active":"2024-09-19T06:05:23.060098+0000","last_became_peered":"2024-09-19T06:05:23.060098+0000","last_unstale":"2024-09-19T06:05:46.520049+0000","last_undegraded":"2024-09-19T06:05:46.520049+0000","last_fullsized":"2024-09-19T06:05:46.520049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:58.800162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519964+0000","last_change":"2024-09-19T06:05:24.699832+0000","last_active":"2024-09-19T06:05:46.519964+0000","last_peered":"2024-09-19T06:05:46.519964+0000","last_clean":"2024-09-19T06:05:46.519964+0000","last_became_active":"2024-09-19T06:05:24.697600+0000","last_became_peered":"2024-09-19T06:05:24.697600+0000","last_unstale":"2024-09-19T06:05:46.519964+0000","last_undegraded":"2024-09-19T06:05:46.519964+0000","last_fullsized":"2024-09-19T06:05:46.519964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:15.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521202+0000","last_change":"2024-09-19T06:05:22.682962+0000","last_active":"2024-09-19T06:05:46.521202+0000","last_peered":"2024-09-19T06:05:46.521202+0000","last_clean":"2024-09-19T06:05:46.521202+0000","last_became_active":"2024-09-19T06:05:22.682573+0000","last_became_peered":"2024-09-19T06:05:22.682573+0000","last_unstale":"2024-09-19T06:05:46.521202+0000","last_undegraded":"2024-09-19T06:05:46.521202+0000","last_fullsized":"2024-09-19T06:05:46.521202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:31.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"activating","last_fresh":"2024-09-19T06:05:46.518241+0000","last_change":"2024-09-19T06:05:46.518241+0000","last_active":"2024-09-19T06:05:45.519007+0000","last_peered":"2024-09-19T06:05:26.522832+0000","last_clean":"2024-09-19T06:05:26.522832+0000","last_became_active":"2024-09-19T06:05:24.707289+0000","last_became_peered":"2024-09-19T06:05:24.707289+0000","last_unstale":"2024-09-19T06:05:46.518241+0000","last_undegraded":"2024-09-19T06:05:46.518241+0000","last_fullsized":"2024-09-19T06:05:46.518241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":["11","4","5","9"],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902723+0000","last_change":"2024-09-19T06:05:22.684007+0000","last_active":"2024-09-19T06:05:46.902723+0000","last_peered":"2024-09-19T06:05:46.902723+0000","last_clean":"2024-09-19T06:05:46.902723+0000","last_became_active":"2024-09-19T06:05:22.683606+0000","last_became_peered":"2024-09-19T06:05:22.683606+0000","last_unstale":"2024-09-19T06:05:46.902723+0000","last_undegraded":"2024-09-19T06:05:46.902723+0000","last_fullsized":"2024-09-19T06:05:46.902723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:29.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902839+0000","last_change":"2024-09-19T06:05:24.698057+0000","last_active":"2024-09-19T06:05:46.902839+0000","last_peered":"2024-09-19T06:05:46.902839+0000","last_clean":"2024-09-19T06:05:46.902839+0000","last_became_active":"2024-09-19T06:05:24.697604+0000","last_became_peered":"2024-09-19T06:05:24.697604+0000","last_unstale":"2024-09-19T06:05:46.902839+0000","last_undegraded":"2024-09-19T06:05:46.902839+0000","last_fullsized":"2024-09-19T06:05:46.902839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:33.246096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520103+0000","last_change":"2024-09-19T06:05:22.680641+0000","last_active":"2024-09-19T06:05:46.520103+0000","last_peered":"2024-09-19T06:05:46.520103+0000","last_clean":"2024-09-19T06:05:46.520103+0000","last_became_active":"2024-09-19T06:05:22.680282+0000","last_became_peered":"2024-09-19T06:05:22.680282+0000","last_unstale":"2024-09-19T06:05:46.520103+0000","last_undegraded":"2024-09-19T06:05:46.520103+0000","last_fullsized":"2024-09-19T06:05:46.520103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:07.171581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902552+0000","last_change":"2024-09-19T06:05:24.705525+0000","last_active":"2024-09-19T06:05:46.902552+0000","last_peered":"2024-09-19T06:05:46.902552+0000","last_clean":"2024-09-19T06:05:46.902552+0000","last_became_active":"2024-09-19T06:05:24.705226+0000","last_became_peered":"2024-09-19T06:05:24.705226+0000","last_unstale":"2024-09-19T06:05:46.902552+0000","last_undegraded":"2024-09-19T06:05:46.902552+0000","last_fullsized":"2024-09-19T06:05:46.902552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:51.020525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522657+0000","last_change":"2024-09-19T06:05:23.060628+0000","last_active":"2024-09-19T06:05:46.522657+0000","last_peered":"2024-09-19T06:05:46.522657+0000","last_clean":"2024-09-19T06:05:46.522657+0000","last_became_active":"2024-09-19T06:05:23.060066+0000","last_became_peered":"2024-09-19T06:05:23.060066+0000","last_unstale":"2024-09-19T06:05:46.522657+0000","last_undegraded":"2024-09-19T06:05:46.522657+0000","last_fullsized":"2024-09-19T06:05:46.522657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:55.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902770+0000","last_change":"2024-09-19T06:05:24.701994+0000","last_active":"2024-09-19T06:05:46.902770+0000","last_peered":"2024-09-19T06:05:46.902770+0000","last_clean":"2024-09-19T06:05:46.902770+0000","last_became_active":"2024-09-19T06:05:24.701648+0000","last_became_peered":"2024-09-19T06:05:24.701648+0000","last_unstale":"2024-09-19T06:05:46.902770+0000","last_undegraded":"2024-09-19T06:05:46.902770+0000","last_fullsized":"2024-09-19T06:05:46.902770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:16.475339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902639+0000","last_change":"2024-09-19T06:04:14.186274+0000","last_active":"2024-09-19T06:05:46.902639+0000","last_peered":"2024-09-19T06:05:46.902639+0000","last_clean":"2024-09-19T06:05:46.902639+0000","last_became_active":"2024-09-19T06:04:14.185907+0000","last_became_peered":"2024-09-19T06:04:14.185907+0000","last_unstale":"2024-09-19T06:05:46.902639+0000","last_undegraded":"2024-09-19T06:05:46.902639+0000","last_fullsized":"2024-09-19T06:05:46.902639+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_clean_scrub_stamp":"2024-09-19T06:00:59.680614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:01.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519562+0000","last_change":"2024-09-19T06:05:22.682242+0000","last_active":"2024-09-19T06:05:45.519562+0000","last_peered":"2024-09-19T06:05:45.519562+0000","last_clean":"2024-09-19T06:05:45.519562+0000","last_became_active":"2024-09-19T06:05:22.681896+0000","last_became_peered":"2024-09-19T06:05:22.681896+0000","last_unstale":"2024-09-19T06:05:45.519562+0000","last_undegraded":"2024-09-19T06:05:45.519562+0000","last_fullsized":"2024-09-19T06:05:45.519562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.119422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.962902+0000","last_change":"2024-09-19T06:05:46.962541+0000","last_active":"2024-09-19T06:05:46.962902+0000","last_peered":"2024-09-19T06:05:46.962902+0000","last_clean":"2024-09-19T06:05:46.962902+0000","last_became_active":"2024-09-19T06:05:46.962261+0000","last_became_peered":"2024-09-19T06:05:46.962261+0000","last_unstale":"2024-09-19T06:05:46.962902+0000","last_undegraded":"2024-09-19T06:05:46.962902+0000","last_fullsized":"2024-09-19T06:05:46.962902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:36.355129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902052+0000","last_change":"2024-09-19T06:05:22.685809+0000","last_active":"2024-09-19T06:05:46.902052+0000","last_peered":"2024-09-19T06:05:46.902052+0000","last_clean":"2024-09-19T06:05:46.902052+0000","last_became_active":"2024-09-19T06:05:22.685466+0000","last_became_peered":"2024-09-19T06:05:22.685466+0000","last_unstale":"2024-09-19T06:05:46.902052+0000","last_undegraded":"2024-09-19T06:05:46.902052+0000","last_fullsized":"2024-09-19T06:05:46.902052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:43.793845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903209+0000","last_change":"2024-09-19T06:05:24.701105+0000","last_active":"2024-09-19T06:05:46.903209+0000","last_peered":"2024-09-19T06:05:46.903209+0000","last_clean":"2024-09-19T06:05:46.903209+0000","last_became_active":"2024-09-19T06:05:24.700825+0000","last_became_peered":"2024-09-19T06:05:24.700825+0000","last_unstale":"2024-09-19T06:05:46.903209+0000","last_undegraded":"2024-09-19T06:05:46.903209+0000","last_fullsized":"2024-09-19T06:05:46.903209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:35.707437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:47.907231+0000","last_change":"2024-09-19T06:05:23.059587+0000","last_active":"2024-09-19T06:05:47.907231+0000","last_peered":"2024-09-19T06:05:47.907231+0000","last_clean":"2024-09-19T06:05:47.907231+0000","last_became_active":"2024-09-19T06:05:23.059248+0000","last_became_peered":"2024-09-19T06:05:23.059248+0000","last_unstale":"2024-09-19T06:05:47.907231+0000","last_undegraded":"2024-09-19T06:05:47.907231+0000","last_fullsized":"2024-09-19T06:05:47.907231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:25.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520818+0000","last_change":"2024-09-19T06:05:24.701610+0000","last_active":"2024-09-19T06:05:46.520818+0000","last_peered":"2024-09-19T06:05:46.520818+0000","last_clean":"2024-09-19T06:05:46.520818+0000","last_became_active":"2024-09-19T06:05:24.697296+0000","last_became_peered":"2024-09-19T06:05:24.697296+0000","last_unstale":"2024-09-19T06:05:46.520818+0000","last_undegraded":"2024-09-19T06:05:46.520818+0000","last_fullsized":"2024-09-19T06:05:46.520818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:52.256284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902512+0000","last_change":"2024-09-19T06:05:22.684818+0000","last_active":"2024-09-19T06:05:46.902512+0000","last_peered":"2024-09-19T06:05:46.902512+0000","last_clean":"2024-09-19T06:05:46.902512+0000","last_became_active":"2024-09-19T06:05:22.684211+0000","last_became_peered":"2024-09-19T06:05:22.684211+0000","last_unstale":"2024-09-19T06:05:46.902512+0000","last_undegraded":"2024-09-19T06:05:46.902512+0000","last_fullsized":"2024-09-19T06:05:46.902512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:50.711805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517975+0000","last_change":"2024-09-19T06:05:24.702992+0000","last_active":"2024-09-19T06:05:46.517975+0000","last_peered":"2024-09-19T06:05:46.517975+0000","last_clean":"2024-09-19T06:05:46.517975+0000","last_became_active":"2024-09-19T06:05:24.702643+0000","last_became_peered":"2024-09-19T06:05:24.702643+0000","last_unstale":"2024-09-19T06:05:46.517975+0000","last_undegraded":"2024-09-19T06:05:46.517975+0000","last_fullsized":"2024-09-19T06:05:46.517975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:40.651861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518397+0000","last_change":"2024-09-19T06:05:23.060444+0000","last_active":"2024-09-19T06:05:46.518397+0000","last_peered":"2024-09-19T06:05:46.518397+0000","last_clean":"2024-09-19T06:05:46.518397+0000","last_became_active":"2024-09-19T06:05:23.059879+0000","last_became_peered":"2024-09-19T06:05:23.059879+0000","last_unstale":"2024-09-19T06:05:46.518397+0000","last_undegraded":"2024-09-19T06:05:46.518397+0000","last_fullsized":"2024-09-19T06:05:46.518397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:39.013096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517898+0000","last_change":"2024-09-19T06:05:24.694892+0000","last_active":"2024-09-19T06:05:46.517898+0000","last_peered":"2024-09-19T06:05:46.517898+0000","last_clean":"2024-09-19T06:05:46.517898+0000","last_became_active":"2024-09-19T06:05:24.694534+0000","last_became_peered":"2024-09-19T06:05:24.694534+0000","last_unstale":"2024-09-19T06:05:46.517898+0000","last_undegraded":"2024-09-19T06:05:46.517898+0000","last_fullsized":"2024-09-19T06:05:46.517898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:50.633035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521062+0000","last_change":"2024-09-19T06:05:23.060597+0000","last_active":"2024-09-19T06:05:46.521062+0000","last_peered":"2024-09-19T06:05:46.521062+0000","last_clean":"2024-09-19T06:05:46.521062+0000","last_became_active":"2024-09-19T06:05:23.060235+0000","last_became_peered":"2024-09-19T06:05:23.060235+0000","last_unstale":"2024-09-19T06:05:46.521062+0000","last_undegraded":"2024-09-19T06:05:46.521062+0000","last_fullsized":"2024-09-19T06:05:46.521062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:54.517780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903431+0000","last_change":"2024-09-19T06:05:24.698131+0000","last_active":"2024-09-19T06:05:46.903431+0000","last_peered":"2024-09-19T06:05:46.903431+0000","last_clean":"2024-09-19T06:05:46.903431+0000","last_became_active":"2024-09-19T06:05:24.697784+0000","last_became_peered":"2024-09-19T06:05:24.697784+0000","last_unstale":"2024-09-19T06:05:46.903431+0000","last_undegraded":"2024-09-19T06:05:46.903431+0000","last_fullsized":"2024-09-19T06:05:46.903431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:49.563908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519139+0000","last_change":"2024-09-19T06:05:22.679532+0000","last_active":"2024-09-19T06:05:46.519139+0000","last_peered":"2024-09-19T06:05:46.519139+0000","last_clean":"2024-09-19T06:05:46.519139+0000","last_became_active":"2024-09-19T06:05:22.679156+0000","last_became_peered":"2024-09-19T06:05:22.679156+0000","last_unstale":"2024-09-19T06:05:46.519139+0000","last_undegraded":"2024-09-19T06:05:46.519139+0000","last_fullsized":"2024-09-19T06:05:46.519139+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:31.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520541+0000","last_change":"2024-09-19T06:05:24.698383+0000","last_active":"2024-09-19T06:05:45.520541+0000","last_peered":"2024-09-19T06:05:45.520541+0000","last_clean":"2024-09-19T06:05:45.520541+0000","last_became_active":"2024-09-19T06:05:24.698044+0000","last_became_peered":"2024-09-19T06:05:24.698044+0000","last_unstale":"2024-09-19T06:05:45.520541+0000","last_undegraded":"2024-09-19T06:05:45.520541+0000","last_fullsized":"2024-09-19T06:05:45.520541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:53.388847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519548+0000","last_change":"2024-09-19T06:05:22.684799+0000","last_active":"2024-09-19T06:05:45.519548+0000","last_peered":"2024-09-19T06:05:45.519548+0000","last_clean":"2024-09-19T06:05:45.519548+0000","last_became_active":"2024-09-19T06:05:22.684376+0000","last_became_peered":"2024-09-19T06:05:22.684376+0000","last_unstale":"2024-09-19T06:05:45.519548+0000","last_undegraded":"2024-09-19T06:05:45.519548+0000","last_fullsized":"2024-09-19T06:05:45.519548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.124960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519736+0000","last_change":"2024-09-19T06:05:24.693751+0000","last_active":"2024-09-19T06:05:46.519736+0000","last_peered":"2024-09-19T06:05:46.519736+0000","last_clean":"2024-09-19T06:05:46.519736+0000","last_became_active":"2024-09-19T06:05:24.693442+0000","last_became_peered":"2024-09-19T06:05:24.693442+0000","last_unstale":"2024-09-19T06:05:46.519736+0000","last_undegraded":"2024-09-19T06:05:46.519736+0000","last_fullsized":"2024-09-19T06:05:46.519736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:46.491860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961568+0000","last_change":"2024-09-19T06:05:23.060522+0000","last_active":"2024-09-19T06:05:46.961568+0000","last_peered":"2024-09-19T06:05:46.961568+0000","last_clean":"2024-09-19T06:05:46.961568+0000","last_became_active":"2024-09-19T06:05:23.060170+0000","last_became_peered":"2024-09-19T06:05:23.060170+0000","last_unstale":"2024-09-19T06:05:46.961568+0000","last_undegraded":"2024-09-19T06:05:46.961568+0000","last_fullsized":"2024-09-19T06:05:46.961568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:54.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520186+0000","last_change":"2024-09-19T06:05:24.701242+0000","last_active":"2024-09-19T06:05:46.520186+0000","last_peered":"2024-09-19T06:05:46.520186+0000","last_clean":"2024-09-19T06:05:46.520186+0000","last_became_active":"2024-09-19T06:05:24.700813+0000","last_became_peered":"2024-09-19T06:05:24.700813+0000","last_unstale":"2024-09-19T06:05:46.520186+0000","last_undegraded":"2024-09-19T06:05:46.520186+0000","last_fullsized":"2024-09-19T06:05:46.520186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:42.706448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519153+0000","last_change":"2024-09-19T06:05:22.677502+0000","last_active":"2024-09-19T06:05:45.519153+0000","last_peered":"2024-09-19T06:05:45.519153+0000","last_clean":"2024-09-19T06:05:45.519153+0000","last_became_active":"2024-09-19T06:05:22.677082+0000","last_became_peered":"2024-09-19T06:05:22.677082+0000","last_unstale":"2024-09-19T06:05:45.519153+0000","last_undegraded":"2024-09-19T06:05:45.519153+0000","last_fullsized":"2024-09-19T06:05:45.519153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:30.991778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517459+0000","last_change":"2024-09-19T06:05:24.703155+0000","last_active":"2024-09-19T06:05:46.517459+0000","last_peered":"2024-09-19T06:05:46.517459+0000","last_clean":"2024-09-19T06:05:46.517459+0000","last_became_active":"2024-09-19T06:05:24.702570+0000","last_became_peered":"2024-09-19T06:05:24.702570+0000","last_unstale":"2024-09-19T06:05:46.517459+0000","last_undegraded":"2024-09-19T06:05:46.517459+0000","last_fullsized":"2024-09-19T06:05:46.517459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:36.016886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":9,"reported_epoch":80,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-19T06:05:46.523692+0000","last_change":"2024-09-19T06:05:46.523692+0000","last_active":"2024-09-19T06:05:46.523692+0000","last_peered":"2024-09-19T06:05:46.523692+0000","last_clean":"2024-09-19T06:05:33.863678+0000","last_became_active":"2024-09-19T06:05:46.523271+0000","last_became_peered":"2024-09-19T06:05:46.523271+0000","last_unstale":"2024-09-19T06:05:46.523692+0000","last_undegraded":"2024-09-19T06:05:46.517640+0000","last_fullsized":"2024-09-19T06:05:46.523692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":1,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":["2","3","8"],"object_location_counts":[{"shards":"2,3,8","objects":1}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.521497+0000","last_change":"2024-09-19T06:05:24.694476+0000","last_active":"2024-09-19T06:05:45.521497+0000","last_peered":"2024-09-19T06:05:45.521497+0000","last_clean":"2024-09-19T06:05:45.521497+0000","last_became_active":"2024-09-19T06:05:24.694147+0000","last_became_peered":"2024-09-19T06:05:24.694147+0000","last_unstale":"2024-09-19T06:05:45.521497+0000","last_undegraded":"2024-09-19T06:05:45.521497+0000","last_fullsized":"2024-09-19T06:05:45.521497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:48.830522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520434+0000","last_change":"2024-09-19T06:05:22.687422+0000","last_active":"2024-09-19T06:05:46.520434+0000","last_peered":"2024-09-19T06:05:46.520434+0000","last_clean":"2024-09-19T06:05:46.520434+0000","last_became_active":"2024-09-19T06:05:22.686950+0000","last_became_peered":"2024-09-19T06:05:22.686950+0000","last_unstale":"2024-09-19T06:05:46.520434+0000","last_undegraded":"2024-09-19T06:05:46.520434+0000","last_fullsized":"2024-09-19T06:05:46.520434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:49.279769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902432+0000","last_change":"2024-09-19T06:05:24.695701+0000","last_active":"2024-09-19T06:05:46.902432+0000","last_peered":"2024-09-19T06:05:46.902432+0000","last_clean":"2024-09-19T06:05:46.902432+0000","last_became_active":"2024-09-19T06:05:24.695341+0000","last_became_peered":"2024-09-19T06:05:24.695341+0000","last_unstale":"2024-09-19T06:05:46.902432+0000","last_undegraded":"2024-09-19T06:05:46.902432+0000","last_fullsized":"2024-09-19T06:05:46.902432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:52.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519721+0000","last_change":"2024-09-19T06:05:24.703456+0000","last_active":"2024-09-19T06:05:46.519721+0000","last_peered":"2024-09-19T06:05:46.519721+0000","last_clean":"2024-09-19T06:05:46.519721+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:46.519721+0000","last_undegraded":"2024-09-19T06:05:46.519721+0000","last_fullsized":"2024-09-19T06:05:46.519721+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:15.159843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520802+0000","last_change":"2024-09-19T06:05:22.683833+0000","last_active":"2024-09-19T06:05:46.520802+0000","last_peered":"2024-09-19T06:05:46.520802+0000","last_clean":"2024-09-19T06:05:46.520802+0000","last_became_active":"2024-09-19T06:05:22.683439+0000","last_became_peered":"2024-09-19T06:05:22.683439+0000","last_unstale":"2024-09-19T06:05:46.520802+0000","last_undegraded":"2024-09-19T06:05:46.520802+0000","last_fullsized":"2024-09-19T06:05:46.520802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:52.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961492+0000","last_change":"2024-09-19T06:05:24.695905+0000","last_active":"2024-09-19T06:05:46.961492+0000","last_peered":"2024-09-19T06:05:46.961492+0000","last_clean":"2024-09-19T06:05:46.961492+0000","last_became_active":"2024-09-19T06:05:24.695570+0000","last_became_peered":"2024-09-19T06:05:24.695570+0000","last_unstale":"2024-09-19T06:05:46.961492+0000","last_undegraded":"2024-09-19T06:05:46.961492+0000","last_fullsized":"2024-09-19T06:05:46.961492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:00.167126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520961+0000","last_change":"2024-09-19T06:05:22.686853+0000","last_active":"2024-09-19T06:05:46.520961+0000","last_peered":"2024-09-19T06:05:46.520961+0000","last_clean":"2024-09-19T06:05:46.520961+0000","last_became_active":"2024-09-19T06:05:22.686143+0000","last_became_peered":"2024-09-19T06:05:22.686143+0000","last_unstale":"2024-09-19T06:05:46.520961+0000","last_undegraded":"2024-09-19T06:05:46.520961+0000","last_fullsized":"2024-09-19T06:05:46.520961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:30.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519841+0000","last_change":"2024-09-19T06:05:24.702420+0000","last_active":"2024-09-19T06:05:46.519841+0000","last_peered":"2024-09-19T06:05:46.519841+0000","last_clean":"2024-09-19T06:05:46.519841+0000","last_became_active":"2024-09-19T06:05:24.702140+0000","last_became_peered":"2024-09-19T06:05:24.702140+0000","last_unstale":"2024-09-19T06:05:46.519841+0000","last_undegraded":"2024-09-19T06:05:46.519841+0000","last_fullsized":"2024-09-19T06:05:46.519841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:27.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.520502+0000","last_change":"2024-09-19T06:05:23.059638+0000","last_active":"2024-09-19T06:05:45.520502+0000","last_peered":"2024-09-19T06:05:45.520502+0000","last_clean":"2024-09-19T06:05:45.520502+0000","last_became_active":"2024-09-19T06:05:23.059273+0000","last_became_peered":"2024-09-19T06:05:23.059273+0000","last_unstale":"2024-09-19T06:05:45.520502+0000","last_undegraded":"2024-09-19T06:05:45.520502+0000","last_fullsized":"2024-09-19T06:05:45.520502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:56.981598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T06:05:45.519791+0000","last_change":"2024-09-19T06:05:24.703608+0000","last_active":"2024-09-19T06:05:45.519791+0000","last_peered":"2024-09-19T06:05:45.519791+0000","last_clean":"2024-09-19T06:05:45.519791+0000","last_became_active":"2024-09-19T06:05:24.703300+0000","last_became_peered":"2024-09-19T06:05:24.703300+0000","last_unstale":"2024-09-19T06:05:45.519791+0000","last_undegraded":"2024-09-19T06:05:45.519791+0000","last_fullsized":"2024-09-19T06:05:45.519791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.063545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518702+0000","last_change":"2024-09-19T06:05:22.679379+0000","last_active":"2024-09-19T06:05:46.518702+0000","last_peered":"2024-09-19T06:05:46.518702+0000","last_clean":"2024-09-19T06:05:46.518702+0000","last_became_active":"2024-09-19T06:05:22.679091+0000","last_became_peered":"2024-09-19T06:05:22.679091+0000","last_unstale":"2024-09-19T06:05:46.518702+0000","last_undegraded":"2024-09-19T06:05:46.518702+0000","last_fullsized":"2024-09-19T06:05:46.518702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57979,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":5,"num_objects_missing":5,"num_objects_degraded":1,"num_objects_misplaced":4,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":115,"num_read_kb":116,"num_write":152,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":165389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645329,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":419478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874262,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1564672,"data_stored":1073750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037787,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":888832,"data_stored":428136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":428056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32640,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712512,"statfs":{"total":95995035648,"available":95961612288,"internally_reserved":0,"allocated":1482752,"data_stored":1019595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659178,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":427525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888111,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1495040,"data_stored":1019279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":419540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":419414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444092,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":478746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":477430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":428796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":51428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":55947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:05:53.894 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-19T06:05:53.894 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.13', 'version': "78'6", 'reported_seq': 10, 'reported_epoch': 80, 'state': 'active+recovering', 'last_fresh': '2024-09-19T06:05:46.524417+0000', 'last_change': '2024-09-19T06:05:46.525009+0000', 'last_active': '2024-09-19T06:05:46.524417+0000', 'last_peered': '2024-09-19T06:05:46.524417+0000', 'last_clean': '2024-09-19T06:05:34.883165+0000', 'last_became_active': '2024-09-19T06:05:46.521700+0000', 'last_became_peered': '2024-09-19T06:05:46.521700+0000', 'last_unstale': '2024-09-19T06:05:46.524417+0000', 'last_undegraded': '2024-09-19T06:05:46.517686+0000', 'last_fullsized': '2024-09-19T06:05:46.524417+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 75, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T06:05:21.667156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T06:05:21.667156+0000', 'last_clean_scrub_stamp': '2024-09-19T06:05:21.667156+0000', 'objects_scrubbed': 0, 'log_size': 6, 'log_dups_size': 0, 'ondisk_log_size': 6, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 34, 'num_objects': 4, 'num_object_clones': 0, 'num_object_copies': 12, 'num_objects_missing_on_primary': 4, 'num_objects_missing': 4, 'num_objects_degraded': 0, 'num_objects_misplaced': 4, 'num_objects_unfound': 0, 'num_objects_dirty': 4, 'num_whiteouts': 0, 'num_read': 1, 'num_read_kb': 1, 'num_write': 9, 'num_write_kb': 7, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 3, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 10, 3], 'acting': [11, 10, 3], 'avail_no_missing': ['2', '3', '10'], 'object_location_counts': [{'shards': '2,3,10', 'objects': 4}], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-09-19T06:05:53.894 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-19T06:05:53.895 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 17, 'reported_epoch': 80, 'state': 'activating', 'last_fresh': '2024-09-19T06:05:46.518241+0000', 'last_change': '2024-09-19T06:05:46.518241+0000', 'last_active': '2024-09-19T06:05:45.519007+0000', 'last_peered': '2024-09-19T06:05:26.522832+0000', 'last_clean': '2024-09-19T06:05:26.522832+0000', 'last_became_active': '2024-09-19T06:05:24.707289+0000', 'last_became_peered': '2024-09-19T06:05:24.707289+0000', 'last_unstale': '2024-09-19T06:05:46.518241+0000', 'last_undegraded': '2024-09-19T06:05:46.518241+0000', 'last_fullsized': '2024-09-19T06:05:46.518241+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 76, 'last_epoch_clean': 77, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T06:05:23.670658+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T06:05:23.670658+0000', 'last_clean_scrub_stamp': '2024-09-19T06:05:23.670658+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 9, 4], 'acting': [11, 9, 4], 'avail_no_missing': ['11', '4', '5', '9'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-09-19T06:05:53.895 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-19T06:05:53.895 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.a', 'version': "78'1", 'reported_seq': 9, 'reported_epoch': 80, 'state': 'active+recovery_wait+degraded', 'last_fresh': '2024-09-19T06:05:46.523692+0000', 'last_change': '2024-09-19T06:05:46.523692+0000', 'last_active': '2024-09-19T06:05:46.523692+0000', 'last_peered': '2024-09-19T06:05:46.523692+0000', 'last_clean': '2024-09-19T06:05:33.863678+0000', 'last_became_active': '2024-09-19T06:05:46.523271+0000', 'last_became_peered': '2024-09-19T06:05:46.523271+0000', 'last_unstale': '2024-09-19T06:05:46.523692+0000', 'last_undegraded': '2024-09-19T06:05:46.517640+0000', 'last_fullsized': '2024-09-19T06:05:46.523692+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 75, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T06:05:21.667156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T06:05:21.667156+0000', 'last_clean_scrub_stamp': '2024-09-19T06:05:21.667156+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 3, 'num_objects_missing_on_primary': 1, 'num_objects_missing': 1, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 1, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 3, 8], 'acting': [11, 3, 8], 'avail_no_missing': ['2', '3', '8'], 'object_location_counts': [{'shards': '2,3,8', 'objects': 1}], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-09-19T06:05:53.895 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph status --format=json 2024-09-19T06:05:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:53 smithi174 ceph-mon[34488]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2024-09-19T06:05:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:53 smithi174 ceph-mon[34488]: Cluster is now healthy 2024-09-19T06:05:54.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:53 smithi169 ceph-mon[34350]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2024-09-19T06:05:54.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:53 smithi169 ceph-mon[34350]: Cluster is now healthy 2024-09-19T06:05:54.144 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:54.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.602+0000 7f3012d25640 1 -- 172.21.15.103:0/1187053528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f300c101df0 msgr2=0x7f300c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.602+0000 7f3012d25640 1 --2- 172.21.15.103:0/1187053528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f300c101df0 0x7f300c1021d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3000009900 tx=0x7f300002a410 comp rx=0 tx=0).stop 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.602+0000 7f3012d25640 1 -- 172.21.15.103:0/1187053528 shutdown_connections 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.602+0000 7f3012d25640 1 --2- 172.21.15.103:0/1187053528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300c106f20 0x7f300c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.602+0000 7f3012d25640 1 --2- 172.21.15.103:0/1187053528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f300c1027a0 0x7f300c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.602+0000 7f3012d25640 1 --2- 172.21.15.103:0/1187053528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f300c101df0 0x7f300c1021d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.602+0000 7f3012d25640 1 -- 172.21.15.103:0/1187053528 >> 172.21.15.103:0/1187053528 conn(0x7f300c0fd8b0 msgr2=0x7f300c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.602+0000 7f3012d25640 1 -- 172.21.15.103:0/1187053528 shutdown_connections 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.602+0000 7f3012d25640 1 -- 172.21.15.103:0/1187053528 wait complete. 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f3012d25640 1 Processor -- start 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f3012d25640 1 -- start start 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f3012d25640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f300c101df0 0x7f300c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f3012d25640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300c1027a0 0x7f300c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f3012d25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f300c106f20 0x7f300c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f3012d25640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f300c111e50 con 0x7f300c106f20 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f3012d25640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f300c111cd0 con 0x7f300c1027a0 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f3012d25640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f300c111fd0 con 0x7f300c101df0 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f30112c2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f300c106f20 0x7f300c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f30112c2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f300c106f20 0x7f300c19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60512/0 (socket says 172.21.15.103:60512) 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f30112c2640 1 -- 172.21.15.103:0/4147086587 learned_addr learned my addr 172.21.15.103:0/4147086587 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.603+0000 7f300bfff640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300c1027a0 0x7f300c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f3010ac1640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f300c101df0 0x7f300c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f30112c2640 1 -- 172.21.15.103:0/4147086587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f300c101df0 msgr2=0x7f300c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f30112c2640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f300c101df0 0x7f300c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f30112c2640 1 -- 172.21.15.103:0/4147086587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300c1027a0 msgr2=0x7f300c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f30112c2640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300c1027a0 0x7f300c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f30112c2640 1 -- 172.21.15.103:0/4147086587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300c19d490 con 0x7f300c106f20 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f30112c2640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f300c106f20 0x7f300c19cdb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f300400cad0 tx=0x7f300400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f3009ffb640 1 -- 172.21.15.103:0/4147086587 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300400ad60 con 0x7f300c106f20 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f3012d25640 1 -- 172.21.15.103:0/4147086587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300c19d780 con 0x7f300c106f20 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f3009ffb640 1 -- 172.21.15.103:0/4147086587 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3004005020 con 0x7f300c106f20 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f3009ffb640 1 -- 172.21.15.103:0/4147086587 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300400f6b0 con 0x7f300c106f20 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.604+0000 7f3012d25640 1 -- 172.21.15.103:0/4147086587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300c1a5060 con 0x7f300c106f20 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.605+0000 7f3012d25640 1 -- 172.21.15.103:0/4147086587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300c1021d0 con 0x7f300c106f20 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.606+0000 7f3009ffb640 1 -- 172.21.15.103:0/4147086587 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f30040051d0 con 0x7f300c106f20 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.607+0000 7f3009ffb640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f2ffc0a32d0 0x7f2ffc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.607+0000 7f3010ac1640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f2ffc0a32d0 0x7f2ffc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.607+0000 7f3009ffb640 1 -- 172.21.15.103:0/4147086587 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f30040cfb10 con 0x7f300c106f20 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.607+0000 7f3010ac1640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f2ffc0a32d0 0x7f2ffc0a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3000031440 tx=0x7f30000095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.611+0000 7f3009ffb640 1 -- 172.21.15.103:0/4147086587 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3004014030 con 0x7f300c106f20 2024-09-19T06:05:54.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.843+0000 7f3012d25640 1 -- 172.21.15.103:0/4147086587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f300c10a100 con 0x7f300c106f20 2024-09-19T06:05:54.846 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:54 smithi103 ceph-mon[30925]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:54.846 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:54 smithi103 ceph-mon[30925]: pgmap v284: 97 pgs: 97 active+clean; 633 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:54.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.844+0000 7f3009ffb640 1 -- 172.21.15.103:0/4147086587 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2893 (secure 0 0 0) 0x7f300409c700 con 0x7f300c106f20 2024-09-19T06:05:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:54.847 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":381,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1726725875,"num_in_osds":12,"osd_in_since":1726725852,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":64,"data_bytes":648581,"bytes_used":370315264,"bytes_avail":1151570112512,"bytes_total":1151940427776,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":4,"recovering_keys_per_sec":1,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"read_bytes_sec":8573,"write_bytes_sec":4350,"read_op_per_sec":7,"write_op_per_sec":2},"fsmap":{"epoch":24,"btime":"2024-09-19T06:05:36:880542+0000","id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"e","status":"up:standby-replay","gid":24437},{"filesystem_id":1,"rank":1,"name":"f","status":"up:standby-replay","gid":24454},{"filesystem_id":1,"rank":0,"name":"h","status":"up:standby-replay","gid":24455},{"filesystem_id":1,"rank":2,"name":"c","status":"up:active","gid":24463},{"filesystem_id":1,"rank":1,"name":"i","status":"up:active","gid":24475},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24488}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.103:8443/"}},"servicemap":{"epoch":21,"modified":"2024-09-19T06:05:51.456291+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T06:05:54.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 -- 172.21.15.103:0/4147086587 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f2ffc0a32d0 msgr2=0x7f2ffc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f2ffc0a32d0 0x7f2ffc0a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3000031440 tx=0x7f30000095f0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 -- 172.21.15.103:0/4147086587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f300c106f20 msgr2=0x7f300c19cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f300c106f20 0x7f300c19cdb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f300400cad0 tx=0x7f300400ced0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 -- 172.21.15.103:0/4147086587 shutdown_connections 2024-09-19T06:05:54.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f2ffc0a32d0 0x7f2ffc0a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f300c106f20 0x7f300c19cdb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f300c1027a0 0x7f300c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 --2- 172.21.15.103:0/4147086587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f300c101df0 0x7f300c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 -- 172.21.15.103:0/4147086587 >> 172.21.15.103:0/4147086587 conn(0x7f300c0fd8b0 msgr2=0x7f300c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:54.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 -- 172.21.15.103:0/4147086587 shutdown_connections 2024-09-19T06:05:54.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:54.846+0000 7f3012d25640 1 -- 172.21.15.103:0/4147086587 wait complete. 2024-09-19T06:05:54.855 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:54 smithi174 ceph-mon[34488]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:54.855 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:54 smithi174 ceph-mon[34488]: pgmap v284: 97 pgs: 97 active+clean; 633 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:54.929 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:54 smithi169 ceph-mon[34350]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:54.929 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:54 smithi169 ceph-mon[34350]: pgmap v284: 97 pgs: 97 active+clean; 633 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:55.525 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-09-19T06:05:55.526 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:05:55.776 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:55.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:55 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/4147086587' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T06:05:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:55 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/4147086587' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T06:05:56.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:55 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/4147086587' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T06:05:56.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.254+0000 7ff16d080640 1 -- 172.21.15.103:0/1668968564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff168102da0 msgr2=0x7ff168103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:56.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.254+0000 7ff16d080640 1 --2- 172.21.15.103:0/1668968564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff168102da0 0x7ff168103180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff160009900 tx=0x7ff16002a4a0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.254+0000 7ff16d080640 1 -- 172.21.15.103:0/1668968564 shutdown_connections 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.254+0000 7ff16d080640 1 --2- 172.21.15.103:0/1668968564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff16810c180 0x7ff16810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.254+0000 7ff16d080640 1 --2- 172.21.15.103:0/1668968564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1681036c0 0x7ff16810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.254+0000 7ff16d080640 1 --2- 172.21.15.103:0/1668968564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff168102da0 0x7ff168103180 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.254+0000 7ff16d080640 1 -- 172.21.15.103:0/1668968564 >> 172.21.15.103:0/1668968564 conn(0x7ff1680fc7a0 msgr2=0x7ff1680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.254+0000 7ff16d080640 1 -- 172.21.15.103:0/1668968564 shutdown_connections 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.254+0000 7ff16d080640 1 -- 172.21.15.103:0/1668968564 wait complete. 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.255+0000 7ff16d080640 1 Processor -- start 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.255+0000 7ff16d080640 1 -- start start 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.255+0000 7ff16d080640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff168102da0 0x7ff168198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.255+0000 7ff16d080640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1681036c0 0x7ff168198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.255+0000 7ff16d080640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff16810c180 0x7ff16819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.255+0000 7ff16d080640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff168111ef0 con 0x7ff1681036c0 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.255+0000 7ff16d080640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff168111d70 con 0x7ff16810c180 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.255+0000 7ff16d080640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff168112070 con 0x7ff168102da0 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1681036c0 0x7ff168198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1681036c0 0x7ff168198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60542/0 (socket says 172.21.15.103:60542) 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16659c640 1 -- 172.21.15.103:0/2083064 learned_addr learned my addr 172.21.15.103:0/2083064 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff166d9d640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff168102da0 0x7ff168198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16659c640 1 -- 172.21.15.103:0/2083064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff168102da0 msgr2=0x7ff168198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16659c640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff168102da0 0x7ff168198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16659c640 1 -- 172.21.15.103:0/2083064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff16810c180 msgr2=0x7ff16819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16659c640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff16810c180 0x7ff16819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16659c640 1 -- 172.21.15.103:0/2083064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16819d500 con 0x7ff1681036c0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16659c640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1681036c0 0x7ff168198a90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff15000ba50 tx=0x7ff15000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff15ffff640 1 -- 172.21.15.103:0/2083064 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150019070 con 0x7ff1681036c0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff15ffff640 1 -- 172.21.15.103:0/2083064 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff15000cbe0 con 0x7ff1681036c0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16d080640 1 -- 172.21.15.103:0/2083064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff16819d7f0 con 0x7ff1681036c0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff15ffff640 1 -- 172.21.15.103:0/2083064 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1500075d0 con 0x7ff1681036c0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.256+0000 7ff16d080640 1 -- 172.21.15.103:0/2083064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1681a50d0 con 0x7ff1681036c0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.257+0000 7ff16d080640 1 -- 172.21.15.103:0/2083064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff168103200 con 0x7ff1681036c0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.258+0000 7ff15ffff640 1 -- 172.21.15.103:0/2083064 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff15001c070 con 0x7ff1681036c0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.259+0000 7ff15ffff640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff1540a32d0 0x7ff1540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.259+0000 7ff166d9d640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff1540a32d0 0x7ff1540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.259+0000 7ff15ffff640 1 -- 172.21.15.103:0/2083064 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ff1500cf4d0 con 0x7ff1681036c0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.260+0000 7ff166d9d640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff1540a32d0 0x7ff1540a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff160031440 tx=0x7ff160031c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.262+0000 7ff15ffff640 1 -- 172.21.15.103:0/2083064 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff15009c1d0 con 0x7ff1681036c0 2024-09-19T06:05:56.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.428+0000 7ff16d080640 1 -- 172.21.15.103:0/2083064 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff168062630 con 0x7ff1540a32d0 2024-09-19T06:05:56.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.435+0000 7ff15ffff640 1 -- 172.21.15.103:0/2083064 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258716 (secure 0 0 0) 0x7ff168062630 con 0x7ff1540a32d0 2024-09-19T06:05:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:05:56.440 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T06:05:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.438+0000 7ff16d080640 1 -- 172.21.15.103:0/2083064 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff1540a32d0 msgr2=0x7ff1540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.438+0000 7ff16d080640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff1540a32d0 0x7ff1540a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff160031440 tx=0x7ff160031c30 comp rx=0 tx=0).stop 2024-09-19T06:05:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.439+0000 7ff16d080640 1 -- 172.21.15.103:0/2083064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1681036c0 msgr2=0x7ff168198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.439+0000 7ff16d080640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1681036c0 0x7ff168198a90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff15000ba50 tx=0x7ff15000bf10 comp rx=0 tx=0).stop 2024-09-19T06:05:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.439+0000 7ff16d080640 1 -- 172.21.15.103:0/2083064 shutdown_connections 2024-09-19T06:05:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.439+0000 7ff16d080640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff1540a32d0 0x7ff1540a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.439+0000 7ff16d080640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff16810c180 0x7ff16819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.439+0000 7ff16d080640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1681036c0 0x7ff168198a90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.439+0000 7ff16d080640 1 --2- 172.21.15.103:0/2083064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff168102da0 0x7ff168198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.439+0000 7ff16d080640 1 -- 172.21.15.103:0/2083064 >> 172.21.15.103:0/2083064 conn(0x7ff1680fc7a0 msgr2=0x7ff1680fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.439+0000 7ff16d080640 1 -- 172.21.15.103:0/2083064 shutdown_connections 2024-09-19T06:05:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:05:56.439+0000 7ff16d080640 1 -- 172.21.15.103:0/2083064 wait complete. 2024-09-19T06:05:56.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:56 smithi103 ceph-mon[30925]: pgmap v285: 97 pgs: 97 active+clean; 633 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:56.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:56 smithi174 ceph-mon[34488]: pgmap v285: 97 pgs: 97 active+clean; 633 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:57.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:56 smithi169 ceph-mon[34350]: pgmap v285: 97 pgs: 97 active+clean; 633 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:57.258 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-19T06:05:55.457206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648581,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":261,"num_read_kb":240,"num_write":341,"num_write_kb":3040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361628,"kb_used_data":12336,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580196,"statfs":{"total":1151940427776,"available":1151570120704,"internally_reserved":0,"allocated":12632064,"data_stored":7073559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27539,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":72,"num_write":22,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.942645"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518052+0000","last_change":"2024-09-19T06:05:24.703290+0000","last_active":"2024-09-19T06:05:46.518052+0000","last_peered":"2024-09-19T06:05:46.518052+0000","last_clean":"2024-09-19T06:05:46.518052+0000","last_became_active":"2024-09-19T06:05:24.702343+0000","last_became_peered":"2024-09-19T06:05:24.702343+0000","last_unstale":"2024-09-19T06:05:46.518052+0000","last_undegraded":"2024-09-19T06:05:46.518052+0000","last_fullsized":"2024-09-19T06:05:46.518052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.594004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519636+0000","last_change":"2024-09-19T06:05:24.700363+0000","last_active":"2024-09-19T06:05:46.519636+0000","last_peered":"2024-09-19T06:05:46.519636+0000","last_clean":"2024-09-19T06:05:46.519636+0000","last_became_active":"2024-09-19T06:05:24.700066+0000","last_became_peered":"2024-09-19T06:05:24.700066+0000","last_unstale":"2024-09-19T06:05:46.519636+0000","last_undegraded":"2024-09-19T06:05:46.519636+0000","last_fullsized":"2024-09-19T06:05:46.519636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:26.094195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519554+0000","last_change":"2024-09-19T06:05:24.702458+0000","last_active":"2024-09-19T06:05:46.519554+0000","last_peered":"2024-09-19T06:05:46.519554+0000","last_clean":"2024-09-19T06:05:46.519554+0000","last_became_active":"2024-09-19T06:05:24.702029+0000","last_became_peered":"2024-09-19T06:05:24.702029+0000","last_unstale":"2024-09-19T06:05:46.519554+0000","last_undegraded":"2024-09-19T06:05:46.519554+0000","last_fullsized":"2024-09-19T06:05:46.519554+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905954+0000","last_change":"2024-09-19T06:05:24.699402+0000","last_active":"2024-09-19T06:05:46.905954+0000","last_peered":"2024-09-19T06:05:46.905954+0000","last_clean":"2024-09-19T06:05:46.905954+0000","last_became_active":"2024-09-19T06:05:24.698191+0000","last_became_peered":"2024-09-19T06:05:24.698191+0000","last_unstale":"2024-09-19T06:05:46.905954+0000","last_undegraded":"2024-09-19T06:05:46.905954+0000","last_fullsized":"2024-09-19T06:05:46.905954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.056347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520337+0000","last_change":"2024-09-19T06:05:24.699821+0000","last_active":"2024-09-19T06:05:46.520337+0000","last_peered":"2024-09-19T06:05:46.520337+0000","last_clean":"2024-09-19T06:05:46.520337+0000","last_became_active":"2024-09-19T06:05:24.699493+0000","last_became_peered":"2024-09-19T06:05:24.699493+0000","last_unstale":"2024-09-19T06:05:46.520337+0000","last_undegraded":"2024-09-19T06:05:46.520337+0000","last_fullsized":"2024-09-19T06:05:46.520337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:34.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517699+0000","last_change":"2024-09-19T06:05:24.697821+0000","last_active":"2024-09-19T06:05:46.517699+0000","last_peered":"2024-09-19T06:05:46.517699+0000","last_clean":"2024-09-19T06:05:46.517699+0000","last_became_active":"2024-09-19T06:05:24.697495+0000","last_became_peered":"2024-09-19T06:05:24.697495+0000","last_unstale":"2024-09-19T06:05:46.517699+0000","last_undegraded":"2024-09-19T06:05:46.517699+0000","last_fullsized":"2024-09-19T06:05:46.517699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:03.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902318+0000","last_change":"2024-09-19T06:05:24.704610+0000","last_active":"2024-09-19T06:05:46.902318+0000","last_peered":"2024-09-19T06:05:46.902318+0000","last_clean":"2024-09-19T06:05:46.902318+0000","last_became_active":"2024-09-19T06:05:24.704288+0000","last_became_peered":"2024-09-19T06:05:24.704288+0000","last_unstale":"2024-09-19T06:05:46.902318+0000","last_undegraded":"2024-09-19T06:05:46.902318+0000","last_fullsized":"2024-09-19T06:05:46.902318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.530553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516407+0000","last_change":"2024-09-19T06:05:24.693662+0000","last_active":"2024-09-19T06:05:46.516407+0000","last_peered":"2024-09-19T06:05:46.516407+0000","last_clean":"2024-09-19T06:05:46.516407+0000","last_became_active":"2024-09-19T06:05:24.693327+0000","last_became_peered":"2024-09-19T06:05:24.693327+0000","last_unstale":"2024-09-19T06:05:46.516407+0000","last_undegraded":"2024-09-19T06:05:46.516407+0000","last_fullsized":"2024-09-19T06:05:46.516407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:39.646907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961884+0000","last_change":"2024-09-19T06:05:24.702552+0000","last_active":"2024-09-19T06:05:46.961884+0000","last_peered":"2024-09-19T06:05:46.961884+0000","last_clean":"2024-09-19T06:05:46.961884+0000","last_became_active":"2024-09-19T06:05:24.701090+0000","last_became_peered":"2024-09-19T06:05:24.701090+0000","last_unstale":"2024-09-19T06:05:46.961884+0000","last_undegraded":"2024-09-19T06:05:46.961884+0000","last_fullsized":"2024-09-19T06:05:46.961884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:44.361368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.524330+0000","last_change":"2024-09-19T06:05:46.524330+0000","last_active":"2024-09-19T06:05:46.524330+0000","last_peered":"2024-09-19T06:05:46.524330+0000","last_clean":"2024-09-19T06:05:46.524330+0000","last_became_active":"2024-09-19T06:05:46.523934+0000","last_became_peered":"2024-09-19T06:05:46.523934+0000","last_unstale":"2024-09-19T06:05:46.524330+0000","last_undegraded":"2024-09-19T06:05:46.524330+0000","last_fullsized":"2024-09-19T06:05:46.524330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:11:12.301698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902755+0000","last_change":"2024-09-19T06:05:24.703118+0000","last_active":"2024-09-19T06:05:46.902755+0000","last_peered":"2024-09-19T06:05:46.902755+0000","last_clean":"2024-09-19T06:05:46.902755+0000","last_became_active":"2024-09-19T06:05:24.702561+0000","last_became_peered":"2024-09-19T06:05:24.702561+0000","last_unstale":"2024-09-19T06:05:46.902755+0000","last_undegraded":"2024-09-19T06:05:46.902755+0000","last_fullsized":"2024-09-19T06:05:46.902755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:51.063256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.906049+0000","last_change":"2024-09-19T06:05:24.698704+0000","last_active":"2024-09-19T06:05:46.906049+0000","last_peered":"2024-09-19T06:05:46.906049+0000","last_clean":"2024-09-19T06:05:46.906049+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:46.906049+0000","last_undegraded":"2024-09-19T06:05:46.906049+0000","last_fullsized":"2024-09-19T06:05:46.906049+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:35.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903589+0000","last_change":"2024-09-19T06:05:24.696236+0000","last_active":"2024-09-19T06:05:46.903589+0000","last_peered":"2024-09-19T06:05:46.903589+0000","last_clean":"2024-09-19T06:05:46.903589+0000","last_became_active":"2024-09-19T06:05:24.695952+0000","last_became_peered":"2024-09-19T06:05:24.695952+0000","last_unstale":"2024-09-19T06:05:46.903589+0000","last_undegraded":"2024-09-19T06:05:46.903589+0000","last_fullsized":"2024-09-19T06:05:46.903589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:17.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519455+0000","last_change":"2024-09-19T06:05:24.699962+0000","last_active":"2024-09-19T06:05:46.519455+0000","last_peered":"2024-09-19T06:05:46.519455+0000","last_clean":"2024-09-19T06:05:46.519455+0000","last_became_active":"2024-09-19T06:05:24.699625+0000","last_became_peered":"2024-09-19T06:05:24.699625+0000","last_unstale":"2024-09-19T06:05:46.519455+0000","last_undegraded":"2024-09-19T06:05:46.519455+0000","last_fullsized":"2024-09-19T06:05:46.519455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:34.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519460+0000","last_change":"2024-09-19T06:05:24.701310+0000","last_active":"2024-09-19T06:05:46.519460+0000","last_peered":"2024-09-19T06:05:46.519460+0000","last_clean":"2024-09-19T06:05:46.519460+0000","last_became_active":"2024-09-19T06:05:24.701032+0000","last_became_peered":"2024-09-19T06:05:24.701032+0000","last_unstale":"2024-09-19T06:05:46.519460+0000","last_undegraded":"2024-09-19T06:05:46.519460+0000","last_fullsized":"2024-09-19T06:05:46.519460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:29.557533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961314+0000","last_change":"2024-09-19T06:05:24.699803+0000","last_active":"2024-09-19T06:05:46.961314+0000","last_peered":"2024-09-19T06:05:46.961314+0000","last_clean":"2024-09-19T06:05:46.961314+0000","last_became_active":"2024-09-19T06:05:24.699506+0000","last_became_peered":"2024-09-19T06:05:24.699506+0000","last_unstale":"2024-09-19T06:05:46.961314+0000","last_undegraded":"2024-09-19T06:05:46.961314+0000","last_fullsized":"2024-09-19T06:05:46.961314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:32.669231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518157+0000","last_change":"2024-09-19T06:05:24.703805+0000","last_active":"2024-09-19T06:05:46.518157+0000","last_peered":"2024-09-19T06:05:46.518157+0000","last_clean":"2024-09-19T06:05:46.518157+0000","last_became_active":"2024-09-19T06:05:24.702728+0000","last_became_peered":"2024-09-19T06:05:24.702728+0000","last_unstale":"2024-09-19T06:05:46.518157+0000","last_undegraded":"2024-09-19T06:05:46.518157+0000","last_fullsized":"2024-09-19T06:05:46.518157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:20.807530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518737+0000","last_change":"2024-09-19T06:05:24.691055+0000","last_active":"2024-09-19T06:05:46.518737+0000","last_peered":"2024-09-19T06:05:46.518737+0000","last_clean":"2024-09-19T06:05:46.518737+0000","last_became_active":"2024-09-19T06:05:24.690165+0000","last_became_peered":"2024-09-19T06:05:24.690165+0000","last_unstale":"2024-09-19T06:05:46.518737+0000","last_undegraded":"2024-09-19T06:05:46.518737+0000","last_fullsized":"2024-09-19T06:05:46.518737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:48.656335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521695+0000","last_change":"2024-09-19T06:05:24.697955+0000","last_active":"2024-09-19T06:05:46.521695+0000","last_peered":"2024-09-19T06:05:46.521695+0000","last_clean":"2024-09-19T06:05:46.521695+0000","last_became_active":"2024-09-19T06:05:24.697598+0000","last_became_peered":"2024-09-19T06:05:24.697598+0000","last_unstale":"2024-09-19T06:05:46.521695+0000","last_undegraded":"2024-09-19T06:05:46.521695+0000","last_fullsized":"2024-09-19T06:05:46.521695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.458647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517664+0000","last_change":"2024-09-19T06:05:24.705110+0000","last_active":"2024-09-19T06:05:46.517664+0000","last_peered":"2024-09-19T06:05:46.517664+0000","last_clean":"2024-09-19T06:05:46.517664+0000","last_became_active":"2024-09-19T06:05:24.704783+0000","last_became_peered":"2024-09-19T06:05:24.704783+0000","last_unstale":"2024-09-19T06:05:46.517664+0000","last_undegraded":"2024-09-19T06:05:46.517664+0000","last_fullsized":"2024-09-19T06:05:46.517664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:43.092969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903641+0000","last_change":"2024-09-19T06:05:24.693845+0000","last_active":"2024-09-19T06:05:46.903641+0000","last_peered":"2024-09-19T06:05:46.903641+0000","last_clean":"2024-09-19T06:05:46.903641+0000","last_became_active":"2024-09-19T06:05:24.693385+0000","last_became_peered":"2024-09-19T06:05:24.693385+0000","last_unstale":"2024-09-19T06:05:46.903641+0000","last_undegraded":"2024-09-19T06:05:46.903641+0000","last_fullsized":"2024-09-19T06:05:46.903641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:05.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961617+0000","last_change":"2024-09-19T06:05:24.697903+0000","last_active":"2024-09-19T06:05:46.961617+0000","last_peered":"2024-09-19T06:05:46.961617+0000","last_clean":"2024-09-19T06:05:46.961617+0000","last_became_active":"2024-09-19T06:05:24.697566+0000","last_became_peered":"2024-09-19T06:05:24.697566+0000","last_unstale":"2024-09-19T06:05:46.961617+0000","last_undegraded":"2024-09-19T06:05:46.961617+0000","last_fullsized":"2024-09-19T06:05:46.961617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:10.340401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516463+0000","last_change":"2024-09-19T06:05:24.696888+0000","last_active":"2024-09-19T06:05:46.516463+0000","last_peered":"2024-09-19T06:05:46.516463+0000","last_clean":"2024-09-19T06:05:46.516463+0000","last_became_active":"2024-09-19T06:05:24.696554+0000","last_became_peered":"2024-09-19T06:05:24.696554+0000","last_unstale":"2024-09-19T06:05:46.516463+0000","last_undegraded":"2024-09-19T06:05:46.516463+0000","last_fullsized":"2024-09-19T06:05:46.516463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520726+0000","last_change":"2024-09-19T06:05:24.692443+0000","last_active":"2024-09-19T06:05:46.520726+0000","last_peered":"2024-09-19T06:05:46.520726+0000","last_clean":"2024-09-19T06:05:46.520726+0000","last_became_active":"2024-09-19T06:05:24.690555+0000","last_became_peered":"2024-09-19T06:05:24.690555+0000","last_unstale":"2024-09-19T06:05:46.520726+0000","last_undegraded":"2024-09-19T06:05:46.520726+0000","last_fullsized":"2024-09-19T06:05:46.520726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:29.340744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516645+0000","last_change":"2024-09-19T06:05:24.699379+0000","last_active":"2024-09-19T06:05:46.516645+0000","last_peered":"2024-09-19T06:05:46.516645+0000","last_clean":"2024-09-19T06:05:46.516645+0000","last_became_active":"2024-09-19T06:05:24.699056+0000","last_became_peered":"2024-09-19T06:05:24.699056+0000","last_unstale":"2024-09-19T06:05:46.516645+0000","last_undegraded":"2024-09-19T06:05:46.516645+0000","last_fullsized":"2024-09-19T06:05:46.516645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:30.337080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521950+0000","last_change":"2024-09-19T06:05:24.698672+0000","last_active":"2024-09-19T06:05:46.521950+0000","last_peered":"2024-09-19T06:05:46.521950+0000","last_clean":"2024-09-19T06:05:46.521950+0000","last_became_active":"2024-09-19T06:05:24.698229+0000","last_became_peered":"2024-09-19T06:05:24.698229+0000","last_unstale":"2024-09-19T06:05:46.521950+0000","last_undegraded":"2024-09-19T06:05:46.521950+0000","last_fullsized":"2024-09-19T06:05:46.521950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.082538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517858+0000","last_change":"2024-09-19T06:05:24.707830+0000","last_active":"2024-09-19T06:05:46.517858+0000","last_peered":"2024-09-19T06:05:46.517858+0000","last_clean":"2024-09-19T06:05:46.517858+0000","last_became_active":"2024-09-19T06:05:24.707478+0000","last_became_peered":"2024-09-19T06:05:24.707478+0000","last_unstale":"2024-09-19T06:05:46.517858+0000","last_undegraded":"2024-09-19T06:05:46.517858+0000","last_fullsized":"2024-09-19T06:05:46.517858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:33.484877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903437+0000","last_change":"2024-09-19T06:05:24.697232+0000","last_active":"2024-09-19T06:05:46.903437+0000","last_peered":"2024-09-19T06:05:46.903437+0000","last_clean":"2024-09-19T06:05:46.903437+0000","last_became_active":"2024-09-19T06:05:24.696727+0000","last_became_peered":"2024-09-19T06:05:24.696727+0000","last_unstale":"2024-09-19T06:05:46.903437+0000","last_undegraded":"2024-09-19T06:05:46.903437+0000","last_fullsized":"2024-09-19T06:05:46.903437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:36.168493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519637+0000","last_change":"2024-09-19T06:05:24.695489+0000","last_active":"2024-09-19T06:05:46.519637+0000","last_peered":"2024-09-19T06:05:46.519637+0000","last_clean":"2024-09-19T06:05:46.519637+0000","last_became_active":"2024-09-19T06:05:24.695012+0000","last_became_peered":"2024-09-19T06:05:24.695012+0000","last_unstale":"2024-09-19T06:05:46.519637+0000","last_undegraded":"2024-09-19T06:05:46.519637+0000","last_fullsized":"2024-09-19T06:05:46.519637+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:41.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522199+0000","last_change":"2024-09-19T06:05:24.697294+0000","last_active":"2024-09-19T06:05:46.522199+0000","last_peered":"2024-09-19T06:05:46.522199+0000","last_clean":"2024-09-19T06:05:46.522199+0000","last_became_active":"2024-09-19T06:05:24.696563+0000","last_became_peered":"2024-09-19T06:05:24.696563+0000","last_unstale":"2024-09-19T06:05:46.522199+0000","last_undegraded":"2024-09-19T06:05:46.522199+0000","last_fullsized":"2024-09-19T06:05:46.522199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:41.861120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520918+0000","last_change":"2024-09-19T06:05:24.702710+0000","last_active":"2024-09-19T06:05:46.520918+0000","last_peered":"2024-09-19T06:05:46.520918+0000","last_clean":"2024-09-19T06:05:46.520918+0000","last_became_active":"2024-09-19T06:05:24.702039+0000","last_became_peered":"2024-09-19T06:05:24.702039+0000","last_unstale":"2024-09-19T06:05:46.520918+0000","last_undegraded":"2024-09-19T06:05:46.520918+0000","last_fullsized":"2024-09-19T06:05:46.520918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:23.831807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517416+0000","last_change":"2024-09-19T06:05:24.707671+0000","last_active":"2024-09-19T06:05:46.517416+0000","last_peered":"2024-09-19T06:05:46.517416+0000","last_clean":"2024-09-19T06:05:46.517416+0000","last_became_active":"2024-09-19T06:05:24.707325+0000","last_became_peered":"2024-09-19T06:05:24.707325+0000","last_unstale":"2024-09-19T06:05:46.517416+0000","last_undegraded":"2024-09-19T06:05:46.517416+0000","last_fullsized":"2024-09-19T06:05:46.517416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:32.149103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520934+0000","last_change":"2024-09-19T06:05:24.704875+0000","last_active":"2024-09-19T06:05:46.520934+0000","last_peered":"2024-09-19T06:05:46.520934+0000","last_clean":"2024-09-19T06:05:46.520934+0000","last_became_active":"2024-09-19T06:05:24.704501+0000","last_became_peered":"2024-09-19T06:05:24.704501+0000","last_unstale":"2024-09-19T06:05:46.520934+0000","last_undegraded":"2024-09-19T06:05:46.520934+0000","last_fullsized":"2024-09-19T06:05:46.520934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:48.905457+0000","last_change":"2024-09-19T06:05:22.687857+0000","last_active":"2024-09-19T06:05:48.905457+0000","last_peered":"2024-09-19T06:05:48.905457+0000","last_clean":"2024-09-19T06:05:48.905457+0000","last_became_active":"2024-09-19T06:05:22.687573+0000","last_became_peered":"2024-09-19T06:05:22.687573+0000","last_unstale":"2024-09-19T06:05:48.905457+0000","last_undegraded":"2024-09-19T06:05:48.905457+0000","last_fullsized":"2024-09-19T06:05:48.905457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:31.972444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.904521+0000","last_change":"2024-09-19T06:05:46.904521+0000","last_active":"2024-09-19T06:05:46.904521+0000","last_peered":"2024-09-19T06:05:46.904521+0000","last_clean":"2024-09-19T06:05:46.904521+0000","last_became_active":"2024-09-19T06:05:46.904146+0000","last_became_peered":"2024-09-19T06:05:46.904146+0000","last_unstale":"2024-09-19T06:05:46.904521+0000","last_undegraded":"2024-09-19T06:05:46.904521+0000","last_fullsized":"2024-09-19T06:05:46.904521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:48.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517810+0000","last_change":"2024-09-19T06:05:22.680500+0000","last_active":"2024-09-19T06:05:46.517810+0000","last_peered":"2024-09-19T06:05:46.517810+0000","last_clean":"2024-09-19T06:05:46.517810+0000","last_became_active":"2024-09-19T06:05:22.679947+0000","last_became_peered":"2024-09-19T06:05:22.679947+0000","last_unstale":"2024-09-19T06:05:46.517810+0000","last_undegraded":"2024-09-19T06:05:46.517810+0000","last_fullsized":"2024-09-19T06:05:46.517810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:34.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902704+0000","last_change":"2024-09-19T06:05:22.680962+0000","last_active":"2024-09-19T06:05:46.902704+0000","last_peered":"2024-09-19T06:05:46.902704+0000","last_clean":"2024-09-19T06:05:46.902704+0000","last_became_active":"2024-09-19T06:05:22.680662+0000","last_became_peered":"2024-09-19T06:05:22.680662+0000","last_unstale":"2024-09-19T06:05:46.902704+0000","last_undegraded":"2024-09-19T06:05:46.902704+0000","last_fullsized":"2024-09-19T06:05:46.902704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.296422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516416+0000","last_change":"2024-09-19T06:05:24.695214+0000","last_active":"2024-09-19T06:05:46.516416+0000","last_peered":"2024-09-19T06:05:46.516416+0000","last_clean":"2024-09-19T06:05:46.516416+0000","last_became_active":"2024-09-19T06:05:24.694930+0000","last_became_peered":"2024-09-19T06:05:24.694930+0000","last_unstale":"2024-09-19T06:05:46.516416+0000","last_undegraded":"2024-09-19T06:05:46.516416+0000","last_fullsized":"2024-09-19T06:05:46.516416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:51.382934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520982+0000","last_change":"2024-09-19T06:05:22.684504+0000","last_active":"2024-09-19T06:05:46.520982+0000","last_peered":"2024-09-19T06:05:46.520982+0000","last_clean":"2024-09-19T06:05:46.520982+0000","last_became_active":"2024-09-19T06:05:22.684169+0000","last_became_peered":"2024-09-19T06:05:22.684169+0000","last_unstale":"2024-09-19T06:05:46.520982+0000","last_undegraded":"2024-09-19T06:05:46.520982+0000","last_fullsized":"2024-09-19T06:05:46.520982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:29.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518059+0000","last_change":"2024-09-19T06:05:24.693056+0000","last_active":"2024-09-19T06:05:46.518059+0000","last_peered":"2024-09-19T06:05:46.518059+0000","last_clean":"2024-09-19T06:05:46.518059+0000","last_became_active":"2024-09-19T06:05:24.692544+0000","last_became_peered":"2024-09-19T06:05:24.692544+0000","last_unstale":"2024-09-19T06:05:46.518059+0000","last_undegraded":"2024-09-19T06:05:46.518059+0000","last_fullsized":"2024-09-19T06:05:46.518059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:45.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:48.904828+0000","last_change":"2024-09-19T06:05:22.682854+0000","last_active":"2024-09-19T06:05:48.904828+0000","last_peered":"2024-09-19T06:05:48.904828+0000","last_clean":"2024-09-19T06:05:48.904828+0000","last_became_active":"2024-09-19T06:05:22.682406+0000","last_became_peered":"2024-09-19T06:05:22.682406+0000","last_unstale":"2024-09-19T06:05:48.904828+0000","last_undegraded":"2024-09-19T06:05:48.904828+0000","last_fullsized":"2024-09-19T06:05:48.904828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.206144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961915+0000","last_change":"2024-09-19T06:05:24.699408+0000","last_active":"2024-09-19T06:05:46.961915+0000","last_peered":"2024-09-19T06:05:46.961915+0000","last_clean":"2024-09-19T06:05:46.961915+0000","last_became_active":"2024-09-19T06:05:24.699106+0000","last_became_peered":"2024-09-19T06:05:24.699106+0000","last_unstale":"2024-09-19T06:05:46.961915+0000","last_undegraded":"2024-09-19T06:05:46.961915+0000","last_fullsized":"2024-09-19T06:05:46.961915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:37.487458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902210+0000","last_change":"2024-09-19T06:05:22.686106+0000","last_active":"2024-09-19T06:05:46.902210+0000","last_peered":"2024-09-19T06:05:46.902210+0000","last_clean":"2024-09-19T06:05:46.902210+0000","last_became_active":"2024-09-19T06:05:22.685763+0000","last_became_peered":"2024-09-19T06:05:22.685763+0000","last_unstale":"2024-09-19T06:05:46.902210+0000","last_undegraded":"2024-09-19T06:05:46.902210+0000","last_fullsized":"2024-09-19T06:05:46.902210+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:57.889128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.524038+0000","last_change":"2024-09-19T06:05:46.524038+0000","last_active":"2024-09-19T06:05:46.524038+0000","last_peered":"2024-09-19T06:05:46.524038+0000","last_clean":"2024-09-19T06:05:46.524038+0000","last_became_active":"2024-09-19T06:05:46.523746+0000","last_became_peered":"2024-09-19T06:05:46.523746+0000","last_unstale":"2024-09-19T06:05:46.524038+0000","last_undegraded":"2024-09-19T06:05:46.524038+0000","last_fullsized":"2024-09-19T06:05:46.524038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:17.361840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519825+0000","last_change":"2024-09-19T06:05:23.060545+0000","last_active":"2024-09-19T06:05:46.519825+0000","last_peered":"2024-09-19T06:05:46.519825+0000","last_clean":"2024-09-19T06:05:46.519825+0000","last_became_active":"2024-09-19T06:05:23.060187+0000","last_became_peered":"2024-09-19T06:05:23.060187+0000","last_unstale":"2024-09-19T06:05:46.519825+0000","last_undegraded":"2024-09-19T06:05:46.519825+0000","last_fullsized":"2024-09-19T06:05:46.519825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.604284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961566+0000","last_change":"2024-09-19T06:05:24.702535+0000","last_active":"2024-09-19T06:05:46.961566+0000","last_peered":"2024-09-19T06:05:46.961566+0000","last_clean":"2024-09-19T06:05:46.961566+0000","last_became_active":"2024-09-19T06:05:24.701616+0000","last_became_peered":"2024-09-19T06:05:24.701616+0000","last_unstale":"2024-09-19T06:05:46.961566+0000","last_undegraded":"2024-09-19T06:05:46.961566+0000","last_fullsized":"2024-09-19T06:05:46.961566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:43.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'26","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:49.907015+0000","last_change":"2024-09-19T06:05:22.685460+0000","last_active":"2024-09-19T06:05:49.907015+0000","last_peered":"2024-09-19T06:05:49.907015+0000","last_clean":"2024-09-19T06:05:49.907015+0000","last_became_active":"2024-09-19T06:05:22.685086+0000","last_became_peered":"2024-09-19T06:05:22.685086+0000","last_unstale":"2024-09-19T06:05:49.907015+0000","last_undegraded":"2024-09-19T06:05:49.907015+0000","last_fullsized":"2024-09-19T06:05:49.907015+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:10.373783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54369,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":67,"num_write":27,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520872+0000","last_change":"2024-09-19T06:05:24.700431+0000","last_active":"2024-09-19T06:05:46.520872+0000","last_peered":"2024-09-19T06:05:46.520872+0000","last_clean":"2024-09-19T06:05:46.520872+0000","last_became_active":"2024-09-19T06:05:24.700092+0000","last_became_peered":"2024-09-19T06:05:24.700092+0000","last_unstale":"2024-09-19T06:05:46.520872+0000","last_undegraded":"2024-09-19T06:05:46.520872+0000","last_fullsized":"2024-09-19T06:05:46.520872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:17.208392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.530433+0000","last_change":"2024-09-19T06:05:46.530433+0000","last_active":"2024-09-19T06:05:46.530433+0000","last_peered":"2024-09-19T06:05:46.530433+0000","last_clean":"2024-09-19T06:05:46.530433+0000","last_became_active":"2024-09-19T06:05:46.521700+0000","last_became_peered":"2024-09-19T06:05:46.521700+0000","last_unstale":"2024-09-19T06:05:46.530433+0000","last_undegraded":"2024-09-19T06:05:46.530433+0000","last_fullsized":"2024-09-19T06:05:46.530433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:40.489547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903307+0000","last_change":"2024-09-19T06:05:24.699149+0000","last_active":"2024-09-19T06:05:46.903307+0000","last_peered":"2024-09-19T06:05:46.903307+0000","last_clean":"2024-09-19T06:05:46.903307+0000","last_became_active":"2024-09-19T06:05:24.698846+0000","last_became_peered":"2024-09-19T06:05:24.698846+0000","last_unstale":"2024-09-19T06:05:46.903307+0000","last_undegraded":"2024-09-19T06:05:46.903307+0000","last_fullsized":"2024-09-19T06:05:46.903307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:19.416169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519763+0000","last_change":"2024-09-19T06:05:22.682157+0000","last_active":"2024-09-19T06:05:46.519763+0000","last_peered":"2024-09-19T06:05:46.519763+0000","last_clean":"2024-09-19T06:05:46.519763+0000","last_became_active":"2024-09-19T06:05:22.681816+0000","last_became_peered":"2024-09-19T06:05:22.681816+0000","last_unstale":"2024-09-19T06:05:46.519763+0000","last_undegraded":"2024-09-19T06:05:46.519763+0000","last_fullsized":"2024-09-19T06:05:46.519763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:05.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902542+0000","last_change":"2024-09-19T06:05:24.699233+0000","last_active":"2024-09-19T06:05:46.902542+0000","last_peered":"2024-09-19T06:05:46.902542+0000","last_clean":"2024-09-19T06:05:46.902542+0000","last_became_active":"2024-09-19T06:05:24.698918+0000","last_became_peered":"2024-09-19T06:05:24.698918+0000","last_unstale":"2024-09-19T06:05:46.902542+0000","last_undegraded":"2024-09-19T06:05:46.902542+0000","last_fullsized":"2024-09-19T06:05:46.902542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:49.910647+0000","last_change":"2024-09-19T06:05:22.682161+0000","last_active":"2024-09-19T06:05:49.910647+0000","last_peered":"2024-09-19T06:05:49.910647+0000","last_clean":"2024-09-19T06:05:49.910647+0000","last_became_active":"2024-09-19T06:05:22.681805+0000","last_became_peered":"2024-09-19T06:05:22.681805+0000","last_unstale":"2024-09-19T06:05:49.910647+0000","last_undegraded":"2024-09-19T06:05:49.910647+0000","last_fullsized":"2024-09-19T06:05:49.910647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:27.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902474+0000","last_change":"2024-09-19T06:05:24.703668+0000","last_active":"2024-09-19T06:05:46.902474+0000","last_peered":"2024-09-19T06:05:46.902474+0000","last_clean":"2024-09-19T06:05:46.902474+0000","last_became_active":"2024-09-19T06:05:24.703342+0000","last_became_peered":"2024-09-19T06:05:24.703342+0000","last_unstale":"2024-09-19T06:05:46.902474+0000","last_undegraded":"2024-09-19T06:05:46.902474+0000","last_fullsized":"2024-09-19T06:05:46.902474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:30.399187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520049+0000","last_change":"2024-09-19T06:05:23.060458+0000","last_active":"2024-09-19T06:05:46.520049+0000","last_peered":"2024-09-19T06:05:46.520049+0000","last_clean":"2024-09-19T06:05:46.520049+0000","last_became_active":"2024-09-19T06:05:23.060098+0000","last_became_peered":"2024-09-19T06:05:23.060098+0000","last_unstale":"2024-09-19T06:05:46.520049+0000","last_undegraded":"2024-09-19T06:05:46.520049+0000","last_fullsized":"2024-09-19T06:05:46.520049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:58.800162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519964+0000","last_change":"2024-09-19T06:05:24.699832+0000","last_active":"2024-09-19T06:05:46.519964+0000","last_peered":"2024-09-19T06:05:46.519964+0000","last_clean":"2024-09-19T06:05:46.519964+0000","last_became_active":"2024-09-19T06:05:24.697600+0000","last_became_peered":"2024-09-19T06:05:24.697600+0000","last_unstale":"2024-09-19T06:05:46.519964+0000","last_undegraded":"2024-09-19T06:05:46.519964+0000","last_fullsized":"2024-09-19T06:05:46.519964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:15.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521202+0000","last_change":"2024-09-19T06:05:22.682962+0000","last_active":"2024-09-19T06:05:46.521202+0000","last_peered":"2024-09-19T06:05:46.521202+0000","last_clean":"2024-09-19T06:05:46.521202+0000","last_became_active":"2024-09-19T06:05:22.682573+0000","last_became_peered":"2024-09-19T06:05:22.682573+0000","last_unstale":"2024-09-19T06:05:46.521202+0000","last_undegraded":"2024-09-19T06:05:46.521202+0000","last_fullsized":"2024-09-19T06:05:46.521202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:31.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.907103+0000","last_change":"2024-09-19T06:05:46.907103+0000","last_active":"2024-09-19T06:05:46.907103+0000","last_peered":"2024-09-19T06:05:46.907103+0000","last_clean":"2024-09-19T06:05:46.907103+0000","last_became_active":"2024-09-19T06:05:46.906741+0000","last_became_peered":"2024-09-19T06:05:46.906741+0000","last_unstale":"2024-09-19T06:05:46.907103+0000","last_undegraded":"2024-09-19T06:05:46.907103+0000","last_fullsized":"2024-09-19T06:05:46.907103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:42.275594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902723+0000","last_change":"2024-09-19T06:05:22.684007+0000","last_active":"2024-09-19T06:05:46.902723+0000","last_peered":"2024-09-19T06:05:46.902723+0000","last_clean":"2024-09-19T06:05:46.902723+0000","last_became_active":"2024-09-19T06:05:22.683606+0000","last_became_peered":"2024-09-19T06:05:22.683606+0000","last_unstale":"2024-09-19T06:05:46.902723+0000","last_undegraded":"2024-09-19T06:05:46.902723+0000","last_fullsized":"2024-09-19T06:05:46.902723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:29.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902839+0000","last_change":"2024-09-19T06:05:24.698057+0000","last_active":"2024-09-19T06:05:46.902839+0000","last_peered":"2024-09-19T06:05:46.902839+0000","last_clean":"2024-09-19T06:05:46.902839+0000","last_became_active":"2024-09-19T06:05:24.697604+0000","last_became_peered":"2024-09-19T06:05:24.697604+0000","last_unstale":"2024-09-19T06:05:46.902839+0000","last_undegraded":"2024-09-19T06:05:46.902839+0000","last_fullsized":"2024-09-19T06:05:46.902839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:33.246096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520103+0000","last_change":"2024-09-19T06:05:22.680641+0000","last_active":"2024-09-19T06:05:46.520103+0000","last_peered":"2024-09-19T06:05:46.520103+0000","last_clean":"2024-09-19T06:05:46.520103+0000","last_became_active":"2024-09-19T06:05:22.680282+0000","last_became_peered":"2024-09-19T06:05:22.680282+0000","last_unstale":"2024-09-19T06:05:46.520103+0000","last_undegraded":"2024-09-19T06:05:46.520103+0000","last_fullsized":"2024-09-19T06:05:46.520103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:07.171581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902552+0000","last_change":"2024-09-19T06:05:24.705525+0000","last_active":"2024-09-19T06:05:46.902552+0000","last_peered":"2024-09-19T06:05:46.902552+0000","last_clean":"2024-09-19T06:05:46.902552+0000","last_became_active":"2024-09-19T06:05:24.705226+0000","last_became_peered":"2024-09-19T06:05:24.705226+0000","last_unstale":"2024-09-19T06:05:46.902552+0000","last_undegraded":"2024-09-19T06:05:46.902552+0000","last_fullsized":"2024-09-19T06:05:46.902552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:51.020525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522657+0000","last_change":"2024-09-19T06:05:23.060628+0000","last_active":"2024-09-19T06:05:46.522657+0000","last_peered":"2024-09-19T06:05:46.522657+0000","last_clean":"2024-09-19T06:05:46.522657+0000","last_became_active":"2024-09-19T06:05:23.060066+0000","last_became_peered":"2024-09-19T06:05:23.060066+0000","last_unstale":"2024-09-19T06:05:46.522657+0000","last_undegraded":"2024-09-19T06:05:46.522657+0000","last_fullsized":"2024-09-19T06:05:46.522657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:55.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902770+0000","last_change":"2024-09-19T06:05:24.701994+0000","last_active":"2024-09-19T06:05:46.902770+0000","last_peered":"2024-09-19T06:05:46.902770+0000","last_clean":"2024-09-19T06:05:46.902770+0000","last_became_active":"2024-09-19T06:05:24.701648+0000","last_became_peered":"2024-09-19T06:05:24.701648+0000","last_unstale":"2024-09-19T06:05:46.902770+0000","last_undegraded":"2024-09-19T06:05:46.902770+0000","last_fullsized":"2024-09-19T06:05:46.902770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:16.475339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902639+0000","last_change":"2024-09-19T06:04:14.186274+0000","last_active":"2024-09-19T06:05:46.902639+0000","last_peered":"2024-09-19T06:05:46.902639+0000","last_clean":"2024-09-19T06:05:46.902639+0000","last_became_active":"2024-09-19T06:04:14.185907+0000","last_became_peered":"2024-09-19T06:04:14.185907+0000","last_unstale":"2024-09-19T06:05:46.902639+0000","last_undegraded":"2024-09-19T06:05:46.902639+0000","last_fullsized":"2024-09-19T06:05:46.902639+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_clean_scrub_stamp":"2024-09-19T06:00:59.680614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:01.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905464+0000","last_change":"2024-09-19T06:05:22.682242+0000","last_active":"2024-09-19T06:05:46.905464+0000","last_peered":"2024-09-19T06:05:46.905464+0000","last_clean":"2024-09-19T06:05:46.905464+0000","last_became_active":"2024-09-19T06:05:22.681896+0000","last_became_peered":"2024-09-19T06:05:22.681896+0000","last_unstale":"2024-09-19T06:05:46.905464+0000","last_undegraded":"2024-09-19T06:05:46.905464+0000","last_fullsized":"2024-09-19T06:05:46.905464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.119422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.962902+0000","last_change":"2024-09-19T06:05:46.962541+0000","last_active":"2024-09-19T06:05:46.962902+0000","last_peered":"2024-09-19T06:05:46.962902+0000","last_clean":"2024-09-19T06:05:46.962902+0000","last_became_active":"2024-09-19T06:05:46.962261+0000","last_became_peered":"2024-09-19T06:05:46.962261+0000","last_unstale":"2024-09-19T06:05:46.962902+0000","last_undegraded":"2024-09-19T06:05:46.962902+0000","last_fullsized":"2024-09-19T06:05:46.962902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:36.355129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902052+0000","last_change":"2024-09-19T06:05:22.685809+0000","last_active":"2024-09-19T06:05:46.902052+0000","last_peered":"2024-09-19T06:05:46.902052+0000","last_clean":"2024-09-19T06:05:46.902052+0000","last_became_active":"2024-09-19T06:05:22.685466+0000","last_became_peered":"2024-09-19T06:05:22.685466+0000","last_unstale":"2024-09-19T06:05:46.902052+0000","last_undegraded":"2024-09-19T06:05:46.902052+0000","last_fullsized":"2024-09-19T06:05:46.902052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:43.793845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903209+0000","last_change":"2024-09-19T06:05:24.701105+0000","last_active":"2024-09-19T06:05:46.903209+0000","last_peered":"2024-09-19T06:05:46.903209+0000","last_clean":"2024-09-19T06:05:46.903209+0000","last_became_active":"2024-09-19T06:05:24.700825+0000","last_became_peered":"2024-09-19T06:05:24.700825+0000","last_unstale":"2024-09-19T06:05:46.903209+0000","last_undegraded":"2024-09-19T06:05:46.903209+0000","last_fullsized":"2024-09-19T06:05:46.903209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:35.707437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":46,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:52.914039+0000","last_change":"2024-09-19T06:05:23.059587+0000","last_active":"2024-09-19T06:05:52.914039+0000","last_peered":"2024-09-19T06:05:52.914039+0000","last_clean":"2024-09-19T06:05:52.914039+0000","last_became_active":"2024-09-19T06:05:23.059248+0000","last_became_peered":"2024-09-19T06:05:23.059248+0000","last_unstale":"2024-09-19T06:05:52.914039+0000","last_undegraded":"2024-09-19T06:05:52.914039+0000","last_fullsized":"2024-09-19T06:05:52.914039+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:25.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520818+0000","last_change":"2024-09-19T06:05:24.701610+0000","last_active":"2024-09-19T06:05:46.520818+0000","last_peered":"2024-09-19T06:05:46.520818+0000","last_clean":"2024-09-19T06:05:46.520818+0000","last_became_active":"2024-09-19T06:05:24.697296+0000","last_became_peered":"2024-09-19T06:05:24.697296+0000","last_unstale":"2024-09-19T06:05:46.520818+0000","last_undegraded":"2024-09-19T06:05:46.520818+0000","last_fullsized":"2024-09-19T06:05:46.520818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:52.256284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902512+0000","last_change":"2024-09-19T06:05:22.684818+0000","last_active":"2024-09-19T06:05:46.902512+0000","last_peered":"2024-09-19T06:05:46.902512+0000","last_clean":"2024-09-19T06:05:46.902512+0000","last_became_active":"2024-09-19T06:05:22.684211+0000","last_became_peered":"2024-09-19T06:05:22.684211+0000","last_unstale":"2024-09-19T06:05:46.902512+0000","last_undegraded":"2024-09-19T06:05:46.902512+0000","last_fullsized":"2024-09-19T06:05:46.902512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:50.711805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517975+0000","last_change":"2024-09-19T06:05:24.702992+0000","last_active":"2024-09-19T06:05:46.517975+0000","last_peered":"2024-09-19T06:05:46.517975+0000","last_clean":"2024-09-19T06:05:46.517975+0000","last_became_active":"2024-09-19T06:05:24.702643+0000","last_became_peered":"2024-09-19T06:05:24.702643+0000","last_unstale":"2024-09-19T06:05:46.517975+0000","last_undegraded":"2024-09-19T06:05:46.517975+0000","last_fullsized":"2024-09-19T06:05:46.517975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:40.651861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518397+0000","last_change":"2024-09-19T06:05:23.060444+0000","last_active":"2024-09-19T06:05:46.518397+0000","last_peered":"2024-09-19T06:05:46.518397+0000","last_clean":"2024-09-19T06:05:46.518397+0000","last_became_active":"2024-09-19T06:05:23.059879+0000","last_became_peered":"2024-09-19T06:05:23.059879+0000","last_unstale":"2024-09-19T06:05:46.518397+0000","last_undegraded":"2024-09-19T06:05:46.518397+0000","last_fullsized":"2024-09-19T06:05:46.518397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:39.013096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517898+0000","last_change":"2024-09-19T06:05:24.694892+0000","last_active":"2024-09-19T06:05:46.517898+0000","last_peered":"2024-09-19T06:05:46.517898+0000","last_clean":"2024-09-19T06:05:46.517898+0000","last_became_active":"2024-09-19T06:05:24.694534+0000","last_became_peered":"2024-09-19T06:05:24.694534+0000","last_unstale":"2024-09-19T06:05:46.517898+0000","last_undegraded":"2024-09-19T06:05:46.517898+0000","last_fullsized":"2024-09-19T06:05:46.517898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:50.633035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521062+0000","last_change":"2024-09-19T06:05:23.060597+0000","last_active":"2024-09-19T06:05:46.521062+0000","last_peered":"2024-09-19T06:05:46.521062+0000","last_clean":"2024-09-19T06:05:46.521062+0000","last_became_active":"2024-09-19T06:05:23.060235+0000","last_became_peered":"2024-09-19T06:05:23.060235+0000","last_unstale":"2024-09-19T06:05:46.521062+0000","last_undegraded":"2024-09-19T06:05:46.521062+0000","last_fullsized":"2024-09-19T06:05:46.521062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:54.517780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903431+0000","last_change":"2024-09-19T06:05:24.698131+0000","last_active":"2024-09-19T06:05:46.903431+0000","last_peered":"2024-09-19T06:05:46.903431+0000","last_clean":"2024-09-19T06:05:46.903431+0000","last_became_active":"2024-09-19T06:05:24.697784+0000","last_became_peered":"2024-09-19T06:05:24.697784+0000","last_unstale":"2024-09-19T06:05:46.903431+0000","last_undegraded":"2024-09-19T06:05:46.903431+0000","last_fullsized":"2024-09-19T06:05:46.903431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:49.563908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:48.700895+0000","last_change":"2024-09-19T06:05:22.679532+0000","last_active":"2024-09-19T06:05:48.700895+0000","last_peered":"2024-09-19T06:05:48.700895+0000","last_clean":"2024-09-19T06:05:48.700895+0000","last_became_active":"2024-09-19T06:05:22.679156+0000","last_became_peered":"2024-09-19T06:05:22.679156+0000","last_unstale":"2024-09-19T06:05:48.700895+0000","last_undegraded":"2024-09-19T06:05:48.700895+0000","last_fullsized":"2024-09-19T06:05:48.700895+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:31.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516744+0000","last_change":"2024-09-19T06:05:24.698383+0000","last_active":"2024-09-19T06:05:46.516744+0000","last_peered":"2024-09-19T06:05:46.516744+0000","last_clean":"2024-09-19T06:05:46.516744+0000","last_became_active":"2024-09-19T06:05:24.698044+0000","last_became_peered":"2024-09-19T06:05:24.698044+0000","last_unstale":"2024-09-19T06:05:46.516744+0000","last_undegraded":"2024-09-19T06:05:46.516744+0000","last_fullsized":"2024-09-19T06:05:46.516744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:53.388847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905533+0000","last_change":"2024-09-19T06:05:22.684799+0000","last_active":"2024-09-19T06:05:46.905533+0000","last_peered":"2024-09-19T06:05:46.905533+0000","last_clean":"2024-09-19T06:05:46.905533+0000","last_became_active":"2024-09-19T06:05:22.684376+0000","last_became_peered":"2024-09-19T06:05:22.684376+0000","last_unstale":"2024-09-19T06:05:46.905533+0000","last_undegraded":"2024-09-19T06:05:46.905533+0000","last_fullsized":"2024-09-19T06:05:46.905533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.124960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519736+0000","last_change":"2024-09-19T06:05:24.693751+0000","last_active":"2024-09-19T06:05:46.519736+0000","last_peered":"2024-09-19T06:05:46.519736+0000","last_clean":"2024-09-19T06:05:46.519736+0000","last_became_active":"2024-09-19T06:05:24.693442+0000","last_became_peered":"2024-09-19T06:05:24.693442+0000","last_unstale":"2024-09-19T06:05:46.519736+0000","last_undegraded":"2024-09-19T06:05:46.519736+0000","last_fullsized":"2024-09-19T06:05:46.519736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:46.491860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961568+0000","last_change":"2024-09-19T06:05:23.060522+0000","last_active":"2024-09-19T06:05:46.961568+0000","last_peered":"2024-09-19T06:05:46.961568+0000","last_clean":"2024-09-19T06:05:46.961568+0000","last_became_active":"2024-09-19T06:05:23.060170+0000","last_became_peered":"2024-09-19T06:05:23.060170+0000","last_unstale":"2024-09-19T06:05:46.961568+0000","last_undegraded":"2024-09-19T06:05:46.961568+0000","last_fullsized":"2024-09-19T06:05:46.961568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:54.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520186+0000","last_change":"2024-09-19T06:05:24.701242+0000","last_active":"2024-09-19T06:05:46.520186+0000","last_peered":"2024-09-19T06:05:46.520186+0000","last_clean":"2024-09-19T06:05:46.520186+0000","last_became_active":"2024-09-19T06:05:24.700813+0000","last_became_peered":"2024-09-19T06:05:24.700813+0000","last_unstale":"2024-09-19T06:05:46.520186+0000","last_undegraded":"2024-09-19T06:05:46.520186+0000","last_fullsized":"2024-09-19T06:05:46.520186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:42.706448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516577+0000","last_change":"2024-09-19T06:05:22.677502+0000","last_active":"2024-09-19T06:05:46.516577+0000","last_peered":"2024-09-19T06:05:46.516577+0000","last_clean":"2024-09-19T06:05:46.516577+0000","last_became_active":"2024-09-19T06:05:22.677082+0000","last_became_peered":"2024-09-19T06:05:22.677082+0000","last_unstale":"2024-09-19T06:05:46.516577+0000","last_undegraded":"2024-09-19T06:05:46.516577+0000","last_fullsized":"2024-09-19T06:05:46.516577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:30.991778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517459+0000","last_change":"2024-09-19T06:05:24.703155+0000","last_active":"2024-09-19T06:05:46.517459+0000","last_peered":"2024-09-19T06:05:46.517459+0000","last_clean":"2024-09-19T06:05:46.517459+0000","last_became_active":"2024-09-19T06:05:24.702570+0000","last_became_peered":"2024-09-19T06:05:24.702570+0000","last_unstale":"2024-09-19T06:05:46.517459+0000","last_undegraded":"2024-09-19T06:05:46.517459+0000","last_fullsized":"2024-09-19T06:05:46.517459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:36.016886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.532666+0000","last_change":"2024-09-19T06:05:46.532666+0000","last_active":"2024-09-19T06:05:46.532666+0000","last_peered":"2024-09-19T06:05:46.532666+0000","last_clean":"2024-09-19T06:05:46.532666+0000","last_became_active":"2024-09-19T06:05:46.523271+0000","last_became_peered":"2024-09-19T06:05:46.523271+0000","last_unstale":"2024-09-19T06:05:46.532666+0000","last_undegraded":"2024-09-19T06:05:46.532666+0000","last_fullsized":"2024-09-19T06:05:46.532666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:04.627727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516710+0000","last_change":"2024-09-19T06:05:24.694476+0000","last_active":"2024-09-19T06:05:46.516710+0000","last_peered":"2024-09-19T06:05:46.516710+0000","last_clean":"2024-09-19T06:05:46.516710+0000","last_became_active":"2024-09-19T06:05:24.694147+0000","last_became_peered":"2024-09-19T06:05:24.694147+0000","last_unstale":"2024-09-19T06:05:46.516710+0000","last_undegraded":"2024-09-19T06:05:46.516710+0000","last_fullsized":"2024-09-19T06:05:46.516710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:48.830522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520434+0000","last_change":"2024-09-19T06:05:22.687422+0000","last_active":"2024-09-19T06:05:46.520434+0000","last_peered":"2024-09-19T06:05:46.520434+0000","last_clean":"2024-09-19T06:05:46.520434+0000","last_became_active":"2024-09-19T06:05:22.686950+0000","last_became_peered":"2024-09-19T06:05:22.686950+0000","last_unstale":"2024-09-19T06:05:46.520434+0000","last_undegraded":"2024-09-19T06:05:46.520434+0000","last_fullsized":"2024-09-19T06:05:46.520434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:49.279769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902432+0000","last_change":"2024-09-19T06:05:24.695701+0000","last_active":"2024-09-19T06:05:46.902432+0000","last_peered":"2024-09-19T06:05:46.902432+0000","last_clean":"2024-09-19T06:05:46.902432+0000","last_became_active":"2024-09-19T06:05:24.695341+0000","last_became_peered":"2024-09-19T06:05:24.695341+0000","last_unstale":"2024-09-19T06:05:46.902432+0000","last_undegraded":"2024-09-19T06:05:46.902432+0000","last_fullsized":"2024-09-19T06:05:46.902432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:52.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519721+0000","last_change":"2024-09-19T06:05:24.703456+0000","last_active":"2024-09-19T06:05:46.519721+0000","last_peered":"2024-09-19T06:05:46.519721+0000","last_clean":"2024-09-19T06:05:46.519721+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:46.519721+0000","last_undegraded":"2024-09-19T06:05:46.519721+0000","last_fullsized":"2024-09-19T06:05:46.519721+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:15.159843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520802+0000","last_change":"2024-09-19T06:05:22.683833+0000","last_active":"2024-09-19T06:05:46.520802+0000","last_peered":"2024-09-19T06:05:46.520802+0000","last_clean":"2024-09-19T06:05:46.520802+0000","last_became_active":"2024-09-19T06:05:22.683439+0000","last_became_peered":"2024-09-19T06:05:22.683439+0000","last_unstale":"2024-09-19T06:05:46.520802+0000","last_undegraded":"2024-09-19T06:05:46.520802+0000","last_fullsized":"2024-09-19T06:05:46.520802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:52.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961492+0000","last_change":"2024-09-19T06:05:24.695905+0000","last_active":"2024-09-19T06:05:46.961492+0000","last_peered":"2024-09-19T06:05:46.961492+0000","last_clean":"2024-09-19T06:05:46.961492+0000","last_became_active":"2024-09-19T06:05:24.695570+0000","last_became_peered":"2024-09-19T06:05:24.695570+0000","last_unstale":"2024-09-19T06:05:46.961492+0000","last_undegraded":"2024-09-19T06:05:46.961492+0000","last_fullsized":"2024-09-19T06:05:46.961492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:00.167126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520961+0000","last_change":"2024-09-19T06:05:22.686853+0000","last_active":"2024-09-19T06:05:46.520961+0000","last_peered":"2024-09-19T06:05:46.520961+0000","last_clean":"2024-09-19T06:05:46.520961+0000","last_became_active":"2024-09-19T06:05:22.686143+0000","last_became_peered":"2024-09-19T06:05:22.686143+0000","last_unstale":"2024-09-19T06:05:46.520961+0000","last_undegraded":"2024-09-19T06:05:46.520961+0000","last_fullsized":"2024-09-19T06:05:46.520961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:30.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519841+0000","last_change":"2024-09-19T06:05:24.702420+0000","last_active":"2024-09-19T06:05:46.519841+0000","last_peered":"2024-09-19T06:05:46.519841+0000","last_clean":"2024-09-19T06:05:46.519841+0000","last_became_active":"2024-09-19T06:05:24.702140+0000","last_became_peered":"2024-09-19T06:05:24.702140+0000","last_unstale":"2024-09-19T06:05:46.519841+0000","last_undegraded":"2024-09-19T06:05:46.519841+0000","last_fullsized":"2024-09-19T06:05:46.519841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:27.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517042+0000","last_change":"2024-09-19T06:05:23.059638+0000","last_active":"2024-09-19T06:05:46.517042+0000","last_peered":"2024-09-19T06:05:46.517042+0000","last_clean":"2024-09-19T06:05:46.517042+0000","last_became_active":"2024-09-19T06:05:23.059273+0000","last_became_peered":"2024-09-19T06:05:23.059273+0000","last_unstale":"2024-09-19T06:05:46.517042+0000","last_undegraded":"2024-09-19T06:05:46.517042+0000","last_fullsized":"2024-09-19T06:05:46.517042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:56.981598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516857+0000","last_change":"2024-09-19T06:05:24.703608+0000","last_active":"2024-09-19T06:05:46.516857+0000","last_peered":"2024-09-19T06:05:46.516857+0000","last_clean":"2024-09-19T06:05:46.516857+0000","last_became_active":"2024-09-19T06:05:24.703300+0000","last_became_peered":"2024-09-19T06:05:24.703300+0000","last_unstale":"2024-09-19T06:05:46.516857+0000","last_undegraded":"2024-09-19T06:05:46.516857+0000","last_fullsized":"2024-09-19T06:05:46.516857+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.063545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518702+0000","last_change":"2024-09-19T06:05:22.679379+0000","last_active":"2024-09-19T06:05:46.518702+0000","last_peered":"2024-09-19T06:05:46.518702+0000","last_clean":"2024-09-19T06:05:46.518702+0000","last_became_active":"2024-09-19T06:05:22.679091+0000","last_became_peered":"2024-09-19T06:05:22.679091+0000","last_unstale":"2024-09-19T06:05:46.518702+0000","last_undegraded":"2024-09-19T06:05:46.518702+0000","last_fullsized":"2024-09-19T06:05:46.518702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57979,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":158,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":173937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645330,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":427934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874262,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1564672,"data_stored":1073750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037788,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":428136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":428056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32640,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712512,"statfs":{"total":95995035648,"available":95961612288,"internally_reserved":0,"allocated":1482752,"data_stored":1019595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659179,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":427525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888111,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1495040,"data_stored":1019279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":483003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":481687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":428796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":55685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":55947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:05:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:57 smithi174 ceph-mon[34488]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:57 smithi103 ceph-mon[30925]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:58.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:57 smithi169 ceph-mon[34350]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:05:58 smithi174 ceph-mon[34488]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 7 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:05:58.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:05:58 smithi103 ceph-mon[30925]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 7 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:05:59.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:05:58 smithi169 ceph-mon[34350]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 7 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:06:00.265 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:06:00.525 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:00.933 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:00 smithi103 ceph-mon[30925]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:06:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:00 smithi174 ceph-mon[34488]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:06:01.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:00 smithi169 ceph-mon[34350]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:06:01.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.012+0000 7ff2d2176640 1 -- 172.21.15.103:0/3125996017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2cc101420 msgr2=0x7ff2cc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.012+0000 7ff2d2176640 1 --2- 172.21.15.103:0/3125996017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2cc101420 0x7ff2cc10d950 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009cd0 tx=0x7ff2c402a910 comp rx=0 tx=0).stop 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.012+0000 7ff2d2176640 1 -- 172.21.15.103:0/3125996017 shutdown_connections 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.012+0000 7ff2d2176640 1 --2- 172.21.15.103:0/3125996017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2cc101420 0x7ff2cc10d950 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.012+0000 7ff2d2176640 1 --2- 172.21.15.103:0/3125996017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2cc100a80 0x7ff2cc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.012+0000 7ff2d2176640 1 --2- 172.21.15.103:0/3125996017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2cc106a80 0x7ff2cc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.012+0000 7ff2d2176640 1 -- 172.21.15.103:0/3125996017 >> 172.21.15.103:0/3125996017 conn(0x7ff2cc0fc7a0 msgr2=0x7ff2cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.012+0000 7ff2d2176640 1 -- 172.21.15.103:0/3125996017 shutdown_connections 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.012+0000 7ff2d2176640 1 -- 172.21.15.103:0/3125996017 wait complete. 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.012+0000 7ff2d2176640 1 Processor -- start 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2d2176640 1 -- start start 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2d2176640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2cc100a80 0x7ff2cc1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2d2176640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2cc101420 0x7ff2cc199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:01.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2d2176640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2cc106a80 0x7ff2cc1a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2d2176640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc110d70 con 0x7ff2cc100a80 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2d2176640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc110bf0 con 0x7ff2cc106a80 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2d2176640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc110ef0 con 0x7ff2cc101420 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2cc100a80 0x7ff2cc1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2cc100a80 0x7ff2cc1991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35494/0 (socket says 172.21.15.103:35494) 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/583247400 learned_addr learned my addr 172.21.15.103:0/583247400 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cbfff640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2cc106a80 0x7ff2cc1a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/583247400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2cc101420 msgr2=0x7ff2cc199700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cb7fe640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2cc101420 0x7ff2cc199700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/583247400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2cc106a80 msgr2=0x7ff2cc1a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cb7fe640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2cc106a80 0x7ff2cc1a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/583247400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2cc1a4780 con 0x7ff2cc100a80 2024-09-19T06:06:01.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cbfff640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2cc106a80 0x7ff2cc1a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.013+0000 7ff2cb7fe640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2cc100a80 0x7ff2cc1991c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400c920 tx=0x7ff2b400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.014+0000 7ff2c8ff9640 1 -- 172.21.15.103:0/583247400 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4007c70 con 0x7ff2cc100a80 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.014+0000 7ff2d2176640 1 -- 172.21.15.103:0/583247400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2cc1a4950 con 0x7ff2cc100a80 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.014+0000 7ff2c8ff9640 1 -- 172.21.15.103:0/583247400 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2b4007e10 con 0x7ff2cc100a80 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.014+0000 7ff2c8ff9640 1 -- 172.21.15.103:0/583247400 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4018820 con 0x7ff2cc100a80 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.014+0000 7ff2d2176640 1 -- 172.21.15.103:0/583247400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2cc1a4e40 con 0x7ff2cc100a80 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.015+0000 7ff2d2176640 1 -- 172.21.15.103:0/583247400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2cc100ee0 con 0x7ff2cc100a80 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.016+0000 7ff2c8ff9640 1 -- 172.21.15.103:0/583247400 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff2b40189c0 con 0x7ff2cc100a80 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.017+0000 7ff2c8ff9640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff2b80a32d0 0x7ff2b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.017+0000 7ff2caffd640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff2b80a32d0 0x7ff2b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.017+0000 7ff2c8ff9640 1 -- 172.21.15.103:0/583247400 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ff2b40cfc70 con 0x7ff2cc100a80 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.018+0000 7ff2caffd640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff2b80a32d0 0x7ff2b80a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc06b2e0 tx=0x7ff2bc006bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:01.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.021+0000 7ff2c8ff9640 1 -- 172.21.15.103:0/583247400 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2b4014030 con 0x7ff2cc100a80 2024-09-19T06:06:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.186+0000 7ff2d2176640 1 -- 172.21.15.103:0/583247400 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2cc062630 con 0x7ff2b80a32d0 2024-09-19T06:06:01.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.193+0000 7ff2c8ff9640 1 -- 172.21.15.103:0/583247400 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258721 (secure 0 0 0) 0x7ff2cc062630 con 0x7ff2b80a32d0 2024-09-19T06:06:01.196 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:01.197 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T06:06:01.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 -- 172.21.15.103:0/583247400 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff2b80a32d0 msgr2=0x7ff2b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:01.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff2b80a32d0 0x7ff2b80a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc06b2e0 tx=0x7ff2bc006bd0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 -- 172.21.15.103:0/583247400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2cc100a80 msgr2=0x7ff2cc1991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:01.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2cc100a80 0x7ff2cc1991c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400c920 tx=0x7ff2b400cde0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 -- 172.21.15.103:0/583247400 shutdown_connections 2024-09-19T06:06:01.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff2b80a32d0 0x7ff2b80a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2cc106a80 0x7ff2cc1a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2cc101420 0x7ff2cc199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 --2- 172.21.15.103:0/583247400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2cc100a80 0x7ff2cc1991c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 -- 172.21.15.103:0/583247400 >> 172.21.15.103:0/583247400 conn(0x7ff2cc0fc7a0 msgr2=0x7ff2cc0fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:01.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 -- 172.21.15.103:0/583247400 shutdown_connections 2024-09-19T06:06:01.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:01.196+0000 7ff2d2176640 1 -- 172.21.15.103:0/583247400 wait complete. 2024-09-19T06:06:01.856 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-19T06:05:59.458254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653976,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":287,"num_read_kb":255,"num_write":343,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361640,"kb_used_data":12348,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580184,"statfs":{"total":1151940427776,"available":1151570108416,"internally_reserved":0,"allocated":12644352,"data_stored":7089744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9769,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":-5,"num_objects_missing":-5,"num_objects_degraded":-1,"num_objects_misplaced":-4,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":44,"num_write":15,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003186"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518052+0000","last_change":"2024-09-19T06:05:24.703290+0000","last_active":"2024-09-19T06:05:46.518052+0000","last_peered":"2024-09-19T06:05:46.518052+0000","last_clean":"2024-09-19T06:05:46.518052+0000","last_became_active":"2024-09-19T06:05:24.702343+0000","last_became_peered":"2024-09-19T06:05:24.702343+0000","last_unstale":"2024-09-19T06:05:46.518052+0000","last_undegraded":"2024-09-19T06:05:46.518052+0000","last_fullsized":"2024-09-19T06:05:46.518052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.594004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519636+0000","last_change":"2024-09-19T06:05:24.700363+0000","last_active":"2024-09-19T06:05:46.519636+0000","last_peered":"2024-09-19T06:05:46.519636+0000","last_clean":"2024-09-19T06:05:46.519636+0000","last_became_active":"2024-09-19T06:05:24.700066+0000","last_became_peered":"2024-09-19T06:05:24.700066+0000","last_unstale":"2024-09-19T06:05:46.519636+0000","last_undegraded":"2024-09-19T06:05:46.519636+0000","last_fullsized":"2024-09-19T06:05:46.519636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:26.094195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519554+0000","last_change":"2024-09-19T06:05:24.702458+0000","last_active":"2024-09-19T06:05:46.519554+0000","last_peered":"2024-09-19T06:05:46.519554+0000","last_clean":"2024-09-19T06:05:46.519554+0000","last_became_active":"2024-09-19T06:05:24.702029+0000","last_became_peered":"2024-09-19T06:05:24.702029+0000","last_unstale":"2024-09-19T06:05:46.519554+0000","last_undegraded":"2024-09-19T06:05:46.519554+0000","last_fullsized":"2024-09-19T06:05:46.519554+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905954+0000","last_change":"2024-09-19T06:05:24.699402+0000","last_active":"2024-09-19T06:05:46.905954+0000","last_peered":"2024-09-19T06:05:46.905954+0000","last_clean":"2024-09-19T06:05:46.905954+0000","last_became_active":"2024-09-19T06:05:24.698191+0000","last_became_peered":"2024-09-19T06:05:24.698191+0000","last_unstale":"2024-09-19T06:05:46.905954+0000","last_undegraded":"2024-09-19T06:05:46.905954+0000","last_fullsized":"2024-09-19T06:05:46.905954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.056347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520337+0000","last_change":"2024-09-19T06:05:24.699821+0000","last_active":"2024-09-19T06:05:46.520337+0000","last_peered":"2024-09-19T06:05:46.520337+0000","last_clean":"2024-09-19T06:05:46.520337+0000","last_became_active":"2024-09-19T06:05:24.699493+0000","last_became_peered":"2024-09-19T06:05:24.699493+0000","last_unstale":"2024-09-19T06:05:46.520337+0000","last_undegraded":"2024-09-19T06:05:46.520337+0000","last_fullsized":"2024-09-19T06:05:46.520337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:34.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517699+0000","last_change":"2024-09-19T06:05:24.697821+0000","last_active":"2024-09-19T06:05:46.517699+0000","last_peered":"2024-09-19T06:05:46.517699+0000","last_clean":"2024-09-19T06:05:46.517699+0000","last_became_active":"2024-09-19T06:05:24.697495+0000","last_became_peered":"2024-09-19T06:05:24.697495+0000","last_unstale":"2024-09-19T06:05:46.517699+0000","last_undegraded":"2024-09-19T06:05:46.517699+0000","last_fullsized":"2024-09-19T06:05:46.517699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:03.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902318+0000","last_change":"2024-09-19T06:05:24.704610+0000","last_active":"2024-09-19T06:05:46.902318+0000","last_peered":"2024-09-19T06:05:46.902318+0000","last_clean":"2024-09-19T06:05:46.902318+0000","last_became_active":"2024-09-19T06:05:24.704288+0000","last_became_peered":"2024-09-19T06:05:24.704288+0000","last_unstale":"2024-09-19T06:05:46.902318+0000","last_undegraded":"2024-09-19T06:05:46.902318+0000","last_fullsized":"2024-09-19T06:05:46.902318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.530553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516407+0000","last_change":"2024-09-19T06:05:24.693662+0000","last_active":"2024-09-19T06:05:46.516407+0000","last_peered":"2024-09-19T06:05:46.516407+0000","last_clean":"2024-09-19T06:05:46.516407+0000","last_became_active":"2024-09-19T06:05:24.693327+0000","last_became_peered":"2024-09-19T06:05:24.693327+0000","last_unstale":"2024-09-19T06:05:46.516407+0000","last_undegraded":"2024-09-19T06:05:46.516407+0000","last_fullsized":"2024-09-19T06:05:46.516407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:39.646907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961884+0000","last_change":"2024-09-19T06:05:24.702552+0000","last_active":"2024-09-19T06:05:46.961884+0000","last_peered":"2024-09-19T06:05:46.961884+0000","last_clean":"2024-09-19T06:05:46.961884+0000","last_became_active":"2024-09-19T06:05:24.701090+0000","last_became_peered":"2024-09-19T06:05:24.701090+0000","last_unstale":"2024-09-19T06:05:46.961884+0000","last_undegraded":"2024-09-19T06:05:46.961884+0000","last_fullsized":"2024-09-19T06:05:46.961884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:44.361368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.524330+0000","last_change":"2024-09-19T06:05:46.524330+0000","last_active":"2024-09-19T06:05:46.524330+0000","last_peered":"2024-09-19T06:05:46.524330+0000","last_clean":"2024-09-19T06:05:46.524330+0000","last_became_active":"2024-09-19T06:05:46.523934+0000","last_became_peered":"2024-09-19T06:05:46.523934+0000","last_unstale":"2024-09-19T06:05:46.524330+0000","last_undegraded":"2024-09-19T06:05:46.524330+0000","last_fullsized":"2024-09-19T06:05:46.524330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:11:12.301698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902755+0000","last_change":"2024-09-19T06:05:24.703118+0000","last_active":"2024-09-19T06:05:46.902755+0000","last_peered":"2024-09-19T06:05:46.902755+0000","last_clean":"2024-09-19T06:05:46.902755+0000","last_became_active":"2024-09-19T06:05:24.702561+0000","last_became_peered":"2024-09-19T06:05:24.702561+0000","last_unstale":"2024-09-19T06:05:46.902755+0000","last_undegraded":"2024-09-19T06:05:46.902755+0000","last_fullsized":"2024-09-19T06:05:46.902755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:51.063256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.906049+0000","last_change":"2024-09-19T06:05:24.698704+0000","last_active":"2024-09-19T06:05:46.906049+0000","last_peered":"2024-09-19T06:05:46.906049+0000","last_clean":"2024-09-19T06:05:46.906049+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:46.906049+0000","last_undegraded":"2024-09-19T06:05:46.906049+0000","last_fullsized":"2024-09-19T06:05:46.906049+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:35.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903589+0000","last_change":"2024-09-19T06:05:24.696236+0000","last_active":"2024-09-19T06:05:46.903589+0000","last_peered":"2024-09-19T06:05:46.903589+0000","last_clean":"2024-09-19T06:05:46.903589+0000","last_became_active":"2024-09-19T06:05:24.695952+0000","last_became_peered":"2024-09-19T06:05:24.695952+0000","last_unstale":"2024-09-19T06:05:46.903589+0000","last_undegraded":"2024-09-19T06:05:46.903589+0000","last_fullsized":"2024-09-19T06:05:46.903589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:17.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519455+0000","last_change":"2024-09-19T06:05:24.699962+0000","last_active":"2024-09-19T06:05:46.519455+0000","last_peered":"2024-09-19T06:05:46.519455+0000","last_clean":"2024-09-19T06:05:46.519455+0000","last_became_active":"2024-09-19T06:05:24.699625+0000","last_became_peered":"2024-09-19T06:05:24.699625+0000","last_unstale":"2024-09-19T06:05:46.519455+0000","last_undegraded":"2024-09-19T06:05:46.519455+0000","last_fullsized":"2024-09-19T06:05:46.519455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:34.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519460+0000","last_change":"2024-09-19T06:05:24.701310+0000","last_active":"2024-09-19T06:05:46.519460+0000","last_peered":"2024-09-19T06:05:46.519460+0000","last_clean":"2024-09-19T06:05:46.519460+0000","last_became_active":"2024-09-19T06:05:24.701032+0000","last_became_peered":"2024-09-19T06:05:24.701032+0000","last_unstale":"2024-09-19T06:05:46.519460+0000","last_undegraded":"2024-09-19T06:05:46.519460+0000","last_fullsized":"2024-09-19T06:05:46.519460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:29.557533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961314+0000","last_change":"2024-09-19T06:05:24.699803+0000","last_active":"2024-09-19T06:05:46.961314+0000","last_peered":"2024-09-19T06:05:46.961314+0000","last_clean":"2024-09-19T06:05:46.961314+0000","last_became_active":"2024-09-19T06:05:24.699506+0000","last_became_peered":"2024-09-19T06:05:24.699506+0000","last_unstale":"2024-09-19T06:05:46.961314+0000","last_undegraded":"2024-09-19T06:05:46.961314+0000","last_fullsized":"2024-09-19T06:05:46.961314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:32.669231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518157+0000","last_change":"2024-09-19T06:05:24.703805+0000","last_active":"2024-09-19T06:05:46.518157+0000","last_peered":"2024-09-19T06:05:46.518157+0000","last_clean":"2024-09-19T06:05:46.518157+0000","last_became_active":"2024-09-19T06:05:24.702728+0000","last_became_peered":"2024-09-19T06:05:24.702728+0000","last_unstale":"2024-09-19T06:05:46.518157+0000","last_undegraded":"2024-09-19T06:05:46.518157+0000","last_fullsized":"2024-09-19T06:05:46.518157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:20.807530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518737+0000","last_change":"2024-09-19T06:05:24.691055+0000","last_active":"2024-09-19T06:05:46.518737+0000","last_peered":"2024-09-19T06:05:46.518737+0000","last_clean":"2024-09-19T06:05:46.518737+0000","last_became_active":"2024-09-19T06:05:24.690165+0000","last_became_peered":"2024-09-19T06:05:24.690165+0000","last_unstale":"2024-09-19T06:05:46.518737+0000","last_undegraded":"2024-09-19T06:05:46.518737+0000","last_fullsized":"2024-09-19T06:05:46.518737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:48.656335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521695+0000","last_change":"2024-09-19T06:05:24.697955+0000","last_active":"2024-09-19T06:05:46.521695+0000","last_peered":"2024-09-19T06:05:46.521695+0000","last_clean":"2024-09-19T06:05:46.521695+0000","last_became_active":"2024-09-19T06:05:24.697598+0000","last_became_peered":"2024-09-19T06:05:24.697598+0000","last_unstale":"2024-09-19T06:05:46.521695+0000","last_undegraded":"2024-09-19T06:05:46.521695+0000","last_fullsized":"2024-09-19T06:05:46.521695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.458647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517664+0000","last_change":"2024-09-19T06:05:24.705110+0000","last_active":"2024-09-19T06:05:46.517664+0000","last_peered":"2024-09-19T06:05:46.517664+0000","last_clean":"2024-09-19T06:05:46.517664+0000","last_became_active":"2024-09-19T06:05:24.704783+0000","last_became_peered":"2024-09-19T06:05:24.704783+0000","last_unstale":"2024-09-19T06:05:46.517664+0000","last_undegraded":"2024-09-19T06:05:46.517664+0000","last_fullsized":"2024-09-19T06:05:46.517664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:43.092969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903641+0000","last_change":"2024-09-19T06:05:24.693845+0000","last_active":"2024-09-19T06:05:46.903641+0000","last_peered":"2024-09-19T06:05:46.903641+0000","last_clean":"2024-09-19T06:05:46.903641+0000","last_became_active":"2024-09-19T06:05:24.693385+0000","last_became_peered":"2024-09-19T06:05:24.693385+0000","last_unstale":"2024-09-19T06:05:46.903641+0000","last_undegraded":"2024-09-19T06:05:46.903641+0000","last_fullsized":"2024-09-19T06:05:46.903641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:05.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961617+0000","last_change":"2024-09-19T06:05:24.697903+0000","last_active":"2024-09-19T06:05:46.961617+0000","last_peered":"2024-09-19T06:05:46.961617+0000","last_clean":"2024-09-19T06:05:46.961617+0000","last_became_active":"2024-09-19T06:05:24.697566+0000","last_became_peered":"2024-09-19T06:05:24.697566+0000","last_unstale":"2024-09-19T06:05:46.961617+0000","last_undegraded":"2024-09-19T06:05:46.961617+0000","last_fullsized":"2024-09-19T06:05:46.961617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:10.340401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516463+0000","last_change":"2024-09-19T06:05:24.696888+0000","last_active":"2024-09-19T06:05:46.516463+0000","last_peered":"2024-09-19T06:05:46.516463+0000","last_clean":"2024-09-19T06:05:46.516463+0000","last_became_active":"2024-09-19T06:05:24.696554+0000","last_became_peered":"2024-09-19T06:05:24.696554+0000","last_unstale":"2024-09-19T06:05:46.516463+0000","last_undegraded":"2024-09-19T06:05:46.516463+0000","last_fullsized":"2024-09-19T06:05:46.516463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520726+0000","last_change":"2024-09-19T06:05:24.692443+0000","last_active":"2024-09-19T06:05:46.520726+0000","last_peered":"2024-09-19T06:05:46.520726+0000","last_clean":"2024-09-19T06:05:46.520726+0000","last_became_active":"2024-09-19T06:05:24.690555+0000","last_became_peered":"2024-09-19T06:05:24.690555+0000","last_unstale":"2024-09-19T06:05:46.520726+0000","last_undegraded":"2024-09-19T06:05:46.520726+0000","last_fullsized":"2024-09-19T06:05:46.520726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:29.340744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516645+0000","last_change":"2024-09-19T06:05:24.699379+0000","last_active":"2024-09-19T06:05:46.516645+0000","last_peered":"2024-09-19T06:05:46.516645+0000","last_clean":"2024-09-19T06:05:46.516645+0000","last_became_active":"2024-09-19T06:05:24.699056+0000","last_became_peered":"2024-09-19T06:05:24.699056+0000","last_unstale":"2024-09-19T06:05:46.516645+0000","last_undegraded":"2024-09-19T06:05:46.516645+0000","last_fullsized":"2024-09-19T06:05:46.516645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:30.337080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521950+0000","last_change":"2024-09-19T06:05:24.698672+0000","last_active":"2024-09-19T06:05:46.521950+0000","last_peered":"2024-09-19T06:05:46.521950+0000","last_clean":"2024-09-19T06:05:46.521950+0000","last_became_active":"2024-09-19T06:05:24.698229+0000","last_became_peered":"2024-09-19T06:05:24.698229+0000","last_unstale":"2024-09-19T06:05:46.521950+0000","last_undegraded":"2024-09-19T06:05:46.521950+0000","last_fullsized":"2024-09-19T06:05:46.521950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.082538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517858+0000","last_change":"2024-09-19T06:05:24.707830+0000","last_active":"2024-09-19T06:05:46.517858+0000","last_peered":"2024-09-19T06:05:46.517858+0000","last_clean":"2024-09-19T06:05:46.517858+0000","last_became_active":"2024-09-19T06:05:24.707478+0000","last_became_peered":"2024-09-19T06:05:24.707478+0000","last_unstale":"2024-09-19T06:05:46.517858+0000","last_undegraded":"2024-09-19T06:05:46.517858+0000","last_fullsized":"2024-09-19T06:05:46.517858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:33.484877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903437+0000","last_change":"2024-09-19T06:05:24.697232+0000","last_active":"2024-09-19T06:05:46.903437+0000","last_peered":"2024-09-19T06:05:46.903437+0000","last_clean":"2024-09-19T06:05:46.903437+0000","last_became_active":"2024-09-19T06:05:24.696727+0000","last_became_peered":"2024-09-19T06:05:24.696727+0000","last_unstale":"2024-09-19T06:05:46.903437+0000","last_undegraded":"2024-09-19T06:05:46.903437+0000","last_fullsized":"2024-09-19T06:05:46.903437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:36.168493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519637+0000","last_change":"2024-09-19T06:05:24.695489+0000","last_active":"2024-09-19T06:05:46.519637+0000","last_peered":"2024-09-19T06:05:46.519637+0000","last_clean":"2024-09-19T06:05:46.519637+0000","last_became_active":"2024-09-19T06:05:24.695012+0000","last_became_peered":"2024-09-19T06:05:24.695012+0000","last_unstale":"2024-09-19T06:05:46.519637+0000","last_undegraded":"2024-09-19T06:05:46.519637+0000","last_fullsized":"2024-09-19T06:05:46.519637+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:41.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522199+0000","last_change":"2024-09-19T06:05:24.697294+0000","last_active":"2024-09-19T06:05:46.522199+0000","last_peered":"2024-09-19T06:05:46.522199+0000","last_clean":"2024-09-19T06:05:46.522199+0000","last_became_active":"2024-09-19T06:05:24.696563+0000","last_became_peered":"2024-09-19T06:05:24.696563+0000","last_unstale":"2024-09-19T06:05:46.522199+0000","last_undegraded":"2024-09-19T06:05:46.522199+0000","last_fullsized":"2024-09-19T06:05:46.522199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:41.861120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520918+0000","last_change":"2024-09-19T06:05:24.702710+0000","last_active":"2024-09-19T06:05:46.520918+0000","last_peered":"2024-09-19T06:05:46.520918+0000","last_clean":"2024-09-19T06:05:46.520918+0000","last_became_active":"2024-09-19T06:05:24.702039+0000","last_became_peered":"2024-09-19T06:05:24.702039+0000","last_unstale":"2024-09-19T06:05:46.520918+0000","last_undegraded":"2024-09-19T06:05:46.520918+0000","last_fullsized":"2024-09-19T06:05:46.520918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:23.831807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517416+0000","last_change":"2024-09-19T06:05:24.707671+0000","last_active":"2024-09-19T06:05:46.517416+0000","last_peered":"2024-09-19T06:05:46.517416+0000","last_clean":"2024-09-19T06:05:46.517416+0000","last_became_active":"2024-09-19T06:05:24.707325+0000","last_became_peered":"2024-09-19T06:05:24.707325+0000","last_unstale":"2024-09-19T06:05:46.517416+0000","last_undegraded":"2024-09-19T06:05:46.517416+0000","last_fullsized":"2024-09-19T06:05:46.517416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:32.149103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520934+0000","last_change":"2024-09-19T06:05:24.704875+0000","last_active":"2024-09-19T06:05:46.520934+0000","last_peered":"2024-09-19T06:05:46.520934+0000","last_clean":"2024-09-19T06:05:46.520934+0000","last_became_active":"2024-09-19T06:05:24.704501+0000","last_became_peered":"2024-09-19T06:05:24.704501+0000","last_unstale":"2024-09-19T06:05:46.520934+0000","last_undegraded":"2024-09-19T06:05:46.520934+0000","last_fullsized":"2024-09-19T06:05:46.520934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:53.913314+0000","last_change":"2024-09-19T06:05:22.687857+0000","last_active":"2024-09-19T06:05:53.913314+0000","last_peered":"2024-09-19T06:05:53.913314+0000","last_clean":"2024-09-19T06:05:53.913314+0000","last_became_active":"2024-09-19T06:05:22.687573+0000","last_became_peered":"2024-09-19T06:05:22.687573+0000","last_unstale":"2024-09-19T06:05:53.913314+0000","last_undegraded":"2024-09-19T06:05:53.913314+0000","last_fullsized":"2024-09-19T06:05:53.913314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:31.972444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.904521+0000","last_change":"2024-09-19T06:05:46.904521+0000","last_active":"2024-09-19T06:05:46.904521+0000","last_peered":"2024-09-19T06:05:46.904521+0000","last_clean":"2024-09-19T06:05:46.904521+0000","last_became_active":"2024-09-19T06:05:46.904146+0000","last_became_peered":"2024-09-19T06:05:46.904146+0000","last_unstale":"2024-09-19T06:05:46.904521+0000","last_undegraded":"2024-09-19T06:05:46.904521+0000","last_fullsized":"2024-09-19T06:05:46.904521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:48.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517810+0000","last_change":"2024-09-19T06:05:22.680500+0000","last_active":"2024-09-19T06:05:46.517810+0000","last_peered":"2024-09-19T06:05:46.517810+0000","last_clean":"2024-09-19T06:05:46.517810+0000","last_became_active":"2024-09-19T06:05:22.679947+0000","last_became_peered":"2024-09-19T06:05:22.679947+0000","last_unstale":"2024-09-19T06:05:46.517810+0000","last_undegraded":"2024-09-19T06:05:46.517810+0000","last_fullsized":"2024-09-19T06:05:46.517810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:34.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902704+0000","last_change":"2024-09-19T06:05:22.680962+0000","last_active":"2024-09-19T06:05:46.902704+0000","last_peered":"2024-09-19T06:05:46.902704+0000","last_clean":"2024-09-19T06:05:46.902704+0000","last_became_active":"2024-09-19T06:05:22.680662+0000","last_became_peered":"2024-09-19T06:05:22.680662+0000","last_unstale":"2024-09-19T06:05:46.902704+0000","last_undegraded":"2024-09-19T06:05:46.902704+0000","last_fullsized":"2024-09-19T06:05:46.902704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.296422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516416+0000","last_change":"2024-09-19T06:05:24.695214+0000","last_active":"2024-09-19T06:05:46.516416+0000","last_peered":"2024-09-19T06:05:46.516416+0000","last_clean":"2024-09-19T06:05:46.516416+0000","last_became_active":"2024-09-19T06:05:24.694930+0000","last_became_peered":"2024-09-19T06:05:24.694930+0000","last_unstale":"2024-09-19T06:05:46.516416+0000","last_undegraded":"2024-09-19T06:05:46.516416+0000","last_fullsized":"2024-09-19T06:05:46.516416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:51.382934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520982+0000","last_change":"2024-09-19T06:05:22.684504+0000","last_active":"2024-09-19T06:05:46.520982+0000","last_peered":"2024-09-19T06:05:46.520982+0000","last_clean":"2024-09-19T06:05:46.520982+0000","last_became_active":"2024-09-19T06:05:22.684169+0000","last_became_peered":"2024-09-19T06:05:22.684169+0000","last_unstale":"2024-09-19T06:05:46.520982+0000","last_undegraded":"2024-09-19T06:05:46.520982+0000","last_fullsized":"2024-09-19T06:05:46.520982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:29.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518059+0000","last_change":"2024-09-19T06:05:24.693056+0000","last_active":"2024-09-19T06:05:46.518059+0000","last_peered":"2024-09-19T06:05:46.518059+0000","last_clean":"2024-09-19T06:05:46.518059+0000","last_became_active":"2024-09-19T06:05:24.692544+0000","last_became_peered":"2024-09-19T06:05:24.692544+0000","last_unstale":"2024-09-19T06:05:46.518059+0000","last_undegraded":"2024-09-19T06:05:46.518059+0000","last_fullsized":"2024-09-19T06:05:46.518059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:45.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":46,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:53.912711+0000","last_change":"2024-09-19T06:05:22.682854+0000","last_active":"2024-09-19T06:05:53.912711+0000","last_peered":"2024-09-19T06:05:53.912711+0000","last_clean":"2024-09-19T06:05:53.912711+0000","last_became_active":"2024-09-19T06:05:22.682406+0000","last_became_peered":"2024-09-19T06:05:22.682406+0000","last_unstale":"2024-09-19T06:05:53.912711+0000","last_undegraded":"2024-09-19T06:05:53.912711+0000","last_fullsized":"2024-09-19T06:05:53.912711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.206144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961915+0000","last_change":"2024-09-19T06:05:24.699408+0000","last_active":"2024-09-19T06:05:46.961915+0000","last_peered":"2024-09-19T06:05:46.961915+0000","last_clean":"2024-09-19T06:05:46.961915+0000","last_became_active":"2024-09-19T06:05:24.699106+0000","last_became_peered":"2024-09-19T06:05:24.699106+0000","last_unstale":"2024-09-19T06:05:46.961915+0000","last_undegraded":"2024-09-19T06:05:46.961915+0000","last_fullsized":"2024-09-19T06:05:46.961915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:37.487458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902210+0000","last_change":"2024-09-19T06:05:22.686106+0000","last_active":"2024-09-19T06:05:46.902210+0000","last_peered":"2024-09-19T06:05:46.902210+0000","last_clean":"2024-09-19T06:05:46.902210+0000","last_became_active":"2024-09-19T06:05:22.685763+0000","last_became_peered":"2024-09-19T06:05:22.685763+0000","last_unstale":"2024-09-19T06:05:46.902210+0000","last_undegraded":"2024-09-19T06:05:46.902210+0000","last_fullsized":"2024-09-19T06:05:46.902210+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:57.889128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.524038+0000","last_change":"2024-09-19T06:05:46.524038+0000","last_active":"2024-09-19T06:05:46.524038+0000","last_peered":"2024-09-19T06:05:46.524038+0000","last_clean":"2024-09-19T06:05:46.524038+0000","last_became_active":"2024-09-19T06:05:46.523746+0000","last_became_peered":"2024-09-19T06:05:46.523746+0000","last_unstale":"2024-09-19T06:05:46.524038+0000","last_undegraded":"2024-09-19T06:05:46.524038+0000","last_fullsized":"2024-09-19T06:05:46.524038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:17.361840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519825+0000","last_change":"2024-09-19T06:05:23.060545+0000","last_active":"2024-09-19T06:05:46.519825+0000","last_peered":"2024-09-19T06:05:46.519825+0000","last_clean":"2024-09-19T06:05:46.519825+0000","last_became_active":"2024-09-19T06:05:23.060187+0000","last_became_peered":"2024-09-19T06:05:23.060187+0000","last_unstale":"2024-09-19T06:05:46.519825+0000","last_undegraded":"2024-09-19T06:05:46.519825+0000","last_fullsized":"2024-09-19T06:05:46.519825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.604284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961566+0000","last_change":"2024-09-19T06:05:24.702535+0000","last_active":"2024-09-19T06:05:46.961566+0000","last_peered":"2024-09-19T06:05:46.961566+0000","last_clean":"2024-09-19T06:05:46.961566+0000","last_became_active":"2024-09-19T06:05:24.701616+0000","last_became_peered":"2024-09-19T06:05:24.701616+0000","last_unstale":"2024-09-19T06:05:46.961566+0000","last_undegraded":"2024-09-19T06:05:46.961566+0000","last_fullsized":"2024-09-19T06:05:46.961566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:43.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":99,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:55.309604+0000","last_change":"2024-09-19T06:05:22.685460+0000","last_active":"2024-09-19T06:05:55.309604+0000","last_peered":"2024-09-19T06:05:55.309604+0000","last_clean":"2024-09-19T06:05:55.309604+0000","last_became_active":"2024-09-19T06:05:22.685086+0000","last_became_peered":"2024-09-19T06:05:22.685086+0000","last_unstale":"2024-09-19T06:05:55.309604+0000","last_undegraded":"2024-09-19T06:05:55.309604+0000","last_fullsized":"2024-09-19T06:05:55.309604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:10.373783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":77,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520872+0000","last_change":"2024-09-19T06:05:24.700431+0000","last_active":"2024-09-19T06:05:46.520872+0000","last_peered":"2024-09-19T06:05:46.520872+0000","last_clean":"2024-09-19T06:05:46.520872+0000","last_became_active":"2024-09-19T06:05:24.700092+0000","last_became_peered":"2024-09-19T06:05:24.700092+0000","last_unstale":"2024-09-19T06:05:46.520872+0000","last_undegraded":"2024-09-19T06:05:46.520872+0000","last_fullsized":"2024-09-19T06:05:46.520872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:17.208392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.530433+0000","last_change":"2024-09-19T06:05:46.530433+0000","last_active":"2024-09-19T06:05:46.530433+0000","last_peered":"2024-09-19T06:05:46.530433+0000","last_clean":"2024-09-19T06:05:46.530433+0000","last_became_active":"2024-09-19T06:05:46.521700+0000","last_became_peered":"2024-09-19T06:05:46.521700+0000","last_unstale":"2024-09-19T06:05:46.530433+0000","last_undegraded":"2024-09-19T06:05:46.530433+0000","last_fullsized":"2024-09-19T06:05:46.530433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:40.489547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903307+0000","last_change":"2024-09-19T06:05:24.699149+0000","last_active":"2024-09-19T06:05:46.903307+0000","last_peered":"2024-09-19T06:05:46.903307+0000","last_clean":"2024-09-19T06:05:46.903307+0000","last_became_active":"2024-09-19T06:05:24.698846+0000","last_became_peered":"2024-09-19T06:05:24.698846+0000","last_unstale":"2024-09-19T06:05:46.903307+0000","last_undegraded":"2024-09-19T06:05:46.903307+0000","last_fullsized":"2024-09-19T06:05:46.903307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:19.416169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519763+0000","last_change":"2024-09-19T06:05:22.682157+0000","last_active":"2024-09-19T06:05:46.519763+0000","last_peered":"2024-09-19T06:05:46.519763+0000","last_clean":"2024-09-19T06:05:46.519763+0000","last_became_active":"2024-09-19T06:05:22.681816+0000","last_became_peered":"2024-09-19T06:05:22.681816+0000","last_unstale":"2024-09-19T06:05:46.519763+0000","last_undegraded":"2024-09-19T06:05:46.519763+0000","last_fullsized":"2024-09-19T06:05:46.519763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:05.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902542+0000","last_change":"2024-09-19T06:05:24.699233+0000","last_active":"2024-09-19T06:05:46.902542+0000","last_peered":"2024-09-19T06:05:46.902542+0000","last_clean":"2024-09-19T06:05:46.902542+0000","last_became_active":"2024-09-19T06:05:24.698918+0000","last_became_peered":"2024-09-19T06:05:24.698918+0000","last_unstale":"2024-09-19T06:05:46.902542+0000","last_undegraded":"2024-09-19T06:05:46.902542+0000","last_fullsized":"2024-09-19T06:05:46.902542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:54.917136+0000","last_change":"2024-09-19T06:05:22.682161+0000","last_active":"2024-09-19T06:05:54.917136+0000","last_peered":"2024-09-19T06:05:54.917136+0000","last_clean":"2024-09-19T06:05:54.917136+0000","last_became_active":"2024-09-19T06:05:22.681805+0000","last_became_peered":"2024-09-19T06:05:22.681805+0000","last_unstale":"2024-09-19T06:05:54.917136+0000","last_undegraded":"2024-09-19T06:05:54.917136+0000","last_fullsized":"2024-09-19T06:05:54.917136+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:27.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902474+0000","last_change":"2024-09-19T06:05:24.703668+0000","last_active":"2024-09-19T06:05:46.902474+0000","last_peered":"2024-09-19T06:05:46.902474+0000","last_clean":"2024-09-19T06:05:46.902474+0000","last_became_active":"2024-09-19T06:05:24.703342+0000","last_became_peered":"2024-09-19T06:05:24.703342+0000","last_unstale":"2024-09-19T06:05:46.902474+0000","last_undegraded":"2024-09-19T06:05:46.902474+0000","last_fullsized":"2024-09-19T06:05:46.902474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:30.399187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520049+0000","last_change":"2024-09-19T06:05:23.060458+0000","last_active":"2024-09-19T06:05:46.520049+0000","last_peered":"2024-09-19T06:05:46.520049+0000","last_clean":"2024-09-19T06:05:46.520049+0000","last_became_active":"2024-09-19T06:05:23.060098+0000","last_became_peered":"2024-09-19T06:05:23.060098+0000","last_unstale":"2024-09-19T06:05:46.520049+0000","last_undegraded":"2024-09-19T06:05:46.520049+0000","last_fullsized":"2024-09-19T06:05:46.520049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:58.800162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519964+0000","last_change":"2024-09-19T06:05:24.699832+0000","last_active":"2024-09-19T06:05:46.519964+0000","last_peered":"2024-09-19T06:05:46.519964+0000","last_clean":"2024-09-19T06:05:46.519964+0000","last_became_active":"2024-09-19T06:05:24.697600+0000","last_became_peered":"2024-09-19T06:05:24.697600+0000","last_unstale":"2024-09-19T06:05:46.519964+0000","last_undegraded":"2024-09-19T06:05:46.519964+0000","last_fullsized":"2024-09-19T06:05:46.519964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:15.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521202+0000","last_change":"2024-09-19T06:05:22.682962+0000","last_active":"2024-09-19T06:05:46.521202+0000","last_peered":"2024-09-19T06:05:46.521202+0000","last_clean":"2024-09-19T06:05:46.521202+0000","last_became_active":"2024-09-19T06:05:22.682573+0000","last_became_peered":"2024-09-19T06:05:22.682573+0000","last_unstale":"2024-09-19T06:05:46.521202+0000","last_undegraded":"2024-09-19T06:05:46.521202+0000","last_fullsized":"2024-09-19T06:05:46.521202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:31.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.907103+0000","last_change":"2024-09-19T06:05:46.907103+0000","last_active":"2024-09-19T06:05:46.907103+0000","last_peered":"2024-09-19T06:05:46.907103+0000","last_clean":"2024-09-19T06:05:46.907103+0000","last_became_active":"2024-09-19T06:05:46.906741+0000","last_became_peered":"2024-09-19T06:05:46.906741+0000","last_unstale":"2024-09-19T06:05:46.907103+0000","last_undegraded":"2024-09-19T06:05:46.907103+0000","last_fullsized":"2024-09-19T06:05:46.907103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:42.275594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902723+0000","last_change":"2024-09-19T06:05:22.684007+0000","last_active":"2024-09-19T06:05:46.902723+0000","last_peered":"2024-09-19T06:05:46.902723+0000","last_clean":"2024-09-19T06:05:46.902723+0000","last_became_active":"2024-09-19T06:05:22.683606+0000","last_became_peered":"2024-09-19T06:05:22.683606+0000","last_unstale":"2024-09-19T06:05:46.902723+0000","last_undegraded":"2024-09-19T06:05:46.902723+0000","last_fullsized":"2024-09-19T06:05:46.902723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:29.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902839+0000","last_change":"2024-09-19T06:05:24.698057+0000","last_active":"2024-09-19T06:05:46.902839+0000","last_peered":"2024-09-19T06:05:46.902839+0000","last_clean":"2024-09-19T06:05:46.902839+0000","last_became_active":"2024-09-19T06:05:24.697604+0000","last_became_peered":"2024-09-19T06:05:24.697604+0000","last_unstale":"2024-09-19T06:05:46.902839+0000","last_undegraded":"2024-09-19T06:05:46.902839+0000","last_fullsized":"2024-09-19T06:05:46.902839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:33.246096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520103+0000","last_change":"2024-09-19T06:05:22.680641+0000","last_active":"2024-09-19T06:05:46.520103+0000","last_peered":"2024-09-19T06:05:46.520103+0000","last_clean":"2024-09-19T06:05:46.520103+0000","last_became_active":"2024-09-19T06:05:22.680282+0000","last_became_peered":"2024-09-19T06:05:22.680282+0000","last_unstale":"2024-09-19T06:05:46.520103+0000","last_undegraded":"2024-09-19T06:05:46.520103+0000","last_fullsized":"2024-09-19T06:05:46.520103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:07.171581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902552+0000","last_change":"2024-09-19T06:05:24.705525+0000","last_active":"2024-09-19T06:05:46.902552+0000","last_peered":"2024-09-19T06:05:46.902552+0000","last_clean":"2024-09-19T06:05:46.902552+0000","last_became_active":"2024-09-19T06:05:24.705226+0000","last_became_peered":"2024-09-19T06:05:24.705226+0000","last_unstale":"2024-09-19T06:05:46.902552+0000","last_undegraded":"2024-09-19T06:05:46.902552+0000","last_fullsized":"2024-09-19T06:05:46.902552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:51.020525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522657+0000","last_change":"2024-09-19T06:05:23.060628+0000","last_active":"2024-09-19T06:05:46.522657+0000","last_peered":"2024-09-19T06:05:46.522657+0000","last_clean":"2024-09-19T06:05:46.522657+0000","last_became_active":"2024-09-19T06:05:23.060066+0000","last_became_peered":"2024-09-19T06:05:23.060066+0000","last_unstale":"2024-09-19T06:05:46.522657+0000","last_undegraded":"2024-09-19T06:05:46.522657+0000","last_fullsized":"2024-09-19T06:05:46.522657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:55.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902770+0000","last_change":"2024-09-19T06:05:24.701994+0000","last_active":"2024-09-19T06:05:46.902770+0000","last_peered":"2024-09-19T06:05:46.902770+0000","last_clean":"2024-09-19T06:05:46.902770+0000","last_became_active":"2024-09-19T06:05:24.701648+0000","last_became_peered":"2024-09-19T06:05:24.701648+0000","last_unstale":"2024-09-19T06:05:46.902770+0000","last_undegraded":"2024-09-19T06:05:46.902770+0000","last_fullsized":"2024-09-19T06:05:46.902770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:16.475339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902639+0000","last_change":"2024-09-19T06:04:14.186274+0000","last_active":"2024-09-19T06:05:46.902639+0000","last_peered":"2024-09-19T06:05:46.902639+0000","last_clean":"2024-09-19T06:05:46.902639+0000","last_became_active":"2024-09-19T06:04:14.185907+0000","last_became_peered":"2024-09-19T06:04:14.185907+0000","last_unstale":"2024-09-19T06:05:46.902639+0000","last_undegraded":"2024-09-19T06:05:46.902639+0000","last_fullsized":"2024-09-19T06:05:46.902639+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_clean_scrub_stamp":"2024-09-19T06:00:59.680614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:01.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905464+0000","last_change":"2024-09-19T06:05:22.682242+0000","last_active":"2024-09-19T06:05:46.905464+0000","last_peered":"2024-09-19T06:05:46.905464+0000","last_clean":"2024-09-19T06:05:46.905464+0000","last_became_active":"2024-09-19T06:05:22.681896+0000","last_became_peered":"2024-09-19T06:05:22.681896+0000","last_unstale":"2024-09-19T06:05:46.905464+0000","last_undegraded":"2024-09-19T06:05:46.905464+0000","last_fullsized":"2024-09-19T06:05:46.905464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.119422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.962902+0000","last_change":"2024-09-19T06:05:46.962541+0000","last_active":"2024-09-19T06:05:46.962902+0000","last_peered":"2024-09-19T06:05:46.962902+0000","last_clean":"2024-09-19T06:05:46.962902+0000","last_became_active":"2024-09-19T06:05:46.962261+0000","last_became_peered":"2024-09-19T06:05:46.962261+0000","last_unstale":"2024-09-19T06:05:46.962902+0000","last_undegraded":"2024-09-19T06:05:46.962902+0000","last_fullsized":"2024-09-19T06:05:46.962902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:36.355129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902052+0000","last_change":"2024-09-19T06:05:22.685809+0000","last_active":"2024-09-19T06:05:46.902052+0000","last_peered":"2024-09-19T06:05:46.902052+0000","last_clean":"2024-09-19T06:05:46.902052+0000","last_became_active":"2024-09-19T06:05:22.685466+0000","last_became_peered":"2024-09-19T06:05:22.685466+0000","last_unstale":"2024-09-19T06:05:46.902052+0000","last_undegraded":"2024-09-19T06:05:46.902052+0000","last_fullsized":"2024-09-19T06:05:46.902052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:43.793845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903209+0000","last_change":"2024-09-19T06:05:24.701105+0000","last_active":"2024-09-19T06:05:46.903209+0000","last_peered":"2024-09-19T06:05:46.903209+0000","last_clean":"2024-09-19T06:05:46.903209+0000","last_became_active":"2024-09-19T06:05:24.700825+0000","last_became_peered":"2024-09-19T06:05:24.700825+0000","last_unstale":"2024-09-19T06:05:46.903209+0000","last_undegraded":"2024-09-19T06:05:46.903209+0000","last_fullsized":"2024-09-19T06:05:46.903209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:35.707437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":46,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:52.914039+0000","last_change":"2024-09-19T06:05:23.059587+0000","last_active":"2024-09-19T06:05:52.914039+0000","last_peered":"2024-09-19T06:05:52.914039+0000","last_clean":"2024-09-19T06:05:52.914039+0000","last_became_active":"2024-09-19T06:05:23.059248+0000","last_became_peered":"2024-09-19T06:05:23.059248+0000","last_unstale":"2024-09-19T06:05:52.914039+0000","last_undegraded":"2024-09-19T06:05:52.914039+0000","last_fullsized":"2024-09-19T06:05:52.914039+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:25.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520818+0000","last_change":"2024-09-19T06:05:24.701610+0000","last_active":"2024-09-19T06:05:46.520818+0000","last_peered":"2024-09-19T06:05:46.520818+0000","last_clean":"2024-09-19T06:05:46.520818+0000","last_became_active":"2024-09-19T06:05:24.697296+0000","last_became_peered":"2024-09-19T06:05:24.697296+0000","last_unstale":"2024-09-19T06:05:46.520818+0000","last_undegraded":"2024-09-19T06:05:46.520818+0000","last_fullsized":"2024-09-19T06:05:46.520818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:52.256284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902512+0000","last_change":"2024-09-19T06:05:22.684818+0000","last_active":"2024-09-19T06:05:46.902512+0000","last_peered":"2024-09-19T06:05:46.902512+0000","last_clean":"2024-09-19T06:05:46.902512+0000","last_became_active":"2024-09-19T06:05:22.684211+0000","last_became_peered":"2024-09-19T06:05:22.684211+0000","last_unstale":"2024-09-19T06:05:46.902512+0000","last_undegraded":"2024-09-19T06:05:46.902512+0000","last_fullsized":"2024-09-19T06:05:46.902512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:50.711805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517975+0000","last_change":"2024-09-19T06:05:24.702992+0000","last_active":"2024-09-19T06:05:46.517975+0000","last_peered":"2024-09-19T06:05:46.517975+0000","last_clean":"2024-09-19T06:05:46.517975+0000","last_became_active":"2024-09-19T06:05:24.702643+0000","last_became_peered":"2024-09-19T06:05:24.702643+0000","last_unstale":"2024-09-19T06:05:46.517975+0000","last_undegraded":"2024-09-19T06:05:46.517975+0000","last_fullsized":"2024-09-19T06:05:46.517975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:40.651861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518397+0000","last_change":"2024-09-19T06:05:23.060444+0000","last_active":"2024-09-19T06:05:46.518397+0000","last_peered":"2024-09-19T06:05:46.518397+0000","last_clean":"2024-09-19T06:05:46.518397+0000","last_became_active":"2024-09-19T06:05:23.059879+0000","last_became_peered":"2024-09-19T06:05:23.059879+0000","last_unstale":"2024-09-19T06:05:46.518397+0000","last_undegraded":"2024-09-19T06:05:46.518397+0000","last_fullsized":"2024-09-19T06:05:46.518397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:39.013096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517898+0000","last_change":"2024-09-19T06:05:24.694892+0000","last_active":"2024-09-19T06:05:46.517898+0000","last_peered":"2024-09-19T06:05:46.517898+0000","last_clean":"2024-09-19T06:05:46.517898+0000","last_became_active":"2024-09-19T06:05:24.694534+0000","last_became_peered":"2024-09-19T06:05:24.694534+0000","last_unstale":"2024-09-19T06:05:46.517898+0000","last_undegraded":"2024-09-19T06:05:46.517898+0000","last_fullsized":"2024-09-19T06:05:46.517898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:50.633035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521062+0000","last_change":"2024-09-19T06:05:23.060597+0000","last_active":"2024-09-19T06:05:46.521062+0000","last_peered":"2024-09-19T06:05:46.521062+0000","last_clean":"2024-09-19T06:05:46.521062+0000","last_became_active":"2024-09-19T06:05:23.060235+0000","last_became_peered":"2024-09-19T06:05:23.060235+0000","last_unstale":"2024-09-19T06:05:46.521062+0000","last_undegraded":"2024-09-19T06:05:46.521062+0000","last_fullsized":"2024-09-19T06:05:46.521062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:54.517780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903431+0000","last_change":"2024-09-19T06:05:24.698131+0000","last_active":"2024-09-19T06:05:46.903431+0000","last_peered":"2024-09-19T06:05:46.903431+0000","last_clean":"2024-09-19T06:05:46.903431+0000","last_became_active":"2024-09-19T06:05:24.697784+0000","last_became_peered":"2024-09-19T06:05:24.697784+0000","last_unstale":"2024-09-19T06:05:46.903431+0000","last_undegraded":"2024-09-19T06:05:46.903431+0000","last_fullsized":"2024-09-19T06:05:46.903431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:49.563908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:48.700895+0000","last_change":"2024-09-19T06:05:22.679532+0000","last_active":"2024-09-19T06:05:48.700895+0000","last_peered":"2024-09-19T06:05:48.700895+0000","last_clean":"2024-09-19T06:05:48.700895+0000","last_became_active":"2024-09-19T06:05:22.679156+0000","last_became_peered":"2024-09-19T06:05:22.679156+0000","last_unstale":"2024-09-19T06:05:48.700895+0000","last_undegraded":"2024-09-19T06:05:48.700895+0000","last_fullsized":"2024-09-19T06:05:48.700895+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:31.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516744+0000","last_change":"2024-09-19T06:05:24.698383+0000","last_active":"2024-09-19T06:05:46.516744+0000","last_peered":"2024-09-19T06:05:46.516744+0000","last_clean":"2024-09-19T06:05:46.516744+0000","last_became_active":"2024-09-19T06:05:24.698044+0000","last_became_peered":"2024-09-19T06:05:24.698044+0000","last_unstale":"2024-09-19T06:05:46.516744+0000","last_undegraded":"2024-09-19T06:05:46.516744+0000","last_fullsized":"2024-09-19T06:05:46.516744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:53.388847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905533+0000","last_change":"2024-09-19T06:05:22.684799+0000","last_active":"2024-09-19T06:05:46.905533+0000","last_peered":"2024-09-19T06:05:46.905533+0000","last_clean":"2024-09-19T06:05:46.905533+0000","last_became_active":"2024-09-19T06:05:22.684376+0000","last_became_peered":"2024-09-19T06:05:22.684376+0000","last_unstale":"2024-09-19T06:05:46.905533+0000","last_undegraded":"2024-09-19T06:05:46.905533+0000","last_fullsized":"2024-09-19T06:05:46.905533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.124960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519736+0000","last_change":"2024-09-19T06:05:24.693751+0000","last_active":"2024-09-19T06:05:46.519736+0000","last_peered":"2024-09-19T06:05:46.519736+0000","last_clean":"2024-09-19T06:05:46.519736+0000","last_became_active":"2024-09-19T06:05:24.693442+0000","last_became_peered":"2024-09-19T06:05:24.693442+0000","last_unstale":"2024-09-19T06:05:46.519736+0000","last_undegraded":"2024-09-19T06:05:46.519736+0000","last_fullsized":"2024-09-19T06:05:46.519736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:46.491860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961568+0000","last_change":"2024-09-19T06:05:23.060522+0000","last_active":"2024-09-19T06:05:46.961568+0000","last_peered":"2024-09-19T06:05:46.961568+0000","last_clean":"2024-09-19T06:05:46.961568+0000","last_became_active":"2024-09-19T06:05:23.060170+0000","last_became_peered":"2024-09-19T06:05:23.060170+0000","last_unstale":"2024-09-19T06:05:46.961568+0000","last_undegraded":"2024-09-19T06:05:46.961568+0000","last_fullsized":"2024-09-19T06:05:46.961568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:54.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520186+0000","last_change":"2024-09-19T06:05:24.701242+0000","last_active":"2024-09-19T06:05:46.520186+0000","last_peered":"2024-09-19T06:05:46.520186+0000","last_clean":"2024-09-19T06:05:46.520186+0000","last_became_active":"2024-09-19T06:05:24.700813+0000","last_became_peered":"2024-09-19T06:05:24.700813+0000","last_unstale":"2024-09-19T06:05:46.520186+0000","last_undegraded":"2024-09-19T06:05:46.520186+0000","last_fullsized":"2024-09-19T06:05:46.520186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:42.706448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516577+0000","last_change":"2024-09-19T06:05:22.677502+0000","last_active":"2024-09-19T06:05:46.516577+0000","last_peered":"2024-09-19T06:05:46.516577+0000","last_clean":"2024-09-19T06:05:46.516577+0000","last_became_active":"2024-09-19T06:05:22.677082+0000","last_became_peered":"2024-09-19T06:05:22.677082+0000","last_unstale":"2024-09-19T06:05:46.516577+0000","last_undegraded":"2024-09-19T06:05:46.516577+0000","last_fullsized":"2024-09-19T06:05:46.516577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:30.991778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517459+0000","last_change":"2024-09-19T06:05:24.703155+0000","last_active":"2024-09-19T06:05:46.517459+0000","last_peered":"2024-09-19T06:05:46.517459+0000","last_clean":"2024-09-19T06:05:46.517459+0000","last_became_active":"2024-09-19T06:05:24.702570+0000","last_became_peered":"2024-09-19T06:05:24.702570+0000","last_unstale":"2024-09-19T06:05:46.517459+0000","last_undegraded":"2024-09-19T06:05:46.517459+0000","last_fullsized":"2024-09-19T06:05:46.517459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:36.016886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.532666+0000","last_change":"2024-09-19T06:05:46.532666+0000","last_active":"2024-09-19T06:05:46.532666+0000","last_peered":"2024-09-19T06:05:46.532666+0000","last_clean":"2024-09-19T06:05:46.532666+0000","last_became_active":"2024-09-19T06:05:46.523271+0000","last_became_peered":"2024-09-19T06:05:46.523271+0000","last_unstale":"2024-09-19T06:05:46.532666+0000","last_undegraded":"2024-09-19T06:05:46.532666+0000","last_fullsized":"2024-09-19T06:05:46.532666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:04.627727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516710+0000","last_change":"2024-09-19T06:05:24.694476+0000","last_active":"2024-09-19T06:05:46.516710+0000","last_peered":"2024-09-19T06:05:46.516710+0000","last_clean":"2024-09-19T06:05:46.516710+0000","last_became_active":"2024-09-19T06:05:24.694147+0000","last_became_peered":"2024-09-19T06:05:24.694147+0000","last_unstale":"2024-09-19T06:05:46.516710+0000","last_undegraded":"2024-09-19T06:05:46.516710+0000","last_fullsized":"2024-09-19T06:05:46.516710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:48.830522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520434+0000","last_change":"2024-09-19T06:05:22.687422+0000","last_active":"2024-09-19T06:05:46.520434+0000","last_peered":"2024-09-19T06:05:46.520434+0000","last_clean":"2024-09-19T06:05:46.520434+0000","last_became_active":"2024-09-19T06:05:22.686950+0000","last_became_peered":"2024-09-19T06:05:22.686950+0000","last_unstale":"2024-09-19T06:05:46.520434+0000","last_undegraded":"2024-09-19T06:05:46.520434+0000","last_fullsized":"2024-09-19T06:05:46.520434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:49.279769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902432+0000","last_change":"2024-09-19T06:05:24.695701+0000","last_active":"2024-09-19T06:05:46.902432+0000","last_peered":"2024-09-19T06:05:46.902432+0000","last_clean":"2024-09-19T06:05:46.902432+0000","last_became_active":"2024-09-19T06:05:24.695341+0000","last_became_peered":"2024-09-19T06:05:24.695341+0000","last_unstale":"2024-09-19T06:05:46.902432+0000","last_undegraded":"2024-09-19T06:05:46.902432+0000","last_fullsized":"2024-09-19T06:05:46.902432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:52.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519721+0000","last_change":"2024-09-19T06:05:24.703456+0000","last_active":"2024-09-19T06:05:46.519721+0000","last_peered":"2024-09-19T06:05:46.519721+0000","last_clean":"2024-09-19T06:05:46.519721+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:46.519721+0000","last_undegraded":"2024-09-19T06:05:46.519721+0000","last_fullsized":"2024-09-19T06:05:46.519721+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:15.159843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520802+0000","last_change":"2024-09-19T06:05:22.683833+0000","last_active":"2024-09-19T06:05:46.520802+0000","last_peered":"2024-09-19T06:05:46.520802+0000","last_clean":"2024-09-19T06:05:46.520802+0000","last_became_active":"2024-09-19T06:05:22.683439+0000","last_became_peered":"2024-09-19T06:05:22.683439+0000","last_unstale":"2024-09-19T06:05:46.520802+0000","last_undegraded":"2024-09-19T06:05:46.520802+0000","last_fullsized":"2024-09-19T06:05:46.520802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:52.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961492+0000","last_change":"2024-09-19T06:05:24.695905+0000","last_active":"2024-09-19T06:05:46.961492+0000","last_peered":"2024-09-19T06:05:46.961492+0000","last_clean":"2024-09-19T06:05:46.961492+0000","last_became_active":"2024-09-19T06:05:24.695570+0000","last_became_peered":"2024-09-19T06:05:24.695570+0000","last_unstale":"2024-09-19T06:05:46.961492+0000","last_undegraded":"2024-09-19T06:05:46.961492+0000","last_fullsized":"2024-09-19T06:05:46.961492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:00.167126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520961+0000","last_change":"2024-09-19T06:05:22.686853+0000","last_active":"2024-09-19T06:05:46.520961+0000","last_peered":"2024-09-19T06:05:46.520961+0000","last_clean":"2024-09-19T06:05:46.520961+0000","last_became_active":"2024-09-19T06:05:22.686143+0000","last_became_peered":"2024-09-19T06:05:22.686143+0000","last_unstale":"2024-09-19T06:05:46.520961+0000","last_undegraded":"2024-09-19T06:05:46.520961+0000","last_fullsized":"2024-09-19T06:05:46.520961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:30.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519841+0000","last_change":"2024-09-19T06:05:24.702420+0000","last_active":"2024-09-19T06:05:46.519841+0000","last_peered":"2024-09-19T06:05:46.519841+0000","last_clean":"2024-09-19T06:05:46.519841+0000","last_became_active":"2024-09-19T06:05:24.702140+0000","last_became_peered":"2024-09-19T06:05:24.702140+0000","last_unstale":"2024-09-19T06:05:46.519841+0000","last_undegraded":"2024-09-19T06:05:46.519841+0000","last_fullsized":"2024-09-19T06:05:46.519841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:27.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517042+0000","last_change":"2024-09-19T06:05:23.059638+0000","last_active":"2024-09-19T06:05:46.517042+0000","last_peered":"2024-09-19T06:05:46.517042+0000","last_clean":"2024-09-19T06:05:46.517042+0000","last_became_active":"2024-09-19T06:05:23.059273+0000","last_became_peered":"2024-09-19T06:05:23.059273+0000","last_unstale":"2024-09-19T06:05:46.517042+0000","last_undegraded":"2024-09-19T06:05:46.517042+0000","last_fullsized":"2024-09-19T06:05:46.517042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:56.981598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516857+0000","last_change":"2024-09-19T06:05:24.703608+0000","last_active":"2024-09-19T06:05:46.516857+0000","last_peered":"2024-09-19T06:05:46.516857+0000","last_clean":"2024-09-19T06:05:46.516857+0000","last_became_active":"2024-09-19T06:05:24.703300+0000","last_became_peered":"2024-09-19T06:05:24.703300+0000","last_unstale":"2024-09-19T06:05:46.516857+0000","last_undegraded":"2024-09-19T06:05:46.516857+0000","last_fullsized":"2024-09-19T06:05:46.516857+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.063545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518702+0000","last_change":"2024-09-19T06:05:22.679379+0000","last_active":"2024-09-19T06:05:46.518702+0000","last_peered":"2024-09-19T06:05:46.518702+0000","last_clean":"2024-09-19T06:05:46.518702+0000","last_became_active":"2024-09-19T06:05:22.679091+0000","last_became_peered":"2024-09-19T06:05:22.679091+0000","last_unstale":"2024-09-19T06:05:46.518702+0000","last_undegraded":"2024-09-19T06:05:46.518702+0000","last_fullsized":"2024-09-19T06:05:46.518702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63374,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":151,"num_read_kb":136,"num_write":160,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645331,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":427934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874263,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1079145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037789,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":428136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266722,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":428056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32640,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712512,"statfs":{"total":95995035648,"available":95961612288,"internally_reserved":0,"allocated":1482752,"data_stored":1019595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659179,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":427525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888112,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1495040,"data_stored":1019279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":488398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":487082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":428796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:06:01.860 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:06:01.860 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T06:06:01.860 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T06:06:02.107 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:02.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.528+0000 7f8076c5d640 1 -- 172.21.15.103:0/751497617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070102e10 msgr2=0x7f8070103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:02.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.528+0000 7f8076c5d640 1 --2- 172.21.15.103:0/751497617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070102e10 0x7f8070103290 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f805c009900 tx=0x7f805c02a410 comp rx=0 tx=0).stop 2024-09-19T06:06:02.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.528+0000 7f8076c5d640 1 -- 172.21.15.103:0/751497617 shutdown_connections 2024-09-19T06:06:02.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.528+0000 7f8076c5d640 1 --2- 172.21.15.103:0/751497617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80701037d0 0x7f807010a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.528+0000 7f8076c5d640 1 --2- 172.21.15.103:0/751497617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070102e10 0x7f8070103290 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.528+0000 7f8076c5d640 1 --2- 172.21.15.103:0/751497617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8070101c10 0x7f8070102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.528+0000 7f8076c5d640 1 -- 172.21.15.103:0/751497617 >> 172.21.15.103:0/751497617 conn(0x7f80700fd3c0 msgr2=0x7f80700ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.528+0000 7f8076c5d640 1 -- 172.21.15.103:0/751497617 shutdown_connections 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.528+0000 7f8076c5d640 1 -- 172.21.15.103:0/751497617 wait complete. 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f8076c5d640 1 Processor -- start 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f8076c5d640 1 -- start start 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f8076c5d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8070101c10 0x7f8070075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f8076c5d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070102e10 0x7f80700745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f8076c5d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80701037d0 0x7f8070074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f8076c5d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f807010d720 con 0x7f8070102e10 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f8076c5d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f807010d5a0 con 0x7f8070101c10 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f8076c5d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f807010d8a0 con 0x7f80701037d0 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f806ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070102e10 0x7f80700745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f806ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070102e10 0x7f80700745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35506/0 (socket says 172.21.15.103:35506) 2024-09-19T06:06:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f806ffff640 1 -- 172.21.15.103:0/3100129233 learned_addr learned my addr 172.21.15.103:0/3100129233 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f80749f9640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8070101c10 0x7f8070075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f80751fa640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80701037d0 0x7f8070074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f806ffff640 1 -- 172.21.15.103:0/3100129233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80701037d0 msgr2=0x7f8070074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f806ffff640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80701037d0 0x7f8070074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.529+0000 7f806ffff640 1 -- 172.21.15.103:0/3100129233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8070101c10 msgr2=0x7f8070075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.530+0000 7f806ffff640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8070101c10 0x7f8070075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.530+0000 7f806ffff640 1 -- 172.21.15.103:0/3100129233 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80700753e0 con 0x7f8070102e10 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.530+0000 7f806ffff640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070102e10 0x7f80700745e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f805c004770 tx=0x7f805c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.530+0000 7f806dffb640 1 -- 172.21.15.103:0/3100129233 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c03f030 con 0x7f8070102e10 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.530+0000 7f806dffb640 1 -- 172.21.15.103:0/3100129233 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f805c003cb0 con 0x7f8070102e10 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.530+0000 7f8076c5d640 1 -- 172.21.15.103:0/3100129233 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80701a1f60 con 0x7f8070102e10 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.530+0000 7f806dffb640 1 -- 172.21.15.103:0/3100129233 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c035070 con 0x7f8070102e10 2024-09-19T06:06:02.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.530+0000 7f8076c5d640 1 -- 172.21.15.103:0/3100129233 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80701a2350 con 0x7f8070102e10 2024-09-19T06:06:02.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.531+0000 7f8076c5d640 1 -- 172.21.15.103:0/3100129233 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8070109150 con 0x7f8070102e10 2024-09-19T06:06:02.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.532+0000 7f806dffb640 1 -- 172.21.15.103:0/3100129233 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f805c042030 con 0x7f8070102e10 2024-09-19T06:06:02.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.533+0000 7f806dffb640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80600a32d0 0x7f80600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:02.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.533+0000 7f80749f9640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80600a32d0 0x7f80600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:02.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.533+0000 7f806dffb640 1 -- 172.21.15.103:0/3100129233 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f805c0f0410 con 0x7f8070102e10 2024-09-19T06:06:02.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.533+0000 7f80749f9640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80600a32d0 0x7f80600a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8070102c70 tx=0x7f806400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:02.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.537+0000 7f806dffb640 1 -- 172.21.15.103:0/3100129233 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f805c0bd000 con 0x7f8070102e10 2024-09-19T06:06:02.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.773+0000 7f8076c5d640 1 -- 172.21.15.103:0/3100129233 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f807002d7c0 con 0x7f8070102e10 2024-09-19T06:06:02.774 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:02 smithi103 ceph-mon[30925]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:02.775 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:02 smithi103 ceph-mon[30925]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 8 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:06:02.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.775+0000 7f806dffb640 1 -- 172.21.15.103:0/3100129233 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f805c0bc900 con 0x7f8070102e10 2024-09-19T06:06:02.777 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-19T06:06:02.777 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBKv+tmti0kLhAAdVVHVu3Hg0YJ4FjIObzsLw== 2024-09-19T06:06:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 -- 172.21.15.103:0/3100129233 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80600a32d0 msgr2=0x7f80600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80600a32d0 0x7f80600a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8070102c70 tx=0x7f806400b390 comp rx=0 tx=0).stop 2024-09-19T06:06:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 -- 172.21.15.103:0/3100129233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070102e10 msgr2=0x7f80700745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070102e10 0x7f80700745e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f805c004770 tx=0x7f805c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 -- 172.21.15.103:0/3100129233 shutdown_connections 2024-09-19T06:06:02.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80600a32d0 0x7f80600a5790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80701037d0 0x7f8070074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070102e10 0x7f80700745e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 --2- 172.21.15.103:0/3100129233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8070101c10 0x7f8070075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 -- 172.21.15.103:0/3100129233 >> 172.21.15.103:0/3100129233 conn(0x7f80700fd3c0 msgr2=0x7f8070106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:02.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 -- 172.21.15.103:0/3100129233 shutdown_connections 2024-09-19T06:06:02.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:02.777+0000 7f8076c5d640 1 -- 172.21.15.103:0/3100129233 wait complete. 2024-09-19T06:06:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:02 smithi174 ceph-mon[34488]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:02 smithi174 ceph-mon[34488]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 8 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:06:03.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:02 smithi169 ceph-mon[34350]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:03.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:02 smithi169 ceph-mon[34350]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 8 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:06:03.621 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T06:06:03.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T06:06:03.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T06:06:03.661 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T06:06:03.661 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T06:06:03.662 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T06:06:03.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:03 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3100129233' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:06:03.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:03 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3100129233' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:06:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:03 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3100129233' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:06:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:03 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3100129233' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:06:03.959 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:04.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:03 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3100129233' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:06:04.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:03 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3100129233' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:06:04.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.429+0000 7fab935c6640 1 -- 172.21.15.103:0/2188597865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c100e20 msgr2=0x7fab8c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:04.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.429+0000 7fab935c6640 1 --2- 172.21.15.103:0/2188597865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c100e20 0x7fab8c101200 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fab84009ca0 tx=0x7fab8402a950 comp rx=0 tx=0).stop 2024-09-19T06:06:04.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 -- 172.21.15.103:0/2188597865 shutdown_connections 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 --2- 172.21.15.103:0/2188597865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8c102ef0 0x7fab8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 --2- 172.21.15.103:0/2188597865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab8c102570 0x7fab8c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 --2- 172.21.15.103:0/2188597865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c100e20 0x7fab8c101200 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 -- 172.21.15.103:0/2188597865 >> 172.21.15.103:0/2188597865 conn(0x7fab8c0fc7d0 msgr2=0x7fab8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 -- 172.21.15.103:0/2188597865 shutdown_connections 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 -- 172.21.15.103:0/2188597865 wait complete. 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 Processor -- start 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 -- start start 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab8c100e20 0x7fab8c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c102570 0x7fab8c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8c102ef0 0x7fab8c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.430+0000 7fab935c6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c110e50 con 0x7fab8c102570 2024-09-19T06:06:04.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab935c6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c110cd0 con 0x7fab8c102ef0 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab935c6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c110fd0 con 0x7fab8c100e20 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab90b61640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c102570 0x7fab8c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab90b61640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c102570 0x7fab8c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35520/0 (socket says 172.21.15.103:35520) 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab90b61640 1 -- 172.21.15.103:0/1298383664 learned_addr learned my addr 172.21.15.103:0/1298383664 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab91362640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab8c100e20 0x7fab8c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab91b63640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8c102ef0 0x7fab8c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab90b61640 1 -- 172.21.15.103:0/1298383664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab8c100e20 msgr2=0x7fab8c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab90b61640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab8c100e20 0x7fab8c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab90b61640 1 -- 172.21.15.103:0/1298383664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8c102ef0 msgr2=0x7fab8c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab90b61640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8c102ef0 0x7fab8c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab90b61640 1 -- 172.21.15.103:0/1298383664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c1a6940 con 0x7fab8c102570 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab91b63640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8c102ef0 0x7fab8c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:04.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab91362640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab8c100e20 0x7fab8c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab90b61640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c102570 0x7fab8c0fd1c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab8000b4a0 tx=0x7fab8000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab8a7fc640 1 -- 172.21.15.103:0/1298383664 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80014070 con 0x7fab8c102570 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab8a7fc640 1 -- 172.21.15.103:0/1298383664 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab80010ac0 con 0x7fab8c102570 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab935c6640 1 -- 172.21.15.103:0/1298383664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c1a6c30 con 0x7fab8c102570 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab8a7fc640 1 -- 172.21.15.103:0/1298383664 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80017c30 con 0x7fab8c102570 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.431+0000 7fab935c6640 1 -- 172.21.15.103:0/1298383664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1a71c0 con 0x7fab8c102570 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.433+0000 7fab935c6640 1 -- 172.21.15.103:0/1298383664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c101200 con 0x7fab8c102570 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.433+0000 7fab8a7fc640 1 -- 172.21.15.103:0/1298383664 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fab80017070 con 0x7fab8c102570 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.434+0000 7fab8a7fc640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab740a3350 0x7fab740a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.435+0000 7fab91362640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab740a3350 0x7fab740a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.435+0000 7fab8a7fc640 1 -- 172.21.15.103:0/1298383664 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fab800cefa0 con 0x7fab8c102570 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.435+0000 7fab91362640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab740a3350 0x7fab740a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab84005cc0 tx=0x7fab84005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:04.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.439+0000 7fab8a7fc640 1 -- 172.21.15.103:0/1298383664 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab8009bd40 con 0x7fab8c102570 2024-09-19T06:06:04.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.662+0000 7fab935c6640 1 -- 172.21.15.103:0/1298383664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fab8c1a73f0 con 0x7fab8c102570 2024-09-19T06:06:04.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.666+0000 7fab8a7fc640 1 -- 172.21.15.103:0/1298383664 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264054 (secure 0 0 0) 0x7fab80097070 con 0x7fab8c102570 2024-09-19T06:06:04.671 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.669+0000 7fab935c6640 1 -- 172.21.15.103:0/1298383664 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab740a3350 msgr2=0x7fab740a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.669+0000 7fab935c6640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab740a3350 0x7fab740a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab84005cc0 tx=0x7fab84005c30 comp rx=0 tx=0).stop 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.669+0000 7fab935c6640 1 -- 172.21.15.103:0/1298383664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c102570 msgr2=0x7fab8c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.669+0000 7fab935c6640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c102570 0x7fab8c0fd1c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab8000b4a0 tx=0x7fab8000b960 comp rx=0 tx=0).stop 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.669+0000 7fab935c6640 1 -- 172.21.15.103:0/1298383664 shutdown_connections 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.669+0000 7fab935c6640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab740a3350 0x7fab740a5810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.669+0000 7fab935c6640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab8c102ef0 0x7fab8c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.669+0000 7fab935c6640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c102570 0x7fab8c0fd1c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.670+0000 7fab935c6640 1 --2- 172.21.15.103:0/1298383664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab8c100e20 0x7fab8c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.670+0000 7fab935c6640 1 -- 172.21.15.103:0/1298383664 >> 172.21.15.103:0/1298383664 conn(0x7fab8c0fc7d0 msgr2=0x7fab8c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.670+0000 7fab935c6640 1 -- 172.21.15.103:0/1298383664 shutdown_connections 2024-09-19T06:06:04.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:04.670+0000 7fab935c6640 1 -- 172.21.15.103:0/1298383664 wait complete. 2024-09-19T06:06:04.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:04 smithi103 ceph-mon[30925]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:06:04.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:04 smithi174 ceph-mon[34488]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:06:05.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:04 smithi169 ceph-mon[34350]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:06:05.433 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":253046125},{"type":"v1","addr":"172.21.15.103:6801","nonce":253046125}]},"active_addr":"172.21.15.103:6801/253046125","active_change":"2024-09-19T05:58:45.371891+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.103:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2210851046}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2607266510}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":550453146}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1612408044}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":708355172}]}]} 2024-09-19T06:06:05.439 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T06:06:05.439 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T06:06:05.439 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:06:05.693 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:05.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:05 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1298383664' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:06:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:05 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1298383664' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:06:06.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:05 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1298383664' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:06:06.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.178+0000 7f83bbf63640 1 -- 172.21.15.103:0/2274901695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83b4101de0 msgr2=0x7f83b41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:06.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.178+0000 7f83bbf63640 1 --2- 172.21.15.103:0/2274901695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83b4101de0 0x7f83b41021c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009900 tx=0x7f83ac02a410 comp rx=0 tx=0).stop 2024-09-19T06:06:06.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.178+0000 7f83bbf63640 1 -- 172.21.15.103:0/2274901695 shutdown_connections 2024-09-19T06:06:06.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.178+0000 7f83bbf63640 1 --2- 172.21.15.103:0/2274901695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b4106f10 0x7f83b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.178+0000 7f83bbf63640 1 --2- 172.21.15.103:0/2274901695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83b4102790 0x7f83b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.178+0000 7f83bbf63640 1 --2- 172.21.15.103:0/2274901695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83b4101de0 0x7f83b41021c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.178+0000 7f83bbf63640 1 -- 172.21.15.103:0/2274901695 >> 172.21.15.103:0/2274901695 conn(0x7f83b40fd8c0 msgr2=0x7f83b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:06.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.178+0000 7f83bbf63640 1 -- 172.21.15.103:0/2274901695 shutdown_connections 2024-09-19T06:06:06.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.178+0000 7f83bbf63640 1 -- 172.21.15.103:0/2274901695 wait complete. 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83bbf63640 1 Processor -- start 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83bbf63640 1 -- start start 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83bbf63640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83b4101de0 0x7f83b4198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83bbf63640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b4102790 0x7f83b4198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83bbf63640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83b4106f10 0x7f83b419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83bbf63640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4111e60 con 0x7f83b4101de0 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83bbf63640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4111ce0 con 0x7f83b4106f10 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83bbf63640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4111fe0 con 0x7f83b4102790 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83b9cff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83b4101de0 0x7f83b4198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83b9cff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83b4101de0 0x7f83b4198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35528/0 (socket says 172.21.15.103:35528) 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83b9cff640 1 -- 172.21.15.103:0/218482421 learned_addr learned my addr 172.21.15.103:0/218482421 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83b94fe640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b4102790 0x7f83b4198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:06.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83b9cff640 1 -- 172.21.15.103:0/218482421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b4102790 msgr2=0x7f83b4198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83b9cff640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b4102790 0x7f83b4198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83b9cff640 1 -- 172.21.15.103:0/218482421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83b4106f10 msgr2=0x7f83b419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83b9cff640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83b4106f10 0x7f83b419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.179+0000 7f83b9cff640 1 -- 172.21.15.103:0/218482421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b419d3b0 con 0x7f83b4101de0 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.180+0000 7f83b9cff640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83b4101de0 0x7f83b4198400 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f83ac005940 tx=0x7f83ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.180+0000 7f83b2ffd640 1 -- 172.21.15.103:0/218482421 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac03f030 con 0x7f83b4101de0 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.180+0000 7f83bbf63640 1 -- 172.21.15.103:0/218482421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b419d640 con 0x7f83b4101de0 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.180+0000 7f83b2ffd640 1 -- 172.21.15.103:0/218482421 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83ac003aa0 con 0x7f83b4101de0 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.180+0000 7f83b2ffd640 1 -- 172.21.15.103:0/218482421 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac035070 con 0x7f83b4101de0 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.180+0000 7f83bbf63640 1 -- 172.21.15.103:0/218482421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b41a4f80 con 0x7f83b4101de0 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.181+0000 7f83bbf63640 1 -- 172.21.15.103:0/218482421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b41032c0 con 0x7f83b4101de0 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.182+0000 7f83b2ffd640 1 -- 172.21.15.103:0/218482421 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f83ac042030 con 0x7f83b4101de0 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.182+0000 7f83b2ffd640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f839c0a32d0 0x7f839c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:06.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.183+0000 7f83b94fe640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f839c0a32d0 0x7f839c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:06.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.183+0000 7f83b2ffd640 1 -- 172.21.15.103:0/218482421 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f83ac0f02d0 con 0x7f83b4101de0 2024-09-19T06:06:06.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.183+0000 7f83b94fe640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f839c0a32d0 0x7f839c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83b40fdd50 tx=0x7f83a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:06.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.187+0000 7f83b2ffd640 1 -- 172.21.15.103:0/218482421 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83ac0bcec0 con 0x7f83b4101de0 2024-09-19T06:06:06.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.353+0000 7f83bbf63640 1 -- 172.21.15.103:0/218482421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83b410a0f0 con 0x7f83b4101de0 2024-09-19T06:06:06.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.354+0000 7f83b2ffd640 1 -- 172.21.15.103:0/218482421 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22681 (secure 0 0 0) 0x7f83ac0bc7c0 con 0x7f83b4101de0 2024-09-19T06:06:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:06.356 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:05:46.513696+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:05:21.617020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:05:23.597579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:06:06.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 -- 172.21.15.103:0/218482421 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f839c0a32d0 msgr2=0x7f839c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:06.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f839c0a32d0 0x7f839c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83b40fdd50 tx=0x7f83a8008040 comp rx=0 tx=0).stop 2024-09-19T06:06:06.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 -- 172.21.15.103:0/218482421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83b4101de0 msgr2=0x7f83b4198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:06.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83b4101de0 0x7f83b4198400 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f83ac005940 tx=0x7f83ac004270 comp rx=0 tx=0).stop 2024-09-19T06:06:06.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 -- 172.21.15.103:0/218482421 shutdown_connections 2024-09-19T06:06:06.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f839c0a32d0 0x7f839c0a5790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83b4106f10 0x7f83b419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b4102790 0x7f83b4198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 --2- 172.21.15.103:0/218482421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83b4101de0 0x7f83b4198400 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 -- 172.21.15.103:0/218482421 >> 172.21.15.103:0/218482421 conn(0x7f83b40fd8c0 msgr2=0x7f83b40fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:06.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 -- 172.21.15.103:0/218482421 shutdown_connections 2024-09-19T06:06:06.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:06.357+0000 7f83bbf63640 1 -- 172.21.15.103:0/218482421 wait complete. 2024-09-19T06:06:06.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:06 smithi174 ceph-mon[34488]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T06:06:06.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:06 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/218482421' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:06.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:06 smithi103 ceph-mon[30925]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T06:06:06.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:06 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/218482421' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:07.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:06 smithi169 ceph-mon[34350]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T06:06:07.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:06 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/218482421' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:07.126 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T06:06:07.126 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:06:07.373 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:07.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 -- 172.21.15.103:0/1481486298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234106a80 msgr2=0x7f3234106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 --2- 172.21.15.103:0/1481486298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234106a80 0x7f3234106e60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f322c009930 tx=0x7f322c02a420 comp rx=0 tx=0).stop 2024-09-19T06:06:07.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 -- 172.21.15.103:0/1481486298 shutdown_connections 2024-09-19T06:06:07.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 --2- 172.21.15.103:0/1481486298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3234101420 0x7f323410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 --2- 172.21.15.103:0/1481486298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3234100a80 0x7f3234100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 --2- 172.21.15.103:0/1481486298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234106a80 0x7f3234106e60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 -- 172.21.15.103:0/1481486298 >> 172.21.15.103:0/1481486298 conn(0x7f32340fc7a0 msgr2=0x7f32340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:07.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 -- 172.21.15.103:0/1481486298 shutdown_connections 2024-09-19T06:06:07.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 -- 172.21.15.103:0/1481486298 wait complete. 2024-09-19T06:06:07.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 Processor -- start 2024-09-19T06:06:07.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 -- start start 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234100a80 0x7f32341983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.845+0000 7f323bdab640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3234101420 0x7f3234198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f323bdab640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3234106a80 0x7f323419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f323bdab640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3234110cf0 con 0x7f3234100a80 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f323bdab640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3234110b70 con 0x7f3234106a80 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f323bdab640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3234110e70 con 0x7f3234101420 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239b47640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234100a80 0x7f32341983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239b47640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234100a80 0x7f32341983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35540/0 (socket says 172.21.15.103:35540) 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239b47640 1 -- 172.21.15.103:0/2134996200 learned_addr learned my addr 172.21.15.103:0/2134996200 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f323a348640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3234106a80 0x7f323419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239346640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3234101420 0x7f3234198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239b47640 1 -- 172.21.15.103:0/2134996200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3234101420 msgr2=0x7f3234198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239b47640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3234101420 0x7f3234198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239b47640 1 -- 172.21.15.103:0/2134996200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3234106a80 msgr2=0x7f323419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239b47640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3234106a80 0x7f323419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239b47640 1 -- 172.21.15.103:0/2134996200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323419d370 con 0x7f3234100a80 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239346640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3234101420 0x7f3234198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3239b47640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234100a80 0x7f32341983c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f322c004770 tx=0x7f322c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3232ffd640 1 -- 172.21.15.103:0/2134996200 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c03f070 con 0x7f3234100a80 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3232ffd640 1 -- 172.21.15.103:0/2134996200 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f322c03b460 con 0x7f3234100a80 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f323bdab640 1 -- 172.21.15.103:0/2134996200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f323419d600 con 0x7f3234100a80 2024-09-19T06:06:07.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f3232ffd640 1 -- 172.21.15.103:0/2134996200 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c035070 con 0x7f3234100a80 2024-09-19T06:06:07.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.846+0000 7f323bdab640 1 -- 172.21.15.103:0/2134996200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32341a4f40 con 0x7f3234100a80 2024-09-19T06:06:07.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.847+0000 7f323bdab640 1 -- 172.21.15.103:0/2134996200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32341021c0 con 0x7f3234100a80 2024-09-19T06:06:07.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.848+0000 7f3232ffd640 1 -- 172.21.15.103:0/2134996200 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f322c03b610 con 0x7f3234100a80 2024-09-19T06:06:07.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.849+0000 7f3232ffd640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f321c0a32d0 0x7f321c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.849+0000 7f3239346640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f321c0a32d0 0x7f321c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.850+0000 7f3232ffd640 1 -- 172.21.15.103:0/2134996200 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f322c0efe30 con 0x7f3234100a80 2024-09-19T06:06:07.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.850+0000 7f3239346640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f321c0a32d0 0x7f321c0a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f32340fee30 tx=0x7f32280082f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:07.854+0000 7f3232ffd640 1 -- 172.21.15.103:0/2134996200 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f322c0bca20 con 0x7f3234100a80 2024-09-19T06:06:08.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.022+0000 7f323bdab640 1 -- 172.21.15.103:0/2134996200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32341a51d0 con 0x7f3234100a80 2024-09-19T06:06:08.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.023+0000 7f3232ffd640 1 -- 172.21.15.103:0/2134996200 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22681 (secure 0 0 0) 0x7f322c0bc320 con 0x7f3234100a80 2024-09-19T06:06:08.025 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:08.025 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:05:46.513696+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:05:21.617020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:05:23.597579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:06:08.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 -- 172.21.15.103:0/2134996200 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f321c0a32d0 msgr2=0x7f321c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:08.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f321c0a32d0 0x7f321c0a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f32340fee30 tx=0x7f32280082f0 comp rx=0 tx=0).stop 2024-09-19T06:06:08.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 -- 172.21.15.103:0/2134996200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234100a80 msgr2=0x7f32341983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:08.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234100a80 0x7f32341983c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f322c004770 tx=0x7f322c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:06:08.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 -- 172.21.15.103:0/2134996200 shutdown_connections 2024-09-19T06:06:08.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f321c0a32d0 0x7f321c0a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:08.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3234106a80 0x7f323419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:08.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3234101420 0x7f3234198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:08.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 --2- 172.21.15.103:0/2134996200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234100a80 0x7f32341983c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:08.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 -- 172.21.15.103:0/2134996200 >> 172.21.15.103:0/2134996200 conn(0x7f32340fc7a0 msgr2=0x7f3234104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:08.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 -- 172.21.15.103:0/2134996200 shutdown_connections 2024-09-19T06:06:08.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:08.026+0000 7f323bdab640 1 -- 172.21.15.103:0/2134996200 wait complete. 2024-09-19T06:06:08.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:08 smithi103 ceph-mon[30925]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T06:06:08.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:08 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2134996200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:08.753 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T06:06:08.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T06:06:08.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T06:06:08.755 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T06:06:08.755 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T06:06:08.756 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T06:06:08.756 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T06:06:08.756 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T06:06:08.757 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T06:06:08.757 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T06:06:08.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T06:06:08.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T06:06:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:08 smithi174 ceph-mon[34488]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T06:06:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:08 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2134996200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:09.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:08 smithi169 ceph-mon[34350]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T06:06:09.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:08 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2134996200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:09.397 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:09.430 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:10.084 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:10.085 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:10.085 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:10.085 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:10.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.282+0000 7fbdadd85640 1 -- 172.21.15.103:0/108860723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda8102790 msgr2=0x7fbda81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.282+0000 7fbdadd85640 1 --2- 172.21.15.103:0/108860723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda8102790 0x7fbda81067e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009900 tx=0x7fbd9c02a410 comp rx=0 tx=0).stop 2024-09-19T06:06:10.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.282+0000 7fbdadd85640 1 -- 172.21.15.103:0/108860723 shutdown_connections 2024-09-19T06:06:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.282+0000 7fbdadd85640 1 --2- 172.21.15.103:0/108860723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda8106f10 0x7fbda810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.282+0000 7fbdadd85640 1 --2- 172.21.15.103:0/108860723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda8102790 0x7fbda81067e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.282+0000 7fbdadd85640 1 --2- 172.21.15.103:0/108860723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbda8101de0 0x7fbda81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.282+0000 7fbdadd85640 1 -- 172.21.15.103:0/108860723 >> 172.21.15.103:0/108860723 conn(0x7fbda80fd8c0 msgr2=0x7fbda80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.282+0000 7fbdadd85640 1 -- 172.21.15.103:0/108860723 shutdown_connections 2024-09-19T06:06:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.282+0000 7fbdadd85640 1 -- 172.21.15.103:0/108860723 wait complete. 2024-09-19T06:06:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbdadd85640 1 Processor -- start 2024-09-19T06:06:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbdadd85640 1 -- start start 2024-09-19T06:06:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbdadd85640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda8101de0 0x7fbda80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbdadd85640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbda8102790 0x7fbda8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbdadd85640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda8106f10 0x7fbda8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbdadd85640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbda8111e40 con 0x7fbda8101de0 2024-09-19T06:06:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbdadd85640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbda8111cc0 con 0x7fbda8106f10 2024-09-19T06:06:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbdadd85640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbda8111fc0 con 0x7fbda8102790 2024-09-19T06:06:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbda77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda8101de0 0x7fbda80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbda77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda8101de0 0x7fbda80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59684/0 (socket says 172.21.15.103:59684) 2024-09-19T06:06:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbda77fe640 1 -- 172.21.15.103:0/1566433214 learned_addr learned my addr 172.21.15.103:0/1566433214 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbda6ffd640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbda8102790 0x7fbda8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbda7fff640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda8106f10 0x7fbda8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbda77fe640 1 -- 172.21.15.103:0/1566433214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbda8102790 msgr2=0x7fbda8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbda77fe640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbda8102790 0x7fbda8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbda77fe640 1 -- 172.21.15.103:0/1566433214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda8106f10 msgr2=0x7fbda8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbda77fe640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbda8106f10 0x7fbda8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.283+0000 7fbda77fe640 1 -- 172.21.15.103:0/1566433214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda81a6900 con 0x7fbda8101de0 2024-09-19T06:06:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.284+0000 7fbda77fe640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda8101de0 0x7fbda80744f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800b4a0 tx=0x7fbd9800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.284+0000 7fbda4ff9640 1 -- 172.21.15.103:0/1566433214 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98014070 con 0x7fbda8101de0 2024-09-19T06:06:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.284+0000 7fbda4ff9640 1 -- 172.21.15.103:0/1566433214 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd98010ac0 con 0x7fbda8101de0 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.284+0000 7fbda4ff9640 1 -- 172.21.15.103:0/1566433214 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98017c30 con 0x7fbda8101de0 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.284+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda81a6bf0 con 0x7fbda8101de0 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.284+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda81a7150 con 0x7fbda8101de0 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.285+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbda8062880 con 0x7fbda8101de0 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.286+0000 7fbda4ff9640 1 -- 172.21.15.103:0/1566433214 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fbd98017070 con 0x7fbda8101de0 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.286+0000 7fbda4ff9640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd900a3350 0x7fbd900a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.287+0000 7fbda6ffd640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd900a3350 0x7fbd900a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.287+0000 7fbda4ff9640 1 -- 172.21.15.103:0/1566433214 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fbd980cf150 con 0x7fbda8101de0 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.287+0000 7fbda4ff9640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] conn(0x7fbd900ace80 0x7fbd900af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.287+0000 7fbda4ff9640 1 -- 172.21.15.103:0/1566433214 --> [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd900af9f0 con 0x7fbd900ace80 2024-09-19T06:06:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.287+0000 7fbda4ff9640 1 -- 172.21.15.103:0/1566433214 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fbd980cf500 con 0x7fbda8101de0 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.287+0000 7fbda7fff640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] conn(0x7fbd900ace80 0x7fbd900af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.287+0000 7fbda6ffd640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd900a3350 0x7fbd900a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c031440 tx=0x7fbd9c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.287+0000 7fbda7fff640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] conn(0x7fbd900ace80 0x7fbd900af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.288+0000 7fbda4ff9640 1 -- 172.21.15.103:0/1566433214 <== osd.9 v2:172.21.15.103:6826/1803309974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd900af9f0 con 0x7fbd900ace80 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.301+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 --> [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbda8062d00 con 0x7fbd900ace80 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.301+0000 7fbda4ff9640 1 -- 172.21.15.103:0/1566433214 <== osd.9 v2:172.21.15.103:6826/1803309974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbda8062d00 con 0x7fbd900ace80 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] conn(0x7fbd900ace80 msgr2=0x7fbd900af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbdadd85640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] conn(0x7fbd900ace80 0x7fbd900af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd900a3350 msgr2=0x7fbd900a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbdadd85640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbd900a3350 0x7fbd900a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c031440 tx=0x7fbd9c0095f0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda8101de0 msgr2=0x7fbda80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbdadd85640 1 --2- 172.21.15.103:0/1566433214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda8101de0 0x7fbda80744f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800b4a0 tx=0x7fbd9800b960 comp rx=0 tx=0).stop 2024-09-19T06:06:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbda7fff640 1 -- 172.21.15.103:0/1566433214 reap_dead start 2024-09-19T06:06:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 shutdown_connections 2024-09-19T06:06:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 >> 172.21.15.103:0/1566433214 conn(0x7fbda80fd8c0 msgr2=0x7fbda80fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 shutdown_connections 2024-09-19T06:06:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.302+0000 7fbdadd85640 1 -- 172.21.15.103:0/1566433214 wait complete. 2024-09-19T06:06:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.695+0000 7f3128560640 1 -- 172.21.15.103:0/3306101802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3120105ad0 msgr2=0x7f3120105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.695+0000 7f3128560640 1 --2- 172.21.15.103:0/3306101802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3120105ad0 0x7f3120105eb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f311c009900 tx=0x7f311c02a410 comp rx=0 tx=0).stop 2024-09-19T06:06:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.695+0000 7f3128560640 1 -- 172.21.15.103:0/3306101802 shutdown_connections 2024-09-19T06:06:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.695+0000 7f3128560640 1 --2- 172.21.15.103:0/3306101802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3120101b60 0x7f312010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.695+0000 7f3128560640 1 --2- 172.21.15.103:0/3306101802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31201011c0 0x7f3120101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.695+0000 7f3128560640 1 --2- 172.21.15.103:0/3306101802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3120105ad0 0x7f3120105eb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.695+0000 7f3128560640 1 -- 172.21.15.103:0/3306101802 >> 172.21.15.103:0/3306101802 conn(0x7f3120077210 msgr2=0x7f31200fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3128560640 1 -- 172.21.15.103:0/3306101802 shutdown_connections 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3128560640 1 -- 172.21.15.103:0/3306101802 wait complete. 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3128560640 1 Processor -- start 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3128560640 1 -- start start 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3128560640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31201011c0 0x7f3120198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3128560640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3120101b60 0x7f3120198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3128560640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3120105ad0 0x7f312019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3128560640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3120110da0 con 0x7f3120101b60 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3128560640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3120110c20 con 0x7f3120105ad0 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3128560640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3120110f20 con 0x7f31201011c0 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3125afb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3120101b60 0x7f3120198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3125afb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3120101b60 0x7f3120198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59702/0 (socket says 172.21.15.103:59702) 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.696+0000 7f3125afb640 1 -- 172.21.15.103:0/2239769580 learned_addr learned my addr 172.21.15.103:0/2239769580 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f31262fc640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31201011c0 0x7f3120198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f3126afd640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3120105ad0 0x7f312019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f3125afb640 1 -- 172.21.15.103:0/2239769580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31201011c0 msgr2=0x7f3120198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f3125afb640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31201011c0 0x7f3120198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f3125afb640 1 -- 172.21.15.103:0/2239769580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3120105ad0 msgr2=0x7f312019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f3125afb640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3120105ad0 0x7f312019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f3125afb640 1 -- 172.21.15.103:0/2239769580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312019d2b0 con 0x7f3120101b60 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f3126afd640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3120105ad0 0x7f312019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f31262fc640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31201011c0 0x7f3120198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f3125afb640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3120101b60 0x7f3120198840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f311000c970 tx=0x7f311000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f31177fe640 1 -- 172.21.15.103:0/2239769580 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110007bb0 con 0x7f3120101b60 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312019d5a0 con 0x7f3120101b60 2024-09-19T06:06:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f31177fe640 1 -- 172.21.15.103:0/2239769580 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3110007d50 con 0x7f3120101b60 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f31177fe640 1 -- 172.21.15.103:0/2239769580 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311000f450 con 0x7f3120101b60 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.697+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31201a4e80 con 0x7f3120101b60 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.698+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3120062940 con 0x7f3120101b60 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.699+0000 7f31177fe640 1 -- 172.21.15.103:0/2239769580 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f3110004f20 con 0x7f3120101b60 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.700+0000 7f31177fe640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f310c0a32d0 0x7f310c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.700+0000 7f31262fc640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f310c0a32d0 0x7f310c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.700+0000 7f31177fe640 1 -- 172.21.15.103:0/2239769580 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f31100cfcb0 con 0x7f3120101b60 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.700+0000 7f31177fe640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] conn(0x7f310c0ace00 0x7f310c0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.700+0000 7f31177fe640 1 -- 172.21.15.103:0/2239769580 --> [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3110017e70 con 0x7f310c0ace00 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.700+0000 7f31177fe640 1 -- 172.21.15.103:0/2239769580 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f31100d0100 con 0x7f3120101b60 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.700+0000 7f31262fc640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f310c0a32d0 0x7f310c0a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f311c005ab0 tx=0x7f311c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.701+0000 7f3126afd640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] conn(0x7f310c0ace00 0x7f310c0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.701+0000 7f3126afd640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] conn(0x7f310c0ace00 0x7f310c0af2a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.702+0000 7f31177fe640 1 -- 172.21.15.103:0/2239769580 <== osd.4 v2:172.21.15.169:6808/1020121864 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3110017e70 con 0x7f310c0ace00 2024-09-19T06:06:10.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.717+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 --> [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3120062dc0 con 0x7f310c0ace00 2024-09-19T06:06:10.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.717+0000 7f31177fe640 1 -- 172.21.15.103:0/2239769580 <== osd.4 v2:172.21.15.169:6808/1020121864 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3120062dc0 con 0x7f310c0ace00 2024-09-19T06:06:10.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.718+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 >> [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] conn(0x7f310c0ace00 msgr2=0x7f310c0af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.718+0000 7f3128560640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] conn(0x7f310c0ace00 0x7f310c0af2a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:10.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.718+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f310c0a32d0 msgr2=0x7f310c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.718+0000 7f3128560640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f310c0a32d0 0x7f310c0a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f311c005ab0 tx=0x7f311c005a20 comp rx=0 tx=0).stop 2024-09-19T06:06:10.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.718+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3120101b60 msgr2=0x7f3120198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:10.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.718+0000 7f3128560640 1 --2- 172.21.15.103:0/2239769580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3120101b60 0x7f3120198840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f311000c970 tx=0x7f311000ce30 comp rx=0 tx=0).stop 2024-09-19T06:06:10.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.718+0000 7f3126afd640 1 -- 172.21.15.103:0/2239769580 reap_dead start 2024-09-19T06:06:10.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.718+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 shutdown_connections 2024-09-19T06:06:10.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.718+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 >> 172.21.15.103:0/2239769580 conn(0x7f3120077210 msgr2=0x7f31201005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:10.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.719+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 shutdown_connections 2024-09-19T06:06:10.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:10.719+0000 7f3128560640 1 -- 172.21.15.103:0/2239769580 wait complete. 2024-09-19T06:06:10.722 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:10.722 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:10.722 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:10.723 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:10 smithi174 ceph-mon[34488]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T06:06:10.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:10 smithi103 ceph-mon[30925]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T06:06:11.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:10 smithi169 ceph-mon[34350]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T06:06:11.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.838+0000 7f0759cb4640 1 -- 172.21.15.103:0/1598642654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0754106f10 msgr2=0x7f075410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.838+0000 7f0759cb4640 1 --2- 172.21.15.103:0/1598642654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0754106f10 0x7f075410ea90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f074c009ca0 tx=0x7f074c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.838+0000 7f0759cb4640 1 -- 172.21.15.103:0/1598642654 shutdown_connections 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.838+0000 7f0759cb4640 1 --2- 172.21.15.103:0/1598642654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0754106f10 0x7f075410ea90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.838+0000 7f0759cb4640 1 --2- 172.21.15.103:0/1598642654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0754102790 0x7f07541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.838+0000 7f0759cb4640 1 --2- 172.21.15.103:0/1598642654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0754101de0 0x7f07541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.838+0000 7f0759cb4640 1 -- 172.21.15.103:0/1598642654 >> 172.21.15.103:0/1598642654 conn(0x7f07540fd8c0 msgr2=0x7f07540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.838+0000 7f0759cb4640 1 -- 172.21.15.103:0/1598642654 shutdown_connections 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.838+0000 7f0759cb4640 1 -- 172.21.15.103:0/1598642654 wait complete. 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f0759cb4640 1 Processor -- start 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f0759cb4640 1 -- start start 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f0759cb4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0754101de0 0x7f0754198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f0759cb4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0754102790 0x7f07541989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f0759cb4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0754106f10 0x7f075419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f0759cb4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0754111ec0 con 0x7f0754101de0 2024-09-19T06:06:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f0759cb4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0754111d40 con 0x7f0754106f10 2024-09-19T06:06:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f0759cb4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0754112040 con 0x7f0754102790 2024-09-19T06:06:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f07537fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0754101de0 0x7f0754198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f07537fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0754101de0 0x7f0754198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59714/0 (socket says 172.21.15.103:59714) 2024-09-19T06:06:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f07537fe640 1 -- 172.21.15.103:0/1873392613 learned_addr learned my addr 172.21.15.103:0/1873392613 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f0752ffd640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0754102790 0x7f07541989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f0753fff640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0754106f10 0x7f075419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f07537fe640 1 -- 172.21.15.103:0/1873392613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0754102790 msgr2=0x7f07541989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f07537fe640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0754102790 0x7f07541989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f07537fe640 1 -- 172.21.15.103:0/1873392613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0754106f10 msgr2=0x7f075419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f07537fe640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0754106f10 0x7f075419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.839+0000 7f07537fe640 1 -- 172.21.15.103:0/1873392613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075419d430 con 0x7f0754101de0 2024-09-19T06:06:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.840+0000 7f07537fe640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0754101de0 0x7f0754198480 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f074400b4a0 tx=0x7f074400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.840+0000 7f0750ff9640 1 -- 172.21.15.103:0/1873392613 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744014070 con 0x7f0754101de0 2024-09-19T06:06:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.840+0000 7f0750ff9640 1 -- 172.21.15.103:0/1873392613 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0744010ac0 con 0x7f0754101de0 2024-09-19T06:06:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.840+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075419d720 con 0x7f0754101de0 2024-09-19T06:06:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.840+0000 7f0750ff9640 1 -- 172.21.15.103:0/1873392613 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744017c30 con 0x7f0754101de0 2024-09-19T06:06:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.840+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07541a5000 con 0x7f0754101de0 2024-09-19T06:06:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.841+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0754062900 con 0x7f0754101de0 2024-09-19T06:06:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.842+0000 7f0750ff9640 1 -- 172.21.15.103:0/1873392613 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0744017070 con 0x7f0754101de0 2024-09-19T06:06:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.842+0000 7f0750ff9640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f073c0a32d0 0x7f073c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.843+0000 7f0752ffd640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f073c0a32d0 0x7f073c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.843+0000 7f0750ff9640 1 -- 172.21.15.103:0/1873392613 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f07440cf0e0 con 0x7f0754101de0 2024-09-19T06:06:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.843+0000 7f0750ff9640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] conn(0x7f073c0ace00 0x7f073c0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.843+0000 7f0750ff9640 1 -- 172.21.15.103:0/1873392613 --> [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f073c0af970 con 0x7f073c0ace00 2024-09-19T06:06:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.843+0000 7f0750ff9640 1 -- 172.21.15.103:0/1873392613 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f07440d6050 con 0x7f0754101de0 2024-09-19T06:06:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.843+0000 7f0752ffd640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f073c0a32d0 0x7f073c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f07540ffe50 tx=0x7f0748008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.843+0000 7f0753fff640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] conn(0x7f073c0ace00 0x7f073c0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.843+0000 7f0753fff640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] conn(0x7f073c0ace00 0x7f073c0af2a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.844+0000 7f0750ff9640 1 -- 172.21.15.103:0/1873392613 <== osd.7 v2:172.21.15.169:6816/337716664 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f073c0af970 con 0x7f073c0ace00 2024-09-19T06:06:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.858+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 --> [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0754062d80 con 0x7f073c0ace00 2024-09-19T06:06:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.858+0000 7f0750ff9640 1 -- 172.21.15.103:0/1873392613 <== osd.7 v2:172.21.15.169:6816/337716664 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0754062d80 con 0x7f073c0ace00 2024-09-19T06:06:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 >> [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] conn(0x7f073c0ace00 msgr2=0x7f073c0af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0759cb4640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] conn(0x7f073c0ace00 0x7f073c0af2a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f073c0a32d0 msgr2=0x7f073c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0759cb4640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f073c0a32d0 0x7f073c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f07540ffe50 tx=0x7f0748008040 comp rx=0 tx=0).stop 2024-09-19T06:06:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0754101de0 msgr2=0x7f0754198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0759cb4640 1 --2- 172.21.15.103:0/1873392613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0754101de0 0x7f0754198480 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f074400b4a0 tx=0x7f074400b960 comp rx=0 tx=0).stop 2024-09-19T06:06:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0753fff640 1 -- 172.21.15.103:0/1873392613 reap_dead start 2024-09-19T06:06:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 shutdown_connections 2024-09-19T06:06:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 >> 172.21.15.103:0/1873392613 conn(0x7f07540fd8c0 msgr2=0x7f07540fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 shutdown_connections 2024-09-19T06:06:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:11.859+0000 7f0759cb4640 1 -- 172.21.15.103:0/1873392613 wait complete. 2024-09-19T06:06:12.578 INFO:teuthology.orchestra.run.smithi103.stdout:197568495657 2024-09-19T06:06:12.579 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T06:06:12.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:12 smithi174 ceph-mon[34488]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-19T06:06:12.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:12 smithi103 ceph-mon[30925]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-19T06:06:13.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:12 smithi169 ceph-mon[34350]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-19T06:06:13.078 INFO:teuthology.orchestra.run.smithi103.stdout:128849018936 2024-09-19T06:06:13.079 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T06:06:13.315 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:13.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.512+0000 7f30ed845640 1 -- 172.21.15.103:0/1767747784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e8101420 msgr2=0x7f30e810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:13.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.512+0000 7f30ed845640 1 --2- 172.21.15.103:0/1767747784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e8101420 0x7f30e810d950 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009930 tx=0x7f30d802a420 comp rx=0 tx=0).stop 2024-09-19T06:06:13.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.512+0000 7f30ed845640 1 -- 172.21.15.103:0/1767747784 shutdown_connections 2024-09-19T06:06:13.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.512+0000 7f30ed845640 1 --2- 172.21.15.103:0/1767747784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e8101420 0x7f30e810d950 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.512+0000 7f30ed845640 1 --2- 172.21.15.103:0/1767747784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e8100a80 0x7f30e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.512+0000 7f30ed845640 1 --2- 172.21.15.103:0/1767747784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30e8106a80 0x7f30e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.512+0000 7f30ed845640 1 -- 172.21.15.103:0/1767747784 >> 172.21.15.103:0/1767747784 conn(0x7f30e80fc7a0 msgr2=0x7f30e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.512+0000 7f30ed845640 1 -- 172.21.15.103:0/1767747784 shutdown_connections 2024-09-19T06:06:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.512+0000 7f30ed845640 1 -- 172.21.15.103:0/1767747784 wait complete. 2024-09-19T06:06:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30ed845640 1 Processor -- start 2024-09-19T06:06:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30ed845640 1 -- start start 2024-09-19T06:06:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30ed845640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e8100a80 0x7f30e81971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30ed845640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30e8101420 0x7f30e8197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30ed845640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e8106a80 0x7f30e819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30ed845640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8110d30 con 0x7f30e8106a80 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30ed845640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8110bb0 con 0x7f30e8101420 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30ed845640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8110eb0 con 0x7f30e8100a80 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e8106a80 0x7f30e819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e8106a80 0x7f30e819baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59734/0 (socket says 172.21.15.103:59734) 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30e77fe640 1 -- 172.21.15.103:0/1287714408 learned_addr learned my addr 172.21.15.103:0/1287714408 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30e67fc640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30e8101420 0x7f30e8197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.513+0000 7f30e6ffd640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e8100a80 0x7f30e81971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30e6ffd640 1 -- 172.21.15.103:0/1287714408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30e8101420 msgr2=0x7f30e8197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30e6ffd640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30e8101420 0x7f30e8197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30e6ffd640 1 -- 172.21.15.103:0/1287714408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e8106a80 msgr2=0x7f30e819baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30e6ffd640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e8106a80 0x7f30e819baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30e6ffd640 1 -- 172.21.15.103:0/1287714408 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e819c180 con 0x7f30e8100a80 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30e77fe640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e8106a80 0x7f30e819baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30e6ffd640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e8100a80 0x7f30e81971d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f30e000cce0 tx=0x7f30e000a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30ec843640 1 -- 172.21.15.103:0/1287714408 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e000f450 con 0x7f30e8100a80 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e819c470 con 0x7f30e8100a80 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30ec843640 1 -- 172.21.15.103:0/1287714408 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30e000faa0 con 0x7f30e8100a80 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30ec843640 1 -- 172.21.15.103:0/1287714408 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e0018a60 con 0x7f30e8100a80 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.514+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e81a3d50 con 0x7f30e8100a80 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.515+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30e8062980 con 0x7f30e8100a80 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.516+0000 7f30ec843640 1 -- 172.21.15.103:0/1287714408 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f30e0018c00 con 0x7f30e8100a80 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.517+0000 7f30ec843640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30d00a32d0 0x7f30d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.517+0000 7f30e67fc640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30d00a32d0 0x7f30d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:13.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.517+0000 7f30ec843640 1 -- 172.21.15.103:0/1287714408 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f30e00d0030 con 0x7f30e8100a80 2024-09-19T06:06:13.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.517+0000 7f30ec843640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] conn(0x7f30d00ace00 0x7f30d00af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:13.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.517+0000 7f30ec843640 1 -- 172.21.15.103:0/1287714408 --> [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30e0015e70 con 0x7f30d00ace00 2024-09-19T06:06:13.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.517+0000 7f30ec843640 1 -- 172.21.15.103:0/1287714408 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f30e00d0480 con 0x7f30e8100a80 2024-09-19T06:06:13.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.517+0000 7f30e67fc640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30d00a32d0 0x7f30d00a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f30e80fed70 tx=0x7f30dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:13.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.518+0000 7f30e77fe640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] conn(0x7f30d00ace00 0x7f30d00af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:13.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.518+0000 7f30e77fe640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] conn(0x7f30d00ace00 0x7f30d00af2a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:13.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.519+0000 7f30ec843640 1 -- 172.21.15.103:0/1287714408 <== osd.11 v2:172.21.15.174:6824/1501737377 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f30e0015e70 con 0x7f30d00ace00 2024-09-19T06:06:13.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.532+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 --> [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f30e8062d80 con 0x7f30d00ace00 2024-09-19T06:06:13.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ec843640 1 -- 172.21.15.103:0/1287714408 <== osd.11 v2:172.21.15.174:6824/1501737377 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f30e8062d80 con 0x7f30d00ace00 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 >> [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] conn(0x7f30d00ace00 msgr2=0x7f30d00af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ed845640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] conn(0x7f30d00ace00 0x7f30d00af2a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30d00a32d0 msgr2=0x7f30d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ed845640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f30d00a32d0 0x7f30d00a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f30e80fed70 tx=0x7f30dc005f90 comp rx=0 tx=0).stop 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e8100a80 msgr2=0x7f30e81971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ed845640 1 --2- 172.21.15.103:0/1287714408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e8100a80 0x7f30e81971d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f30e000cce0 tx=0x7f30e000a620 comp rx=0 tx=0).stop 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30e77fe640 1 -- 172.21.15.103:0/1287714408 reap_dead start 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 shutdown_connections 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 >> 172.21.15.103:0/1287714408 conn(0x7f30e80fc7a0 msgr2=0x7f30e80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 shutdown_connections 2024-09-19T06:06:13.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:13.533+0000 7f30ed845640 1 -- 172.21.15.103:0/1287714408 wait complete. 2024-09-19T06:06:14.398 INFO:teuthology.orchestra.run.smithi103.stdout:257698037792 2024-09-19T06:06:14.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T06:06:14.869 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:14 smithi103 ceph-mon[30925]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:06:14.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:14 smithi174 ceph-mon[34488]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:06:15.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:14 smithi169 ceph-mon[34350]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:06:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.246+0000 7fa571588640 1 -- 172.21.15.103:0/2468600260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c1036e0 msgr2=0x7fa56c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.246+0000 7fa571588640 1 --2- 172.21.15.103:0/2468600260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c1036e0 0x7fa56c107b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa560009930 tx=0x7fa56002a420 comp rx=0 tx=0).stop 2024-09-19T06:06:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.247+0000 7fa571588640 1 -- 172.21.15.103:0/2468600260 shutdown_connections 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.247+0000 7fa571588640 1 --2- 172.21.15.103:0/2468600260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa56c1082a0 0x7fa56c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.247+0000 7fa571588640 1 --2- 172.21.15.103:0/2468600260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c1036e0 0x7fa56c107b90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.247+0000 7fa571588640 1 --2- 172.21.15.103:0/2468600260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa56c102d30 0x7fa56c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.247+0000 7fa571588640 1 -- 172.21.15.103:0/2468600260 >> 172.21.15.103:0/2468600260 conn(0x7fa56c0fc7d0 msgr2=0x7fa56c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.247+0000 7fa571588640 1 -- 172.21.15.103:0/2468600260 shutdown_connections 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.247+0000 7fa571588640 1 -- 172.21.15.103:0/2468600260 wait complete. 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.247+0000 7fa571588640 1 Processor -- start 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa571588640 1 -- start start 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa571588640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa56c102d30 0x7fa56c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa571588640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c1036e0 0x7fa56c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa571588640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa56c1082a0 0x7fa56c19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa571588640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c111f70 con 0x7fa56c1036e0 2024-09-19T06:06:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa571588640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c111df0 con 0x7fa56c1082a0 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa571588640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1120f0 con 0x7fa56c102d30 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c1036e0 0x7fa56c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c1036e0 0x7fa56c198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59758/0 (socket says 172.21.15.103:59758) 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56a7fc640 1 -- 172.21.15.103:0/422755690 learned_addr learned my addr 172.21.15.103:0/422755690 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56b7fe640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa56c1082a0 0x7fa56c19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56affd640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa56c102d30 0x7fa56c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56a7fc640 1 -- 172.21.15.103:0/422755690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa56c102d30 msgr2=0x7fa56c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56a7fc640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa56c102d30 0x7fa56c198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56a7fc640 1 -- 172.21.15.103:0/422755690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa56c1082a0 msgr2=0x7fa56c19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56a7fc640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa56c1082a0 0x7fa56c19ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56a7fc640 1 -- 172.21.15.103:0/422755690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c19d520 con 0x7fa56c1036e0 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56affd640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa56c102d30 0x7fa56c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:15.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa56a7fc640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c1036e0 0x7fa56c198ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa560009230 tx=0x7fa560004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.248+0000 7fa553fff640 1 -- 172.21.15.103:0/422755690 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56003f030 con 0x7fa56c1036e0 2024-09-19T06:06:15.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.249+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c19d7b0 con 0x7fa56c1036e0 2024-09-19T06:06:15.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.249+0000 7fa553fff640 1 -- 172.21.15.103:0/422755690 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5600035f0 con 0x7fa56c1036e0 2024-09-19T06:06:15.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.249+0000 7fa553fff640 1 -- 172.21.15.103:0/422755690 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560035070 con 0x7fa56c1036e0 2024-09-19T06:06:15.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.249+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c1a50f0 con 0x7fa56c1036e0 2024-09-19T06:06:15.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.249+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa56c062980 con 0x7fa56c1036e0 2024-09-19T06:06:15.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.251+0000 7fa553fff640 1 -- 172.21.15.103:0/422755690 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fa560003aa0 con 0x7fa56c1036e0 2024-09-19T06:06:15.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.251+0000 7fa553fff640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa5540a32d0 0x7fa5540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.251+0000 7fa56affd640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa5540a32d0 0x7fa5540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.252+0000 7fa553fff640 1 -- 172.21.15.103:0/422755690 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fa5600f0a50 con 0x7fa56c1036e0 2024-09-19T06:06:15.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.252+0000 7fa553fff640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] conn(0x7fa5540ace00 0x7fa5540af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.252+0000 7fa553fff640 1 -- 172.21.15.103:0/422755690 --> [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5540af970 con 0x7fa5540ace00 2024-09-19T06:06:15.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.252+0000 7fa553fff640 1 -- 172.21.15.103:0/422755690 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fa5600f0ea0 con 0x7fa56c1036e0 2024-09-19T06:06:15.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.252+0000 7fa56b7fe640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] conn(0x7fa5540ace00 0x7fa5540af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.252+0000 7fa56affd640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa5540a32d0 0x7fa5540a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa55c005c40 tx=0x7fa55c0082f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.252+0000 7fa56b7fe640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] conn(0x7fa5540ace00 0x7fa5540af2a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.253+0000 7fa553fff640 1 -- 172.21.15.103:0/422755690 <== osd.6 v2:172.21.15.103:6818/2136065370 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5540af970 con 0x7fa5540ace00 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.266+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 --> [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa56c062d80 con 0x7fa5540ace00 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.266+0000 7fa553fff640 1 -- 172.21.15.103:0/422755690 <== osd.6 v2:172.21.15.103:6818/2136065370 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa56c062d80 con 0x7fa5540ace00 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.266+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] conn(0x7fa5540ace00 msgr2=0x7fa5540af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.267+0000 7fa571588640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] conn(0x7fa5540ace00 0x7fa5540af2a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.267+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa5540a32d0 msgr2=0x7fa5540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.267+0000 7fa571588640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa5540a32d0 0x7fa5540a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa55c005c40 tx=0x7fa55c0082f0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.267+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c1036e0 msgr2=0x7fa56c198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.267+0000 7fa571588640 1 --2- 172.21.15.103:0/422755690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c1036e0 0x7fa56c198ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa560009230 tx=0x7fa560004270 comp rx=0 tx=0).stop 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.267+0000 7fa56b7fe640 1 -- 172.21.15.103:0/422755690 reap_dead start 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.267+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 shutdown_connections 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.267+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 >> 172.21.15.103:0/422755690 conn(0x7fa56c0fc7d0 msgr2=0x7fa56c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.267+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 shutdown_connections 2024-09-19T06:06:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.267+0000 7fa571588640 1 -- 172.21.15.103:0/422755690 wait complete. 2024-09-19T06:06:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.676+0000 7f827f4f1640 1 -- 172.21.15.103:0/3908112481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e480 msgr2=0x7f8278110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.676+0000 7f827f4f1640 1 --2- 172.21.15.103:0/3908112481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e480 0x7f8278110870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8268009ca0 tx=0x7f826802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.676+0000 7f827f4f1640 1 -- 172.21.15.103:0/3908112481 shutdown_connections 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.676+0000 7f827f4f1640 1 --2- 172.21.15.103:0/3908112481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e480 0x7f8278110870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.676+0000 7f827f4f1640 1 --2- 172.21.15.103:0/3908112481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8278101280 0x7f827810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.676+0000 7f827f4f1640 1 --2- 172.21.15.103:0/3908112481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82781008d0 0x7f8278100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.676+0000 7f827f4f1640 1 -- 172.21.15.103:0/3908112481 >> 172.21.15.103:0/3908112481 conn(0x7f82780fc7a0 msgr2=0x7f82780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.676+0000 7f827f4f1640 1 -- 172.21.15.103:0/3908112481 shutdown_connections 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.676+0000 7f827f4f1640 1 -- 172.21.15.103:0/3908112481 wait complete. 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827f4f1640 1 Processor -- start 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827f4f1640 1 -- start start 2024-09-19T06:06:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827f4f1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82781008d0 0x7f827819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827f4f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278101280 0x7f827819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827f4f1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e480 0x7f827819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827f4f1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8278114010 con 0x7f827810e480 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827f4f1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8278113e90 con 0x7f8278101280 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827f4f1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8278114190 con 0x7f82781008d0 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827da8e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e480 0x7f827819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827da8e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e480 0x7f827819ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59776/0 (socket says 172.21.15.103:59776) 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827da8e640 1 -- 172.21.15.103:0/768830041 learned_addr learned my addr 172.21.15.103:0/768830041 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827d28d640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82781008d0 0x7f827819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827ca8c640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278101280 0x7f827819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827da8e640 1 -- 172.21.15.103:0/768830041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82781008d0 msgr2=0x7f827819a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827da8e640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82781008d0 0x7f827819a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827da8e640 1 -- 172.21.15.103:0/768830041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278101280 msgr2=0x7f827819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827da8e640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278101280 0x7f827819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827da8e640 1 -- 172.21.15.103:0/768830041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827819f520 con 0x7f827810e480 2024-09-19T06:06:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827ca8c640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278101280 0x7f827819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.677+0000 7f827da8e640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e480 0x7f827819ee40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8268004af0 tx=0x7f8268032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.678+0000 7f82767fc640 1 -- 172.21.15.103:0/768830041 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268003d30 con 0x7f827810e480 2024-09-19T06:06:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.678+0000 7f82767fc640 1 -- 172.21.15.103:0/768830041 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82680044f0 con 0x7f827810e480 2024-09-19T06:06:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.678+0000 7f82767fc640 1 -- 172.21.15.103:0/768830041 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268030c60 con 0x7f827810e480 2024-09-19T06:06:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.678+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827819f7b0 con 0x7f827810e480 2024-09-19T06:06:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.678+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82781a70f0 con 0x7f827810e480 2024-09-19T06:06:15.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.679+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8278062980 con 0x7f827810e480 2024-09-19T06:06:15.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.680+0000 7f82767fc640 1 -- 172.21.15.103:0/768830041 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f82680046a0 con 0x7f827810e480 2024-09-19T06:06:15.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.681+0000 7f82767fc640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f82600a32d0 0x7f82600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.681+0000 7f827d28d640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f82600a32d0 0x7f82600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.681+0000 7f82767fc640 1 -- 172.21.15.103:0/768830041 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f82680f1290 con 0x7f827810e480 2024-09-19T06:06:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.681+0000 7f82767fc640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] conn(0x7f82600ace00 0x7f82600af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.681+0000 7f82767fc640 1 -- 172.21.15.103:0/768830041 --> [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f826803ce50 con 0x7f82600ace00 2024-09-19T06:06:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.681+0000 7f82767fc640 1 -- 172.21.15.103:0/768830041 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f82680f1640 con 0x7f827810e480 2024-09-19T06:06:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.681+0000 7f827d28d640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f82600a32d0 0x7f82600a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f827000bbe0 tx=0x7f827000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.681+0000 7f827ca8c640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] conn(0x7f82600ace00 0x7f82600af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.682+0000 7f827ca8c640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] conn(0x7f82600ace00 0x7f82600af2a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.682+0000 7f82767fc640 1 -- 172.21.15.103:0/768830041 <== osd.1 v2:172.21.15.169:6800/528006707 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f826803ce50 con 0x7f82600ace00 2024-09-19T06:06:15.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.696+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 --> [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8278062e00 con 0x7f82600ace00 2024-09-19T06:06:15.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f82767fc640 1 -- 172.21.15.103:0/768830041 <== osd.1 v2:172.21.15.169:6800/528006707 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8278062e00 con 0x7f82600ace00 2024-09-19T06:06:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 >> [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] conn(0x7f82600ace00 msgr2=0x7f82600af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827f4f1640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] conn(0x7f82600ace00 0x7f82600af2a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f82600a32d0 msgr2=0x7f82600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827f4f1640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f82600a32d0 0x7f82600a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f827000bbe0 tx=0x7f827000b390 comp rx=0 tx=0).stop 2024-09-19T06:06:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e480 msgr2=0x7f827819ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827f4f1640 1 --2- 172.21.15.103:0/768830041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e480 0x7f827819ee40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8268004af0 tx=0x7f8268032ff0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827da8e640 1 -- 172.21.15.103:0/768830041 reap_dead start 2024-09-19T06:06:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 shutdown_connections 2024-09-19T06:06:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 >> 172.21.15.103:0/768830041 conn(0x7f82780fc7a0 msgr2=0x7f82780feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 shutdown_connections 2024-09-19T06:06:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:15.697+0000 7f827f4f1640 1 -- 172.21.15.103:0/768830041 wait complete. 2024-09-19T06:06:16.393 INFO:teuthology.orchestra.run.smithi103.stdout:55834574920 2024-09-19T06:06:16.393 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T06:06:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.596+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/1860784807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d58102790 msgr2=0x7f9d581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.596+0000 7f9d5ef4f640 1 --2- 172.21.15.103:0/1860784807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d58102790 0x7f9d581067e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009900 tx=0x7f9d4402a410 comp rx=0 tx=0).stop 2024-09-19T06:06:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.596+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/1860784807 shutdown_connections 2024-09-19T06:06:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.596+0000 7f9d5ef4f640 1 --2- 172.21.15.103:0/1860784807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d58106f10 0x7f9d5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.596+0000 7f9d5ef4f640 1 --2- 172.21.15.103:0/1860784807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d58102790 0x7f9d581067e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.596+0000 7f9d5ef4f640 1 --2- 172.21.15.103:0/1860784807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d58101de0 0x7f9d581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.596+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/1860784807 >> 172.21.15.103:0/1860784807 conn(0x7f9d580fd8c0 msgr2=0x7f9d580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.596+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/1860784807 shutdown_connections 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.596+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/1860784807 wait complete. 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.596+0000 7f9d5ef4f640 1 Processor -- start 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d5ef4f640 1 -- start start 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d5ef4f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d58101de0 0x7f9d580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d5ef4f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d58102790 0x7f9d58074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d5ef4f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d58106f10 0x7f9d58074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d5ef4f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9d58111e20 con 0x7f9d58102790 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d5ef4f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9d58111ca0 con 0x7f9d58106f10 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d5ef4f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9d58111fa0 con 0x7f9d58101de0 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d57fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d58102790 0x7f9d58074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d57fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d58102790 0x7f9d58074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59788/0 (socket says 172.21.15.103:59788) 2024-09-19T06:06:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d57fff640 1 -- 172.21.15.103:0/2255680776 learned_addr learned my addr 172.21.15.103:0/2255680776 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:16.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d5cceb640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d58101de0 0x7f9d580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:16.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d5d4ec640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d58106f10 0x7f9d58074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:16.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d57fff640 1 -- 172.21.15.103:0/2255680776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d58101de0 msgr2=0x7f9d580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d57fff640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d58101de0 0x7f9d580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d57fff640 1 -- 172.21.15.103:0/2255680776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d58106f10 msgr2=0x7f9d58074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d57fff640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d58106f10 0x7f9d58074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d57fff640 1 -- 172.21.15.103:0/2255680776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d581a6880 con 0x7f9d58102790 2024-09-19T06:06:16.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d5d4ec640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d58106f10 0x7f9d58074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:16.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.597+0000 7f9d57fff640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d58102790 0x7f9d58074a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9d44005940 tx=0x7f9d44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:16.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.598+0000 7f9d55ffb640 1 -- 172.21.15.103:0/2255680776 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4403f030 con 0x7f9d58102790 2024-09-19T06:06:16.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.598+0000 7f9d55ffb640 1 -- 172.21.15.103:0/2255680776 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d44003aa0 con 0x7f9d58102790 2024-09-19T06:06:16.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.598+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d581a6b10 con 0x7f9d58102790 2024-09-19T06:06:16.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.598+0000 7f9d55ffb640 1 -- 172.21.15.103:0/2255680776 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44035070 con 0x7f9d58102790 2024-09-19T06:06:16.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.598+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d581a6ff0 con 0x7f9d58102790 2024-09-19T06:06:16.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.599+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d58062900 con 0x7f9d58102790 2024-09-19T06:06:16.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.600+0000 7f9d55ffb640 1 -- 172.21.15.103:0/2255680776 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9d44042030 con 0x7f9d58102790 2024-09-19T06:06:16.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.600+0000 7f9d55ffb640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9d480a32d0 0x7f9d480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:16.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.601+0000 7f9d5cceb640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9d480a32d0 0x7f9d480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.601+0000 7f9d55ffb640 1 -- 172.21.15.103:0/2255680776 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f9d440f0970 con 0x7f9d58102790 2024-09-19T06:06:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.601+0000 7f9d55ffb640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] conn(0x7f9d480ace00 0x7f9d480af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.601+0000 7f9d55ffb640 1 -- 172.21.15.103:0/2255680776 --> [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d480af970 con 0x7f9d480ace00 2024-09-19T06:06:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.601+0000 7f9d55ffb640 1 -- 172.21.15.103:0/2255680776 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f9d440f0dc0 con 0x7f9d58102790 2024-09-19T06:06:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.601+0000 7f9d5d4ec640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] conn(0x7f9d480ace00 0x7f9d480af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.601+0000 7f9d5cceb640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9d480a32d0 0x7f9d480a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c005fd0 tx=0x7f9d4c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.601+0000 7f9d5d4ec640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] conn(0x7f9d480ace00 0x7f9d480af2a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.602+0000 7f9d55ffb640 1 -- 172.21.15.103:0/2255680776 <== osd.3 v2:172.21.15.103:6810/1485292164 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d480af970 con 0x7f9d480ace00 2024-09-19T06:06:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.615+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 --> [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9d58062d80 con 0x7f9d480ace00 2024-09-19T06:06:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.616+0000 7f9d55ffb640 1 -- 172.21.15.103:0/2255680776 <== osd.3 v2:172.21.15.103:6810/1485292164 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9d58062d80 con 0x7f9d480ace00 2024-09-19T06:06:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.616+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] conn(0x7f9d480ace00 msgr2=0x7f9d480af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.616+0000 7f9d5ef4f640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] conn(0x7f9d480ace00 0x7f9d480af2a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.616+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9d480a32d0 msgr2=0x7f9d480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.616+0000 7f9d5ef4f640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f9d480a32d0 0x7f9d480a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c005fd0 tx=0x7f9d4c005850 comp rx=0 tx=0).stop 2024-09-19T06:06:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.616+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d58102790 msgr2=0x7f9d58074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.616+0000 7f9d5ef4f640 1 --2- 172.21.15.103:0/2255680776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d58102790 0x7f9d58074a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9d44005940 tx=0x7f9d44004270 comp rx=0 tx=0).stop 2024-09-19T06:06:16.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.616+0000 7f9d5d4ec640 1 -- 172.21.15.103:0/2255680776 reap_dead start 2024-09-19T06:06:16.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.616+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 shutdown_connections 2024-09-19T06:06:16.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.616+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 >> 172.21.15.103:0/2255680776 conn(0x7f9d580fd8c0 msgr2=0x7f9d580fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:16.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.617+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 shutdown_connections 2024-09-19T06:06:16.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:16.617+0000 7f9d5ef4f640 1 -- 172.21.15.103:0/2255680776 wait complete. 2024-09-19T06:06:16.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:16 smithi174 ceph-mon[34488]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T06:06:16.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:16 smithi103 ceph-mon[30925]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T06:06:17.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:16 smithi169 ceph-mon[34350]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T06:06:17.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.208+0000 7f3bda098640 1 -- 172.21.15.103:0/3830241863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd4106a80 msgr2=0x7f3bd4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.208+0000 7f3bda098640 1 --2- 172.21.15.103:0/3830241863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd4106a80 0x7f3bd4106e60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009cd0 tx=0x7f3bc402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.208+0000 7f3bda098640 1 -- 172.21.15.103:0/3830241863 shutdown_connections 2024-09-19T06:06:17.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.208+0000 7f3bda098640 1 --2- 172.21.15.103:0/3830241863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bd4101420 0x7f3bd410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.208+0000 7f3bda098640 1 --2- 172.21.15.103:0/3830241863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bd4100a80 0x7f3bd4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.208+0000 7f3bda098640 1 --2- 172.21.15.103:0/3830241863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd4106a80 0x7f3bd4106e60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.208+0000 7f3bda098640 1 -- 172.21.15.103:0/3830241863 >> 172.21.15.103:0/3830241863 conn(0x7f3bd40fc7a0 msgr2=0x7f3bd40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:17.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.208+0000 7f3bda098640 1 -- 172.21.15.103:0/3830241863 shutdown_connections 2024-09-19T06:06:17.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.208+0000 7f3bda098640 1 -- 172.21.15.103:0/3830241863 wait complete. 2024-09-19T06:06:17.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.209+0000 7f3bda098640 1 Processor -- start 2024-09-19T06:06:17.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.209+0000 7f3bda098640 1 -- start start 2024-09-19T06:06:17.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.209+0000 7f3bda098640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd4100a80 0x7f3bd4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.209+0000 7f3bda098640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bd4101420 0x7f3bd4198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.209+0000 7f3bda098640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bd4106a80 0x7f3bd419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.209+0000 7f3bda098640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4110d30 con 0x7f3bd4100a80 2024-09-19T06:06:17.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.209+0000 7f3bda098640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4110bb0 con 0x7f3bd4106a80 2024-09-19T06:06:17.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.209+0000 7f3bda098640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4110eb0 con 0x7f3bd4101420 2024-09-19T06:06:17.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.209+0000 7f3bd37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd4100a80 0x7f3bd4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd4100a80 0x7f3bd4198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59812/0 (socket says 172.21.15.103:59812) 2024-09-19T06:06:17.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd37fe640 1 -- 172.21.15.103:0/1905535606 learned_addr learned my addr 172.21.15.103:0/1905535606 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:17.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd2ffd640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bd4101420 0x7f3bd4198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd3fff640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bd4106a80 0x7f3bd419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd37fe640 1 -- 172.21.15.103:0/1905535606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bd4101420 msgr2=0x7f3bd4198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd37fe640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bd4101420 0x7f3bd4198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd37fe640 1 -- 172.21.15.103:0/1905535606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bd4106a80 msgr2=0x7f3bd419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd37fe640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bd4106a80 0x7f3bd419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd37fe640 1 -- 172.21.15.103:0/1905535606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd419d2b0 con 0x7f3bd4100a80 2024-09-19T06:06:17.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd37fe640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd4100a80 0x7f3bd4198300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4006010 tx=0x7f3bc4003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:17.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd0ff9640 1 -- 172.21.15.103:0/1905535606 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4004450 con 0x7f3bd4100a80 2024-09-19T06:06:17.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd419d540 con 0x7f3bd4100a80 2024-09-19T06:06:17.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd0ff9640 1 -- 172.21.15.103:0/1905535606 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3bc40045f0 con 0x7f3bd4100a80 2024-09-19T06:06:17.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bd0ff9640 1 -- 172.21.15.103:0/1905535606 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40466e0 con 0x7f3bd4100a80 2024-09-19T06:06:17.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.210+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd41a4e80 con 0x7f3bd4100a80 2024-09-19T06:06:17.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.211+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3bd406aae0 con 0x7f3bd4100a80 2024-09-19T06:06:17.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.212+0000 7f3bd0ff9640 1 -- 172.21.15.103:0/1905535606 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f3bc4046880 con 0x7f3bd4100a80 2024-09-19T06:06:17.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.213+0000 7f3bd0ff9640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3bbc0a32d0 0x7f3bbc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.213+0000 7f3bd2ffd640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3bbc0a32d0 0x7f3bbc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.213+0000 7f3bd0ff9640 1 -- 172.21.15.103:0/1905535606 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3bc402e030 con 0x7f3bd4100a80 2024-09-19T06:06:17.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.213+0000 7f3bd0ff9640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] conn(0x7f3bbc0ace00 0x7f3bbc0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.213+0000 7f3bd0ff9640 1 -- 172.21.15.103:0/1905535606 --> [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bbc0af970 con 0x7f3bbc0ace00 2024-09-19T06:06:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.213+0000 7f3bd0ff9640 1 -- 172.21.15.103:0/1905535606 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f3bc40f1970 con 0x7f3bd4100a80 2024-09-19T06:06:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.214+0000 7f3bd3fff640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] conn(0x7f3bbc0ace00 0x7f3bbc0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.214+0000 7f3bd2ffd640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3bbc0a32d0 0x7f3bbc0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3bd406b870 tx=0x7f3bc800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.214+0000 7f3bd3fff640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] conn(0x7f3bbc0ace00 0x7f3bbc0af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.214+0000 7f3bd0ff9640 1 -- 172.21.15.103:0/1905535606 <== osd.0 v2:172.21.15.103:6802/123668985 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3bbc0af970 con 0x7f3bbc0ace00 2024-09-19T06:06:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.228+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 --> [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3bd41021c0 con 0x7f3bbc0ace00 2024-09-19T06:06:17.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.228+0000 7f3bd0ff9640 1 -- 172.21.15.103:0/1905535606 <== osd.0 v2:172.21.15.103:6802/123668985 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3bd41021c0 con 0x7f3bbc0ace00 2024-09-19T06:06:17.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.228+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] conn(0x7f3bbc0ace00 msgr2=0x7f3bbc0af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.228+0000 7f3bda098640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] conn(0x7f3bbc0ace00 0x7f3bbc0af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.228+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3bbc0a32d0 msgr2=0x7f3bbc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.228+0000 7f3bda098640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3bbc0a32d0 0x7f3bbc0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3bd406b870 tx=0x7f3bc800a4c0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.228+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd4100a80 msgr2=0x7f3bd4198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.228+0000 7f3bda098640 1 --2- 172.21.15.103:0/1905535606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd4100a80 0x7f3bd4198300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4006010 tx=0x7f3bc4003c70 comp rx=0 tx=0).stop 2024-09-19T06:06:17.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.229+0000 7f3bd3fff640 1 -- 172.21.15.103:0/1905535606 reap_dead start 2024-09-19T06:06:17.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.229+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 shutdown_connections 2024-09-19T06:06:17.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.229+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 >> 172.21.15.103:0/1905535606 conn(0x7f3bd40fc7a0 msgr2=0x7f3bd4104ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:17.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.229+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 shutdown_connections 2024-09-19T06:06:17.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:17.229+0000 7f3bda098640 1 -- 172.21.15.103:0/1905535606 wait complete. 2024-09-19T06:06:18.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.056+0000 7f23b95c0640 1 -- 172.21.15.103:0/2900361430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23b4102d30 msgr2=0x7f23b4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:18.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.056+0000 7f23b95c0640 1 --2- 172.21.15.103:0/2900361430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23b4102d30 0x7f23b4103110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009930 tx=0x7f23a402a440 comp rx=0 tx=0).stop 2024-09-19T06:06:18.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.056+0000 7f23b95c0640 1 -- 172.21.15.103:0/2900361430 shutdown_connections 2024-09-19T06:06:18.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.056+0000 7f23b95c0640 1 --2- 172.21.15.103:0/2900361430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23b41082a0 0x7f23b410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.056+0000 7f23b95c0640 1 --2- 172.21.15.103:0/2900361430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23b41036e0 0x7f23b4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.056+0000 7f23b95c0640 1 --2- 172.21.15.103:0/2900361430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23b4102d30 0x7f23b4103110 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.056+0000 7f23b95c0640 1 -- 172.21.15.103:0/2900361430 >> 172.21.15.103:0/2900361430 conn(0x7f23b40fc7d0 msgr2=0x7f23b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:18.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.056+0000 7f23b95c0640 1 -- 172.21.15.103:0/2900361430 shutdown_connections 2024-09-19T06:06:18.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.056+0000 7f23b95c0640 1 -- 172.21.15.103:0/2900361430 wait complete. 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b95c0640 1 Processor -- start 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b95c0640 1 -- start start 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b95c0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23b4102d30 0x7f23b4198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b95c0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23b41036e0 0x7f23b4198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b95c0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23b41082a0 0x7f23b419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b95c0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f23b4112010 con 0x7f23b4102d30 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b95c0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f23b4111e90 con 0x7f23b41082a0 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b95c0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f23b4112190 con 0x7f23b41036e0 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23b4102d30 0x7f23b4198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23b4102d30 0x7f23b4198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59824/0 (socket says 172.21.15.103:59824) 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.057+0000 7f23b2ffd640 1 -- 172.21.15.103:0/994537217 learned_addr learned my addr 172.21.15.103:0/994537217 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:18.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b27fc640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23b41036e0 0x7f23b4198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b37fe640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23b41082a0 0x7f23b419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b2ffd640 1 -- 172.21.15.103:0/994537217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23b41036e0 msgr2=0x7f23b4198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b2ffd640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23b41036e0 0x7f23b4198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b2ffd640 1 -- 172.21.15.103:0/994537217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23b41082a0 msgr2=0x7f23b419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b2ffd640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23b41082a0 0x7f23b419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b2ffd640 1 -- 172.21.15.103:0/994537217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b419d5e0 con 0x7f23b4102d30 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b37fe640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23b41082a0 0x7f23b419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b2ffd640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23b4102d30 0x7f23b4198630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f23a4005940 tx=0x7f23a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f239bfff640 1 -- 172.21.15.103:0/994537217 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a403f030 con 0x7f23b4102d30 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b419d870 con 0x7f23b4102d30 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f239bfff640 1 -- 172.21.15.103:0/994537217 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23a4003cb0 con 0x7f23b4102d30 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f239bfff640 1 -- 172.21.15.103:0/994537217 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4035070 con 0x7f23b4102d30 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.058+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b41a51b0 con 0x7f23b4102d30 2024-09-19T06:06:18.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.059+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23b4062980 con 0x7f23b4102d30 2024-09-19T06:06:18.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.060+0000 7f239bfff640 1 -- 172.21.15.103:0/994537217 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f23a4042030 con 0x7f23b4102d30 2024-09-19T06:06:18.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.061+0000 7f239bfff640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f239c0a32d0 0x7f239c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:18.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.061+0000 7f23b27fc640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f239c0a32d0 0x7f239c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:18.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.061+0000 7f239bfff640 1 -- 172.21.15.103:0/994537217 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f23a40f06b0 con 0x7f23b4102d30 2024-09-19T06:06:18.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.061+0000 7f239bfff640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] conn(0x7f239c0accd0 0x7f239c0af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:18.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.061+0000 7f239bfff640 1 -- 172.21.15.103:0/994537217 --> [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23a4001d30 con 0x7f239c0accd0 2024-09-19T06:06:18.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.061+0000 7f239bfff640 1 -- 172.21.15.103:0/994537217 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f23a40f0b00 con 0x7f23b4102d30 2024-09-19T06:06:18.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.061+0000 7f23b27fc640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f239c0a32d0 0x7f239c0a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23b40fef10 tx=0x7f23a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:18.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.062+0000 7f23b37fe640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] conn(0x7f239c0accd0 0x7f239c0af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:18.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.062+0000 7f23b37fe640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] conn(0x7f239c0accd0 0x7f239c0af170 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:18.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.063+0000 7f239bfff640 1 -- 172.21.15.103:0/994537217 <== osd.8 v2:172.21.15.174:6816/1949689360 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f23a4001d30 con 0x7f239c0accd0 2024-09-19T06:06:18.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.079+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 --> [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f23b4062d80 con 0x7f239c0accd0 2024-09-19T06:06:18.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.079+0000 7f239bfff640 1 -- 172.21.15.103:0/994537217 <== osd.8 v2:172.21.15.174:6816/1949689360 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f23b4062d80 con 0x7f239c0accd0 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 >> [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] conn(0x7f239c0accd0 msgr2=0x7f239c0af170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b95c0640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] conn(0x7f239c0accd0 0x7f239c0af170 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f239c0a32d0 msgr2=0x7f239c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b95c0640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f239c0a32d0 0x7f239c0a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23b40fef10 tx=0x7f23a8008040 comp rx=0 tx=0).stop 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23b4102d30 msgr2=0x7f23b4198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b95c0640 1 --2- 172.21.15.103:0/994537217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23b4102d30 0x7f23b4198630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f23a4005940 tx=0x7f23a40042f0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b37fe640 1 -- 172.21.15.103:0/994537217 reap_dead start 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 shutdown_connections 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 >> 172.21.15.103:0/994537217 conn(0x7f23b40fc7d0 msgr2=0x7f23b4105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 shutdown_connections 2024-09-19T06:06:18.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:18.080+0000 7f23b95c0640 1 -- 172.21.15.103:0/994537217 wait complete. 2024-09-19T06:06:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:309237645335 2024-09-19T06:06:18.534 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T06:06:18.836 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:18 smithi103 ceph-mon[30925]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-09-19T06:06:18.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:18 smithi174 ceph-mon[34488]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-09-19T06:06:19.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:18 smithi169 ceph-mon[34350]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-09-19T06:06:19.180 INFO:teuthology.orchestra.run.smithi103.stdout:227633266726 2024-09-19T06:06:19.180 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T06:06:19.422 INFO:teuthology.orchestra.run.smithi103.stdout:34359738445 2024-09-19T06:06:19.422 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.590+0000 7f0e99493640 1 -- 172.21.15.103:0/1482421257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e94074e30 msgr2=0x7f0e9410df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.590+0000 7f0e99493640 1 --2- 172.21.15.103:0/1482421257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e94074e30 0x7f0e9410df00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c009900 tx=0x7f0e7c02a480 comp rx=0 tx=0).stop 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.590+0000 7f0e99493640 1 -- 172.21.15.103:0/1482421257 shutdown_connections 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.590+0000 7f0e99493640 1 --2- 172.21.15.103:0/1482421257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e9410e440 0x7f0e94110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.590+0000 7f0e99493640 1 --2- 172.21.15.103:0/1482421257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e94074e30 0x7f0e9410df00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.590+0000 7f0e99493640 1 --2- 172.21.15.103:0/1482421257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e94074510 0x7f0e940748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.590+0000 7f0e99493640 1 -- 172.21.15.103:0/1482421257 >> 172.21.15.103:0/1482421257 conn(0x7f0e940fd8c0 msgr2=0x7f0e940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.590+0000 7f0e99493640 1 -- 172.21.15.103:0/1482421257 shutdown_connections 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.590+0000 7f0e99493640 1 -- 172.21.15.103:0/1482421257 wait complete. 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.590+0000 7f0e99493640 1 Processor -- start 2024-09-19T06:06:19.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e99493640 1 -- start start 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e99493640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e94074510 0x7f0e9419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e99493640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e94074e30 0x7f0e9419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e99493640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e9410e440 0x7f0e9419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e99493640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e94114010 con 0x7f0e94074510 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e99493640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0e94113e90 con 0x7f0e94074e30 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e99493640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0e94114190 con 0x7f0e9410e440 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e92ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e94074510 0x7f0e9419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e92ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e94074510 0x7f0e9419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59844/0 (socket says 172.21.15.103:59844) 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e92ffd640 1 -- 172.21.15.103:0/408389820 learned_addr learned my addr 172.21.15.103:0/408389820 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e937fe640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e9410e440 0x7f0e9419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e927fc640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e94074e30 0x7f0e9419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e92ffd640 1 -- 172.21.15.103:0/408389820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e9410e440 msgr2=0x7f0e9419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e92ffd640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e9410e440 0x7f0e9419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e92ffd640 1 -- 172.21.15.103:0/408389820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e94074e30 msgr2=0x7f0e9419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e92ffd640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e94074e30 0x7f0e9419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.591+0000 7f0e92ffd640 1 -- 172.21.15.103:0/408389820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9419f570 con 0x7f0e94074510 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.592+0000 7f0e92ffd640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e94074510 0x7f0e9419a5c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400d950 tx=0x7f0e8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.592+0000 7f0e8bfff640 1 -- 172.21.15.103:0/408389820 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84017070 con 0x7f0e94074510 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.592+0000 7f0e8bfff640 1 -- 172.21.15.103:0/408389820 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e84009c30 con 0x7f0e94074510 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.592+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9419f860 con 0x7f0e94074510 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.592+0000 7f0e8bfff640 1 -- 172.21.15.103:0/408389820 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400f620 con 0x7f0e94074510 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.592+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e941a7140 con 0x7f0e94074510 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.593+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e94062980 con 0x7f0e94074510 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.595+0000 7f0e8bfff640 1 -- 172.21.15.103:0/408389820 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0e840109a0 con 0x7f0e94074510 2024-09-19T06:06:19.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.595+0000 7f0e8bfff640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f0e800a32d0 0x7f0e800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.595+0000 7f0e8bfff640 1 -- 172.21.15.103:0/408389820 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0e840cf990 con 0x7f0e94074510 2024-09-19T06:06:19.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.595+0000 7f0e927fc640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f0e800a32d0 0x7f0e800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.596+0000 7f0e8bfff640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] conn(0x7f0e800ace00 0x7f0e800af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.596+0000 7f0e8bfff640 1 -- 172.21.15.103:0/408389820 --> [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e800af970 con 0x7f0e800ace00 2024-09-19T06:06:19.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.596+0000 7f0e8bfff640 1 -- 172.21.15.103:0/408389820 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f0e840cfde0 con 0x7f0e94074510 2024-09-19T06:06:19.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.596+0000 7f0e927fc640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f0e800a32d0 0x7f0e800a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c031440 tx=0x7f0e7c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:19.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.596+0000 7f0e937fe640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] conn(0x7f0e800ace00 0x7f0e800af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.596+0000 7f0e937fe640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] conn(0x7f0e800ace00 0x7f0e800af2a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:19.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.597+0000 7f0e8bfff640 1 -- 172.21.15.103:0/408389820 <== osd.2 v2:172.21.15.174:6800/3967741036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e800af970 con 0x7f0e800ace00 2024-09-19T06:06:19.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.611+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 --> [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e94062d80 con 0x7f0e800ace00 2024-09-19T06:06:19.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.612+0000 7f0e8bfff640 1 -- 172.21.15.103:0/408389820 <== osd.2 v2:172.21.15.174:6800/3967741036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0e94062d80 con 0x7f0e800ace00 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.612+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 >> [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] conn(0x7f0e800ace00 msgr2=0x7f0e800af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.612+0000 7f0e99493640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] conn(0x7f0e800ace00 0x7f0e800af2a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.612+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f0e800a32d0 msgr2=0x7f0e800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.612+0000 7f0e99493640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f0e800a32d0 0x7f0e800a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c031440 tx=0x7f0e7c005b50 comp rx=0 tx=0).stop 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.612+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e94074510 msgr2=0x7f0e9419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.612+0000 7f0e99493640 1 --2- 172.21.15.103:0/408389820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e94074510 0x7f0e9419a5c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400d950 tx=0x7f0e8400de10 comp rx=0 tx=0).stop 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.612+0000 7f0e937fe640 1 -- 172.21.15.103:0/408389820 reap_dead start 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.613+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 shutdown_connections 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.613+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 >> 172.21.15.103:0/408389820 conn(0x7f0e940fd8c0 msgr2=0x7f0e940ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.613+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 shutdown_connections 2024-09-19T06:06:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:19.613+0000 7f0e99493640 1 -- 172.21.15.103:0/408389820 wait complete. 2024-09-19T06:06:20.376 INFO:teuthology.orchestra.run.smithi103.stdout:73014444099 2024-09-19T06:06:20.377 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T06:06:20.809 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:20 smithi103 ceph-mon[30925]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T06:06:20.838 INFO:teuthology.orchestra.run.smithi103.stdout:98784247870 2024-09-19T06:06:20.838 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T06:06:20.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:20 smithi174 ceph-mon[34488]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T06:06:21.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:20 smithi169 ceph-mon[34350]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T06:06:21.167 INFO:teuthology.orchestra.run.smithi103.stdout:176093659184 2024-09-19T06:06:21.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T06:06:21.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.393+0000 7ff10fd1f640 1 -- 172.21.15.103:0/721132895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff10810c170 msgr2=0x7ff10810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.393+0000 7ff10fd1f640 1 --2- 172.21.15.103:0/721132895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff10810c170 0x7ff10810e610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff100009ca0 tx=0x7ff10002a950 comp rx=0 tx=0).stop 2024-09-19T06:06:21.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.393+0000 7ff10fd1f640 1 -- 172.21.15.103:0/721132895 shutdown_connections 2024-09-19T06:06:21.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.393+0000 7ff10fd1f640 1 --2- 172.21.15.103:0/721132895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff10810c170 0x7ff10810e610 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.393+0000 7ff10fd1f640 1 --2- 172.21.15.103:0/721132895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff108103660 0x7ff10810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.393+0000 7ff10fd1f640 1 --2- 172.21.15.103:0/721132895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff108102d40 0x7ff108103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.393+0000 7ff10fd1f640 1 -- 172.21.15.103:0/721132895 >> 172.21.15.103:0/721132895 conn(0x7ff1080fc7a0 msgr2=0x7ff1080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:21.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.393+0000 7ff10fd1f640 1 -- 172.21.15.103:0/721132895 shutdown_connections 2024-09-19T06:06:21.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.393+0000 7ff10fd1f640 1 -- 172.21.15.103:0/721132895 wait complete. 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10fd1f640 1 Processor -- start 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10fd1f640 1 -- start start 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10fd1f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff108102d40 0x7ff1081009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10fd1f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff108103660 0x7ff108100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10fd1f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff10810c170 0x7ff108101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10fd1f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff108111e60 con 0x7ff10810c170 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10fd1f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff108111ce0 con 0x7ff108102d40 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10fd1f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff108111fe0 con 0x7ff108103660 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10e2bc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff10810c170 0x7ff108101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10e2bc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff10810c170 0x7ff108101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55742/0 (socket says 172.21.15.103:55742) 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10e2bc640 1 -- 172.21.15.103:0/1393808967 learned_addr learned my addr 172.21.15.103:0/1393808967 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:21.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10d2ba640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff108103660 0x7ff108100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10e2bc640 1 -- 172.21.15.103:0/1393808967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff108103660 msgr2=0x7ff108100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.394+0000 7ff10dabb640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff108102d40 0x7ff1081009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff10e2bc640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff108103660 0x7ff108100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff10e2bc640 1 -- 172.21.15.103:0/1393808967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff108102d40 msgr2=0x7ff1081009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff10e2bc640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff108102d40 0x7ff1081009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff10e2bc640 1 -- 172.21.15.103:0/1393808967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1081a68e0 con 0x7ff10810c170 2024-09-19T06:06:21.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff10dabb640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff108102d40 0x7ff1081009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:21.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff10e2bc640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff10810c170 0x7ff108101420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff10002ae70 tx=0x7ff10002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff0feffd640 1 -- 172.21.15.103:0/1393808967 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100034040 con 0x7ff10810c170 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1081a6b70 con 0x7ff10810c170 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff0feffd640 1 -- 172.21.15.103:0/1393808967 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff1000308f0 con 0x7ff10810c170 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff0feffd640 1 -- 172.21.15.103:0/1393808967 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1000047f0 con 0x7ff10810c170 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.395+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1081a7050 con 0x7ff10810c170 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.396+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1080628c0 con 0x7ff10810c170 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.397+0000 7ff0feffd640 1 -- 172.21.15.103:0/1393808967 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff100037020 con 0x7ff10810c170 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.397+0000 7ff0feffd640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff0f40a32d0 0x7ff0f40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.398+0000 7ff10dabb640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff0f40a32d0 0x7ff0f40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.398+0000 7ff0feffd640 1 -- 172.21.15.103:0/1393808967 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7ff1000f0d20 con 0x7ff10810c170 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.398+0000 7ff0feffd640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] conn(0x7ff0f40ace00 0x7ff0f40af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.398+0000 7ff0feffd640 1 -- 172.21.15.103:0/1393808967 --> [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff100048e50 con 0x7ff0f40ace00 2024-09-19T06:06:21.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.398+0000 7ff0feffd640 1 -- 172.21.15.103:0/1393808967 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff1000f1170 con 0x7ff10810c170 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.398+0000 7ff10dabb640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff0f40a32d0 0x7ff0f40a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff104006fd0 tx=0x7ff104008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.398+0000 7ff10d2ba640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] conn(0x7ff0f40ace00 0x7ff0f40af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.398+0000 7ff10d2ba640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] conn(0x7ff0f40ace00 0x7ff0f40af2a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.399+0000 7ff0feffd640 1 -- 172.21.15.103:0/1393808967 <== osd.10 v2:172.21.15.169:6824/1441835592 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff100048e50 con 0x7ff0f40ace00 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 --> [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff108062cc0 con 0x7ff0f40ace00 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff0feffd640 1 -- 172.21.15.103:0/1393808967 <== osd.10 v2:172.21.15.169:6824/1441835592 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff108062cc0 con 0x7ff0f40ace00 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 >> [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] conn(0x7ff0f40ace00 msgr2=0x7ff0f40af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff10fd1f640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] conn(0x7ff0f40ace00 0x7ff0f40af2a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff0f40a32d0 msgr2=0x7ff0f40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff10fd1f640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7ff0f40a32d0 0x7ff0f40a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff104006fd0 tx=0x7ff104008040 comp rx=0 tx=0).stop 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff10810c170 msgr2=0x7ff108101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff10fd1f640 1 --2- 172.21.15.103:0/1393808967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff10810c170 0x7ff108101420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff10002ae70 tx=0x7ff10002f5d0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff10e2bc640 1 -- 172.21.15.103:0/1393808967 reap_dead start 2024-09-19T06:06:21.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 shutdown_connections 2024-09-19T06:06:21.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.413+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 >> 172.21.15.103:0/1393808967 conn(0x7ff1080fc7a0 msgr2=0x7ff1080fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:21.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.414+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 shutdown_connections 2024-09-19T06:06:21.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:21.414+0000 7ff10fd1f640 1 -- 172.21.15.103:0/1393808967 wait complete. 2024-09-19T06:06:21.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:21 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:21 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:22.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:21 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:22.104 INFO:teuthology.orchestra.run.smithi103.stdout:279172874269 2024-09-19T06:06:22.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T06:06:22.145 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:22.199 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:22.203 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:22.204 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:22.204 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:22.207 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:22.211 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:22.215 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:22.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:22 smithi103 ceph-mon[30925]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T06:06:22.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:22.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:22.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:22.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:22 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:22 smithi174 ceph-mon[34488]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T06:06:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:22.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:22 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:23.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:22 smithi169 ceph-mon[34350]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T06:06:23.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:22 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:23.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:22 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:23.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:22 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:23.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:22 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.099+0000 7f1f17954640 1 -- 172.21.15.103:0/516468602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101de0 msgr2=0x7f1f101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.099+0000 7f1f17954640 1 --2- 172.21.15.103:0/516468602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101de0 0x7f1f101021c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009900 tx=0x7f1f0002a410 comp rx=0 tx=0).stop 2024-09-19T06:06:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.099+0000 7f1f17954640 1 -- 172.21.15.103:0/516468602 shutdown_connections 2024-09-19T06:06:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.099+0000 7f1f17954640 1 --2- 172.21.15.103:0/516468602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10106f10 0x7f1f1010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.099+0000 7f1f17954640 1 --2- 172.21.15.103:0/516468602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f10102790 0x7f1f101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.099+0000 7f1f17954640 1 --2- 172.21.15.103:0/516468602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101de0 0x7f1f101021c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.099+0000 7f1f17954640 1 -- 172.21.15.103:0/516468602 >> 172.21.15.103:0/516468602 conn(0x7f1f100fd8c0 msgr2=0x7f1f100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.099+0000 7f1f17954640 1 -- 172.21.15.103:0/516468602 shutdown_connections 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.099+0000 7f1f17954640 1 -- 172.21.15.103:0/516468602 wait complete. 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.099+0000 7f1f17954640 1 Processor -- start 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f17954640 1 -- start start 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f17954640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101de0 0x7f1f10198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f17954640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f10102790 0x7f1f101988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f17954640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10106f10 0x7f1f1019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f17954640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1f10111de0 con 0x7f1f10101de0 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f17954640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1f10111c60 con 0x7f1f10102790 2024-09-19T06:06:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f17954640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f10111f60 con 0x7f1f10106f10 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f156f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101de0 0x7f1f10198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f156f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101de0 0x7f1f10198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55760/0 (socket says 172.21.15.103:55760) 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f156f0640 1 -- 172.21.15.103:0/1802498716 learned_addr learned my addr 172.21.15.103:0/1802498716 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f15ef1640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10106f10 0x7f1f1019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f14eef640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f10102790 0x7f1f101988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f156f0640 1 -- 172.21.15.103:0/1802498716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10106f10 msgr2=0x7f1f1019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f156f0640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10106f10 0x7f1f1019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f156f0640 1 -- 172.21.15.103:0/1802498716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f10102790 msgr2=0x7f1f101988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f156f0640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f10102790 0x7f1f101988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f156f0640 1 -- 172.21.15.103:0/1802498716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1019d310 con 0x7f1f10101de0 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f156f0640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101de0 0x7f1f10198360 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1f00005940 tx=0x7f1f00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f067fc640 1 -- 172.21.15.103:0/1802498716 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0003f030 con 0x7f1f10101de0 2024-09-19T06:06:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f067fc640 1 -- 172.21.15.103:0/1802498716 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1f00003aa0 con 0x7f1f10101de0 2024-09-19T06:06:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f17954640 1 -- 172.21.15.103:0/1802498716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1019d5a0 con 0x7f1f10101de0 2024-09-19T06:06:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.100+0000 7f1f067fc640 1 -- 172.21.15.103:0/1802498716 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00035070 con 0x7f1f10101de0 2024-09-19T06:06:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.101+0000 7f1f17954640 1 -- 172.21.15.103:0/1802498716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f101a4ee0 con 0x7f1f10101de0 2024-09-19T06:06:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.102+0000 7f1f17954640 1 -- 172.21.15.103:0/1802498716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f101032c0 con 0x7f1f10101de0 2024-09-19T06:06:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.103+0000 7f1f067fc640 1 -- 172.21.15.103:0/1802498716 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f1f00042030 con 0x7f1f10101de0 2024-09-19T06:06:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.103+0000 7f1f067fc640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1efc0a3350 0x7f1efc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.104+0000 7f1f14eef640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1efc0a3350 0x7f1efc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.104+0000 7f1f067fc640 1 -- 172.21.15.103:0/1802498716 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f1f000f0110 con 0x7f1f10101de0 2024-09-19T06:06:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.104+0000 7f1f14eef640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1efc0a3350 0x7f1efc0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f100fff50 tx=0x7f1f0c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.108+0000 7f1f067fc640 1 -- 172.21.15.103:0/1802498716 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1f000bc6b0 con 0x7f1f10101de0 2024-09-19T06:06:23.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.277+0000 7f1f17954640 1 -- 172.21.15.103:0/1802498716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1f1010a120 con 0x7f1f10101de0 2024-09-19T06:06:23.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.277+0000 7f1f067fc640 1 -- 172.21.15.103:0/1802498716 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f000c09b0 con 0x7f1f10101de0 2024-09-19T06:06:23.280 INFO:teuthology.orchestra.run.smithi103.stdout:73014444099 2024-09-19T06:06:23.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 -- 172.21.15.103:0/1802498716 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1efc0a3350 msgr2=0x7f1efc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1efc0a3350 0x7f1efc0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f100fff50 tx=0x7f1f0c00b390 comp rx=0 tx=0).stop 2024-09-19T06:06:23.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 -- 172.21.15.103:0/1802498716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101de0 msgr2=0x7f1f10198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101de0 0x7f1f10198360 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1f00005940 tx=0x7f1f00004270 comp rx=0 tx=0).stop 2024-09-19T06:06:23.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 -- 172.21.15.103:0/1802498716 shutdown_connections 2024-09-19T06:06:23.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1efc0a3350 0x7f1efc0a5810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10106f10 0x7f1f1019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f10102790 0x7f1f101988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 --2- 172.21.15.103:0/1802498716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101de0 0x7f1f10198360 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 -- 172.21.15.103:0/1802498716 >> 172.21.15.103:0/1802498716 conn(0x7f1f100fd8c0 msgr2=0x7f1f100fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:23.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 -- 172.21.15.103:0/1802498716 shutdown_connections 2024-09-19T06:06:23.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.280+0000 7f1f17954640 1 -- 172.21.15.103:0/1802498716 wait complete. 2024-09-19T06:06:23.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.510+0000 7f70e01ac640 1 -- 172.21.15.103:0/4287230233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d8102d30 msgr2=0x7f70d8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.510+0000 7f70e01ac640 1 --2- 172.21.15.103:0/4287230233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d8102d30 0x7f70d8103110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009cd0 tx=0x7f70c802a910 comp rx=0 tx=0).stop 2024-09-19T06:06:23.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.510+0000 7f70e01ac640 1 -- 172.21.15.103:0/4287230233 shutdown_connections 2024-09-19T06:06:23.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.510+0000 7f70e01ac640 1 --2- 172.21.15.103:0/4287230233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70d81082a0 0x7f70d810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.510+0000 7f70e01ac640 1 --2- 172.21.15.103:0/4287230233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70d81036e0 0x7f70d8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.510+0000 7f70e01ac640 1 --2- 172.21.15.103:0/4287230233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d8102d30 0x7f70d8103110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 -- 172.21.15.103:0/4287230233 >> 172.21.15.103:0/4287230233 conn(0x7f70d80fc7d0 msgr2=0x7f70d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:23.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 -- 172.21.15.103:0/4287230233 shutdown_connections 2024-09-19T06:06:23.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 -- 172.21.15.103:0/4287230233 wait complete. 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 Processor -- start 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 -- start start 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70d8102d30 0x7f70d8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d81036e0 0x7f70d8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70d81082a0 0x7f70d819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8111f90 con 0x7f70d81036e0 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8111e10 con 0x7f70d8102d30 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70e01ac640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8112110 con 0x7f70d81082a0 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.511+0000 7f70dd747640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d81036e0 0x7f70d8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70dd747640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d81036e0 0x7f70d8198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55780/0 (socket says 172.21.15.103:55780) 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70dd747640 1 -- 172.21.15.103:0/469426677 learned_addr learned my addr 172.21.15.103:0/469426677 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70ddf48640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70d8102d30 0x7f70d8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70de749640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70d81082a0 0x7f70d819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:23.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70dd747640 1 -- 172.21.15.103:0/469426677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70d81082a0 msgr2=0x7f70d819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70dd747640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70d81082a0 0x7f70d819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70dd747640 1 -- 172.21.15.103:0/469426677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70d8102d30 msgr2=0x7f70d8198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70dd747640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70d8102d30 0x7f70d8198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70dd747640 1 -- 172.21.15.103:0/469426677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d819d4c0 con 0x7f70d81036e0 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70dd747640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d81036e0 0x7f70d8198a50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f70cc006fd0 tx=0x7f70cc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70d6ffd640 1 -- 172.21.15.103:0/469426677 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc011830 con 0x7f70d81036e0 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70d6ffd640 1 -- 172.21.15.103:0/469426677 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70cc016070 con 0x7f70d81036e0 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70d6ffd640 1 -- 172.21.15.103:0/469426677 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc010df0 con 0x7f70d81036e0 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70e01ac640 1 -- 172.21.15.103:0/469426677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d819d7b0 con 0x7f70d81036e0 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.512+0000 7f70e01ac640 1 -- 172.21.15.103:0/469426677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d81a5090 con 0x7f70d81036e0 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.513+0000 7f70e01ac640 1 -- 172.21.15.103:0/469426677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d806a850 con 0x7f70d81036e0 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.514+0000 7f70d6ffd640 1 -- 172.21.15.103:0/469426677 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f70cc0119d0 con 0x7f70d81036e0 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.515+0000 7f70d6ffd640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70c00a3350 0x7f70c00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:23.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.515+0000 7f70ddf48640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70c00a3350 0x7f70c00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:23.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.515+0000 7f70d6ffd640 1 -- 172.21.15.103:0/469426677 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f70cc0ceec0 con 0x7f70d81036e0 2024-09-19T06:06:23.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.516+0000 7f70ddf48640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70c00a3350 0x7f70c00a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f70c80098d0 tx=0x7f70c8009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:23.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.519+0000 7f70d6ffd640 1 -- 172.21.15.103:0/469426677 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70cc09bbc0 con 0x7f70d81036e0 2024-09-19T06:06:23.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.695+0000 7f70e01ac640 1 -- 172.21.15.103:0/469426677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f70d810a2b0 con 0x7f70d81036e0 2024-09-19T06:06:23.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.695+0000 7f70d6ffd640 1 -- 172.21.15.103:0/469426677 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f70cc09b4c0 con 0x7f70d81036e0 2024-09-19T06:06:23.697 INFO:teuthology.orchestra.run.smithi103.stdout:128849018939 2024-09-19T06:06:23.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 -- 172.21.15.103:0/469426677 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70c00a3350 msgr2=0x7f70c00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70c00a3350 0x7f70c00a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f70c80098d0 tx=0x7f70c8009900 comp rx=0 tx=0).stop 2024-09-19T06:06:23.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 -- 172.21.15.103:0/469426677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d81036e0 msgr2=0x7f70d8198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d81036e0 0x7f70d8198a50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f70cc006fd0 tx=0x7f70cc00b8e0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 -- 172.21.15.103:0/469426677 shutdown_connections 2024-09-19T06:06:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70c00a3350 0x7f70c00a5810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70d81082a0 0x7f70d819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d81036e0 0x7f70d8198a50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 --2- 172.21.15.103:0/469426677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70d8102d30 0x7f70d8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 -- 172.21.15.103:0/469426677 >> 172.21.15.103:0/469426677 conn(0x7f70d80fc7d0 msgr2=0x7f70d8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 -- 172.21.15.103:0/469426677 shutdown_connections 2024-09-19T06:06:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:23.697+0000 7f70e01ac640 1 -- 172.21.15.103:0/469426677 wait complete. 2024-09-19T06:06:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:23 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1802498716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:06:23.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:23 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1802498716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:06:24.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:23 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1802498716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:06:24.778 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:24 smithi103 ceph-mon[30925]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T06:06:24.778 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:24 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/469426677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:06:24.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.868+0000 7f4e56e36640 1 -- 172.21.15.103:0/4085764677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e50102570 msgr2=0x7f4e501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.868+0000 7f4e56e36640 1 --2- 172.21.15.103:0/4085764677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e50102570 0x7f4e501029b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009900 tx=0x7f4e3c02a480 comp rx=0 tx=0).stop 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.868+0000 7f4e56e36640 1 -- 172.21.15.103:0/4085764677 shutdown_connections 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.868+0000 7f4e56e36640 1 --2- 172.21.15.103:0/4085764677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e50102ef0 0x7f4e5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.868+0000 7f4e56e36640 1 --2- 172.21.15.103:0/4085764677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e50102570 0x7f4e501029b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.868+0000 7f4e56e36640 1 --2- 172.21.15.103:0/4085764677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e50100e20 0x7f4e50101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.868+0000 7f4e56e36640 1 -- 172.21.15.103:0/4085764677 >> 172.21.15.103:0/4085764677 conn(0x7f4e500fc7d0 msgr2=0x7f4e500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.868+0000 7f4e56e36640 1 -- 172.21.15.103:0/4085764677 shutdown_connections 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.868+0000 7f4e56e36640 1 -- 172.21.15.103:0/4085764677 wait complete. 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e56e36640 1 Processor -- start 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e56e36640 1 -- start start 2024-09-19T06:06:24.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e56e36640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e50100e20 0x7f4e50198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e56e36640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e50102570 0x7f4e50198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e56e36640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e50102ef0 0x7f4e5019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e56e36640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50110e30 con 0x7f4e50102570 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e56e36640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50110cb0 con 0x7f4e50100e20 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e56e36640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50110fb0 con 0x7f4e50102ef0 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e4ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e50102570 0x7f4e50198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e4ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e50102570 0x7f4e50198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55832/0 (socket says 172.21.15.103:55832) 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e4ffff640 1 -- 172.21.15.103:0/1859747307 learned_addr learned my addr 172.21.15.103:0/1859747307 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e553d3640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e50102ef0 0x7f4e5019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.869+0000 7f4e54bd2640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e50100e20 0x7f4e50198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e4ffff640 1 -- 172.21.15.103:0/1859747307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e50102ef0 msgr2=0x7f4e5019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e4ffff640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e50102ef0 0x7f4e5019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e4ffff640 1 -- 172.21.15.103:0/1859747307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e50100e20 msgr2=0x7f4e50198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e4ffff640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e50100e20 0x7f4e50198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e4ffff640 1 -- 172.21.15.103:0/1859747307 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5019d3c0 con 0x7f4e50102570 2024-09-19T06:06:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e4ffff640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e50102570 0x7f4e50198950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c006010 tx=0x7f4e3c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e4dffb640 1 -- 172.21.15.103:0/1859747307 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c03f030 con 0x7f4e50102570 2024-09-19T06:06:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5019d650 con 0x7f4e50102570 2024-09-19T06:06:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e4dffb640 1 -- 172.21.15.103:0/1859747307 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e3c003aa0 con 0x7f4e50102570 2024-09-19T06:06:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e4dffb640 1 -- 172.21.15.103:0/1859747307 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c035070 con 0x7f4e50102570 2024-09-19T06:06:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.870+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e501a4f90 con 0x7f4e50102570 2024-09-19T06:06:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.871+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e50107260 con 0x7f4e50102570 2024-09-19T06:06:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.873+0000 7f4e4dffb640 1 -- 172.21.15.103:0/1859747307 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f4e3c042030 con 0x7f4e50102570 2024-09-19T06:06:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.874+0000 7f4e4dffb640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4e400a32d0 0x7f4e400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.874+0000 7f4e54bd2640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4e400a32d0 0x7f4e400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.874+0000 7f4e4dffb640 1 -- 172.21.15.103:0/1859747307 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f4e3c0f06d0 con 0x7f4e50102570 2024-09-19T06:06:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.874+0000 7f4e4dffb640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] conn(0x7f4e400ace00 0x7f4e400af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.874+0000 7f4e4dffb640 1 -- 172.21.15.103:0/1859747307 --> [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e3c003e30 con 0x7f4e400ace00 2024-09-19T06:06:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.874+0000 7f4e4dffb640 1 -- 172.21.15.103:0/1859747307 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f4e3c0f0b20 con 0x7f4e50102570 2024-09-19T06:06:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.874+0000 7f4e553d3640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] conn(0x7f4e400ace00 0x7f4e400af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.874+0000 7f4e54bd2640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4e400a32d0 0x7f4e400a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009b60 tx=0x7f4e44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.875+0000 7f4e553d3640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] conn(0x7f4e400ace00 0x7f4e400af2a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.876+0000 7f4e4dffb640 1 -- 172.21.15.103:0/1859747307 <== osd.5 v2:172.21.15.174:6808/2373718681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e3c003e30 con 0x7f4e400ace00 2024-09-19T06:06:24.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.889+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 --> [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e501021b0 con 0x7f4e400ace00 2024-09-19T06:06:24.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e4dffb640 1 -- 172.21.15.103:0/1859747307 <== osd.5 v2:172.21.15.174:6808/2373718681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4e501021b0 con 0x7f4e400ace00 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 >> [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] conn(0x7f4e400ace00 msgr2=0x7f4e400af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e56e36640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] conn(0x7f4e400ace00 0x7f4e400af2a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4e400a32d0 msgr2=0x7f4e400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e56e36640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4e400a32d0 0x7f4e400a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009b60 tx=0x7f4e44005f90 comp rx=0 tx=0).stop 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e50102570 msgr2=0x7f4e50198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e56e36640 1 --2- 172.21.15.103:0/1859747307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e50102570 0x7f4e50198950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c006010 tx=0x7f4e3c004270 comp rx=0 tx=0).stop 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e553d3640 1 -- 172.21.15.103:0/1859747307 reap_dead start 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 shutdown_connections 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 >> 172.21.15.103:0/1859747307 conn(0x7f4e500fc7d0 msgr2=0x7f4e50069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 shutdown_connections 2024-09-19T06:06:24.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.890+0000 7f4e56e36640 1 -- 172.21.15.103:0/1859747307 wait complete. 2024-09-19T06:06:24.929 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:24 smithi169 ceph-mon[34350]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T06:06:24.929 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:24 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/469426677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:06:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:24 smithi174 ceph-mon[34488]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T06:06:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:24 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/469426677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:06:25.528 INFO:teuthology.orchestra.run.smithi103.stdout:146028888118 2024-09-19T06:06:25.529 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T06:06:25.844 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:25 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1823089176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:06:25.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.775+0000 7fed09410640 1 -- 172.21.15.103:0/624818924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed04101420 msgr2=0x7fed0410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.775+0000 7fed09410640 1 --2- 172.21.15.103:0/624818924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed04101420 0x7fed0410d950 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009cd0 tx=0x7fecfc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.775+0000 7fed09410640 1 -- 172.21.15.103:0/624818924 shutdown_connections 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.775+0000 7fed09410640 1 --2- 172.21.15.103:0/624818924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed04101420 0x7fed0410d950 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.775+0000 7fed09410640 1 --2- 172.21.15.103:0/624818924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04100a80 0x7fed04100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.775+0000 7fed09410640 1 --2- 172.21.15.103:0/624818924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed04106a80 0x7fed04106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.775+0000 7fed09410640 1 -- 172.21.15.103:0/624818924 >> 172.21.15.103:0/624818924 conn(0x7fed040fc7a0 msgr2=0x7fed040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.775+0000 7fed09410640 1 -- 172.21.15.103:0/624818924 shutdown_connections 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.775+0000 7fed09410640 1 -- 172.21.15.103:0/624818924 wait complete. 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.776+0000 7fed09410640 1 Processor -- start 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.776+0000 7fed09410640 1 -- start start 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.776+0000 7fed09410640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed04100a80 0x7fed04198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.776+0000 7fed09410640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04101420 0x7fed04198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:25.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.776+0000 7fed09410640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed04106a80 0x7fed0419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:25.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.776+0000 7fed09410640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed04110d50 con 0x7fed04100a80 2024-09-19T06:06:25.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.776+0000 7fed09410640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fed04110bd0 con 0x7fed04106a80 2024-09-19T06:06:25.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.776+0000 7fed09410640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed04110ed0 con 0x7fed04101420 2024-09-19T06:06:25.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed02ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed04100a80 0x7fed04198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:25.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed02ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed04100a80 0x7fed04198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55810/0 (socket says 172.21.15.103:55810) 2024-09-19T06:06:25.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed02ffd640 1 -- 172.21.15.103:0/1823089176 learned_addr learned my addr 172.21.15.103:0/1823089176 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:25.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fecfa7fc640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04101420 0x7fed04198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:25.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed037fe640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed04106a80 0x7fed0419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:25.907 INFO:teuthology.orchestra.run.smithi103.stdout:34359738446 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed02ffd640 1 -- 172.21.15.103:0/1823089176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04101420 msgr2=0x7fed04198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed02ffd640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04101420 0x7fed04198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed02ffd640 1 -- 172.21.15.103:0/1823089176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed04106a80 msgr2=0x7fed0419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed02ffd640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed04106a80 0x7fed0419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed02ffd640 1 -- 172.21.15.103:0/1823089176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0419d300 con 0x7fed04100a80 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed037fe640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed04106a80 0x7fed0419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed02ffd640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed04100a80 0x7fed04198350 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fecf400b4a0 tx=0x7fecf400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed00ff9640 1 -- 172.21.15.103:0/1823089176 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4014070 con 0x7fed04100a80 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed09410640 1 -- 172.21.15.103:0/1823089176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0419d5f0 con 0x7fed04100a80 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed00ff9640 1 -- 172.21.15.103:0/1823089176 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fecf4010ac0 con 0x7fed04100a80 2024-09-19T06:06:25.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed00ff9640 1 -- 172.21.15.103:0/1823089176 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4017c30 con 0x7fed04100a80 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.777+0000 7fed09410640 1 -- 172.21.15.103:0/1823089176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed041a4ed0 con 0x7fed04100a80 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.778+0000 7fed09410640 1 -- 172.21.15.103:0/1823089176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed04100ee0 con 0x7fed04100a80 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.780+0000 7fed00ff9640 1 -- 172.21.15.103:0/1823089176 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fecf4017070 con 0x7fed04100a80 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.780+0000 7fed00ff9640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fecf00a3350 0x7fecf00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.780+0000 7fecfa7fc640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fecf00a3350 0x7fecf00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.780+0000 7fed00ff9640 1 -- 172.21.15.103:0/1823089176 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fecf40cef90 con 0x7fed04100a80 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.781+0000 7fecfa7fc640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fecf00a3350 0x7fecf00a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fed040ffde0 tx=0x7fecec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.784+0000 7fed00ff9640 1 -- 172.21.15.103:0/1823089176 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fecf409bc90 con 0x7fed04100a80 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.962+0000 7fed09410640 1 -- 172.21.15.103:0/1823089176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fed041a51d0 con 0x7fed04100a80 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.962+0000 7fed00ff9640 1 -- 172.21.15.103:0/1823089176 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fecf409b590 con 0x7fed04100a80 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 -- 172.21.15.103:0/1823089176 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fecf00a3350 msgr2=0x7fecf00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fecf00a3350 0x7fecf00a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fed040ffde0 tx=0x7fecec00b390 comp rx=0 tx=0).stop 2024-09-19T06:06:25.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 -- 172.21.15.103:0/1823089176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed04100a80 msgr2=0x7fed04198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:25.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed04100a80 0x7fed04198350 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fecf400b4a0 tx=0x7fecf400b960 comp rx=0 tx=0).stop 2024-09-19T06:06:25.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 -- 172.21.15.103:0/1823089176 shutdown_connections 2024-09-19T06:06:25.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fecf00a3350 0x7fecf00a5810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed04106a80 0x7fed0419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04101420 0x7fed04198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 --2- 172.21.15.103:0/1823089176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed04100a80 0x7fed04198350 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 -- 172.21.15.103:0/1823089176 >> 172.21.15.103:0/1823089176 conn(0x7fed040fc7a0 msgr2=0x7fed0406a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:25.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 -- 172.21.15.103:0/1823089176 shutdown_connections 2024-09-19T06:06:25.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:24.964+0000 7fed09410640 1 -- 172.21.15.103:0/1823089176 wait complete. 2024-09-19T06:06:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:25 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1823089176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:06:26.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:25 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1823089176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:06:26.763 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:26 smithi103 ceph-mon[30925]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T06:06:26.763 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:26 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1435684860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:06:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:26 smithi174 ceph-mon[34488]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T06:06:26.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:26 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1435684860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:06:26.957 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444099 got 73014444099 for osd.2 2024-09-19T06:06:26.957 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:27.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 -- 172.21.15.103:0/580793621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f806c100a80 msgr2=0x7f806c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 --2- 172.21.15.103:0/580793621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f806c100a80 0x7f806c100ee0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8054009930 tx=0x7f805402a420 comp rx=0 tx=0).stop 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 -- 172.21.15.103:0/580793621 shutdown_connections 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 --2- 172.21.15.103:0/580793621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f806c101420 0x7f806c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 --2- 172.21.15.103:0/580793621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f806c100a80 0x7f806c100ee0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 --2- 172.21.15.103:0/580793621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806c106a80 0x7f806c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 -- 172.21.15.103:0/580793621 >> 172.21.15.103:0/580793621 conn(0x7f806c0fc7a0 msgr2=0x7f806c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 -- 172.21.15.103:0/580793621 shutdown_connections 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 -- 172.21.15.103:0/580793621 wait complete. 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 Processor -- start 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.580+0000 7f8072934640 1 -- start start 2024-09-19T06:06:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f8072934640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f806c100a80 0x7f806c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f8072934640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f806c101420 0x7f806c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f8072934640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806c106a80 0x7f806c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f8072934640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f806c110cf0 con 0x7f806c101420 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f8072934640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f806c110b70 con 0x7f806c100a80 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f8072934640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f806c110e70 con 0x7f806c106a80 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f806b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f806c101420 0x7f806c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f806bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f806c100a80 0x7f806c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f806b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f806c101420 0x7f806c198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55880/0 (socket says 172.21.15.103:55880) 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f806b7fe640 1 -- 172.21.15.103:0/2843433962 learned_addr learned my addr 172.21.15.103:0/2843433962 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f8070ed1640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806c106a80 0x7f806c19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f806b7fe640 1 -- 172.21.15.103:0/2843433962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806c106a80 msgr2=0x7f806c19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f806b7fe640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806c106a80 0x7f806c19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f806b7fe640 1 -- 172.21.15.103:0/2843433962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f806c100a80 msgr2=0x7f806c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f806b7fe640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f806c100a80 0x7f806c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f806b7fe640 1 -- 172.21.15.103:0/2843433962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c19d2a0 con 0x7f806c101420 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f806b7fe640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f806c101420 0x7f806c198830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8054004770 tx=0x7f80540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f80697fa640 1 -- 172.21.15.103:0/2843433962 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805403f070 con 0x7f806c101420 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f80697fa640 1 -- 172.21.15.103:0/2843433962 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f805403b460 con 0x7f806c101420 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.581+0000 7f8072934640 1 -- 172.21.15.103:0/2843433962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806c19d530 con 0x7f806c101420 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.582+0000 7f80697fa640 1 -- 172.21.15.103:0/2843433962 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8054035070 con 0x7f806c101420 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.582+0000 7f8072934640 1 -- 172.21.15.103:0/2843433962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806c1a4e70 con 0x7f806c101420 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.583+0000 7f8072934640 1 -- 172.21.15.103:0/2843433962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806c1021c0 con 0x7f806c101420 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.584+0000 7f80697fa640 1 -- 172.21.15.103:0/2843433962 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f805403b610 con 0x7f806c101420 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.585+0000 7f80697fa640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80580a32d0 0x7f80580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.585+0000 7f806bfff640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80580a32d0 0x7f80580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:27.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.585+0000 7f80697fa640 1 -- 172.21.15.103:0/2843433962 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f80540efda0 con 0x7f806c101420 2024-09-19T06:06:27.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.585+0000 7f806bfff640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80580a32d0 0x7f80580a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f805c00ab60 tx=0x7f805c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:27.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.589+0000 7f80697fa640 1 -- 172.21.15.103:0/2843433962 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80540bc930 con 0x7f806c101420 2024-09-19T06:06:27.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.760+0000 7f8072934640 1 -- 172.21.15.103:0/2843433962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f806c10a050 con 0x7f806c101420 2024-09-19T06:06:27.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.761+0000 7f80697fa640 1 -- 172.21.15.103:0/2843433962 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f80540bc230 con 0x7f806c101420 2024-09-19T06:06:27.017 INFO:teuthology.orchestra.run.smithi103.stdout:98784247871 2024-09-19T06:06:27.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 -- 172.21.15.103:0/2843433962 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80580a32d0 msgr2=0x7f80580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:27.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80580a32d0 0x7f80580a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f805c00ab60 tx=0x7f805c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 -- 172.21.15.103:0/2843433962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f806c101420 msgr2=0x7f806c198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:27.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f806c101420 0x7f806c198830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8054004770 tx=0x7f80540042f0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 -- 172.21.15.103:0/2843433962 shutdown_connections 2024-09-19T06:06:27.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f80580a32d0 0x7f80580a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806c106a80 0x7f806c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f806c101420 0x7f806c198830 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 --2- 172.21.15.103:0/2843433962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f806c100a80 0x7f806c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:27.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 -- 172.21.15.103:0/2843433962 >> 172.21.15.103:0/2843433962 conn(0x7f806c0fc7a0 msgr2=0x7f806c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:27.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 -- 172.21.15.103:0/2843433962 shutdown_connections 2024-09-19T06:06:27.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.763+0000 7f8072934640 1 -- 172.21.15.103:0/2843433962 wait complete. 2024-09-19T06:06:27.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:26 smithi169 ceph-mon[34350]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T06:06:27.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:26 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1435684860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:06:27.924 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:27 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2843433962' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:06:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:27 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2843433962' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:06:28.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:27 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2843433962' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:06:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.142+0000 7f59ada48640 1 -- 172.21.15.103:0/2861040967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59a8103660 msgr2=0x7f59a810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.142+0000 7f59ada48640 1 --2- 172.21.15.103:0/2861040967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59a8103660 0x7f59a810bb50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f599c009900 tx=0x7f599c02a480 comp rx=0 tx=0).stop 2024-09-19T06:06:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.142+0000 7f59ada48640 1 -- 172.21.15.103:0/2861040967 shutdown_connections 2024-09-19T06:06:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.142+0000 7f59ada48640 1 --2- 172.21.15.103:0/2861040967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a810c170 0x7f59a810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.142+0000 7f59ada48640 1 --2- 172.21.15.103:0/2861040967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59a8103660 0x7f59a810bb50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.142+0000 7f59ada48640 1 --2- 172.21.15.103:0/2861040967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a8102d40 0x7f59a8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.142+0000 7f59ada48640 1 -- 172.21.15.103:0/2861040967 >> 172.21.15.103:0/2861040967 conn(0x7f59a80fc7a0 msgr2=0x7f59a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.142+0000 7f59ada48640 1 -- 172.21.15.103:0/2861040967 shutdown_connections 2024-09-19T06:06:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.142+0000 7f59ada48640 1 -- 172.21.15.103:0/2861040967 wait complete. 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59ada48640 1 Processor -- start 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59ada48640 1 -- start start 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59ada48640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a8102d40 0x7f59a81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59ada48640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8103660 0x7f59a8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59ada48640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59a810c170 0x7f59a8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59ada48640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f59a8111e20 con 0x7f59a810c170 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59ada48640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f59a8111ca0 con 0x7f59a8103660 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59ada48640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f59a8111fa0 con 0x7f59a8102d40 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59a77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59a810c170 0x7f59a8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59a77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59a810c170 0x7f59a8101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55902/0 (socket says 172.21.15.103:55902) 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59a77fe640 1 -- 172.21.15.103:0/321247435 learned_addr learned my addr 172.21.15.103:0/321247435 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59a6ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a8102d40 0x7f59a81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.143+0000 7f59a67fc640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8103660 0x7f59a8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59a77fe640 1 -- 172.21.15.103:0/321247435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a8102d40 msgr2=0x7f59a81009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59a77fe640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a8102d40 0x7f59a81009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59a77fe640 1 -- 172.21.15.103:0/321247435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8103660 msgr2=0x7f59a8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59a77fe640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8103660 0x7f59a8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59a77fe640 1 -- 172.21.15.103:0/321247435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a81a68a0 con 0x7f59a810c170 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59a67fc640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8103660 0x7f59a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59a77fe640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59a810c170 0x7f59a8101420 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f59a000eaa0 tx=0x7f59a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59aca46640 1 -- 172.21.15.103:0/321247435 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a000cdb0 con 0x7f59a810c170 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59aca46640 1 -- 172.21.15.103:0/321247435 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f59a0005020 con 0x7f59a810c170 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59ada48640 1 -- 172.21.15.103:0/321247435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a81a6b90 con 0x7f59a810c170 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59aca46640 1 -- 172.21.15.103:0/321247435 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a00116d0 con 0x7f59a810c170 2024-09-19T06:06:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.144+0000 7f59ada48640 1 -- 172.21.15.103:0/321247435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a81a7080 con 0x7f59a810c170 2024-09-19T06:06:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.145+0000 7f59ada48640 1 -- 172.21.15.103:0/321247435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a8103120 con 0x7f59a810c170 2024-09-19T06:06:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.146+0000 7f59aca46640 1 -- 172.21.15.103:0/321247435 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f59a00051d0 con 0x7f59a810c170 2024-09-19T06:06:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.147+0000 7f59aca46640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f59900a32d0 0x7f59900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.147+0000 7f59a6ffd640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f59900a32d0 0x7f59900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.147+0000 7f59aca46640 1 -- 172.21.15.103:0/321247435 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f59a00cfc00 con 0x7f59a810c170 2024-09-19T06:06:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.147+0000 7f59a6ffd640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f59900a32d0 0x7f59900a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5998005fd0 tx=0x7f599800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.151+0000 7f59aca46640 1 -- 172.21.15.103:0/321247435 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f59a0016030 con 0x7f59a810c170 2024-09-19T06:06:28.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.324+0000 7f59ada48640 1 -- 172.21.15.103:0/321247435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f59a802d7c0 con 0x7f59a810c170 2024-09-19T06:06:28.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.324+0000 7f59aca46640 1 -- 172.21.15.103:0/321247435 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f59a009c7f0 con 0x7f59a810c170 2024-09-19T06:06:28.327 INFO:teuthology.orchestra.run.smithi103.stdout:55834574922 2024-09-19T06:06:28.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.327+0000 7f59ada48640 1 -- 172.21.15.103:0/321247435 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f59900a32d0 msgr2=0x7f59900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:28.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.327+0000 7f59ada48640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f59900a32d0 0x7f59900a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5998005fd0 tx=0x7f599800b390 comp rx=0 tx=0).stop 2024-09-19T06:06:28.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.327+0000 7f59ada48640 1 -- 172.21.15.103:0/321247435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59a810c170 msgr2=0x7f59a8101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:28.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.328+0000 7f59ada48640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59a810c170 0x7f59a8101420 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f59a000eaa0 tx=0x7f59a000ef60 comp rx=0 tx=0).stop 2024-09-19T06:06:28.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.328+0000 7f59ada48640 1 -- 172.21.15.103:0/321247435 shutdown_connections 2024-09-19T06:06:28.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.328+0000 7f59ada48640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f59900a32d0 0x7f59900a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.328+0000 7f59ada48640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59a810c170 0x7f59a8101420 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.328+0000 7f59ada48640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8103660 0x7f59a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.328+0000 7f59ada48640 1 --2- 172.21.15.103:0/321247435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a8102d40 0x7f59a81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.328+0000 7f59ada48640 1 -- 172.21.15.103:0/321247435 >> 172.21.15.103:0/321247435 conn(0x7f59a80fc7a0 msgr2=0x7f59a80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:28.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.328+0000 7f59ada48640 1 -- 172.21.15.103:0/321247435 shutdown_connections 2024-09-19T06:06:28.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.328+0000 7f59ada48640 1 -- 172.21.15.103:0/321247435 wait complete. 2024-09-19T06:06:28.653 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738446 for osd.0 2024-09-19T06:06:28.698 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:28.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.393+0000 7f289ba97640 1 -- 172.21.15.103:0/2634405753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2894102d90 msgr2=0x7f2894103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:28.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.393+0000 7f289ba97640 1 --2- 172.21.15.103:0/2634405753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2894102d90 0x7f2894103170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2890009930 tx=0x7f289002a420 comp rx=0 tx=0).stop 2024-09-19T06:06:28.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.393+0000 7f289ba97640 1 -- 172.21.15.103:0/2634405753 shutdown_connections 2024-09-19T06:06:28.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.393+0000 7f289ba97640 1 --2- 172.21.15.103:0/2634405753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2894108290 0x7f289410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.393+0000 7f289ba97640 1 --2- 172.21.15.103:0/2634405753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2894103740 0x7f2894107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.393+0000 7f289ba97640 1 --2- 172.21.15.103:0/2634405753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2894102d90 0x7f2894103170 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.393+0000 7f289ba97640 1 -- 172.21.15.103:0/2634405753 >> 172.21.15.103:0/2634405753 conn(0x7f28940fc7d0 msgr2=0x7f28940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.393+0000 7f289ba97640 1 -- 172.21.15.103:0/2634405753 shutdown_connections 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.393+0000 7f289ba97640 1 -- 172.21.15.103:0/2634405753 wait complete. 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f289ba97640 1 Processor -- start 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f289ba97640 1 -- start start 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f289ba97640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2894102d90 0x7f289419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f289ba97640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2894103740 0x7f289419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f289ba97640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2894108290 0x7f289419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f289ba97640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2894111f40 con 0x7f2894102d90 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f289ba97640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2894111dc0 con 0x7f2894103740 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f289ba97640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f28941120c0 con 0x7f2894108290 2024-09-19T06:06:28.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f2899833640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2894102d90 0x7f289419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:28.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f2899833640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2894102d90 0x7f289419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55918/0 (socket says 172.21.15.103:55918) 2024-09-19T06:06:28.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f2899833640 1 -- 172.21.15.103:0/3218598818 learned_addr learned my addr 172.21.15.103:0/3218598818 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:28.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f289a034640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2894108290 0x7f289419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:28.738 INFO:teuthology.orchestra.run.smithi103.stdout:257698037795 2024-09-19T06:06:28.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f2899833640 1 -- 172.21.15.103:0/3218598818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2894108290 msgr2=0x7f289419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:28.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f2899833640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2894108290 0x7f289419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f2899833640 1 -- 172.21.15.103:0/3218598818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2894103740 msgr2=0x7f289419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f2899833640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2894103740 0x7f289419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.394+0000 7f2899833640 1 -- 172.21.15.103:0/3218598818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289419f640 con 0x7f2894102d90 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.395+0000 7f2899833640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2894102d90 0x7f289419a690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2890005940 tx=0x7f28900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.395+0000 7f288affd640 1 -- 172.21.15.103:0/3218598818 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289003f030 con 0x7f2894102d90 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.395+0000 7f288affd640 1 -- 172.21.15.103:0/3218598818 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2890003cb0 con 0x7f2894102d90 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.395+0000 7f288affd640 1 -- 172.21.15.103:0/3218598818 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2890035070 con 0x7f2894102d90 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.395+0000 7f289ba97640 1 -- 172.21.15.103:0/3218598818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289419f8d0 con 0x7f2894102d90 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.395+0000 7f289ba97640 1 -- 172.21.15.103:0/3218598818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28941a7210 con 0x7f2894102d90 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.396+0000 7f289ba97640 1 -- 172.21.15.103:0/3218598818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f289406a7f0 con 0x7f2894102d90 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.397+0000 7f288affd640 1 -- 172.21.15.103:0/3218598818 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f2890042030 con 0x7f2894102d90 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.397+0000 7f288affd640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f28800a32d0 0x7f28800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:28.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.397+0000 7f2899032640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f28800a32d0 0x7f28800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.398+0000 7f288affd640 1 -- 172.21.15.103:0/3218598818 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f28900f0300 con 0x7f2894102d90 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.398+0000 7f2899032640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f28800a32d0 0x7f28800a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f28940fe650 tx=0x7f2884005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.401+0000 7f288affd640 1 -- 172.21.15.103:0/3218598818 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f28900bcef0 con 0x7f2894102d90 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.574+0000 7f289ba97640 1 -- 172.21.15.103:0/3218598818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f289410c2b0 con 0x7f2894102d90 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.575+0000 7f288affd640 1 -- 172.21.15.103:0/3218598818 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f28900bc7f0 con 0x7f2894102d90 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 -- 172.21.15.103:0/3218598818 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f28800a32d0 msgr2=0x7f28800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f28800a32d0 0x7f28800a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f28940fe650 tx=0x7f2884005bf0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 -- 172.21.15.103:0/3218598818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2894102d90 msgr2=0x7f289419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2894102d90 0x7f289419a690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2890005940 tx=0x7f28900042f0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 -- 172.21.15.103:0/3218598818 shutdown_connections 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f28800a32d0 0x7f28800a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2894108290 0x7f289419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2894103740 0x7f289419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 --2- 172.21.15.103:0/3218598818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2894102d90 0x7f289419a690 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:28.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 -- 172.21.15.103:0/3218598818 >> 172.21.15.103:0/3218598818 conn(0x7f28940fc7d0 msgr2=0x7f2894100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:28.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 -- 172.21.15.103:0/3218598818 shutdown_connections 2024-09-19T06:06:28.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:28.577+0000 7f289ba97640 1 -- 172.21.15.103:0/3218598818 wait complete. 2024-09-19T06:06:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:28 smithi174 ceph-mon[34488]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T06:06:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:28 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/321247435' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:06:28.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:28 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3218598818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:06:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:28 smithi103 ceph-mon[30925]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T06:06:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:28 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/321247435' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:06:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:28 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3218598818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:06:29.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:28 smithi169 ceph-mon[34350]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T06:06:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:28 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/321247435' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:06:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:28 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3218598818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:06:29.330 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037792 got 257698037795 for osd.9 2024-09-19T06:06:29.331 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:29.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.058+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/4041814712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c410c170 msgr2=0x7fd4c410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.058+0000 7fd4cb3d6640 1 --2- 172.21.15.103:0/4041814712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c410c170 0x7fd4c410e610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009ca0 tx=0x7fd4bc02a950 comp rx=0 tx=0).stop 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.058+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/4041814712 shutdown_connections 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.058+0000 7fd4cb3d6640 1 --2- 172.21.15.103:0/4041814712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c410c170 0x7fd4c410e610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.058+0000 7fd4cb3d6640 1 --2- 172.21.15.103:0/4041814712 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c4103660 0x7fd4c410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.058+0000 7fd4cb3d6640 1 --2- 172.21.15.103:0/4041814712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c4102d40 0x7fd4c4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.058+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/4041814712 >> 172.21.15.103:0/4041814712 conn(0x7fd4c40fc7a0 msgr2=0x7fd4c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.058+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/4041814712 shutdown_connections 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.058+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/4041814712 wait complete. 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4cb3d6640 1 Processor -- start 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4cb3d6640 1 -- start start 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4cb3d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c4102d40 0x7fd4c4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4cb3d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c4103660 0x7fd4c41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:29.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4cb3d6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c410c170 0x7fd4c419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:29.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4cb3d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4111e50 con 0x7fd4c4102d40 2024-09-19T06:06:29.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4cb3d6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4111cd0 con 0x7fd4c4103660 2024-09-19T06:06:29.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4cb3d6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4111fd0 con 0x7fd4c410c170 2024-09-19T06:06:29.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4c9172640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c4102d40 0x7fd4c4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:29.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4c9172640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c4102d40 0x7fd4c4198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55864/0 (socket says 172.21.15.103:55864) 2024-09-19T06:06:29.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4c9172640 1 -- 172.21.15.103:0/1435684860 learned_addr learned my addr 172.21.15.103:0/1435684860 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:29.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4c8971640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c4103660 0x7fd4c41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:29.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.059+0000 7fd4c9973640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c410c170 0x7fd4c419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:29.426 INFO:teuthology.orchestra.run.smithi103.stdout:197568495660 2024-09-19T06:06:29.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4c9172640 1 -- 172.21.15.103:0/1435684860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c410c170 msgr2=0x7fd4c419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:29.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4c9172640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c410c170 0x7fd4c419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4c9172640 1 -- 172.21.15.103:0/1435684860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c4103660 msgr2=0x7fd4c41988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:29.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4c9172640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c4103660 0x7fd4c41988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4c9172640 1 -- 172.21.15.103:0/1435684860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c419d320 con 0x7fd4c4102d40 2024-09-19T06:06:29.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4c9172640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c4102d40 0x7fd4c4198370 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000d950 tx=0x7fd4c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:29.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4ba7fc640 1 -- 172.21.15.103:0/1435684860 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0017030 con 0x7fd4c4102d40 2024-09-19T06:06:29.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4ba7fc640 1 -- 172.21.15.103:0/1435684860 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4c0004020 con 0x7fd4c4102d40 2024-09-19T06:06:29.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/1435684860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c419d610 con 0x7fd4c4102d40 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4ba7fc640 1 -- 172.21.15.103:0/1435684860 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c00047a0 con 0x7fd4c4102d40 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.060+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/1435684860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c41a4ef0 con 0x7fd4c4102d40 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.061+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/1435684860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c4103120 con 0x7fd4c4102d40 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.062+0000 7fd4ba7fc640 1 -- 172.21.15.103:0/1435684860 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd4c00041d0 con 0x7fd4c4102d40 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.063+0000 7fd4ba7fc640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a32d0 0x7fd4b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.063+0000 7fd4c8971640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a32d0 0x7fd4b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.063+0000 7fd4ba7fc640 1 -- 172.21.15.103:0/1435684860 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd4c00cfac0 con 0x7fd4c4102d40 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.063+0000 7fd4c8971640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a32d0 0x7fd4b00a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd4c410d520 tx=0x7fd4b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.066+0000 7fd4ba7fc640 1 -- 172.21.15.103:0/1435684860 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd4c009c6b0 con 0x7fd4c4102d40 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.237+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/1435684860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd4c4106c50 con 0x7fd4c4102d40 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.237+0000 7fd4ba7fc640 1 -- 172.21.15.103:0/1435684860 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd4c009bfb0 con 0x7fd4c4102d40 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/1435684860 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a32d0 msgr2=0x7fd4b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:29.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a32d0 0x7fd4b00a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd4c410d520 tx=0x7fd4b4005f90 comp rx=0 tx=0).stop 2024-09-19T06:06:29.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/1435684860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c4102d40 msgr2=0x7fd4c4198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:29.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c4102d40 0x7fd4c4198370 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000d950 tx=0x7fd4c000de10 comp rx=0 tx=0).stop 2024-09-19T06:06:29.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/1435684860 shutdown_connections 2024-09-19T06:06:29.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a32d0 0x7fd4b00a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c410c170 0x7fd4c419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c4103660 0x7fd4c41988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 --2- 172.21.15.103:0/1435684860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c4102d40 0x7fd4c4198370 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/1435684860 >> 172.21.15.103:0/1435684860 conn(0x7fd4c40fc7a0 msgr2=0x7fd4c40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:29.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/1435684860 shutdown_connections 2024-09-19T06:06:29.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:26.240+0000 7fd4cb3d6640 1 -- 172.21.15.103:0/1435684860 wait complete. 2024-09-19T06:06:30.047 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495657 got 197568495660 for osd.7 2024-09-19T06:06:30.047 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:30.953 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:30 smithi103 ceph-mon[30925]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:06:30.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:30 smithi174 ceph-mon[34488]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:06:30.981 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574922 for osd.1 2024-09-19T06:06:30.981 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:31.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:30 smithi169 ceph-mon[34350]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:06:31.442 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018936 got 128849018939 for osd.4 2024-09-19T06:06:31.442 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:31.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.636+0000 7fc2af359640 1 -- 172.21.15.103:0/2936092108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8106f00 msgr2=0x7fc2a810ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:31.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.636+0000 7fc2af359640 1 --2- 172.21.15.103:0/2936092108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8106f00 0x7fc2a810ea80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009ca0 tx=0x7fc2a002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.636+0000 7fc2af359640 1 -- 172.21.15.103:0/2936092108 shutdown_connections 2024-09-19T06:06:31.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.636+0000 7fc2af359640 1 --2- 172.21.15.103:0/2936092108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8106f00 0x7fc2a810ea80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.636+0000 7fc2af359640 1 --2- 172.21.15.103:0/2936092108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2a8102780 0x7fc2a81067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.636+0000 7fc2af359640 1 --2- 172.21.15.103:0/2936092108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a8101dd0 0x7fc2a81021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.636+0000 7fc2af359640 1 -- 172.21.15.103:0/2936092108 >> 172.21.15.103:0/2936092108 conn(0x7fc2a80fd8b0 msgr2=0x7fc2a80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.636+0000 7fc2af359640 1 -- 172.21.15.103:0/2936092108 shutdown_connections 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.636+0000 7fc2af359640 1 -- 172.21.15.103:0/2936092108 wait complete. 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2af359640 1 Processor -- start 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2af359640 1 -- start start 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2af359640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2a8101dd0 0x7fc2a8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2af359640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8102780 0x7fc2a8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2af359640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a8106f00 0x7fc2a819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2af359640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a8111e10 con 0x7fc2a8102780 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2af359640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a8111c90 con 0x7fc2a8101dd0 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2af359640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a8111f90 con 0x7fc2a8106f00 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2ac8f4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8102780 0x7fc2a8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:31.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2ac8f4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8102780 0x7fc2a8198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44452/0 (socket says 172.21.15.103:44452) 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2ac8f4640 1 -- 172.21.15.103:0/4135096723 learned_addr learned my addr 172.21.15.103:0/4135096723 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2ad0f5640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2a8101dd0 0x7fc2a8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.637+0000 7fc2ad8f6640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a8106f00 0x7fc2a819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc2ac8f4640 1 -- 172.21.15.103:0/4135096723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a8106f00 msgr2=0x7fc2a819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc2ac8f4640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a8106f00 0x7fc2a819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc2ac8f4640 1 -- 172.21.15.103:0/4135096723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2a8101dd0 msgr2=0x7fc2a8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc2ac8f4640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2a8101dd0 0x7fc2a8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc2ac8f4640 1 -- 172.21.15.103:0/4135096723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a819d3f0 con 0x7fc2a8102780 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc2ac8f4640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8102780 0x7fc2a8198980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc29800d950 tx=0x7fc29800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc29e7fc640 1 -- 172.21.15.103:0/4135096723 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298017070 con 0x7fc2a8102780 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc29e7fc640 1 -- 172.21.15.103:0/4135096723 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc298009c30 con 0x7fc2a8102780 2024-09-19T06:06:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc29e7fc640 1 -- 172.21.15.103:0/4135096723 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29800f620 con 0x7fc2a8102780 2024-09-19T06:06:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc2af359640 1 -- 172.21.15.103:0/4135096723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a819d6e0 con 0x7fc2a8102780 2024-09-19T06:06:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.638+0000 7fc2af359640 1 -- 172.21.15.103:0/4135096723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a81a4fc0 con 0x7fc2a8102780 2024-09-19T06:06:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.639+0000 7fc2af359640 1 -- 172.21.15.103:0/4135096723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a81021b0 con 0x7fc2a8102780 2024-09-19T06:06:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.640+0000 7fc29e7fc640 1 -- 172.21.15.103:0/4135096723 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc2980109a0 con 0x7fc2a8102780 2024-09-19T06:06:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.641+0000 7fc29e7fc640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc2940a3350 0x7fc2940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.641+0000 7fc2ad0f5640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc2940a3350 0x7fc2940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.641+0000 7fc29e7fc640 1 -- 172.21.15.103:0/4135096723 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc2980cf600 con 0x7fc2a8102780 2024-09-19T06:06:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.641+0000 7fc2ad0f5640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc2940a3350 0x7fc2940a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4005fd0 tx=0x7fc2a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.645+0000 7fc29e7fc640 1 -- 172.21.15.103:0/4135096723 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc298009de0 con 0x7fc2a8102780 2024-09-19T06:06:31.682 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:31.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.828+0000 7fc2af359640 1 -- 172.21.15.103:0/4135096723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fc2a810a140 con 0x7fc2a8102780 2024-09-19T06:06:31.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.829+0000 7fc29e7fc640 1 -- 172.21.15.103:0/4135096723 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc29809c1f0 con 0x7fc2a8102780 2024-09-19T06:06:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:227633266729 2024-09-19T06:06:31.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 -- 172.21.15.103:0/4135096723 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc2940a3350 msgr2=0x7fc2940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:31.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc2940a3350 0x7fc2940a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4005fd0 tx=0x7fc2a400b390 comp rx=0 tx=0).stop 2024-09-19T06:06:31.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 -- 172.21.15.103:0/4135096723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8102780 msgr2=0x7fc2a8198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:31.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8102780 0x7fc2a8198980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc29800d950 tx=0x7fc29800de10 comp rx=0 tx=0).stop 2024-09-19T06:06:31.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 -- 172.21.15.103:0/4135096723 shutdown_connections 2024-09-19T06:06:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc2940a3350 0x7fc2940a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a8106f00 0x7fc2a819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8102780 0x7fc2a8198980 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 --2- 172.21.15.103:0/4135096723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2a8101dd0 0x7fc2a8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 -- 172.21.15.103:0/4135096723 >> 172.21.15.103:0/4135096723 conn(0x7fc2a80fd8b0 msgr2=0x7fc2a80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 -- 172.21.15.103:0/4135096723 shutdown_connections 2024-09-19T06:06:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:31.831+0000 7fc2af359640 1 -- 172.21.15.103:0/4135096723 wait complete. 2024-09-19T06:06:32.128 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247870 got 98784247871 for osd.3 2024-09-19T06:06:32.128 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.725+0000 7f710688d640 1 -- 172.21.15.103:0/686836665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7100101420 msgr2=0x7f710010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.725+0000 7f710688d640 1 --2- 172.21.15.103:0/686836665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7100101420 0x7f710010d950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009cd0 tx=0x7f70f802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:06:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.725+0000 7f710688d640 1 -- 172.21.15.103:0/686836665 shutdown_connections 2024-09-19T06:06:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.725+0000 7f710688d640 1 --2- 172.21.15.103:0/686836665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7100101420 0x7f710010d950 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.725+0000 7f710688d640 1 --2- 172.21.15.103:0/686836665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7100100a80 0x7f7100100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.725+0000 7f710688d640 1 --2- 172.21.15.103:0/686836665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7100106a80 0x7f7100106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.725+0000 7f710688d640 1 -- 172.21.15.103:0/686836665 >> 172.21.15.103:0/686836665 conn(0x7f71000fc7a0 msgr2=0x7f71000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.725+0000 7f710688d640 1 -- 172.21.15.103:0/686836665 shutdown_connections 2024-09-19T06:06:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.725+0000 7f710688d640 1 -- 172.21.15.103:0/686836665 wait complete. 2024-09-19T06:06:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f710688d640 1 Processor -- start 2024-09-19T06:06:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f710688d640 1 -- start start 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f710688d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7100100a80 0x7f71001972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f710688d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7100101420 0x7f7100197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f710688d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7100106a80 0x7f710019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f710688d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7100110d70 con 0x7f7100100a80 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f710688d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7100110bf0 con 0x7f7100101420 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f710688d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7100110ef0 con 0x7f7100106a80 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f70fffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7100100a80 0x7f71001972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f70fffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7100100a80 0x7f71001972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44474/0 (socket says 172.21.15.103:44474) 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f70fffff640 1 -- 172.21.15.103:0/1663570742 learned_addr learned my addr 172.21.15.103:0/1663570742 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f70fffff640 1 -- 172.21.15.103:0/1663570742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7100106a80 msgr2=0x7f710019bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f7104e2a640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7100106a80 0x7f710019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:32.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f70fffff640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7100106a80 0x7f710019bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f70ff7fe640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7100101420 0x7f7100197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f70fffff640 1 -- 172.21.15.103:0/1663570742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7100101420 msgr2=0x7f7100197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f70fffff640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7100101420 0x7f7100197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.726+0000 7f70fffff640 1 -- 172.21.15.103:0/1663570742 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710019c2a0 con 0x7f7100100a80 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.727+0000 7f70fffff640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7100100a80 0x7f71001972f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f70f000b4a0 tx=0x7f70f000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.727+0000 7f70fd7fa640 1 -- 172.21.15.103:0/1663570742 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0014070 con 0x7f7100100a80 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.727+0000 7f710688d640 1 -- 172.21.15.103:0/1663570742 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710019c590 con 0x7f7100100a80 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.727+0000 7f70fd7fa640 1 -- 172.21.15.103:0/1663570742 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70f0010ac0 con 0x7f7100100a80 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.727+0000 7f70fd7fa640 1 -- 172.21.15.103:0/1663570742 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0017c30 con 0x7f7100100a80 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.727+0000 7f710688d640 1 -- 172.21.15.103:0/1663570742 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71001a3e70 con 0x7f7100100a80 2024-09-19T06:06:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.728+0000 7f710688d640 1 -- 172.21.15.103:0/1663570742 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7100100ee0 con 0x7f7100100a80 2024-09-19T06:06:32.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.729+0000 7f70fd7fa640 1 -- 172.21.15.103:0/1663570742 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f70f0017070 con 0x7f7100100a80 2024-09-19T06:06:32.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.730+0000 7f70fd7fa640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70e80a3350 0x7f70e80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:32.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.730+0000 7f70ff7fe640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70e80a3350 0x7f70e80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:32.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.730+0000 7f70fd7fa640 1 -- 172.21.15.103:0/1663570742 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f70f00cf150 con 0x7f7100100a80 2024-09-19T06:06:32.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.730+0000 7f70ff7fe640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70e80a3350 0x7f70e80a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f70f4005fd0 tx=0x7f70f4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:32.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.734+0000 7f70fd7fa640 1 -- 172.21.15.103:0/1663570742 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70f009bdf0 con 0x7f7100100a80 2024-09-19T06:06:32.789 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:32.789 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:32.790 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:32.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:32 smithi103 ceph-mon[30925]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-19T06:06:32.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:32 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/4135096723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:06:32.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.915+0000 7f710688d640 1 -- 172.21.15.103:0/1663570742 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f7100109070 con 0x7f7100100a80 2024-09-19T06:06:32.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.915+0000 7f70fd7fa640 1 -- 172.21.15.103:0/1663570742 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f70f009b6f0 con 0x7f7100100a80 2024-09-19T06:06:32.918 INFO:teuthology.orchestra.run.smithi103.stdout:309237645338 2024-09-19T06:06:32.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 -- 172.21.15.103:0/1663570742 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70e80a3350 msgr2=0x7f70e80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70e80a3350 0x7f70e80a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f70f4005fd0 tx=0x7f70f4005850 comp rx=0 tx=0).stop 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 -- 172.21.15.103:0/1663570742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7100100a80 msgr2=0x7f71001972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7100100a80 0x7f71001972f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f70f000b4a0 tx=0x7f70f000b960 comp rx=0 tx=0).stop 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 -- 172.21.15.103:0/1663570742 shutdown_connections 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f70e80a3350 0x7f70e80a5810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7100106a80 0x7f710019bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7100101420 0x7f7100197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 --2- 172.21.15.103:0/1663570742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7100100a80 0x7f71001972f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 -- 172.21.15.103:0/1663570742 >> 172.21.15.103:0/1663570742 conn(0x7f71000fc7a0 msgr2=0x7f71000fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 -- 172.21.15.103:0/1663570742 shutdown_connections 2024-09-19T06:06:32.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:32.917+0000 7f710688d640 1 -- 172.21.15.103:0/1663570742 wait complete. 2024-09-19T06:06:32.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:32 smithi174 ceph-mon[34488]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-19T06:06:32.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:32 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/4135096723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:06:33.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:32 smithi169 ceph-mon[34350]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-19T06:06:33.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:32 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/4135096723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:06:33.271 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266726 got 227633266729 for osd.8 2024-09-19T06:06:33.271 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:33.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.730+0000 7fc5f5649640 1 -- 172.21.15.103:0/4055623427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5f010c170 msgr2=0x7fc5f010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:33.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.730+0000 7fc5f5649640 1 --2- 172.21.15.103:0/4055623427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5f010c170 0x7fc5f010e610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009ca0 tx=0x7fc5e802a950 comp rx=0 tx=0).stop 2024-09-19T06:06:33.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.730+0000 7fc5f5649640 1 -- 172.21.15.103:0/4055623427 shutdown_connections 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.730+0000 7fc5f5649640 1 --2- 172.21.15.103:0/4055623427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5f010c170 0x7fc5f010e610 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.730+0000 7fc5f5649640 1 --2- 172.21.15.103:0/4055623427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5f0103660 0x7fc5f010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.730+0000 7fc5f5649640 1 --2- 172.21.15.103:0/4055623427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5f0102d40 0x7fc5f0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.730+0000 7fc5f5649640 1 -- 172.21.15.103:0/4055623427 >> 172.21.15.103:0/4055623427 conn(0x7fc5f00fc7a0 msgr2=0x7fc5f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.730+0000 7fc5f5649640 1 -- 172.21.15.103:0/4055623427 shutdown_connections 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.730+0000 7fc5f5649640 1 -- 172.21.15.103:0/4055623427 wait complete. 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5f5649640 1 Processor -- start 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5f5649640 1 -- start start 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5f5649640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5f0102d40 0x7fc5f019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5f5649640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5f0103660 0x7fc5f019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5f5649640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5f010c170 0x7fc5f019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5f5649640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f01140e0 con 0x7fc5f010c170 2024-09-19T06:06:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5f5649640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f0113f60 con 0x7fc5f0102d40 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5f5649640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f0114260 con 0x7fc5f0103660 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5ef7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5f010c170 0x7fc5f019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5ef7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5f010c170 0x7fc5f019ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44488/0 (socket says 172.21.15.103:44488) 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5ef7fe640 1 -- 172.21.15.103:0/2036676232 learned_addr learned my addr 172.21.15.103:0/2036676232 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.731+0000 7fc5ee7fc640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5f0103660 0x7fc5f019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5eeffd640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5f0102d40 0x7fc5f019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5ef7fe640 1 -- 172.21.15.103:0/2036676232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5f0103660 msgr2=0x7fc5f019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5ef7fe640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5f0103660 0x7fc5f019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5ef7fe640 1 -- 172.21.15.103:0/2036676232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5f0102d40 msgr2=0x7fc5f019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5ef7fe640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5f0102d40 0x7fc5f019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5ef7fe640 1 -- 172.21.15.103:0/2036676232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f019f630 con 0x7fc5f010c170 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5eeffd640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5f0102d40 0x7fc5f019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5ef7fe640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5f010c170 0x7fc5f019ef50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8006010 tx=0x7fc5e802f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5d7fff640 1 -- 172.21.15.103:0/2036676232 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8034040 con 0x7fc5f010c170 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5f5649640 1 -- 172.21.15.103:0/2036676232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f019f8c0 con 0x7fc5f010c170 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5d7fff640 1 -- 172.21.15.103:0/2036676232 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5e8003e00 con 0x7fc5f010c170 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5d7fff640 1 -- 172.21.15.103:0/2036676232 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8045480 con 0x7fc5f010c170 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.732+0000 7fc5f5649640 1 -- 172.21.15.103:0/2036676232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f01a7200 con 0x7fc5f010c170 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.733+0000 7fc5f5649640 1 -- 172.21.15.103:0/2036676232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f01031a0 con 0x7fc5f010c170 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.734+0000 7fc5d7fff640 1 -- 172.21.15.103:0/2036676232 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc5e8037020 con 0x7fc5f010c170 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.735+0000 7fc5d7fff640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc5d80a32d0 0x7fc5d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.735+0000 7fc5eeffd640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc5d80a32d0 0x7fc5d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.735+0000 7fc5d7fff640 1 -- 172.21.15.103:0/2036676232 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc5e80f0b20 con 0x7fc5f010c170 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.735+0000 7fc5eeffd640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc5d80a32d0 0x7fc5d80a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0006fd0 tx=0x7fc5e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.739+0000 7fc5d7fff640 1 -- 172.21.15.103:0/2036676232 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc5e80bd8b0 con 0x7fc5f010c170 2024-09-19T06:06:33.860 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:33 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1663570742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:06:33.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.938+0000 7fc5f5649640 1 -- 172.21.15.103:0/2036676232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fc5f019b9e0 con 0x7fc5f010c170 2024-09-19T06:06:33.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.938+0000 7fc5d7fff640 1 -- 172.21.15.103:0/2036676232 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc5f019b9e0 con 0x7fc5f010c170 2024-09-19T06:06:33.942 INFO:teuthology.orchestra.run.smithi103.stdout:279172874271 2024-09-19T06:06:33.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 -- 172.21.15.103:0/2036676232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc5d80a32d0 msgr2=0x7fc5d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:33.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc5d80a32d0 0x7fc5d80a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0006fd0 tx=0x7fc5e0008040 comp rx=0 tx=0).stop 2024-09-19T06:06:33.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 -- 172.21.15.103:0/2036676232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5f010c170 msgr2=0x7fc5f019ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:33.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5f010c170 0x7fc5f019ef50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8006010 tx=0x7fc5e802f640 comp rx=0 tx=0).stop 2024-09-19T06:06:33.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 -- 172.21.15.103:0/2036676232 shutdown_connections 2024-09-19T06:06:33.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fc5d80a32d0 0x7fc5d80a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:33.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5f010c170 0x7fc5f019ef50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:33.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5f0103660 0x7fc5f019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:33.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 --2- 172.21.15.103:0/2036676232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5f0102d40 0x7fc5f019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:33.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 -- 172.21.15.103:0/2036676232 >> 172.21.15.103:0/2036676232 conn(0x7fc5f00fc7a0 msgr2=0x7fc5f00fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:33.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 -- 172.21.15.103:0/2036676232 shutdown_connections 2024-09-19T06:06:33.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:33.942+0000 7fc5f5649640 1 -- 172.21.15.103:0/2036676232 wait complete. 2024-09-19T06:06:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:33 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1663570742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:06:34.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:33 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1663570742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:06:34.564 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645335 got 309237645338 for osd.11 2024-09-19T06:06:34.565 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:34 smithi174 ceph-mon[34488]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-19T06:06:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:34 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2036676232' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:06:34.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:34.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:34 smithi174 ceph-mon[34488]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:34.978 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:34 smithi103 ceph-mon[30925]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-19T06:06:34.978 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:34.978 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:34.978 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:34 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2036676232' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:06:34.979 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:34.979 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:34.979 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:34 smithi103 ceph-mon[30925]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:35.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:34 smithi169 ceph-mon[34350]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-19T06:06:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:34 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2036676232' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:06:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:35.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:34 smithi169 ceph-mon[34350]: from='mgr.14150 172.21.15.103:0/2632696025' entity='mgr.x' 2024-09-19T06:06:35.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.555+0000 7fbc25436640 1 -- 172.21.15.103:0/3879111147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc2010c170 msgr2=0x7fbc2010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.555+0000 7fbc25436640 1 --2- 172.21.15.103:0/3879111147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc2010c170 0x7fbc2010e610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009ca0 tx=0x7fbc1802a950 comp rx=0 tx=0).stop 2024-09-19T06:06:35.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.555+0000 7fbc25436640 1 -- 172.21.15.103:0/3879111147 shutdown_connections 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.555+0000 7fbc25436640 1 --2- 172.21.15.103:0/3879111147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc2010c170 0x7fbc2010e610 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.555+0000 7fbc25436640 1 --2- 172.21.15.103:0/3879111147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc20103660 0x7fbc2010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.555+0000 7fbc25436640 1 --2- 172.21.15.103:0/3879111147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc20102d40 0x7fbc20103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.555+0000 7fbc25436640 1 -- 172.21.15.103:0/3879111147 >> 172.21.15.103:0/3879111147 conn(0x7fbc200fc7a0 msgr2=0x7fbc200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.555+0000 7fbc25436640 1 -- 172.21.15.103:0/3879111147 shutdown_connections 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.555+0000 7fbc25436640 1 -- 172.21.15.103:0/3879111147 wait complete. 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.556+0000 7fbc25436640 1 Processor -- start 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.556+0000 7fbc25436640 1 -- start start 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.556+0000 7fbc25436640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc20102d40 0x7fbc20198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.556+0000 7fbc25436640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc20103660 0x7fbc20198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.556+0000 7fbc25436640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc2010c170 0x7fbc2019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.556+0000 7fbc25436640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbc20111e20 con 0x7fbc20103660 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.556+0000 7fbc25436640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc20111ca0 con 0x7fbc2010c170 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.556+0000 7fbc25436640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbc20111fa0 con 0x7fbc20102d40 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc1e7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc20103660 0x7fbc20198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc1e7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc20103660 0x7fbc20198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44510/0 (socket says 172.21.15.103:44510) 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc1e7fc640 1 -- 172.21.15.103:0/3849286999 learned_addr learned my addr 172.21.15.103:0/3849286999 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc1effd640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc20102d40 0x7fbc20198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc1e7fc640 1 -- 172.21.15.103:0/3849286999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc20102d40 msgr2=0x7fbc20198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc1e7fc640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc20102d40 0x7fbc20198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc1e7fc640 1 -- 172.21.15.103:0/3849286999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc2010c170 msgr2=0x7fbc2019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc1e7fc640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc2010c170 0x7fbc2019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc1e7fc640 1 -- 172.21.15.103:0/3849286999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2019d2f0 con 0x7fbc20103660 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc1e7fc640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc20103660 0x7fbc20198880 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000d740 tx=0x7fbc1000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc17fff640 1 -- 172.21.15.103:0/3849286999 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10017070 con 0x7fbc20103660 2024-09-19T06:06:35.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc25436640 1 -- 172.21.15.103:0/3849286999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2019d5e0 con 0x7fbc20103660 2024-09-19T06:06:35.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc17fff640 1 -- 172.21.15.103:0/3849286999 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc1000de50 con 0x7fbc20103660 2024-09-19T06:06:35.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc17fff640 1 -- 172.21.15.103:0/3849286999 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000f620 con 0x7fbc20103660 2024-09-19T06:06:35.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.557+0000 7fbc25436640 1 -- 172.21.15.103:0/3849286999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc201a4ec0 con 0x7fbc20103660 2024-09-19T06:06:35.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.558+0000 7fbc25436640 1 -- 172.21.15.103:0/3849286999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc20103120 con 0x7fbc20103660 2024-09-19T06:06:35.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.560+0000 7fbc17fff640 1 -- 172.21.15.103:0/3849286999 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fbc10009c30 con 0x7fbc20103660 2024-09-19T06:06:35.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.560+0000 7fbc17fff640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbc0c0a32d0 0x7fbc0c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:35.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.560+0000 7fbc1effd640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbc0c0a32d0 0x7fbc0c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:35.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.560+0000 7fbc17fff640 1 -- 172.21.15.103:0/3849286999 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fbc100cf620 con 0x7fbc20103660 2024-09-19T06:06:35.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.561+0000 7fbc1effd640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbc0c0a32d0 0x7fbc0c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbc08005fd0 tx=0x7fbc08005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:35.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.564+0000 7fbc17fff640 1 -- 172.21.15.103:0/3849286999 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbc1009c210 con 0x7fbc20103660 2024-09-19T06:06:35.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.737+0000 7fbc25436640 1 -- 172.21.15.103:0/3849286999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbc201a51c0 con 0x7fbc20103660 2024-09-19T06:06:35.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.737+0000 7fbc17fff640 1 -- 172.21.15.103:0/3849286999 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbc1009bb10 con 0x7fbc20103660 2024-09-19T06:06:35.740 INFO:teuthology.orchestra.run.smithi103.stdout:146028888120 2024-09-19T06:06:35.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 -- 172.21.15.103:0/3849286999 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbc0c0a32d0 msgr2=0x7fbc0c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbc0c0a32d0 0x7fbc0c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbc08005fd0 tx=0x7fbc08005e20 comp rx=0 tx=0).stop 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 -- 172.21.15.103:0/3849286999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc20103660 msgr2=0x7fbc20198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc20103660 0x7fbc20198880 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000d740 tx=0x7fbc1000dc00 comp rx=0 tx=0).stop 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 -- 172.21.15.103:0/3849286999 shutdown_connections 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fbc0c0a32d0 0x7fbc0c0a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc2010c170 0x7fbc2019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc20103660 0x7fbc20198880 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 --2- 172.21.15.103:0/3849286999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc20102d40 0x7fbc20198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 -- 172.21.15.103:0/3849286999 >> 172.21.15.103:0/3849286999 conn(0x7fbc200fc7a0 msgr2=0x7fbc200fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 -- 172.21.15.103:0/3849286999 shutdown_connections 2024-09-19T06:06:35.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.739+0000 7fbc25436640 1 -- 172.21.15.103:0/3849286999 wait complete. 2024-09-19T06:06:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.815+0000 7fa9520af640 1 -- 172.21.15.103:0/3164468340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa94c102d40 msgr2=0x7fa94c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.815+0000 7fa9520af640 1 --2- 172.21.15.103:0/3164468340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa94c102d40 0x7fa94c103120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009900 tx=0x7fa93c02a480 comp rx=0 tx=0).stop 2024-09-19T06:06:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.815+0000 7fa9520af640 1 -- 172.21.15.103:0/3164468340 shutdown_connections 2024-09-19T06:06:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.815+0000 7fa9520af640 1 --2- 172.21.15.103:0/3164468340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa94c10c170 0x7fa94c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.815+0000 7fa9520af640 1 --2- 172.21.15.103:0/3164468340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c103660 0x7fa94c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.815+0000 7fa9520af640 1 --2- 172.21.15.103:0/3164468340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa94c102d40 0x7fa94c103120 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.815+0000 7fa9520af640 1 -- 172.21.15.103:0/3164468340 >> 172.21.15.103:0/3164468340 conn(0x7fa94c0fc7a0 msgr2=0x7fa94c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.815+0000 7fa9520af640 1 -- 172.21.15.103:0/3164468340 shutdown_connections 2024-09-19T06:06:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.815+0000 7fa9520af640 1 -- 172.21.15.103:0/3164468340 wait complete. 2024-09-19T06:06:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa9520af640 1 Processor -- start 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa9520af640 1 -- start start 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa9520af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c102d40 0x7fa94c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa9520af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa94c103660 0x7fa94c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa9520af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa94c10c170 0x7fa94c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa9520af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c111e20 con 0x7fa94c10c170 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa9520af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c111ca0 con 0x7fa94c103660 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa9520af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c111fa0 con 0x7fa94c102d40 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa94bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa94c10c170 0x7fa94c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa94bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa94c10c170 0x7fa94c19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44534/0 (socket says 172.21.15.103:44534) 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa94bfff640 1 -- 172.21.15.103:0/92787281 learned_addr learned my addr 172.21.15.103:0/92787281 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa943fff640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa94c103660 0x7fa94c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa94b7fe640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c102d40 0x7fa94c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa94bfff640 1 -- 172.21.15.103:0/92787281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c102d40 msgr2=0x7fa94c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa94bfff640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c102d40 0x7fa94c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa94bfff640 1 -- 172.21.15.103:0/92787281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa94c103660 msgr2=0x7fa94c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa94bfff640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa94c103660 0x7fa94c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa94bfff640 1 -- 172.21.15.103:0/92787281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94c19d350 con 0x7fa94c10c170 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa943fff640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa94c103660 0x7fa94c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.816+0000 7fa94bfff640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa94c10c170 0x7fa94c19cc70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa94400cad0 tx=0x7fa94400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.817+0000 7fa9497fa640 1 -- 172.21.15.103:0/92787281 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94400ae20 con 0x7fa94c10c170 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.817+0000 7fa9497fa640 1 -- 172.21.15.103:0/92787281 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa944005020 con 0x7fa94c10c170 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.817+0000 7fa9520af640 1 -- 172.21.15.103:0/92787281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94c19d640 con 0x7fa94c10c170 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.817+0000 7fa9497fa640 1 -- 172.21.15.103:0/92787281 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94400f6b0 con 0x7fa94c10c170 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.817+0000 7fa9520af640 1 -- 172.21.15.103:0/92787281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa94c1a4f20 con 0x7fa94c10c170 2024-09-19T06:06:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.818+0000 7fa9520af640 1 -- 172.21.15.103:0/92787281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa94c103120 con 0x7fa94c10c170 2024-09-19T06:06:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.819+0000 7fa9497fa640 1 -- 172.21.15.103:0/92787281 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fa9440051d0 con 0x7fa94c10c170 2024-09-19T06:06:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.819+0000 7fa9497fa640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa9380a32d0 0x7fa9380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.820+0000 7fa94b7fe640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa9380a32d0 0x7fa9380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.820+0000 7fa9497fa640 1 -- 172.21.15.103:0/92787281 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fa9440cfef0 con 0x7fa94c10c170 2024-09-19T06:06:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.820+0000 7fa94b7fe640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa9380a32d0 0x7fa9380a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa93c031440 tx=0x7fa93c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.823+0000 7fa9497fa640 1 -- 172.21.15.103:0/92787281 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa9440ff210 con 0x7fa94c10c170 2024-09-19T06:06:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:35 smithi174 ceph-mon[34488]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T06:06:35.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:35 smithi103 ceph-mon[30925]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T06:06:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.992+0000 7fa9520af640 1 -- 172.21.15.103:0/92787281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa94c199700 con 0x7fa94c10c170 2024-09-19T06:06:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.993+0000 7fa9497fa640 1 -- 172.21.15.103:0/92787281 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa944014030 con 0x7fa94c10c170 2024-09-19T06:06:35.995 INFO:teuthology.orchestra.run.smithi103.stdout:176093659188 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 -- 172.21.15.103:0/92787281 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa9380a32d0 msgr2=0x7fa9380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa9380a32d0 0x7fa9380a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa93c031440 tx=0x7fa93c0095f0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 -- 172.21.15.103:0/92787281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa94c10c170 msgr2=0x7fa94c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa94c10c170 0x7fa94c19cc70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa94400cad0 tx=0x7fa94400cf90 comp rx=0 tx=0).stop 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 -- 172.21.15.103:0/92787281 shutdown_connections 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa9380a32d0 0x7fa9380a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa94c10c170 0x7fa94c19cc70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa94c103660 0x7fa94c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 --2- 172.21.15.103:0/92787281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c102d40 0x7fa94c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 -- 172.21.15.103:0/92787281 >> 172.21.15.103:0/92787281 conn(0x7fa94c0fc7a0 msgr2=0x7fa94c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.995+0000 7fa9520af640 1 -- 172.21.15.103:0/92787281 shutdown_connections 2024-09-19T06:06:35.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:35.996+0000 7fa9520af640 1 -- 172.21.15.103:0/92787281 wait complete. 2024-09-19T06:06:36.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:35 smithi169 ceph-mon[34350]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T06:06:36.374 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888118 got 146028888120 for osd.5 2024-09-19T06:06:36.374 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:36.819 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874269 got 279172874271 for osd.10 2024-09-19T06:06:36.819 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:36.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:36 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3849286999' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:06:36.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:36 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/92787281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:06:36.982 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:36 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3849286999' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:06:36.982 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:36 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/92787281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:06:37.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:36 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3849286999' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:06:37.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:36 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/92787281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:06:37.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659184 got 176093659188 for osd.6 2024-09-19T06:06:37.417 DEBUG:teuthology.parallel:result is None 2024-09-19T06:06:37.417 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:06:37.418 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:06:37.669 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:37.953 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:37 smithi103 ceph-mon[30925]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T06:06:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:37 smithi174 ceph-mon[34488]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T06:06:38.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:37 smithi169 ceph-mon[34350]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T06:06:38.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.141+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2688117157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb40102dd0 msgr2=0x7fdb401031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:38.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.141+0000 7fdb47ee4640 1 --2- 172.21.15.103:0/2688117157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb40102dd0 0x7fdb401031b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c009930 tx=0x7fdb3c02a420 comp rx=0 tx=0).stop 2024-09-19T06:06:38.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.141+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2688117157 shutdown_connections 2024-09-19T06:06:38.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.141+0000 7fdb47ee4640 1 --2- 172.21.15.103:0/2688117157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb40108300 0x7fdb4010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:38.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.141+0000 7fdb47ee4640 1 --2- 172.21.15.103:0/2688117157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb40103780 0x7fdb40107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:38.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.141+0000 7fdb47ee4640 1 --2- 172.21.15.103:0/2688117157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb40102dd0 0x7fdb401031b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:38.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.141+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2688117157 >> 172.21.15.103:0/2688117157 conn(0x7fdb400fc7d0 msgr2=0x7fdb400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:38.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2688117157 shutdown_connections 2024-09-19T06:06:38.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2688117157 wait complete. 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb47ee4640 1 Processor -- start 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb47ee4640 1 -- start start 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb47ee4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb40102dd0 0x7fdb40198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb47ee4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb40103780 0x7fdb40198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb47ee4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb40108300 0x7fdb4019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb47ee4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb40111fc0 con 0x7fdb40103780 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb47ee4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdb40111e40 con 0x7fdb40108300 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb47ee4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb40112140 con 0x7fdb40102dd0 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb4547f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb40103780 0x7fdb40198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb4547f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb40103780 0x7fdb40198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44556/0 (socket says 172.21.15.103:44556) 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.142+0000 7fdb4547f640 1 -- 172.21.15.103:0/2627971237 learned_addr learned my addr 172.21.15.103:0/2627971237 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:38.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb46481640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb40108300 0x7fdb4019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb45c80640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb40102dd0 0x7fdb40198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb4547f640 1 -- 172.21.15.103:0/2627971237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb40102dd0 msgr2=0x7fdb40198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb4547f640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb40102dd0 0x7fdb40198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb4547f640 1 -- 172.21.15.103:0/2627971237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb40108300 msgr2=0x7fdb4019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb4547f640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb40108300 0x7fdb4019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb4547f640 1 -- 172.21.15.103:0/2627971237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4019d4f0 con 0x7fdb40103780 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb45c80640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb40102dd0 0x7fdb40198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb4547f640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb40103780 0x7fdb40198a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c970 tx=0x7fdb3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb36ffd640 1 -- 172.21.15.103:0/2627971237 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb30007bb0 con 0x7fdb40103780 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2627971237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4019d7e0 con 0x7fdb40103780 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb36ffd640 1 -- 172.21.15.103:0/2627971237 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb30007d50 con 0x7fdb40103780 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb36ffd640 1 -- 172.21.15.103:0/2627971237 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb30004e10 con 0x7fdb40103780 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.143+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2627971237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb401a50c0 con 0x7fdb40103780 2024-09-19T06:06:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.144+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2627971237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb4006a7b0 con 0x7fdb40103780 2024-09-19T06:06:38.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.145+0000 7fdb36ffd640 1 -- 172.21.15.103:0/2627971237 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fdb30005000 con 0x7fdb40103780 2024-09-19T06:06:38.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.146+0000 7fdb36ffd640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdb2c0a32d0 0x7fdb2c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:38.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.146+0000 7fdb45c80640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdb2c0a32d0 0x7fdb2c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:38.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.146+0000 7fdb36ffd640 1 -- 172.21.15.103:0/2627971237 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fdb300cf8e0 con 0x7fdb40103780 2024-09-19T06:06:38.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.146+0000 7fdb45c80640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdb2c0a32d0 0x7fdb2c0a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c000c00 tx=0x7fdb3c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:38.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.150+0000 7fdb36ffd640 1 -- 172.21.15.103:0/2627971237 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb30014030 con 0x7fdb40103780 2024-09-19T06:06:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.311+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2627971237 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb40062630 con 0x7fdb2c0a32d0 2024-09-19T06:06:38.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.318+0000 7fdb36ffd640 1 -- 172.21.15.103:0/2627971237 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258713 (secure 0 0 0) 0x7fdb40062630 con 0x7fdb2c0a32d0 2024-09-19T06:06:38.323 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:38.324 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T06:06:38.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.320+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2627971237 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdb2c0a32d0 msgr2=0x7fdb2c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:38.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.320+0000 7fdb47ee4640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdb2c0a32d0 0x7fdb2c0a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c000c00 tx=0x7fdb3c031400 comp rx=0 tx=0).stop 2024-09-19T06:06:38.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.320+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2627971237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb40103780 msgr2=0x7fdb40198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:38.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.320+0000 7fdb47ee4640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb40103780 0x7fdb40198a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c970 tx=0x7fdb3000ce30 comp rx=0 tx=0).stop 2024-09-19T06:06:38.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.320+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2627971237 shutdown_connections 2024-09-19T06:06:38.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.320+0000 7fdb47ee4640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fdb2c0a32d0 0x7fdb2c0a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:38.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.320+0000 7fdb47ee4640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb40108300 0x7fdb4019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:38.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.320+0000 7fdb47ee4640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb40103780 0x7fdb40198a80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:38.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.320+0000 7fdb47ee4640 1 --2- 172.21.15.103:0/2627971237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb40102dd0 0x7fdb40198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:38.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.320+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2627971237 >> 172.21.15.103:0/2627971237 conn(0x7fdb400fc7d0 msgr2=0x7fdb40105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:38.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.321+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2627971237 shutdown_connections 2024-09-19T06:06:38.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:38.321+0000 7fdb47ee4640 1 -- 172.21.15.103:0/2627971237 wait complete. 2024-09-19T06:06:38.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:38 smithi103 ceph-mon[30925]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:39.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:38 smithi169 ceph-mon[34350]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:39.083 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-19T06:06:37.468001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653976,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":528,"num_read_kb":381,"num_write":343,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361640,"kb_used_data":12348,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580184,"statfs":{"total":1151940427776,"available":1151570108416,"internally_reserved":0,"allocated":12644352,"data_stored":7089744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":38,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002808"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518052+0000","last_change":"2024-09-19T06:05:24.703290+0000","last_active":"2024-09-19T06:05:46.518052+0000","last_peered":"2024-09-19T06:05:46.518052+0000","last_clean":"2024-09-19T06:05:46.518052+0000","last_became_active":"2024-09-19T06:05:24.702343+0000","last_became_peered":"2024-09-19T06:05:24.702343+0000","last_unstale":"2024-09-19T06:05:46.518052+0000","last_undegraded":"2024-09-19T06:05:46.518052+0000","last_fullsized":"2024-09-19T06:05:46.518052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.594004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519636+0000","last_change":"2024-09-19T06:05:24.700363+0000","last_active":"2024-09-19T06:05:46.519636+0000","last_peered":"2024-09-19T06:05:46.519636+0000","last_clean":"2024-09-19T06:05:46.519636+0000","last_became_active":"2024-09-19T06:05:24.700066+0000","last_became_peered":"2024-09-19T06:05:24.700066+0000","last_unstale":"2024-09-19T06:05:46.519636+0000","last_undegraded":"2024-09-19T06:05:46.519636+0000","last_fullsized":"2024-09-19T06:05:46.519636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:26.094195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519554+0000","last_change":"2024-09-19T06:05:24.702458+0000","last_active":"2024-09-19T06:05:46.519554+0000","last_peered":"2024-09-19T06:05:46.519554+0000","last_clean":"2024-09-19T06:05:46.519554+0000","last_became_active":"2024-09-19T06:05:24.702029+0000","last_became_peered":"2024-09-19T06:05:24.702029+0000","last_unstale":"2024-09-19T06:05:46.519554+0000","last_undegraded":"2024-09-19T06:05:46.519554+0000","last_fullsized":"2024-09-19T06:05:46.519554+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905954+0000","last_change":"2024-09-19T06:05:24.699402+0000","last_active":"2024-09-19T06:05:46.905954+0000","last_peered":"2024-09-19T06:05:46.905954+0000","last_clean":"2024-09-19T06:05:46.905954+0000","last_became_active":"2024-09-19T06:05:24.698191+0000","last_became_peered":"2024-09-19T06:05:24.698191+0000","last_unstale":"2024-09-19T06:05:46.905954+0000","last_undegraded":"2024-09-19T06:05:46.905954+0000","last_fullsized":"2024-09-19T06:05:46.905954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.056347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520337+0000","last_change":"2024-09-19T06:05:24.699821+0000","last_active":"2024-09-19T06:05:46.520337+0000","last_peered":"2024-09-19T06:05:46.520337+0000","last_clean":"2024-09-19T06:05:46.520337+0000","last_became_active":"2024-09-19T06:05:24.699493+0000","last_became_peered":"2024-09-19T06:05:24.699493+0000","last_unstale":"2024-09-19T06:05:46.520337+0000","last_undegraded":"2024-09-19T06:05:46.520337+0000","last_fullsized":"2024-09-19T06:05:46.520337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:34.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517699+0000","last_change":"2024-09-19T06:05:24.697821+0000","last_active":"2024-09-19T06:05:46.517699+0000","last_peered":"2024-09-19T06:05:46.517699+0000","last_clean":"2024-09-19T06:05:46.517699+0000","last_became_active":"2024-09-19T06:05:24.697495+0000","last_became_peered":"2024-09-19T06:05:24.697495+0000","last_unstale":"2024-09-19T06:05:46.517699+0000","last_undegraded":"2024-09-19T06:05:46.517699+0000","last_fullsized":"2024-09-19T06:05:46.517699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:03.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902318+0000","last_change":"2024-09-19T06:05:24.704610+0000","last_active":"2024-09-19T06:05:46.902318+0000","last_peered":"2024-09-19T06:05:46.902318+0000","last_clean":"2024-09-19T06:05:46.902318+0000","last_became_active":"2024-09-19T06:05:24.704288+0000","last_became_peered":"2024-09-19T06:05:24.704288+0000","last_unstale":"2024-09-19T06:05:46.902318+0000","last_undegraded":"2024-09-19T06:05:46.902318+0000","last_fullsized":"2024-09-19T06:05:46.902318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.530553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516407+0000","last_change":"2024-09-19T06:05:24.693662+0000","last_active":"2024-09-19T06:05:46.516407+0000","last_peered":"2024-09-19T06:05:46.516407+0000","last_clean":"2024-09-19T06:05:46.516407+0000","last_became_active":"2024-09-19T06:05:24.693327+0000","last_became_peered":"2024-09-19T06:05:24.693327+0000","last_unstale":"2024-09-19T06:05:46.516407+0000","last_undegraded":"2024-09-19T06:05:46.516407+0000","last_fullsized":"2024-09-19T06:05:46.516407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:39.646907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961884+0000","last_change":"2024-09-19T06:05:24.702552+0000","last_active":"2024-09-19T06:05:46.961884+0000","last_peered":"2024-09-19T06:05:46.961884+0000","last_clean":"2024-09-19T06:05:46.961884+0000","last_became_active":"2024-09-19T06:05:24.701090+0000","last_became_peered":"2024-09-19T06:05:24.701090+0000","last_unstale":"2024-09-19T06:05:46.961884+0000","last_undegraded":"2024-09-19T06:05:46.961884+0000","last_fullsized":"2024-09-19T06:05:46.961884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:44.361368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.524330+0000","last_change":"2024-09-19T06:05:46.524330+0000","last_active":"2024-09-19T06:05:46.524330+0000","last_peered":"2024-09-19T06:05:46.524330+0000","last_clean":"2024-09-19T06:05:46.524330+0000","last_became_active":"2024-09-19T06:05:46.523934+0000","last_became_peered":"2024-09-19T06:05:46.523934+0000","last_unstale":"2024-09-19T06:05:46.524330+0000","last_undegraded":"2024-09-19T06:05:46.524330+0000","last_fullsized":"2024-09-19T06:05:46.524330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:11:12.301698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902755+0000","last_change":"2024-09-19T06:05:24.703118+0000","last_active":"2024-09-19T06:05:46.902755+0000","last_peered":"2024-09-19T06:05:46.902755+0000","last_clean":"2024-09-19T06:05:46.902755+0000","last_became_active":"2024-09-19T06:05:24.702561+0000","last_became_peered":"2024-09-19T06:05:24.702561+0000","last_unstale":"2024-09-19T06:05:46.902755+0000","last_undegraded":"2024-09-19T06:05:46.902755+0000","last_fullsized":"2024-09-19T06:05:46.902755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:51.063256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.906049+0000","last_change":"2024-09-19T06:05:24.698704+0000","last_active":"2024-09-19T06:05:46.906049+0000","last_peered":"2024-09-19T06:05:46.906049+0000","last_clean":"2024-09-19T06:05:46.906049+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:46.906049+0000","last_undegraded":"2024-09-19T06:05:46.906049+0000","last_fullsized":"2024-09-19T06:05:46.906049+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:35.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903589+0000","last_change":"2024-09-19T06:05:24.696236+0000","last_active":"2024-09-19T06:05:46.903589+0000","last_peered":"2024-09-19T06:05:46.903589+0000","last_clean":"2024-09-19T06:05:46.903589+0000","last_became_active":"2024-09-19T06:05:24.695952+0000","last_became_peered":"2024-09-19T06:05:24.695952+0000","last_unstale":"2024-09-19T06:05:46.903589+0000","last_undegraded":"2024-09-19T06:05:46.903589+0000","last_fullsized":"2024-09-19T06:05:46.903589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:17.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519455+0000","last_change":"2024-09-19T06:05:24.699962+0000","last_active":"2024-09-19T06:05:46.519455+0000","last_peered":"2024-09-19T06:05:46.519455+0000","last_clean":"2024-09-19T06:05:46.519455+0000","last_became_active":"2024-09-19T06:05:24.699625+0000","last_became_peered":"2024-09-19T06:05:24.699625+0000","last_unstale":"2024-09-19T06:05:46.519455+0000","last_undegraded":"2024-09-19T06:05:46.519455+0000","last_fullsized":"2024-09-19T06:05:46.519455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:34.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519460+0000","last_change":"2024-09-19T06:05:24.701310+0000","last_active":"2024-09-19T06:05:46.519460+0000","last_peered":"2024-09-19T06:05:46.519460+0000","last_clean":"2024-09-19T06:05:46.519460+0000","last_became_active":"2024-09-19T06:05:24.701032+0000","last_became_peered":"2024-09-19T06:05:24.701032+0000","last_unstale":"2024-09-19T06:05:46.519460+0000","last_undegraded":"2024-09-19T06:05:46.519460+0000","last_fullsized":"2024-09-19T06:05:46.519460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:29.557533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961314+0000","last_change":"2024-09-19T06:05:24.699803+0000","last_active":"2024-09-19T06:05:46.961314+0000","last_peered":"2024-09-19T06:05:46.961314+0000","last_clean":"2024-09-19T06:05:46.961314+0000","last_became_active":"2024-09-19T06:05:24.699506+0000","last_became_peered":"2024-09-19T06:05:24.699506+0000","last_unstale":"2024-09-19T06:05:46.961314+0000","last_undegraded":"2024-09-19T06:05:46.961314+0000","last_fullsized":"2024-09-19T06:05:46.961314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:32.669231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518157+0000","last_change":"2024-09-19T06:05:24.703805+0000","last_active":"2024-09-19T06:05:46.518157+0000","last_peered":"2024-09-19T06:05:46.518157+0000","last_clean":"2024-09-19T06:05:46.518157+0000","last_became_active":"2024-09-19T06:05:24.702728+0000","last_became_peered":"2024-09-19T06:05:24.702728+0000","last_unstale":"2024-09-19T06:05:46.518157+0000","last_undegraded":"2024-09-19T06:05:46.518157+0000","last_fullsized":"2024-09-19T06:05:46.518157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:20.807530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518737+0000","last_change":"2024-09-19T06:05:24.691055+0000","last_active":"2024-09-19T06:05:46.518737+0000","last_peered":"2024-09-19T06:05:46.518737+0000","last_clean":"2024-09-19T06:05:46.518737+0000","last_became_active":"2024-09-19T06:05:24.690165+0000","last_became_peered":"2024-09-19T06:05:24.690165+0000","last_unstale":"2024-09-19T06:05:46.518737+0000","last_undegraded":"2024-09-19T06:05:46.518737+0000","last_fullsized":"2024-09-19T06:05:46.518737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:48.656335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521695+0000","last_change":"2024-09-19T06:05:24.697955+0000","last_active":"2024-09-19T06:05:46.521695+0000","last_peered":"2024-09-19T06:05:46.521695+0000","last_clean":"2024-09-19T06:05:46.521695+0000","last_became_active":"2024-09-19T06:05:24.697598+0000","last_became_peered":"2024-09-19T06:05:24.697598+0000","last_unstale":"2024-09-19T06:05:46.521695+0000","last_undegraded":"2024-09-19T06:05:46.521695+0000","last_fullsized":"2024-09-19T06:05:46.521695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.458647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517664+0000","last_change":"2024-09-19T06:05:24.705110+0000","last_active":"2024-09-19T06:05:46.517664+0000","last_peered":"2024-09-19T06:05:46.517664+0000","last_clean":"2024-09-19T06:05:46.517664+0000","last_became_active":"2024-09-19T06:05:24.704783+0000","last_became_peered":"2024-09-19T06:05:24.704783+0000","last_unstale":"2024-09-19T06:05:46.517664+0000","last_undegraded":"2024-09-19T06:05:46.517664+0000","last_fullsized":"2024-09-19T06:05:46.517664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:43.092969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903641+0000","last_change":"2024-09-19T06:05:24.693845+0000","last_active":"2024-09-19T06:05:46.903641+0000","last_peered":"2024-09-19T06:05:46.903641+0000","last_clean":"2024-09-19T06:05:46.903641+0000","last_became_active":"2024-09-19T06:05:24.693385+0000","last_became_peered":"2024-09-19T06:05:24.693385+0000","last_unstale":"2024-09-19T06:05:46.903641+0000","last_undegraded":"2024-09-19T06:05:46.903641+0000","last_fullsized":"2024-09-19T06:05:46.903641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:05.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961617+0000","last_change":"2024-09-19T06:05:24.697903+0000","last_active":"2024-09-19T06:05:46.961617+0000","last_peered":"2024-09-19T06:05:46.961617+0000","last_clean":"2024-09-19T06:05:46.961617+0000","last_became_active":"2024-09-19T06:05:24.697566+0000","last_became_peered":"2024-09-19T06:05:24.697566+0000","last_unstale":"2024-09-19T06:05:46.961617+0000","last_undegraded":"2024-09-19T06:05:46.961617+0000","last_fullsized":"2024-09-19T06:05:46.961617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:10.340401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516463+0000","last_change":"2024-09-19T06:05:24.696888+0000","last_active":"2024-09-19T06:05:46.516463+0000","last_peered":"2024-09-19T06:05:46.516463+0000","last_clean":"2024-09-19T06:05:46.516463+0000","last_became_active":"2024-09-19T06:05:24.696554+0000","last_became_peered":"2024-09-19T06:05:24.696554+0000","last_unstale":"2024-09-19T06:05:46.516463+0000","last_undegraded":"2024-09-19T06:05:46.516463+0000","last_fullsized":"2024-09-19T06:05:46.516463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520726+0000","last_change":"2024-09-19T06:05:24.692443+0000","last_active":"2024-09-19T06:05:46.520726+0000","last_peered":"2024-09-19T06:05:46.520726+0000","last_clean":"2024-09-19T06:05:46.520726+0000","last_became_active":"2024-09-19T06:05:24.690555+0000","last_became_peered":"2024-09-19T06:05:24.690555+0000","last_unstale":"2024-09-19T06:05:46.520726+0000","last_undegraded":"2024-09-19T06:05:46.520726+0000","last_fullsized":"2024-09-19T06:05:46.520726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:29.340744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516645+0000","last_change":"2024-09-19T06:05:24.699379+0000","last_active":"2024-09-19T06:05:46.516645+0000","last_peered":"2024-09-19T06:05:46.516645+0000","last_clean":"2024-09-19T06:05:46.516645+0000","last_became_active":"2024-09-19T06:05:24.699056+0000","last_became_peered":"2024-09-19T06:05:24.699056+0000","last_unstale":"2024-09-19T06:05:46.516645+0000","last_undegraded":"2024-09-19T06:05:46.516645+0000","last_fullsized":"2024-09-19T06:05:46.516645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:30.337080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521950+0000","last_change":"2024-09-19T06:05:24.698672+0000","last_active":"2024-09-19T06:05:46.521950+0000","last_peered":"2024-09-19T06:05:46.521950+0000","last_clean":"2024-09-19T06:05:46.521950+0000","last_became_active":"2024-09-19T06:05:24.698229+0000","last_became_peered":"2024-09-19T06:05:24.698229+0000","last_unstale":"2024-09-19T06:05:46.521950+0000","last_undegraded":"2024-09-19T06:05:46.521950+0000","last_fullsized":"2024-09-19T06:05:46.521950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.082538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517858+0000","last_change":"2024-09-19T06:05:24.707830+0000","last_active":"2024-09-19T06:05:46.517858+0000","last_peered":"2024-09-19T06:05:46.517858+0000","last_clean":"2024-09-19T06:05:46.517858+0000","last_became_active":"2024-09-19T06:05:24.707478+0000","last_became_peered":"2024-09-19T06:05:24.707478+0000","last_unstale":"2024-09-19T06:05:46.517858+0000","last_undegraded":"2024-09-19T06:05:46.517858+0000","last_fullsized":"2024-09-19T06:05:46.517858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:33.484877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903437+0000","last_change":"2024-09-19T06:05:24.697232+0000","last_active":"2024-09-19T06:05:46.903437+0000","last_peered":"2024-09-19T06:05:46.903437+0000","last_clean":"2024-09-19T06:05:46.903437+0000","last_became_active":"2024-09-19T06:05:24.696727+0000","last_became_peered":"2024-09-19T06:05:24.696727+0000","last_unstale":"2024-09-19T06:05:46.903437+0000","last_undegraded":"2024-09-19T06:05:46.903437+0000","last_fullsized":"2024-09-19T06:05:46.903437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:36.168493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519637+0000","last_change":"2024-09-19T06:05:24.695489+0000","last_active":"2024-09-19T06:05:46.519637+0000","last_peered":"2024-09-19T06:05:46.519637+0000","last_clean":"2024-09-19T06:05:46.519637+0000","last_became_active":"2024-09-19T06:05:24.695012+0000","last_became_peered":"2024-09-19T06:05:24.695012+0000","last_unstale":"2024-09-19T06:05:46.519637+0000","last_undegraded":"2024-09-19T06:05:46.519637+0000","last_fullsized":"2024-09-19T06:05:46.519637+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:41.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522199+0000","last_change":"2024-09-19T06:05:24.697294+0000","last_active":"2024-09-19T06:05:46.522199+0000","last_peered":"2024-09-19T06:05:46.522199+0000","last_clean":"2024-09-19T06:05:46.522199+0000","last_became_active":"2024-09-19T06:05:24.696563+0000","last_became_peered":"2024-09-19T06:05:24.696563+0000","last_unstale":"2024-09-19T06:05:46.522199+0000","last_undegraded":"2024-09-19T06:05:46.522199+0000","last_fullsized":"2024-09-19T06:05:46.522199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:41.861120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520918+0000","last_change":"2024-09-19T06:05:24.702710+0000","last_active":"2024-09-19T06:05:46.520918+0000","last_peered":"2024-09-19T06:05:46.520918+0000","last_clean":"2024-09-19T06:05:46.520918+0000","last_became_active":"2024-09-19T06:05:24.702039+0000","last_became_peered":"2024-09-19T06:05:24.702039+0000","last_unstale":"2024-09-19T06:05:46.520918+0000","last_undegraded":"2024-09-19T06:05:46.520918+0000","last_fullsized":"2024-09-19T06:05:46.520918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:23.831807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517416+0000","last_change":"2024-09-19T06:05:24.707671+0000","last_active":"2024-09-19T06:05:46.517416+0000","last_peered":"2024-09-19T06:05:46.517416+0000","last_clean":"2024-09-19T06:05:46.517416+0000","last_became_active":"2024-09-19T06:05:24.707325+0000","last_became_peered":"2024-09-19T06:05:24.707325+0000","last_unstale":"2024-09-19T06:05:46.517416+0000","last_undegraded":"2024-09-19T06:05:46.517416+0000","last_fullsized":"2024-09-19T06:05:46.517416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:32.149103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520934+0000","last_change":"2024-09-19T06:05:24.704875+0000","last_active":"2024-09-19T06:05:46.520934+0000","last_peered":"2024-09-19T06:05:46.520934+0000","last_clean":"2024-09-19T06:05:46.520934+0000","last_became_active":"2024-09-19T06:05:24.704501+0000","last_became_peered":"2024-09-19T06:05:24.704501+0000","last_unstale":"2024-09-19T06:05:46.520934+0000","last_undegraded":"2024-09-19T06:05:46.520934+0000","last_fullsized":"2024-09-19T06:05:46.520934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:06:33.967380+0000","last_change":"2024-09-19T06:05:22.687857+0000","last_active":"2024-09-19T06:06:33.967380+0000","last_peered":"2024-09-19T06:06:33.967380+0000","last_clean":"2024-09-19T06:06:33.967380+0000","last_became_active":"2024-09-19T06:05:22.687573+0000","last_became_peered":"2024-09-19T06:05:22.687573+0000","last_unstale":"2024-09-19T06:06:33.967380+0000","last_undegraded":"2024-09-19T06:06:33.967380+0000","last_fullsized":"2024-09-19T06:06:33.967380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:31.972444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.904521+0000","last_change":"2024-09-19T06:05:46.904521+0000","last_active":"2024-09-19T06:05:46.904521+0000","last_peered":"2024-09-19T06:05:46.904521+0000","last_clean":"2024-09-19T06:05:46.904521+0000","last_became_active":"2024-09-19T06:05:46.904146+0000","last_became_peered":"2024-09-19T06:05:46.904146+0000","last_unstale":"2024-09-19T06:05:46.904521+0000","last_undegraded":"2024-09-19T06:05:46.904521+0000","last_fullsized":"2024-09-19T06:05:46.904521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:48.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517810+0000","last_change":"2024-09-19T06:05:22.680500+0000","last_active":"2024-09-19T06:05:46.517810+0000","last_peered":"2024-09-19T06:05:46.517810+0000","last_clean":"2024-09-19T06:05:46.517810+0000","last_became_active":"2024-09-19T06:05:22.679947+0000","last_became_peered":"2024-09-19T06:05:22.679947+0000","last_unstale":"2024-09-19T06:05:46.517810+0000","last_undegraded":"2024-09-19T06:05:46.517810+0000","last_fullsized":"2024-09-19T06:05:46.517810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:34.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902704+0000","last_change":"2024-09-19T06:05:22.680962+0000","last_active":"2024-09-19T06:05:46.902704+0000","last_peered":"2024-09-19T06:05:46.902704+0000","last_clean":"2024-09-19T06:05:46.902704+0000","last_became_active":"2024-09-19T06:05:22.680662+0000","last_became_peered":"2024-09-19T06:05:22.680662+0000","last_unstale":"2024-09-19T06:05:46.902704+0000","last_undegraded":"2024-09-19T06:05:46.902704+0000","last_fullsized":"2024-09-19T06:05:46.902704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.296422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516416+0000","last_change":"2024-09-19T06:05:24.695214+0000","last_active":"2024-09-19T06:05:46.516416+0000","last_peered":"2024-09-19T06:05:46.516416+0000","last_clean":"2024-09-19T06:05:46.516416+0000","last_became_active":"2024-09-19T06:05:24.694930+0000","last_became_peered":"2024-09-19T06:05:24.694930+0000","last_unstale":"2024-09-19T06:05:46.516416+0000","last_undegraded":"2024-09-19T06:05:46.516416+0000","last_fullsized":"2024-09-19T06:05:46.516416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:51.382934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520982+0000","last_change":"2024-09-19T06:05:22.684504+0000","last_active":"2024-09-19T06:05:46.520982+0000","last_peered":"2024-09-19T06:05:46.520982+0000","last_clean":"2024-09-19T06:05:46.520982+0000","last_became_active":"2024-09-19T06:05:22.684169+0000","last_became_peered":"2024-09-19T06:05:22.684169+0000","last_unstale":"2024-09-19T06:05:46.520982+0000","last_undegraded":"2024-09-19T06:05:46.520982+0000","last_fullsized":"2024-09-19T06:05:46.520982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:29.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518059+0000","last_change":"2024-09-19T06:05:24.693056+0000","last_active":"2024-09-19T06:05:46.518059+0000","last_peered":"2024-09-19T06:05:46.518059+0000","last_clean":"2024-09-19T06:05:46.518059+0000","last_became_active":"2024-09-19T06:05:24.692544+0000","last_became_peered":"2024-09-19T06:05:24.692544+0000","last_unstale":"2024-09-19T06:05:46.518059+0000","last_undegraded":"2024-09-19T06:05:46.518059+0000","last_fullsized":"2024-09-19T06:05:46.518059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:45.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:06:33.966876+0000","last_change":"2024-09-19T06:05:22.682854+0000","last_active":"2024-09-19T06:06:33.966876+0000","last_peered":"2024-09-19T06:06:33.966876+0000","last_clean":"2024-09-19T06:06:33.966876+0000","last_became_active":"2024-09-19T06:05:22.682406+0000","last_became_peered":"2024-09-19T06:05:22.682406+0000","last_unstale":"2024-09-19T06:06:33.966876+0000","last_undegraded":"2024-09-19T06:06:33.966876+0000","last_fullsized":"2024-09-19T06:06:33.966876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.206144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961915+0000","last_change":"2024-09-19T06:05:24.699408+0000","last_active":"2024-09-19T06:05:46.961915+0000","last_peered":"2024-09-19T06:05:46.961915+0000","last_clean":"2024-09-19T06:05:46.961915+0000","last_became_active":"2024-09-19T06:05:24.699106+0000","last_became_peered":"2024-09-19T06:05:24.699106+0000","last_unstale":"2024-09-19T06:05:46.961915+0000","last_undegraded":"2024-09-19T06:05:46.961915+0000","last_fullsized":"2024-09-19T06:05:46.961915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:37.487458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902210+0000","last_change":"2024-09-19T06:05:22.686106+0000","last_active":"2024-09-19T06:05:46.902210+0000","last_peered":"2024-09-19T06:05:46.902210+0000","last_clean":"2024-09-19T06:05:46.902210+0000","last_became_active":"2024-09-19T06:05:22.685763+0000","last_became_peered":"2024-09-19T06:05:22.685763+0000","last_unstale":"2024-09-19T06:05:46.902210+0000","last_undegraded":"2024-09-19T06:05:46.902210+0000","last_fullsized":"2024-09-19T06:05:46.902210+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:57.889128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.524038+0000","last_change":"2024-09-19T06:05:46.524038+0000","last_active":"2024-09-19T06:05:46.524038+0000","last_peered":"2024-09-19T06:05:46.524038+0000","last_clean":"2024-09-19T06:05:46.524038+0000","last_became_active":"2024-09-19T06:05:46.523746+0000","last_became_peered":"2024-09-19T06:05:46.523746+0000","last_unstale":"2024-09-19T06:05:46.524038+0000","last_undegraded":"2024-09-19T06:05:46.524038+0000","last_fullsized":"2024-09-19T06:05:46.524038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:17.361840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519825+0000","last_change":"2024-09-19T06:05:23.060545+0000","last_active":"2024-09-19T06:05:46.519825+0000","last_peered":"2024-09-19T06:05:46.519825+0000","last_clean":"2024-09-19T06:05:46.519825+0000","last_became_active":"2024-09-19T06:05:23.060187+0000","last_became_peered":"2024-09-19T06:05:23.060187+0000","last_unstale":"2024-09-19T06:05:46.519825+0000","last_undegraded":"2024-09-19T06:05:46.519825+0000","last_fullsized":"2024-09-19T06:05:46.519825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.604284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961566+0000","last_change":"2024-09-19T06:05:24.702535+0000","last_active":"2024-09-19T06:05:46.961566+0000","last_peered":"2024-09-19T06:05:46.961566+0000","last_clean":"2024-09-19T06:05:46.961566+0000","last_became_active":"2024-09-19T06:05:24.701616+0000","last_became_peered":"2024-09-19T06:05:24.701616+0000","last_unstale":"2024-09-19T06:05:46.961566+0000","last_undegraded":"2024-09-19T06:05:46.961566+0000","last_fullsized":"2024-09-19T06:05:46.961566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:43.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":180,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:06:34.968263+0000","last_change":"2024-09-19T06:05:22.685460+0000","last_active":"2024-09-19T06:06:34.968263+0000","last_peered":"2024-09-19T06:06:34.968263+0000","last_clean":"2024-09-19T06:06:34.968263+0000","last_became_active":"2024-09-19T06:05:22.685086+0000","last_became_peered":"2024-09-19T06:05:22.685086+0000","last_unstale":"2024-09-19T06:06:34.968263+0000","last_undegraded":"2024-09-19T06:06:34.968263+0000","last_fullsized":"2024-09-19T06:06:34.968263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:10.373783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":123,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520872+0000","last_change":"2024-09-19T06:05:24.700431+0000","last_active":"2024-09-19T06:05:46.520872+0000","last_peered":"2024-09-19T06:05:46.520872+0000","last_clean":"2024-09-19T06:05:46.520872+0000","last_became_active":"2024-09-19T06:05:24.700092+0000","last_became_peered":"2024-09-19T06:05:24.700092+0000","last_unstale":"2024-09-19T06:05:46.520872+0000","last_undegraded":"2024-09-19T06:05:46.520872+0000","last_fullsized":"2024-09-19T06:05:46.520872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:17.208392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.530433+0000","last_change":"2024-09-19T06:05:46.530433+0000","last_active":"2024-09-19T06:05:46.530433+0000","last_peered":"2024-09-19T06:05:46.530433+0000","last_clean":"2024-09-19T06:05:46.530433+0000","last_became_active":"2024-09-19T06:05:46.521700+0000","last_became_peered":"2024-09-19T06:05:46.521700+0000","last_unstale":"2024-09-19T06:05:46.530433+0000","last_undegraded":"2024-09-19T06:05:46.530433+0000","last_fullsized":"2024-09-19T06:05:46.530433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:40.489547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903307+0000","last_change":"2024-09-19T06:05:24.699149+0000","last_active":"2024-09-19T06:05:46.903307+0000","last_peered":"2024-09-19T06:05:46.903307+0000","last_clean":"2024-09-19T06:05:46.903307+0000","last_became_active":"2024-09-19T06:05:24.698846+0000","last_became_peered":"2024-09-19T06:05:24.698846+0000","last_unstale":"2024-09-19T06:05:46.903307+0000","last_undegraded":"2024-09-19T06:05:46.903307+0000","last_fullsized":"2024-09-19T06:05:46.903307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:19.416169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519763+0000","last_change":"2024-09-19T06:05:22.682157+0000","last_active":"2024-09-19T06:05:46.519763+0000","last_peered":"2024-09-19T06:05:46.519763+0000","last_clean":"2024-09-19T06:05:46.519763+0000","last_became_active":"2024-09-19T06:05:22.681816+0000","last_became_peered":"2024-09-19T06:05:22.681816+0000","last_unstale":"2024-09-19T06:05:46.519763+0000","last_undegraded":"2024-09-19T06:05:46.519763+0000","last_fullsized":"2024-09-19T06:05:46.519763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:05.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902542+0000","last_change":"2024-09-19T06:05:24.699233+0000","last_active":"2024-09-19T06:05:46.902542+0000","last_peered":"2024-09-19T06:05:46.902542+0000","last_clean":"2024-09-19T06:05:46.902542+0000","last_became_active":"2024-09-19T06:05:24.698918+0000","last_became_peered":"2024-09-19T06:05:24.698918+0000","last_unstale":"2024-09-19T06:05:46.902542+0000","last_undegraded":"2024-09-19T06:05:46.902542+0000","last_fullsized":"2024-09-19T06:05:46.902542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:06:34.975047+0000","last_change":"2024-09-19T06:05:22.682161+0000","last_active":"2024-09-19T06:06:34.975047+0000","last_peered":"2024-09-19T06:06:34.975047+0000","last_clean":"2024-09-19T06:06:34.975047+0000","last_became_active":"2024-09-19T06:05:22.681805+0000","last_became_peered":"2024-09-19T06:05:22.681805+0000","last_unstale":"2024-09-19T06:06:34.975047+0000","last_undegraded":"2024-09-19T06:06:34.975047+0000","last_fullsized":"2024-09-19T06:06:34.975047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:27.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902474+0000","last_change":"2024-09-19T06:05:24.703668+0000","last_active":"2024-09-19T06:05:46.902474+0000","last_peered":"2024-09-19T06:05:46.902474+0000","last_clean":"2024-09-19T06:05:46.902474+0000","last_became_active":"2024-09-19T06:05:24.703342+0000","last_became_peered":"2024-09-19T06:05:24.703342+0000","last_unstale":"2024-09-19T06:05:46.902474+0000","last_undegraded":"2024-09-19T06:05:46.902474+0000","last_fullsized":"2024-09-19T06:05:46.902474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:30.399187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520049+0000","last_change":"2024-09-19T06:05:23.060458+0000","last_active":"2024-09-19T06:05:46.520049+0000","last_peered":"2024-09-19T06:05:46.520049+0000","last_clean":"2024-09-19T06:05:46.520049+0000","last_became_active":"2024-09-19T06:05:23.060098+0000","last_became_peered":"2024-09-19T06:05:23.060098+0000","last_unstale":"2024-09-19T06:05:46.520049+0000","last_undegraded":"2024-09-19T06:05:46.520049+0000","last_fullsized":"2024-09-19T06:05:46.520049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:58.800162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519964+0000","last_change":"2024-09-19T06:05:24.699832+0000","last_active":"2024-09-19T06:05:46.519964+0000","last_peered":"2024-09-19T06:05:46.519964+0000","last_clean":"2024-09-19T06:05:46.519964+0000","last_became_active":"2024-09-19T06:05:24.697600+0000","last_became_peered":"2024-09-19T06:05:24.697600+0000","last_unstale":"2024-09-19T06:05:46.519964+0000","last_undegraded":"2024-09-19T06:05:46.519964+0000","last_fullsized":"2024-09-19T06:05:46.519964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:15.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521202+0000","last_change":"2024-09-19T06:05:22.682962+0000","last_active":"2024-09-19T06:05:46.521202+0000","last_peered":"2024-09-19T06:05:46.521202+0000","last_clean":"2024-09-19T06:05:46.521202+0000","last_became_active":"2024-09-19T06:05:22.682573+0000","last_became_peered":"2024-09-19T06:05:22.682573+0000","last_unstale":"2024-09-19T06:05:46.521202+0000","last_undegraded":"2024-09-19T06:05:46.521202+0000","last_fullsized":"2024-09-19T06:05:46.521202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:31.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.907103+0000","last_change":"2024-09-19T06:05:46.907103+0000","last_active":"2024-09-19T06:05:46.907103+0000","last_peered":"2024-09-19T06:05:46.907103+0000","last_clean":"2024-09-19T06:05:46.907103+0000","last_became_active":"2024-09-19T06:05:46.906741+0000","last_became_peered":"2024-09-19T06:05:46.906741+0000","last_unstale":"2024-09-19T06:05:46.907103+0000","last_undegraded":"2024-09-19T06:05:46.907103+0000","last_fullsized":"2024-09-19T06:05:46.907103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:42.275594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902723+0000","last_change":"2024-09-19T06:05:22.684007+0000","last_active":"2024-09-19T06:05:46.902723+0000","last_peered":"2024-09-19T06:05:46.902723+0000","last_clean":"2024-09-19T06:05:46.902723+0000","last_became_active":"2024-09-19T06:05:22.683606+0000","last_became_peered":"2024-09-19T06:05:22.683606+0000","last_unstale":"2024-09-19T06:05:46.902723+0000","last_undegraded":"2024-09-19T06:05:46.902723+0000","last_fullsized":"2024-09-19T06:05:46.902723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:29.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902839+0000","last_change":"2024-09-19T06:05:24.698057+0000","last_active":"2024-09-19T06:05:46.902839+0000","last_peered":"2024-09-19T06:05:46.902839+0000","last_clean":"2024-09-19T06:05:46.902839+0000","last_became_active":"2024-09-19T06:05:24.697604+0000","last_became_peered":"2024-09-19T06:05:24.697604+0000","last_unstale":"2024-09-19T06:05:46.902839+0000","last_undegraded":"2024-09-19T06:05:46.902839+0000","last_fullsized":"2024-09-19T06:05:46.902839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:33.246096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520103+0000","last_change":"2024-09-19T06:05:22.680641+0000","last_active":"2024-09-19T06:05:46.520103+0000","last_peered":"2024-09-19T06:05:46.520103+0000","last_clean":"2024-09-19T06:05:46.520103+0000","last_became_active":"2024-09-19T06:05:22.680282+0000","last_became_peered":"2024-09-19T06:05:22.680282+0000","last_unstale":"2024-09-19T06:05:46.520103+0000","last_undegraded":"2024-09-19T06:05:46.520103+0000","last_fullsized":"2024-09-19T06:05:46.520103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:07.171581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902552+0000","last_change":"2024-09-19T06:05:24.705525+0000","last_active":"2024-09-19T06:05:46.902552+0000","last_peered":"2024-09-19T06:05:46.902552+0000","last_clean":"2024-09-19T06:05:46.902552+0000","last_became_active":"2024-09-19T06:05:24.705226+0000","last_became_peered":"2024-09-19T06:05:24.705226+0000","last_unstale":"2024-09-19T06:05:46.902552+0000","last_undegraded":"2024-09-19T06:05:46.902552+0000","last_fullsized":"2024-09-19T06:05:46.902552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:51.020525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522657+0000","last_change":"2024-09-19T06:05:23.060628+0000","last_active":"2024-09-19T06:05:46.522657+0000","last_peered":"2024-09-19T06:05:46.522657+0000","last_clean":"2024-09-19T06:05:46.522657+0000","last_became_active":"2024-09-19T06:05:23.060066+0000","last_became_peered":"2024-09-19T06:05:23.060066+0000","last_unstale":"2024-09-19T06:05:46.522657+0000","last_undegraded":"2024-09-19T06:05:46.522657+0000","last_fullsized":"2024-09-19T06:05:46.522657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:55.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902770+0000","last_change":"2024-09-19T06:05:24.701994+0000","last_active":"2024-09-19T06:05:46.902770+0000","last_peered":"2024-09-19T06:05:46.902770+0000","last_clean":"2024-09-19T06:05:46.902770+0000","last_became_active":"2024-09-19T06:05:24.701648+0000","last_became_peered":"2024-09-19T06:05:24.701648+0000","last_unstale":"2024-09-19T06:05:46.902770+0000","last_undegraded":"2024-09-19T06:05:46.902770+0000","last_fullsized":"2024-09-19T06:05:46.902770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:16.475339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902639+0000","last_change":"2024-09-19T06:04:14.186274+0000","last_active":"2024-09-19T06:05:46.902639+0000","last_peered":"2024-09-19T06:05:46.902639+0000","last_clean":"2024-09-19T06:05:46.902639+0000","last_became_active":"2024-09-19T06:04:14.185907+0000","last_became_peered":"2024-09-19T06:04:14.185907+0000","last_unstale":"2024-09-19T06:05:46.902639+0000","last_undegraded":"2024-09-19T06:05:46.902639+0000","last_fullsized":"2024-09-19T06:05:46.902639+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_clean_scrub_stamp":"2024-09-19T06:00:59.680614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:01.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905464+0000","last_change":"2024-09-19T06:05:22.682242+0000","last_active":"2024-09-19T06:05:46.905464+0000","last_peered":"2024-09-19T06:05:46.905464+0000","last_clean":"2024-09-19T06:05:46.905464+0000","last_became_active":"2024-09-19T06:05:22.681896+0000","last_became_peered":"2024-09-19T06:05:22.681896+0000","last_unstale":"2024-09-19T06:05:46.905464+0000","last_undegraded":"2024-09-19T06:05:46.905464+0000","last_fullsized":"2024-09-19T06:05:46.905464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.119422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.962902+0000","last_change":"2024-09-19T06:05:46.962541+0000","last_active":"2024-09-19T06:05:46.962902+0000","last_peered":"2024-09-19T06:05:46.962902+0000","last_clean":"2024-09-19T06:05:46.962902+0000","last_became_active":"2024-09-19T06:05:46.962261+0000","last_became_peered":"2024-09-19T06:05:46.962261+0000","last_unstale":"2024-09-19T06:05:46.962902+0000","last_undegraded":"2024-09-19T06:05:46.962902+0000","last_fullsized":"2024-09-19T06:05:46.962902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:36.355129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902052+0000","last_change":"2024-09-19T06:05:22.685809+0000","last_active":"2024-09-19T06:05:46.902052+0000","last_peered":"2024-09-19T06:05:46.902052+0000","last_clean":"2024-09-19T06:05:46.902052+0000","last_became_active":"2024-09-19T06:05:22.685466+0000","last_became_peered":"2024-09-19T06:05:22.685466+0000","last_unstale":"2024-09-19T06:05:46.902052+0000","last_undegraded":"2024-09-19T06:05:46.902052+0000","last_fullsized":"2024-09-19T06:05:46.902052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:43.793845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903209+0000","last_change":"2024-09-19T06:05:24.701105+0000","last_active":"2024-09-19T06:05:46.903209+0000","last_peered":"2024-09-19T06:05:46.903209+0000","last_clean":"2024-09-19T06:05:46.903209+0000","last_became_active":"2024-09-19T06:05:24.700825+0000","last_became_peered":"2024-09-19T06:05:24.700825+0000","last_unstale":"2024-09-19T06:05:46.903209+0000","last_undegraded":"2024-09-19T06:05:46.903209+0000","last_fullsized":"2024-09-19T06:05:46.903209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:35.707437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:06:32.971651+0000","last_change":"2024-09-19T06:05:23.059587+0000","last_active":"2024-09-19T06:06:32.971651+0000","last_peered":"2024-09-19T06:06:32.971651+0000","last_clean":"2024-09-19T06:06:32.971651+0000","last_became_active":"2024-09-19T06:05:23.059248+0000","last_became_peered":"2024-09-19T06:05:23.059248+0000","last_unstale":"2024-09-19T06:06:32.971651+0000","last_undegraded":"2024-09-19T06:06:32.971651+0000","last_fullsized":"2024-09-19T06:06:32.971651+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:25.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520818+0000","last_change":"2024-09-19T06:05:24.701610+0000","last_active":"2024-09-19T06:05:46.520818+0000","last_peered":"2024-09-19T06:05:46.520818+0000","last_clean":"2024-09-19T06:05:46.520818+0000","last_became_active":"2024-09-19T06:05:24.697296+0000","last_became_peered":"2024-09-19T06:05:24.697296+0000","last_unstale":"2024-09-19T06:05:46.520818+0000","last_undegraded":"2024-09-19T06:05:46.520818+0000","last_fullsized":"2024-09-19T06:05:46.520818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:52.256284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902512+0000","last_change":"2024-09-19T06:05:22.684818+0000","last_active":"2024-09-19T06:05:46.902512+0000","last_peered":"2024-09-19T06:05:46.902512+0000","last_clean":"2024-09-19T06:05:46.902512+0000","last_became_active":"2024-09-19T06:05:22.684211+0000","last_became_peered":"2024-09-19T06:05:22.684211+0000","last_unstale":"2024-09-19T06:05:46.902512+0000","last_undegraded":"2024-09-19T06:05:46.902512+0000","last_fullsized":"2024-09-19T06:05:46.902512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:50.711805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517975+0000","last_change":"2024-09-19T06:05:24.702992+0000","last_active":"2024-09-19T06:05:46.517975+0000","last_peered":"2024-09-19T06:05:46.517975+0000","last_clean":"2024-09-19T06:05:46.517975+0000","last_became_active":"2024-09-19T06:05:24.702643+0000","last_became_peered":"2024-09-19T06:05:24.702643+0000","last_unstale":"2024-09-19T06:05:46.517975+0000","last_undegraded":"2024-09-19T06:05:46.517975+0000","last_fullsized":"2024-09-19T06:05:46.517975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:40.651861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518397+0000","last_change":"2024-09-19T06:05:23.060444+0000","last_active":"2024-09-19T06:05:46.518397+0000","last_peered":"2024-09-19T06:05:46.518397+0000","last_clean":"2024-09-19T06:05:46.518397+0000","last_became_active":"2024-09-19T06:05:23.059879+0000","last_became_peered":"2024-09-19T06:05:23.059879+0000","last_unstale":"2024-09-19T06:05:46.518397+0000","last_undegraded":"2024-09-19T06:05:46.518397+0000","last_fullsized":"2024-09-19T06:05:46.518397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:39.013096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517898+0000","last_change":"2024-09-19T06:05:24.694892+0000","last_active":"2024-09-19T06:05:46.517898+0000","last_peered":"2024-09-19T06:05:46.517898+0000","last_clean":"2024-09-19T06:05:46.517898+0000","last_became_active":"2024-09-19T06:05:24.694534+0000","last_became_peered":"2024-09-19T06:05:24.694534+0000","last_unstale":"2024-09-19T06:05:46.517898+0000","last_undegraded":"2024-09-19T06:05:46.517898+0000","last_fullsized":"2024-09-19T06:05:46.517898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:50.633035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521062+0000","last_change":"2024-09-19T06:05:23.060597+0000","last_active":"2024-09-19T06:05:46.521062+0000","last_peered":"2024-09-19T06:05:46.521062+0000","last_clean":"2024-09-19T06:05:46.521062+0000","last_became_active":"2024-09-19T06:05:23.060235+0000","last_became_peered":"2024-09-19T06:05:23.060235+0000","last_unstale":"2024-09-19T06:05:46.521062+0000","last_undegraded":"2024-09-19T06:05:46.521062+0000","last_fullsized":"2024-09-19T06:05:46.521062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:54.517780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903431+0000","last_change":"2024-09-19T06:05:24.698131+0000","last_active":"2024-09-19T06:05:46.903431+0000","last_peered":"2024-09-19T06:05:46.903431+0000","last_clean":"2024-09-19T06:05:46.903431+0000","last_became_active":"2024-09-19T06:05:24.697784+0000","last_became_peered":"2024-09-19T06:05:24.697784+0000","last_unstale":"2024-09-19T06:05:46.903431+0000","last_undegraded":"2024-09-19T06:05:46.903431+0000","last_fullsized":"2024-09-19T06:05:46.903431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:49.563908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:48.700895+0000","last_change":"2024-09-19T06:05:22.679532+0000","last_active":"2024-09-19T06:05:48.700895+0000","last_peered":"2024-09-19T06:05:48.700895+0000","last_clean":"2024-09-19T06:05:48.700895+0000","last_became_active":"2024-09-19T06:05:22.679156+0000","last_became_peered":"2024-09-19T06:05:22.679156+0000","last_unstale":"2024-09-19T06:05:48.700895+0000","last_undegraded":"2024-09-19T06:05:48.700895+0000","last_fullsized":"2024-09-19T06:05:48.700895+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:31.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516744+0000","last_change":"2024-09-19T06:05:24.698383+0000","last_active":"2024-09-19T06:05:46.516744+0000","last_peered":"2024-09-19T06:05:46.516744+0000","last_clean":"2024-09-19T06:05:46.516744+0000","last_became_active":"2024-09-19T06:05:24.698044+0000","last_became_peered":"2024-09-19T06:05:24.698044+0000","last_unstale":"2024-09-19T06:05:46.516744+0000","last_undegraded":"2024-09-19T06:05:46.516744+0000","last_fullsized":"2024-09-19T06:05:46.516744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:53.388847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905533+0000","last_change":"2024-09-19T06:05:22.684799+0000","last_active":"2024-09-19T06:05:46.905533+0000","last_peered":"2024-09-19T06:05:46.905533+0000","last_clean":"2024-09-19T06:05:46.905533+0000","last_became_active":"2024-09-19T06:05:22.684376+0000","last_became_peered":"2024-09-19T06:05:22.684376+0000","last_unstale":"2024-09-19T06:05:46.905533+0000","last_undegraded":"2024-09-19T06:05:46.905533+0000","last_fullsized":"2024-09-19T06:05:46.905533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.124960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519736+0000","last_change":"2024-09-19T06:05:24.693751+0000","last_active":"2024-09-19T06:05:46.519736+0000","last_peered":"2024-09-19T06:05:46.519736+0000","last_clean":"2024-09-19T06:05:46.519736+0000","last_became_active":"2024-09-19T06:05:24.693442+0000","last_became_peered":"2024-09-19T06:05:24.693442+0000","last_unstale":"2024-09-19T06:05:46.519736+0000","last_undegraded":"2024-09-19T06:05:46.519736+0000","last_fullsized":"2024-09-19T06:05:46.519736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:46.491860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961568+0000","last_change":"2024-09-19T06:05:23.060522+0000","last_active":"2024-09-19T06:05:46.961568+0000","last_peered":"2024-09-19T06:05:46.961568+0000","last_clean":"2024-09-19T06:05:46.961568+0000","last_became_active":"2024-09-19T06:05:23.060170+0000","last_became_peered":"2024-09-19T06:05:23.060170+0000","last_unstale":"2024-09-19T06:05:46.961568+0000","last_undegraded":"2024-09-19T06:05:46.961568+0000","last_fullsized":"2024-09-19T06:05:46.961568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:54.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520186+0000","last_change":"2024-09-19T06:05:24.701242+0000","last_active":"2024-09-19T06:05:46.520186+0000","last_peered":"2024-09-19T06:05:46.520186+0000","last_clean":"2024-09-19T06:05:46.520186+0000","last_became_active":"2024-09-19T06:05:24.700813+0000","last_became_peered":"2024-09-19T06:05:24.700813+0000","last_unstale":"2024-09-19T06:05:46.520186+0000","last_undegraded":"2024-09-19T06:05:46.520186+0000","last_fullsized":"2024-09-19T06:05:46.520186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:42.706448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516577+0000","last_change":"2024-09-19T06:05:22.677502+0000","last_active":"2024-09-19T06:05:46.516577+0000","last_peered":"2024-09-19T06:05:46.516577+0000","last_clean":"2024-09-19T06:05:46.516577+0000","last_became_active":"2024-09-19T06:05:22.677082+0000","last_became_peered":"2024-09-19T06:05:22.677082+0000","last_unstale":"2024-09-19T06:05:46.516577+0000","last_undegraded":"2024-09-19T06:05:46.516577+0000","last_fullsized":"2024-09-19T06:05:46.516577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:30.991778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517459+0000","last_change":"2024-09-19T06:05:24.703155+0000","last_active":"2024-09-19T06:05:46.517459+0000","last_peered":"2024-09-19T06:05:46.517459+0000","last_clean":"2024-09-19T06:05:46.517459+0000","last_became_active":"2024-09-19T06:05:24.702570+0000","last_became_peered":"2024-09-19T06:05:24.702570+0000","last_unstale":"2024-09-19T06:05:46.517459+0000","last_undegraded":"2024-09-19T06:05:46.517459+0000","last_fullsized":"2024-09-19T06:05:46.517459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:36.016886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.532666+0000","last_change":"2024-09-19T06:05:46.532666+0000","last_active":"2024-09-19T06:05:46.532666+0000","last_peered":"2024-09-19T06:05:46.532666+0000","last_clean":"2024-09-19T06:05:46.532666+0000","last_became_active":"2024-09-19T06:05:46.523271+0000","last_became_peered":"2024-09-19T06:05:46.523271+0000","last_unstale":"2024-09-19T06:05:46.532666+0000","last_undegraded":"2024-09-19T06:05:46.532666+0000","last_fullsized":"2024-09-19T06:05:46.532666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:04.627727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516710+0000","last_change":"2024-09-19T06:05:24.694476+0000","last_active":"2024-09-19T06:05:46.516710+0000","last_peered":"2024-09-19T06:05:46.516710+0000","last_clean":"2024-09-19T06:05:46.516710+0000","last_became_active":"2024-09-19T06:05:24.694147+0000","last_became_peered":"2024-09-19T06:05:24.694147+0000","last_unstale":"2024-09-19T06:05:46.516710+0000","last_undegraded":"2024-09-19T06:05:46.516710+0000","last_fullsized":"2024-09-19T06:05:46.516710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:48.830522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520434+0000","last_change":"2024-09-19T06:05:22.687422+0000","last_active":"2024-09-19T06:05:46.520434+0000","last_peered":"2024-09-19T06:05:46.520434+0000","last_clean":"2024-09-19T06:05:46.520434+0000","last_became_active":"2024-09-19T06:05:22.686950+0000","last_became_peered":"2024-09-19T06:05:22.686950+0000","last_unstale":"2024-09-19T06:05:46.520434+0000","last_undegraded":"2024-09-19T06:05:46.520434+0000","last_fullsized":"2024-09-19T06:05:46.520434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:49.279769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902432+0000","last_change":"2024-09-19T06:05:24.695701+0000","last_active":"2024-09-19T06:05:46.902432+0000","last_peered":"2024-09-19T06:05:46.902432+0000","last_clean":"2024-09-19T06:05:46.902432+0000","last_became_active":"2024-09-19T06:05:24.695341+0000","last_became_peered":"2024-09-19T06:05:24.695341+0000","last_unstale":"2024-09-19T06:05:46.902432+0000","last_undegraded":"2024-09-19T06:05:46.902432+0000","last_fullsized":"2024-09-19T06:05:46.902432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:52.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519721+0000","last_change":"2024-09-19T06:05:24.703456+0000","last_active":"2024-09-19T06:05:46.519721+0000","last_peered":"2024-09-19T06:05:46.519721+0000","last_clean":"2024-09-19T06:05:46.519721+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:46.519721+0000","last_undegraded":"2024-09-19T06:05:46.519721+0000","last_fullsized":"2024-09-19T06:05:46.519721+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:15.159843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520802+0000","last_change":"2024-09-19T06:05:22.683833+0000","last_active":"2024-09-19T06:05:46.520802+0000","last_peered":"2024-09-19T06:05:46.520802+0000","last_clean":"2024-09-19T06:05:46.520802+0000","last_became_active":"2024-09-19T06:05:22.683439+0000","last_became_peered":"2024-09-19T06:05:22.683439+0000","last_unstale":"2024-09-19T06:05:46.520802+0000","last_undegraded":"2024-09-19T06:05:46.520802+0000","last_fullsized":"2024-09-19T06:05:46.520802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:52.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961492+0000","last_change":"2024-09-19T06:05:24.695905+0000","last_active":"2024-09-19T06:05:46.961492+0000","last_peered":"2024-09-19T06:05:46.961492+0000","last_clean":"2024-09-19T06:05:46.961492+0000","last_became_active":"2024-09-19T06:05:24.695570+0000","last_became_peered":"2024-09-19T06:05:24.695570+0000","last_unstale":"2024-09-19T06:05:46.961492+0000","last_undegraded":"2024-09-19T06:05:46.961492+0000","last_fullsized":"2024-09-19T06:05:46.961492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:00.167126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520961+0000","last_change":"2024-09-19T06:05:22.686853+0000","last_active":"2024-09-19T06:05:46.520961+0000","last_peered":"2024-09-19T06:05:46.520961+0000","last_clean":"2024-09-19T06:05:46.520961+0000","last_became_active":"2024-09-19T06:05:22.686143+0000","last_became_peered":"2024-09-19T06:05:22.686143+0000","last_unstale":"2024-09-19T06:05:46.520961+0000","last_undegraded":"2024-09-19T06:05:46.520961+0000","last_fullsized":"2024-09-19T06:05:46.520961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:30.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519841+0000","last_change":"2024-09-19T06:05:24.702420+0000","last_active":"2024-09-19T06:05:46.519841+0000","last_peered":"2024-09-19T06:05:46.519841+0000","last_clean":"2024-09-19T06:05:46.519841+0000","last_became_active":"2024-09-19T06:05:24.702140+0000","last_became_peered":"2024-09-19T06:05:24.702140+0000","last_unstale":"2024-09-19T06:05:46.519841+0000","last_undegraded":"2024-09-19T06:05:46.519841+0000","last_fullsized":"2024-09-19T06:05:46.519841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:27.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517042+0000","last_change":"2024-09-19T06:05:23.059638+0000","last_active":"2024-09-19T06:05:46.517042+0000","last_peered":"2024-09-19T06:05:46.517042+0000","last_clean":"2024-09-19T06:05:46.517042+0000","last_became_active":"2024-09-19T06:05:23.059273+0000","last_became_peered":"2024-09-19T06:05:23.059273+0000","last_unstale":"2024-09-19T06:05:46.517042+0000","last_undegraded":"2024-09-19T06:05:46.517042+0000","last_fullsized":"2024-09-19T06:05:46.517042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:56.981598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516857+0000","last_change":"2024-09-19T06:05:24.703608+0000","last_active":"2024-09-19T06:05:46.516857+0000","last_peered":"2024-09-19T06:05:46.516857+0000","last_clean":"2024-09-19T06:05:46.516857+0000","last_became_active":"2024-09-19T06:05:24.703300+0000","last_became_peered":"2024-09-19T06:05:24.703300+0000","last_unstale":"2024-09-19T06:05:46.516857+0000","last_undegraded":"2024-09-19T06:05:46.516857+0000","last_fullsized":"2024-09-19T06:05:46.516857+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.063545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518702+0000","last_change":"2024-09-19T06:05:22.679379+0000","last_active":"2024-09-19T06:05:46.518702+0000","last_peered":"2024-09-19T06:05:46.518702+0000","last_clean":"2024-09-19T06:05:46.518702+0000","last_became_active":"2024-09-19T06:05:22.679091+0000","last_became_peered":"2024-09-19T06:05:22.679091+0000","last_unstale":"2024-09-19T06:05:46.518702+0000","last_undegraded":"2024-09-19T06:05:46.518702+0000","last_fullsized":"2024-09-19T06:05:46.518702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63374,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":392,"num_read_kb":262,"num_write":160,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645340,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":427934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874272,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1079145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037797,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":428136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":428056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495662,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32640,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712512,"statfs":{"total":95995035648,"available":95961612288,"internally_reserved":0,"allocated":1482752,"data_stored":1019595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":427525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888121,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1495040,"data_stored":1019279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":488398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":487082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":428796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:06:39.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:06:39.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:38 smithi174 ceph-mon[34488]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:39.341 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.842+0000 7f4ecd26f640 1 -- 172.21.15.103:0/256078537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec8102790 msgr2=0x7f4ec81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.842+0000 7f4ecd26f640 1 --2- 172.21.15.103:0/256078537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec8102790 0x7f4ec81067e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009900 tx=0x7f4ebc02a410 comp rx=0 tx=0).stop 2024-09-19T06:06:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.842+0000 7f4ecd26f640 1 -- 172.21.15.103:0/256078537 shutdown_connections 2024-09-19T06:06:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.842+0000 7f4ecd26f640 1 --2- 172.21.15.103:0/256078537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ec8106f10 0x7f4ec810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.842+0000 7f4ecd26f640 1 --2- 172.21.15.103:0/256078537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec8102790 0x7f4ec81067e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.842+0000 7f4ecd26f640 1 --2- 172.21.15.103:0/256078537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ec8101de0 0x7f4ec81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.842+0000 7f4ecd26f640 1 -- 172.21.15.103:0/256078537 >> 172.21.15.103:0/256078537 conn(0x7f4ec80fd8c0 msgr2=0x7f4ec80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.842+0000 7f4ecd26f640 1 -- 172.21.15.103:0/256078537 shutdown_connections 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.842+0000 7f4ecd26f640 1 -- 172.21.15.103:0/256078537 wait complete. 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ecd26f640 1 Processor -- start 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ecd26f640 1 -- start start 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ecd26f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ec8101de0 0x7f4ec81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ecd26f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ec8102790 0x7f4ec81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ecd26f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec8106f10 0x7f4ec819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ecd26f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec8111e20 con 0x7f4ec8106f10 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ecd26f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec8111ca0 con 0x7f4ec8101de0 2024-09-19T06:06:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ecd26f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec8111fa0 con 0x7f4ec8102790 2024-09-19T06:06:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ec77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec8106f10 0x7f4ec819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ec77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec8106f10 0x7f4ec819cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44578/0 (socket says 172.21.15.103:44578) 2024-09-19T06:06:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.843+0000 7f4ec77fe640 1 -- 172.21.15.103:0/312371244 learned_addr learned my addr 172.21.15.103:0/312371244 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4ec6ffd640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ec8101de0 0x7f4ec81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4ec67fc640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ec8102790 0x7f4ec81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4ec77fe640 1 -- 172.21.15.103:0/312371244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ec8102790 msgr2=0x7f4ec81988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4ec77fe640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ec8102790 0x7f4ec81988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4ec77fe640 1 -- 172.21.15.103:0/312371244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ec8101de0 msgr2=0x7f4ec81983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4ec77fe640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ec8101de0 0x7f4ec81983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4ec77fe640 1 -- 172.21.15.103:0/312371244 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec819d350 con 0x7f4ec8106f10 2024-09-19T06:06:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4ec77fe640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec8106f10 0x7f4ec819cc70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000eaa0 tx=0x7f4ec000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4eaffff640 1 -- 172.21.15.103:0/312371244 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000cdb0 con 0x7f4ec8106f10 2024-09-19T06:06:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4eaffff640 1 -- 172.21.15.103:0/312371244 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ec0005020 con 0x7f4ec8106f10 2024-09-19T06:06:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4ecd26f640 1 -- 172.21.15.103:0/312371244 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec819d640 con 0x7f4ec8106f10 2024-09-19T06:06:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4eaffff640 1 -- 172.21.15.103:0/312371244 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00116d0 con 0x7f4ec8106f10 2024-09-19T06:06:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.844+0000 7f4ecd26f640 1 -- 172.21.15.103:0/312371244 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec81a4f20 con 0x7f4ec8106f10 2024-09-19T06:06:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.845+0000 7f4ecd26f640 1 -- 172.21.15.103:0/312371244 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec81021c0 con 0x7f4ec8106f10 2024-09-19T06:06:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.846+0000 7f4eaffff640 1 -- 172.21.15.103:0/312371244 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f4ec00051d0 con 0x7f4ec8106f10 2024-09-19T06:06:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.847+0000 7f4eaffff640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4eb00a32d0 0x7f4eb00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.847+0000 7f4ec6ffd640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4eb00a32d0 0x7f4eb00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.847+0000 7f4eaffff640 1 -- 172.21.15.103:0/312371244 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f4ec00cfb50 con 0x7f4ec8106f10 2024-09-19T06:06:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.847+0000 7f4ec6ffd640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4eb00a32d0 0x7f4eb00a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8005d00 tx=0x7f4eb800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:39.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:39.851+0000 7f4eaffff640 1 -- 172.21.15.103:0/312371244 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ec0016030 con 0x7f4ec8106f10 2024-09-19T06:06:39.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:39 smithi103 ceph-mon[30925]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:06:40.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.017+0000 7f4ecd26f640 1 -- 172.21.15.103:0/312371244 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ec810a1b0 con 0x7f4eb00a32d0 2024-09-19T06:06:40.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.023+0000 7f4eaffff640 1 -- 172.21.15.103:0/312371244 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258713 (secure 0 0 0) 0x7f4ec810a1b0 con 0x7f4eb00a32d0 2024-09-19T06:06:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:40.028 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T06:06:40.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 -- 172.21.15.103:0/312371244 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4eb00a32d0 msgr2=0x7f4eb00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4eb00a32d0 0x7f4eb00a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8005d00 tx=0x7f4eb800b410 comp rx=0 tx=0).stop 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 -- 172.21.15.103:0/312371244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec8106f10 msgr2=0x7f4ec819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec8106f10 0x7f4ec819cc70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000eaa0 tx=0x7f4ec000ef60 comp rx=0 tx=0).stop 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 -- 172.21.15.103:0/312371244 shutdown_connections 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f4eb00a32d0 0x7f4eb00a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec8106f10 0x7f4ec819cc70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ec8102790 0x7f4ec81988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 --2- 172.21.15.103:0/312371244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ec8101de0 0x7f4ec81983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 -- 172.21.15.103:0/312371244 >> 172.21.15.103:0/312371244 conn(0x7f4ec80fd8c0 msgr2=0x7f4ec80fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 -- 172.21.15.103:0/312371244 shutdown_connections 2024-09-19T06:06:40.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:40.026+0000 7f4ecd26f640 1 -- 172.21.15.103:0/312371244 wait complete. 2024-09-19T06:06:40.032 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:39 smithi169 ceph-mon[34350]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:06:40.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:39 smithi174 ceph-mon[34488]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:06:40.741 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-19T06:06:39.468641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653976,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":528,"num_read_kb":381,"num_write":343,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361640,"kb_used_data":12348,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580184,"statfs":{"total":1151940427776,"available":1151570108416,"internally_reserved":0,"allocated":12644352,"data_stored":7089744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002796"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518052+0000","last_change":"2024-09-19T06:05:24.703290+0000","last_active":"2024-09-19T06:05:46.518052+0000","last_peered":"2024-09-19T06:05:46.518052+0000","last_clean":"2024-09-19T06:05:46.518052+0000","last_became_active":"2024-09-19T06:05:24.702343+0000","last_became_peered":"2024-09-19T06:05:24.702343+0000","last_unstale":"2024-09-19T06:05:46.518052+0000","last_undegraded":"2024-09-19T06:05:46.518052+0000","last_fullsized":"2024-09-19T06:05:46.518052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.594004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519636+0000","last_change":"2024-09-19T06:05:24.700363+0000","last_active":"2024-09-19T06:05:46.519636+0000","last_peered":"2024-09-19T06:05:46.519636+0000","last_clean":"2024-09-19T06:05:46.519636+0000","last_became_active":"2024-09-19T06:05:24.700066+0000","last_became_peered":"2024-09-19T06:05:24.700066+0000","last_unstale":"2024-09-19T06:05:46.519636+0000","last_undegraded":"2024-09-19T06:05:46.519636+0000","last_fullsized":"2024-09-19T06:05:46.519636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:26.094195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519554+0000","last_change":"2024-09-19T06:05:24.702458+0000","last_active":"2024-09-19T06:05:46.519554+0000","last_peered":"2024-09-19T06:05:46.519554+0000","last_clean":"2024-09-19T06:05:46.519554+0000","last_became_active":"2024-09-19T06:05:24.702029+0000","last_became_peered":"2024-09-19T06:05:24.702029+0000","last_unstale":"2024-09-19T06:05:46.519554+0000","last_undegraded":"2024-09-19T06:05:46.519554+0000","last_fullsized":"2024-09-19T06:05:46.519554+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905954+0000","last_change":"2024-09-19T06:05:24.699402+0000","last_active":"2024-09-19T06:05:46.905954+0000","last_peered":"2024-09-19T06:05:46.905954+0000","last_clean":"2024-09-19T06:05:46.905954+0000","last_became_active":"2024-09-19T06:05:24.698191+0000","last_became_peered":"2024-09-19T06:05:24.698191+0000","last_unstale":"2024-09-19T06:05:46.905954+0000","last_undegraded":"2024-09-19T06:05:46.905954+0000","last_fullsized":"2024-09-19T06:05:46.905954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.056347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520337+0000","last_change":"2024-09-19T06:05:24.699821+0000","last_active":"2024-09-19T06:05:46.520337+0000","last_peered":"2024-09-19T06:05:46.520337+0000","last_clean":"2024-09-19T06:05:46.520337+0000","last_became_active":"2024-09-19T06:05:24.699493+0000","last_became_peered":"2024-09-19T06:05:24.699493+0000","last_unstale":"2024-09-19T06:05:46.520337+0000","last_undegraded":"2024-09-19T06:05:46.520337+0000","last_fullsized":"2024-09-19T06:05:46.520337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:34.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517699+0000","last_change":"2024-09-19T06:05:24.697821+0000","last_active":"2024-09-19T06:05:46.517699+0000","last_peered":"2024-09-19T06:05:46.517699+0000","last_clean":"2024-09-19T06:05:46.517699+0000","last_became_active":"2024-09-19T06:05:24.697495+0000","last_became_peered":"2024-09-19T06:05:24.697495+0000","last_unstale":"2024-09-19T06:05:46.517699+0000","last_undegraded":"2024-09-19T06:05:46.517699+0000","last_fullsized":"2024-09-19T06:05:46.517699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:03.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902318+0000","last_change":"2024-09-19T06:05:24.704610+0000","last_active":"2024-09-19T06:05:46.902318+0000","last_peered":"2024-09-19T06:05:46.902318+0000","last_clean":"2024-09-19T06:05:46.902318+0000","last_became_active":"2024-09-19T06:05:24.704288+0000","last_became_peered":"2024-09-19T06:05:24.704288+0000","last_unstale":"2024-09-19T06:05:46.902318+0000","last_undegraded":"2024-09-19T06:05:46.902318+0000","last_fullsized":"2024-09-19T06:05:46.902318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.530553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516407+0000","last_change":"2024-09-19T06:05:24.693662+0000","last_active":"2024-09-19T06:05:46.516407+0000","last_peered":"2024-09-19T06:05:46.516407+0000","last_clean":"2024-09-19T06:05:46.516407+0000","last_became_active":"2024-09-19T06:05:24.693327+0000","last_became_peered":"2024-09-19T06:05:24.693327+0000","last_unstale":"2024-09-19T06:05:46.516407+0000","last_undegraded":"2024-09-19T06:05:46.516407+0000","last_fullsized":"2024-09-19T06:05:46.516407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:39.646907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961884+0000","last_change":"2024-09-19T06:05:24.702552+0000","last_active":"2024-09-19T06:05:46.961884+0000","last_peered":"2024-09-19T06:05:46.961884+0000","last_clean":"2024-09-19T06:05:46.961884+0000","last_became_active":"2024-09-19T06:05:24.701090+0000","last_became_peered":"2024-09-19T06:05:24.701090+0000","last_unstale":"2024-09-19T06:05:46.961884+0000","last_undegraded":"2024-09-19T06:05:46.961884+0000","last_fullsized":"2024-09-19T06:05:46.961884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:44.361368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.524330+0000","last_change":"2024-09-19T06:05:46.524330+0000","last_active":"2024-09-19T06:05:46.524330+0000","last_peered":"2024-09-19T06:05:46.524330+0000","last_clean":"2024-09-19T06:05:46.524330+0000","last_became_active":"2024-09-19T06:05:46.523934+0000","last_became_peered":"2024-09-19T06:05:46.523934+0000","last_unstale":"2024-09-19T06:05:46.524330+0000","last_undegraded":"2024-09-19T06:05:46.524330+0000","last_fullsized":"2024-09-19T06:05:46.524330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:11:12.301698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902755+0000","last_change":"2024-09-19T06:05:24.703118+0000","last_active":"2024-09-19T06:05:46.902755+0000","last_peered":"2024-09-19T06:05:46.902755+0000","last_clean":"2024-09-19T06:05:46.902755+0000","last_became_active":"2024-09-19T06:05:24.702561+0000","last_became_peered":"2024-09-19T06:05:24.702561+0000","last_unstale":"2024-09-19T06:05:46.902755+0000","last_undegraded":"2024-09-19T06:05:46.902755+0000","last_fullsized":"2024-09-19T06:05:46.902755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:51.063256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.906049+0000","last_change":"2024-09-19T06:05:24.698704+0000","last_active":"2024-09-19T06:05:46.906049+0000","last_peered":"2024-09-19T06:05:46.906049+0000","last_clean":"2024-09-19T06:05:46.906049+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:46.906049+0000","last_undegraded":"2024-09-19T06:05:46.906049+0000","last_fullsized":"2024-09-19T06:05:46.906049+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:35.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903589+0000","last_change":"2024-09-19T06:05:24.696236+0000","last_active":"2024-09-19T06:05:46.903589+0000","last_peered":"2024-09-19T06:05:46.903589+0000","last_clean":"2024-09-19T06:05:46.903589+0000","last_became_active":"2024-09-19T06:05:24.695952+0000","last_became_peered":"2024-09-19T06:05:24.695952+0000","last_unstale":"2024-09-19T06:05:46.903589+0000","last_undegraded":"2024-09-19T06:05:46.903589+0000","last_fullsized":"2024-09-19T06:05:46.903589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:17.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519455+0000","last_change":"2024-09-19T06:05:24.699962+0000","last_active":"2024-09-19T06:05:46.519455+0000","last_peered":"2024-09-19T06:05:46.519455+0000","last_clean":"2024-09-19T06:05:46.519455+0000","last_became_active":"2024-09-19T06:05:24.699625+0000","last_became_peered":"2024-09-19T06:05:24.699625+0000","last_unstale":"2024-09-19T06:05:46.519455+0000","last_undegraded":"2024-09-19T06:05:46.519455+0000","last_fullsized":"2024-09-19T06:05:46.519455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:34.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519460+0000","last_change":"2024-09-19T06:05:24.701310+0000","last_active":"2024-09-19T06:05:46.519460+0000","last_peered":"2024-09-19T06:05:46.519460+0000","last_clean":"2024-09-19T06:05:46.519460+0000","last_became_active":"2024-09-19T06:05:24.701032+0000","last_became_peered":"2024-09-19T06:05:24.701032+0000","last_unstale":"2024-09-19T06:05:46.519460+0000","last_undegraded":"2024-09-19T06:05:46.519460+0000","last_fullsized":"2024-09-19T06:05:46.519460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:29.557533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961314+0000","last_change":"2024-09-19T06:05:24.699803+0000","last_active":"2024-09-19T06:05:46.961314+0000","last_peered":"2024-09-19T06:05:46.961314+0000","last_clean":"2024-09-19T06:05:46.961314+0000","last_became_active":"2024-09-19T06:05:24.699506+0000","last_became_peered":"2024-09-19T06:05:24.699506+0000","last_unstale":"2024-09-19T06:05:46.961314+0000","last_undegraded":"2024-09-19T06:05:46.961314+0000","last_fullsized":"2024-09-19T06:05:46.961314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:32.669231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518157+0000","last_change":"2024-09-19T06:05:24.703805+0000","last_active":"2024-09-19T06:05:46.518157+0000","last_peered":"2024-09-19T06:05:46.518157+0000","last_clean":"2024-09-19T06:05:46.518157+0000","last_became_active":"2024-09-19T06:05:24.702728+0000","last_became_peered":"2024-09-19T06:05:24.702728+0000","last_unstale":"2024-09-19T06:05:46.518157+0000","last_undegraded":"2024-09-19T06:05:46.518157+0000","last_fullsized":"2024-09-19T06:05:46.518157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:20.807530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518737+0000","last_change":"2024-09-19T06:05:24.691055+0000","last_active":"2024-09-19T06:05:46.518737+0000","last_peered":"2024-09-19T06:05:46.518737+0000","last_clean":"2024-09-19T06:05:46.518737+0000","last_became_active":"2024-09-19T06:05:24.690165+0000","last_became_peered":"2024-09-19T06:05:24.690165+0000","last_unstale":"2024-09-19T06:05:46.518737+0000","last_undegraded":"2024-09-19T06:05:46.518737+0000","last_fullsized":"2024-09-19T06:05:46.518737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:48.656335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521695+0000","last_change":"2024-09-19T06:05:24.697955+0000","last_active":"2024-09-19T06:05:46.521695+0000","last_peered":"2024-09-19T06:05:46.521695+0000","last_clean":"2024-09-19T06:05:46.521695+0000","last_became_active":"2024-09-19T06:05:24.697598+0000","last_became_peered":"2024-09-19T06:05:24.697598+0000","last_unstale":"2024-09-19T06:05:46.521695+0000","last_undegraded":"2024-09-19T06:05:46.521695+0000","last_fullsized":"2024-09-19T06:05:46.521695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.458647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517664+0000","last_change":"2024-09-19T06:05:24.705110+0000","last_active":"2024-09-19T06:05:46.517664+0000","last_peered":"2024-09-19T06:05:46.517664+0000","last_clean":"2024-09-19T06:05:46.517664+0000","last_became_active":"2024-09-19T06:05:24.704783+0000","last_became_peered":"2024-09-19T06:05:24.704783+0000","last_unstale":"2024-09-19T06:05:46.517664+0000","last_undegraded":"2024-09-19T06:05:46.517664+0000","last_fullsized":"2024-09-19T06:05:46.517664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:43.092969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903641+0000","last_change":"2024-09-19T06:05:24.693845+0000","last_active":"2024-09-19T06:05:46.903641+0000","last_peered":"2024-09-19T06:05:46.903641+0000","last_clean":"2024-09-19T06:05:46.903641+0000","last_became_active":"2024-09-19T06:05:24.693385+0000","last_became_peered":"2024-09-19T06:05:24.693385+0000","last_unstale":"2024-09-19T06:05:46.903641+0000","last_undegraded":"2024-09-19T06:05:46.903641+0000","last_fullsized":"2024-09-19T06:05:46.903641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:05.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961617+0000","last_change":"2024-09-19T06:05:24.697903+0000","last_active":"2024-09-19T06:05:46.961617+0000","last_peered":"2024-09-19T06:05:46.961617+0000","last_clean":"2024-09-19T06:05:46.961617+0000","last_became_active":"2024-09-19T06:05:24.697566+0000","last_became_peered":"2024-09-19T06:05:24.697566+0000","last_unstale":"2024-09-19T06:05:46.961617+0000","last_undegraded":"2024-09-19T06:05:46.961617+0000","last_fullsized":"2024-09-19T06:05:46.961617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:10.340401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516463+0000","last_change":"2024-09-19T06:05:24.696888+0000","last_active":"2024-09-19T06:05:46.516463+0000","last_peered":"2024-09-19T06:05:46.516463+0000","last_clean":"2024-09-19T06:05:46.516463+0000","last_became_active":"2024-09-19T06:05:24.696554+0000","last_became_peered":"2024-09-19T06:05:24.696554+0000","last_unstale":"2024-09-19T06:05:46.516463+0000","last_undegraded":"2024-09-19T06:05:46.516463+0000","last_fullsized":"2024-09-19T06:05:46.516463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520726+0000","last_change":"2024-09-19T06:05:24.692443+0000","last_active":"2024-09-19T06:05:46.520726+0000","last_peered":"2024-09-19T06:05:46.520726+0000","last_clean":"2024-09-19T06:05:46.520726+0000","last_became_active":"2024-09-19T06:05:24.690555+0000","last_became_peered":"2024-09-19T06:05:24.690555+0000","last_unstale":"2024-09-19T06:05:46.520726+0000","last_undegraded":"2024-09-19T06:05:46.520726+0000","last_fullsized":"2024-09-19T06:05:46.520726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:29.340744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516645+0000","last_change":"2024-09-19T06:05:24.699379+0000","last_active":"2024-09-19T06:05:46.516645+0000","last_peered":"2024-09-19T06:05:46.516645+0000","last_clean":"2024-09-19T06:05:46.516645+0000","last_became_active":"2024-09-19T06:05:24.699056+0000","last_became_peered":"2024-09-19T06:05:24.699056+0000","last_unstale":"2024-09-19T06:05:46.516645+0000","last_undegraded":"2024-09-19T06:05:46.516645+0000","last_fullsized":"2024-09-19T06:05:46.516645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:30.337080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521950+0000","last_change":"2024-09-19T06:05:24.698672+0000","last_active":"2024-09-19T06:05:46.521950+0000","last_peered":"2024-09-19T06:05:46.521950+0000","last_clean":"2024-09-19T06:05:46.521950+0000","last_became_active":"2024-09-19T06:05:24.698229+0000","last_became_peered":"2024-09-19T06:05:24.698229+0000","last_unstale":"2024-09-19T06:05:46.521950+0000","last_undegraded":"2024-09-19T06:05:46.521950+0000","last_fullsized":"2024-09-19T06:05:46.521950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.082538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517858+0000","last_change":"2024-09-19T06:05:24.707830+0000","last_active":"2024-09-19T06:05:46.517858+0000","last_peered":"2024-09-19T06:05:46.517858+0000","last_clean":"2024-09-19T06:05:46.517858+0000","last_became_active":"2024-09-19T06:05:24.707478+0000","last_became_peered":"2024-09-19T06:05:24.707478+0000","last_unstale":"2024-09-19T06:05:46.517858+0000","last_undegraded":"2024-09-19T06:05:46.517858+0000","last_fullsized":"2024-09-19T06:05:46.517858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:33.484877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903437+0000","last_change":"2024-09-19T06:05:24.697232+0000","last_active":"2024-09-19T06:05:46.903437+0000","last_peered":"2024-09-19T06:05:46.903437+0000","last_clean":"2024-09-19T06:05:46.903437+0000","last_became_active":"2024-09-19T06:05:24.696727+0000","last_became_peered":"2024-09-19T06:05:24.696727+0000","last_unstale":"2024-09-19T06:05:46.903437+0000","last_undegraded":"2024-09-19T06:05:46.903437+0000","last_fullsized":"2024-09-19T06:05:46.903437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:36.168493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519637+0000","last_change":"2024-09-19T06:05:24.695489+0000","last_active":"2024-09-19T06:05:46.519637+0000","last_peered":"2024-09-19T06:05:46.519637+0000","last_clean":"2024-09-19T06:05:46.519637+0000","last_became_active":"2024-09-19T06:05:24.695012+0000","last_became_peered":"2024-09-19T06:05:24.695012+0000","last_unstale":"2024-09-19T06:05:46.519637+0000","last_undegraded":"2024-09-19T06:05:46.519637+0000","last_fullsized":"2024-09-19T06:05:46.519637+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:41.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522199+0000","last_change":"2024-09-19T06:05:24.697294+0000","last_active":"2024-09-19T06:05:46.522199+0000","last_peered":"2024-09-19T06:05:46.522199+0000","last_clean":"2024-09-19T06:05:46.522199+0000","last_became_active":"2024-09-19T06:05:24.696563+0000","last_became_peered":"2024-09-19T06:05:24.696563+0000","last_unstale":"2024-09-19T06:05:46.522199+0000","last_undegraded":"2024-09-19T06:05:46.522199+0000","last_fullsized":"2024-09-19T06:05:46.522199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:41.861120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520918+0000","last_change":"2024-09-19T06:05:24.702710+0000","last_active":"2024-09-19T06:05:46.520918+0000","last_peered":"2024-09-19T06:05:46.520918+0000","last_clean":"2024-09-19T06:05:46.520918+0000","last_became_active":"2024-09-19T06:05:24.702039+0000","last_became_peered":"2024-09-19T06:05:24.702039+0000","last_unstale":"2024-09-19T06:05:46.520918+0000","last_undegraded":"2024-09-19T06:05:46.520918+0000","last_fullsized":"2024-09-19T06:05:46.520918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:23.831807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517416+0000","last_change":"2024-09-19T06:05:24.707671+0000","last_active":"2024-09-19T06:05:46.517416+0000","last_peered":"2024-09-19T06:05:46.517416+0000","last_clean":"2024-09-19T06:05:46.517416+0000","last_became_active":"2024-09-19T06:05:24.707325+0000","last_became_peered":"2024-09-19T06:05:24.707325+0000","last_unstale":"2024-09-19T06:05:46.517416+0000","last_undegraded":"2024-09-19T06:05:46.517416+0000","last_fullsized":"2024-09-19T06:05:46.517416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:32.149103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520934+0000","last_change":"2024-09-19T06:05:24.704875+0000","last_active":"2024-09-19T06:05:46.520934+0000","last_peered":"2024-09-19T06:05:46.520934+0000","last_clean":"2024-09-19T06:05:46.520934+0000","last_became_active":"2024-09-19T06:05:24.704501+0000","last_became_peered":"2024-09-19T06:05:24.704501+0000","last_unstale":"2024-09-19T06:05:46.520934+0000","last_undegraded":"2024-09-19T06:05:46.520934+0000","last_fullsized":"2024-09-19T06:05:46.520934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:06:33.967380+0000","last_change":"2024-09-19T06:05:22.687857+0000","last_active":"2024-09-19T06:06:33.967380+0000","last_peered":"2024-09-19T06:06:33.967380+0000","last_clean":"2024-09-19T06:06:33.967380+0000","last_became_active":"2024-09-19T06:05:22.687573+0000","last_became_peered":"2024-09-19T06:05:22.687573+0000","last_unstale":"2024-09-19T06:06:33.967380+0000","last_undegraded":"2024-09-19T06:06:33.967380+0000","last_fullsized":"2024-09-19T06:06:33.967380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:31.972444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.904521+0000","last_change":"2024-09-19T06:05:46.904521+0000","last_active":"2024-09-19T06:05:46.904521+0000","last_peered":"2024-09-19T06:05:46.904521+0000","last_clean":"2024-09-19T06:05:46.904521+0000","last_became_active":"2024-09-19T06:05:46.904146+0000","last_became_peered":"2024-09-19T06:05:46.904146+0000","last_unstale":"2024-09-19T06:05:46.904521+0000","last_undegraded":"2024-09-19T06:05:46.904521+0000","last_fullsized":"2024-09-19T06:05:46.904521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:48.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517810+0000","last_change":"2024-09-19T06:05:22.680500+0000","last_active":"2024-09-19T06:05:46.517810+0000","last_peered":"2024-09-19T06:05:46.517810+0000","last_clean":"2024-09-19T06:05:46.517810+0000","last_became_active":"2024-09-19T06:05:22.679947+0000","last_became_peered":"2024-09-19T06:05:22.679947+0000","last_unstale":"2024-09-19T06:05:46.517810+0000","last_undegraded":"2024-09-19T06:05:46.517810+0000","last_fullsized":"2024-09-19T06:05:46.517810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:34.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902704+0000","last_change":"2024-09-19T06:05:22.680962+0000","last_active":"2024-09-19T06:05:46.902704+0000","last_peered":"2024-09-19T06:05:46.902704+0000","last_clean":"2024-09-19T06:05:46.902704+0000","last_became_active":"2024-09-19T06:05:22.680662+0000","last_became_peered":"2024-09-19T06:05:22.680662+0000","last_unstale":"2024-09-19T06:05:46.902704+0000","last_undegraded":"2024-09-19T06:05:46.902704+0000","last_fullsized":"2024-09-19T06:05:46.902704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.296422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516416+0000","last_change":"2024-09-19T06:05:24.695214+0000","last_active":"2024-09-19T06:05:46.516416+0000","last_peered":"2024-09-19T06:05:46.516416+0000","last_clean":"2024-09-19T06:05:46.516416+0000","last_became_active":"2024-09-19T06:05:24.694930+0000","last_became_peered":"2024-09-19T06:05:24.694930+0000","last_unstale":"2024-09-19T06:05:46.516416+0000","last_undegraded":"2024-09-19T06:05:46.516416+0000","last_fullsized":"2024-09-19T06:05:46.516416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:51.382934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520982+0000","last_change":"2024-09-19T06:05:22.684504+0000","last_active":"2024-09-19T06:05:46.520982+0000","last_peered":"2024-09-19T06:05:46.520982+0000","last_clean":"2024-09-19T06:05:46.520982+0000","last_became_active":"2024-09-19T06:05:22.684169+0000","last_became_peered":"2024-09-19T06:05:22.684169+0000","last_unstale":"2024-09-19T06:05:46.520982+0000","last_undegraded":"2024-09-19T06:05:46.520982+0000","last_fullsized":"2024-09-19T06:05:46.520982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:29.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518059+0000","last_change":"2024-09-19T06:05:24.693056+0000","last_active":"2024-09-19T06:05:46.518059+0000","last_peered":"2024-09-19T06:05:46.518059+0000","last_clean":"2024-09-19T06:05:46.518059+0000","last_became_active":"2024-09-19T06:05:24.692544+0000","last_became_peered":"2024-09-19T06:05:24.692544+0000","last_unstale":"2024-09-19T06:05:46.518059+0000","last_undegraded":"2024-09-19T06:05:46.518059+0000","last_fullsized":"2024-09-19T06:05:46.518059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:45.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:06:33.966876+0000","last_change":"2024-09-19T06:05:22.682854+0000","last_active":"2024-09-19T06:06:33.966876+0000","last_peered":"2024-09-19T06:06:33.966876+0000","last_clean":"2024-09-19T06:06:33.966876+0000","last_became_active":"2024-09-19T06:05:22.682406+0000","last_became_peered":"2024-09-19T06:05:22.682406+0000","last_unstale":"2024-09-19T06:06:33.966876+0000","last_undegraded":"2024-09-19T06:06:33.966876+0000","last_fullsized":"2024-09-19T06:06:33.966876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.206144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961915+0000","last_change":"2024-09-19T06:05:24.699408+0000","last_active":"2024-09-19T06:05:46.961915+0000","last_peered":"2024-09-19T06:05:46.961915+0000","last_clean":"2024-09-19T06:05:46.961915+0000","last_became_active":"2024-09-19T06:05:24.699106+0000","last_became_peered":"2024-09-19T06:05:24.699106+0000","last_unstale":"2024-09-19T06:05:46.961915+0000","last_undegraded":"2024-09-19T06:05:46.961915+0000","last_fullsized":"2024-09-19T06:05:46.961915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:37.487458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902210+0000","last_change":"2024-09-19T06:05:22.686106+0000","last_active":"2024-09-19T06:05:46.902210+0000","last_peered":"2024-09-19T06:05:46.902210+0000","last_clean":"2024-09-19T06:05:46.902210+0000","last_became_active":"2024-09-19T06:05:22.685763+0000","last_became_peered":"2024-09-19T06:05:22.685763+0000","last_unstale":"2024-09-19T06:05:46.902210+0000","last_undegraded":"2024-09-19T06:05:46.902210+0000","last_fullsized":"2024-09-19T06:05:46.902210+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:57.889128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.524038+0000","last_change":"2024-09-19T06:05:46.524038+0000","last_active":"2024-09-19T06:05:46.524038+0000","last_peered":"2024-09-19T06:05:46.524038+0000","last_clean":"2024-09-19T06:05:46.524038+0000","last_became_active":"2024-09-19T06:05:46.523746+0000","last_became_peered":"2024-09-19T06:05:46.523746+0000","last_unstale":"2024-09-19T06:05:46.524038+0000","last_undegraded":"2024-09-19T06:05:46.524038+0000","last_fullsized":"2024-09-19T06:05:46.524038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:17.361840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519825+0000","last_change":"2024-09-19T06:05:23.060545+0000","last_active":"2024-09-19T06:05:46.519825+0000","last_peered":"2024-09-19T06:05:46.519825+0000","last_clean":"2024-09-19T06:05:46.519825+0000","last_became_active":"2024-09-19T06:05:23.060187+0000","last_became_peered":"2024-09-19T06:05:23.060187+0000","last_unstale":"2024-09-19T06:05:46.519825+0000","last_undegraded":"2024-09-19T06:05:46.519825+0000","last_fullsized":"2024-09-19T06:05:46.519825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.604284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961566+0000","last_change":"2024-09-19T06:05:24.702535+0000","last_active":"2024-09-19T06:05:46.961566+0000","last_peered":"2024-09-19T06:05:46.961566+0000","last_clean":"2024-09-19T06:05:46.961566+0000","last_became_active":"2024-09-19T06:05:24.701616+0000","last_became_peered":"2024-09-19T06:05:24.701616+0000","last_unstale":"2024-09-19T06:05:46.961566+0000","last_undegraded":"2024-09-19T06:05:46.961566+0000","last_fullsized":"2024-09-19T06:05:46.961566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:43.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":180,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:06:34.968263+0000","last_change":"2024-09-19T06:05:22.685460+0000","last_active":"2024-09-19T06:06:34.968263+0000","last_peered":"2024-09-19T06:06:34.968263+0000","last_clean":"2024-09-19T06:06:34.968263+0000","last_became_active":"2024-09-19T06:05:22.685086+0000","last_became_peered":"2024-09-19T06:05:22.685086+0000","last_unstale":"2024-09-19T06:06:34.968263+0000","last_undegraded":"2024-09-19T06:06:34.968263+0000","last_fullsized":"2024-09-19T06:06:34.968263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:10.373783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":123,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520872+0000","last_change":"2024-09-19T06:05:24.700431+0000","last_active":"2024-09-19T06:05:46.520872+0000","last_peered":"2024-09-19T06:05:46.520872+0000","last_clean":"2024-09-19T06:05:46.520872+0000","last_became_active":"2024-09-19T06:05:24.700092+0000","last_became_peered":"2024-09-19T06:05:24.700092+0000","last_unstale":"2024-09-19T06:05:46.520872+0000","last_undegraded":"2024-09-19T06:05:46.520872+0000","last_fullsized":"2024-09-19T06:05:46.520872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:17.208392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.530433+0000","last_change":"2024-09-19T06:05:46.530433+0000","last_active":"2024-09-19T06:05:46.530433+0000","last_peered":"2024-09-19T06:05:46.530433+0000","last_clean":"2024-09-19T06:05:46.530433+0000","last_became_active":"2024-09-19T06:05:46.521700+0000","last_became_peered":"2024-09-19T06:05:46.521700+0000","last_unstale":"2024-09-19T06:05:46.530433+0000","last_undegraded":"2024-09-19T06:05:46.530433+0000","last_fullsized":"2024-09-19T06:05:46.530433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:40.489547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903307+0000","last_change":"2024-09-19T06:05:24.699149+0000","last_active":"2024-09-19T06:05:46.903307+0000","last_peered":"2024-09-19T06:05:46.903307+0000","last_clean":"2024-09-19T06:05:46.903307+0000","last_became_active":"2024-09-19T06:05:24.698846+0000","last_became_peered":"2024-09-19T06:05:24.698846+0000","last_unstale":"2024-09-19T06:05:46.903307+0000","last_undegraded":"2024-09-19T06:05:46.903307+0000","last_fullsized":"2024-09-19T06:05:46.903307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:19.416169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519763+0000","last_change":"2024-09-19T06:05:22.682157+0000","last_active":"2024-09-19T06:05:46.519763+0000","last_peered":"2024-09-19T06:05:46.519763+0000","last_clean":"2024-09-19T06:05:46.519763+0000","last_became_active":"2024-09-19T06:05:22.681816+0000","last_became_peered":"2024-09-19T06:05:22.681816+0000","last_unstale":"2024-09-19T06:05:46.519763+0000","last_undegraded":"2024-09-19T06:05:46.519763+0000","last_fullsized":"2024-09-19T06:05:46.519763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:05.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902542+0000","last_change":"2024-09-19T06:05:24.699233+0000","last_active":"2024-09-19T06:05:46.902542+0000","last_peered":"2024-09-19T06:05:46.902542+0000","last_clean":"2024-09-19T06:05:46.902542+0000","last_became_active":"2024-09-19T06:05:24.698918+0000","last_became_peered":"2024-09-19T06:05:24.698918+0000","last_unstale":"2024-09-19T06:05:46.902542+0000","last_undegraded":"2024-09-19T06:05:46.902542+0000","last_fullsized":"2024-09-19T06:05:46.902542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:06:34.975047+0000","last_change":"2024-09-19T06:05:22.682161+0000","last_active":"2024-09-19T06:06:34.975047+0000","last_peered":"2024-09-19T06:06:34.975047+0000","last_clean":"2024-09-19T06:06:34.975047+0000","last_became_active":"2024-09-19T06:05:22.681805+0000","last_became_peered":"2024-09-19T06:05:22.681805+0000","last_unstale":"2024-09-19T06:06:34.975047+0000","last_undegraded":"2024-09-19T06:06:34.975047+0000","last_fullsized":"2024-09-19T06:06:34.975047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:27.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902474+0000","last_change":"2024-09-19T06:05:24.703668+0000","last_active":"2024-09-19T06:05:46.902474+0000","last_peered":"2024-09-19T06:05:46.902474+0000","last_clean":"2024-09-19T06:05:46.902474+0000","last_became_active":"2024-09-19T06:05:24.703342+0000","last_became_peered":"2024-09-19T06:05:24.703342+0000","last_unstale":"2024-09-19T06:05:46.902474+0000","last_undegraded":"2024-09-19T06:05:46.902474+0000","last_fullsized":"2024-09-19T06:05:46.902474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:30.399187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520049+0000","last_change":"2024-09-19T06:05:23.060458+0000","last_active":"2024-09-19T06:05:46.520049+0000","last_peered":"2024-09-19T06:05:46.520049+0000","last_clean":"2024-09-19T06:05:46.520049+0000","last_became_active":"2024-09-19T06:05:23.060098+0000","last_became_peered":"2024-09-19T06:05:23.060098+0000","last_unstale":"2024-09-19T06:05:46.520049+0000","last_undegraded":"2024-09-19T06:05:46.520049+0000","last_fullsized":"2024-09-19T06:05:46.520049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:58.800162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519964+0000","last_change":"2024-09-19T06:05:24.699832+0000","last_active":"2024-09-19T06:05:46.519964+0000","last_peered":"2024-09-19T06:05:46.519964+0000","last_clean":"2024-09-19T06:05:46.519964+0000","last_became_active":"2024-09-19T06:05:24.697600+0000","last_became_peered":"2024-09-19T06:05:24.697600+0000","last_unstale":"2024-09-19T06:05:46.519964+0000","last_undegraded":"2024-09-19T06:05:46.519964+0000","last_fullsized":"2024-09-19T06:05:46.519964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:15.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521202+0000","last_change":"2024-09-19T06:05:22.682962+0000","last_active":"2024-09-19T06:05:46.521202+0000","last_peered":"2024-09-19T06:05:46.521202+0000","last_clean":"2024-09-19T06:05:46.521202+0000","last_became_active":"2024-09-19T06:05:22.682573+0000","last_became_peered":"2024-09-19T06:05:22.682573+0000","last_unstale":"2024-09-19T06:05:46.521202+0000","last_undegraded":"2024-09-19T06:05:46.521202+0000","last_fullsized":"2024-09-19T06:05:46.521202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:31.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.907103+0000","last_change":"2024-09-19T06:05:46.907103+0000","last_active":"2024-09-19T06:05:46.907103+0000","last_peered":"2024-09-19T06:05:46.907103+0000","last_clean":"2024-09-19T06:05:46.907103+0000","last_became_active":"2024-09-19T06:05:46.906741+0000","last_became_peered":"2024-09-19T06:05:46.906741+0000","last_unstale":"2024-09-19T06:05:46.907103+0000","last_undegraded":"2024-09-19T06:05:46.907103+0000","last_fullsized":"2024-09-19T06:05:46.907103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:42.275594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902723+0000","last_change":"2024-09-19T06:05:22.684007+0000","last_active":"2024-09-19T06:05:46.902723+0000","last_peered":"2024-09-19T06:05:46.902723+0000","last_clean":"2024-09-19T06:05:46.902723+0000","last_became_active":"2024-09-19T06:05:22.683606+0000","last_became_peered":"2024-09-19T06:05:22.683606+0000","last_unstale":"2024-09-19T06:05:46.902723+0000","last_undegraded":"2024-09-19T06:05:46.902723+0000","last_fullsized":"2024-09-19T06:05:46.902723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:29.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902839+0000","last_change":"2024-09-19T06:05:24.698057+0000","last_active":"2024-09-19T06:05:46.902839+0000","last_peered":"2024-09-19T06:05:46.902839+0000","last_clean":"2024-09-19T06:05:46.902839+0000","last_became_active":"2024-09-19T06:05:24.697604+0000","last_became_peered":"2024-09-19T06:05:24.697604+0000","last_unstale":"2024-09-19T06:05:46.902839+0000","last_undegraded":"2024-09-19T06:05:46.902839+0000","last_fullsized":"2024-09-19T06:05:46.902839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:33.246096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520103+0000","last_change":"2024-09-19T06:05:22.680641+0000","last_active":"2024-09-19T06:05:46.520103+0000","last_peered":"2024-09-19T06:05:46.520103+0000","last_clean":"2024-09-19T06:05:46.520103+0000","last_became_active":"2024-09-19T06:05:22.680282+0000","last_became_peered":"2024-09-19T06:05:22.680282+0000","last_unstale":"2024-09-19T06:05:46.520103+0000","last_undegraded":"2024-09-19T06:05:46.520103+0000","last_fullsized":"2024-09-19T06:05:46.520103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:07.171581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902552+0000","last_change":"2024-09-19T06:05:24.705525+0000","last_active":"2024-09-19T06:05:46.902552+0000","last_peered":"2024-09-19T06:05:46.902552+0000","last_clean":"2024-09-19T06:05:46.902552+0000","last_became_active":"2024-09-19T06:05:24.705226+0000","last_became_peered":"2024-09-19T06:05:24.705226+0000","last_unstale":"2024-09-19T06:05:46.902552+0000","last_undegraded":"2024-09-19T06:05:46.902552+0000","last_fullsized":"2024-09-19T06:05:46.902552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:51.020525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.522657+0000","last_change":"2024-09-19T06:05:23.060628+0000","last_active":"2024-09-19T06:05:46.522657+0000","last_peered":"2024-09-19T06:05:46.522657+0000","last_clean":"2024-09-19T06:05:46.522657+0000","last_became_active":"2024-09-19T06:05:23.060066+0000","last_became_peered":"2024-09-19T06:05:23.060066+0000","last_unstale":"2024-09-19T06:05:46.522657+0000","last_undegraded":"2024-09-19T06:05:46.522657+0000","last_fullsized":"2024-09-19T06:05:46.522657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:55.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902770+0000","last_change":"2024-09-19T06:05:24.701994+0000","last_active":"2024-09-19T06:05:46.902770+0000","last_peered":"2024-09-19T06:05:46.902770+0000","last_clean":"2024-09-19T06:05:46.902770+0000","last_became_active":"2024-09-19T06:05:24.701648+0000","last_became_peered":"2024-09-19T06:05:24.701648+0000","last_unstale":"2024-09-19T06:05:46.902770+0000","last_undegraded":"2024-09-19T06:05:46.902770+0000","last_fullsized":"2024-09-19T06:05:46.902770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:16.475339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902639+0000","last_change":"2024-09-19T06:04:14.186274+0000","last_active":"2024-09-19T06:05:46.902639+0000","last_peered":"2024-09-19T06:05:46.902639+0000","last_clean":"2024-09-19T06:05:46.902639+0000","last_became_active":"2024-09-19T06:04:14.185907+0000","last_became_peered":"2024-09-19T06:04:14.185907+0000","last_unstale":"2024-09-19T06:05:46.902639+0000","last_undegraded":"2024-09-19T06:05:46.902639+0000","last_fullsized":"2024-09-19T06:05:46.902639+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_clean_scrub_stamp":"2024-09-19T06:00:59.680614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:01.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905464+0000","last_change":"2024-09-19T06:05:22.682242+0000","last_active":"2024-09-19T06:05:46.905464+0000","last_peered":"2024-09-19T06:05:46.905464+0000","last_clean":"2024-09-19T06:05:46.905464+0000","last_became_active":"2024-09-19T06:05:22.681896+0000","last_became_peered":"2024-09-19T06:05:22.681896+0000","last_unstale":"2024-09-19T06:05:46.905464+0000","last_undegraded":"2024-09-19T06:05:46.905464+0000","last_fullsized":"2024-09-19T06:05:46.905464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.119422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.962902+0000","last_change":"2024-09-19T06:05:46.962541+0000","last_active":"2024-09-19T06:05:46.962902+0000","last_peered":"2024-09-19T06:05:46.962902+0000","last_clean":"2024-09-19T06:05:46.962902+0000","last_became_active":"2024-09-19T06:05:46.962261+0000","last_became_peered":"2024-09-19T06:05:46.962261+0000","last_unstale":"2024-09-19T06:05:46.962902+0000","last_undegraded":"2024-09-19T06:05:46.962902+0000","last_fullsized":"2024-09-19T06:05:46.962902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:36.355129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902052+0000","last_change":"2024-09-19T06:05:22.685809+0000","last_active":"2024-09-19T06:05:46.902052+0000","last_peered":"2024-09-19T06:05:46.902052+0000","last_clean":"2024-09-19T06:05:46.902052+0000","last_became_active":"2024-09-19T06:05:22.685466+0000","last_became_peered":"2024-09-19T06:05:22.685466+0000","last_unstale":"2024-09-19T06:05:46.902052+0000","last_undegraded":"2024-09-19T06:05:46.902052+0000","last_fullsized":"2024-09-19T06:05:46.902052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:43.793845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903209+0000","last_change":"2024-09-19T06:05:24.701105+0000","last_active":"2024-09-19T06:05:46.903209+0000","last_peered":"2024-09-19T06:05:46.903209+0000","last_clean":"2024-09-19T06:05:46.903209+0000","last_became_active":"2024-09-19T06:05:24.700825+0000","last_became_peered":"2024-09-19T06:05:24.700825+0000","last_unstale":"2024-09-19T06:05:46.903209+0000","last_undegraded":"2024-09-19T06:05:46.903209+0000","last_fullsized":"2024-09-19T06:05:46.903209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:35.707437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:06:32.971651+0000","last_change":"2024-09-19T06:05:23.059587+0000","last_active":"2024-09-19T06:06:32.971651+0000","last_peered":"2024-09-19T06:06:32.971651+0000","last_clean":"2024-09-19T06:06:32.971651+0000","last_became_active":"2024-09-19T06:05:23.059248+0000","last_became_peered":"2024-09-19T06:05:23.059248+0000","last_unstale":"2024-09-19T06:06:32.971651+0000","last_undegraded":"2024-09-19T06:06:32.971651+0000","last_fullsized":"2024-09-19T06:06:32.971651+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:25.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520818+0000","last_change":"2024-09-19T06:05:24.701610+0000","last_active":"2024-09-19T06:05:46.520818+0000","last_peered":"2024-09-19T06:05:46.520818+0000","last_clean":"2024-09-19T06:05:46.520818+0000","last_became_active":"2024-09-19T06:05:24.697296+0000","last_became_peered":"2024-09-19T06:05:24.697296+0000","last_unstale":"2024-09-19T06:05:46.520818+0000","last_undegraded":"2024-09-19T06:05:46.520818+0000","last_fullsized":"2024-09-19T06:05:46.520818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:52.256284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902512+0000","last_change":"2024-09-19T06:05:22.684818+0000","last_active":"2024-09-19T06:05:46.902512+0000","last_peered":"2024-09-19T06:05:46.902512+0000","last_clean":"2024-09-19T06:05:46.902512+0000","last_became_active":"2024-09-19T06:05:22.684211+0000","last_became_peered":"2024-09-19T06:05:22.684211+0000","last_unstale":"2024-09-19T06:05:46.902512+0000","last_undegraded":"2024-09-19T06:05:46.902512+0000","last_fullsized":"2024-09-19T06:05:46.902512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:50.711805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517975+0000","last_change":"2024-09-19T06:05:24.702992+0000","last_active":"2024-09-19T06:05:46.517975+0000","last_peered":"2024-09-19T06:05:46.517975+0000","last_clean":"2024-09-19T06:05:46.517975+0000","last_became_active":"2024-09-19T06:05:24.702643+0000","last_became_peered":"2024-09-19T06:05:24.702643+0000","last_unstale":"2024-09-19T06:05:46.517975+0000","last_undegraded":"2024-09-19T06:05:46.517975+0000","last_fullsized":"2024-09-19T06:05:46.517975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:40.651861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518397+0000","last_change":"2024-09-19T06:05:23.060444+0000","last_active":"2024-09-19T06:05:46.518397+0000","last_peered":"2024-09-19T06:05:46.518397+0000","last_clean":"2024-09-19T06:05:46.518397+0000","last_became_active":"2024-09-19T06:05:23.059879+0000","last_became_peered":"2024-09-19T06:05:23.059879+0000","last_unstale":"2024-09-19T06:05:46.518397+0000","last_undegraded":"2024-09-19T06:05:46.518397+0000","last_fullsized":"2024-09-19T06:05:46.518397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:39.013096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517898+0000","last_change":"2024-09-19T06:05:24.694892+0000","last_active":"2024-09-19T06:05:46.517898+0000","last_peered":"2024-09-19T06:05:46.517898+0000","last_clean":"2024-09-19T06:05:46.517898+0000","last_became_active":"2024-09-19T06:05:24.694534+0000","last_became_peered":"2024-09-19T06:05:24.694534+0000","last_unstale":"2024-09-19T06:05:46.517898+0000","last_undegraded":"2024-09-19T06:05:46.517898+0000","last_fullsized":"2024-09-19T06:05:46.517898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:50.633035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.521062+0000","last_change":"2024-09-19T06:05:23.060597+0000","last_active":"2024-09-19T06:05:46.521062+0000","last_peered":"2024-09-19T06:05:46.521062+0000","last_clean":"2024-09-19T06:05:46.521062+0000","last_became_active":"2024-09-19T06:05:23.060235+0000","last_became_peered":"2024-09-19T06:05:23.060235+0000","last_unstale":"2024-09-19T06:05:46.521062+0000","last_undegraded":"2024-09-19T06:05:46.521062+0000","last_fullsized":"2024-09-19T06:05:46.521062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:54.517780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.903431+0000","last_change":"2024-09-19T06:05:24.698131+0000","last_active":"2024-09-19T06:05:46.903431+0000","last_peered":"2024-09-19T06:05:46.903431+0000","last_clean":"2024-09-19T06:05:46.903431+0000","last_became_active":"2024-09-19T06:05:24.697784+0000","last_became_peered":"2024-09-19T06:05:24.697784+0000","last_unstale":"2024-09-19T06:05:46.903431+0000","last_undegraded":"2024-09-19T06:05:46.903431+0000","last_fullsized":"2024-09-19T06:05:46.903431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:49.563908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:48.700895+0000","last_change":"2024-09-19T06:05:22.679532+0000","last_active":"2024-09-19T06:05:48.700895+0000","last_peered":"2024-09-19T06:05:48.700895+0000","last_clean":"2024-09-19T06:05:48.700895+0000","last_became_active":"2024-09-19T06:05:22.679156+0000","last_became_peered":"2024-09-19T06:05:22.679156+0000","last_unstale":"2024-09-19T06:05:48.700895+0000","last_undegraded":"2024-09-19T06:05:48.700895+0000","last_fullsized":"2024-09-19T06:05:48.700895+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:31.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516744+0000","last_change":"2024-09-19T06:05:24.698383+0000","last_active":"2024-09-19T06:05:46.516744+0000","last_peered":"2024-09-19T06:05:46.516744+0000","last_clean":"2024-09-19T06:05:46.516744+0000","last_became_active":"2024-09-19T06:05:24.698044+0000","last_became_peered":"2024-09-19T06:05:24.698044+0000","last_unstale":"2024-09-19T06:05:46.516744+0000","last_undegraded":"2024-09-19T06:05:46.516744+0000","last_fullsized":"2024-09-19T06:05:46.516744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:53.388847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.905533+0000","last_change":"2024-09-19T06:05:22.684799+0000","last_active":"2024-09-19T06:05:46.905533+0000","last_peered":"2024-09-19T06:05:46.905533+0000","last_clean":"2024-09-19T06:05:46.905533+0000","last_became_active":"2024-09-19T06:05:22.684376+0000","last_became_peered":"2024-09-19T06:05:22.684376+0000","last_unstale":"2024-09-19T06:05:46.905533+0000","last_undegraded":"2024-09-19T06:05:46.905533+0000","last_fullsized":"2024-09-19T06:05:46.905533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.124960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519736+0000","last_change":"2024-09-19T06:05:24.693751+0000","last_active":"2024-09-19T06:05:46.519736+0000","last_peered":"2024-09-19T06:05:46.519736+0000","last_clean":"2024-09-19T06:05:46.519736+0000","last_became_active":"2024-09-19T06:05:24.693442+0000","last_became_peered":"2024-09-19T06:05:24.693442+0000","last_unstale":"2024-09-19T06:05:46.519736+0000","last_undegraded":"2024-09-19T06:05:46.519736+0000","last_fullsized":"2024-09-19T06:05:46.519736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:46.491860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961568+0000","last_change":"2024-09-19T06:05:23.060522+0000","last_active":"2024-09-19T06:05:46.961568+0000","last_peered":"2024-09-19T06:05:46.961568+0000","last_clean":"2024-09-19T06:05:46.961568+0000","last_became_active":"2024-09-19T06:05:23.060170+0000","last_became_peered":"2024-09-19T06:05:23.060170+0000","last_unstale":"2024-09-19T06:05:46.961568+0000","last_undegraded":"2024-09-19T06:05:46.961568+0000","last_fullsized":"2024-09-19T06:05:46.961568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:54.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520186+0000","last_change":"2024-09-19T06:05:24.701242+0000","last_active":"2024-09-19T06:05:46.520186+0000","last_peered":"2024-09-19T06:05:46.520186+0000","last_clean":"2024-09-19T06:05:46.520186+0000","last_became_active":"2024-09-19T06:05:24.700813+0000","last_became_peered":"2024-09-19T06:05:24.700813+0000","last_unstale":"2024-09-19T06:05:46.520186+0000","last_undegraded":"2024-09-19T06:05:46.520186+0000","last_fullsized":"2024-09-19T06:05:46.520186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:42.706448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516577+0000","last_change":"2024-09-19T06:05:22.677502+0000","last_active":"2024-09-19T06:05:46.516577+0000","last_peered":"2024-09-19T06:05:46.516577+0000","last_clean":"2024-09-19T06:05:46.516577+0000","last_became_active":"2024-09-19T06:05:22.677082+0000","last_became_peered":"2024-09-19T06:05:22.677082+0000","last_unstale":"2024-09-19T06:05:46.516577+0000","last_undegraded":"2024-09-19T06:05:46.516577+0000","last_fullsized":"2024-09-19T06:05:46.516577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:30.991778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517459+0000","last_change":"2024-09-19T06:05:24.703155+0000","last_active":"2024-09-19T06:05:46.517459+0000","last_peered":"2024-09-19T06:05:46.517459+0000","last_clean":"2024-09-19T06:05:46.517459+0000","last_became_active":"2024-09-19T06:05:24.702570+0000","last_became_peered":"2024-09-19T06:05:24.702570+0000","last_unstale":"2024-09-19T06:05:46.517459+0000","last_undegraded":"2024-09-19T06:05:46.517459+0000","last_fullsized":"2024-09-19T06:05:46.517459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:36.016886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.532666+0000","last_change":"2024-09-19T06:05:46.532666+0000","last_active":"2024-09-19T06:05:46.532666+0000","last_peered":"2024-09-19T06:05:46.532666+0000","last_clean":"2024-09-19T06:05:46.532666+0000","last_became_active":"2024-09-19T06:05:46.523271+0000","last_became_peered":"2024-09-19T06:05:46.523271+0000","last_unstale":"2024-09-19T06:05:46.532666+0000","last_undegraded":"2024-09-19T06:05:46.532666+0000","last_fullsized":"2024-09-19T06:05:46.532666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:04.627727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516710+0000","last_change":"2024-09-19T06:05:24.694476+0000","last_active":"2024-09-19T06:05:46.516710+0000","last_peered":"2024-09-19T06:05:46.516710+0000","last_clean":"2024-09-19T06:05:46.516710+0000","last_became_active":"2024-09-19T06:05:24.694147+0000","last_became_peered":"2024-09-19T06:05:24.694147+0000","last_unstale":"2024-09-19T06:05:46.516710+0000","last_undegraded":"2024-09-19T06:05:46.516710+0000","last_fullsized":"2024-09-19T06:05:46.516710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:48.830522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520434+0000","last_change":"2024-09-19T06:05:22.687422+0000","last_active":"2024-09-19T06:05:46.520434+0000","last_peered":"2024-09-19T06:05:46.520434+0000","last_clean":"2024-09-19T06:05:46.520434+0000","last_became_active":"2024-09-19T06:05:22.686950+0000","last_became_peered":"2024-09-19T06:05:22.686950+0000","last_unstale":"2024-09-19T06:05:46.520434+0000","last_undegraded":"2024-09-19T06:05:46.520434+0000","last_fullsized":"2024-09-19T06:05:46.520434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:49.279769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.902432+0000","last_change":"2024-09-19T06:05:24.695701+0000","last_active":"2024-09-19T06:05:46.902432+0000","last_peered":"2024-09-19T06:05:46.902432+0000","last_clean":"2024-09-19T06:05:46.902432+0000","last_became_active":"2024-09-19T06:05:24.695341+0000","last_became_peered":"2024-09-19T06:05:24.695341+0000","last_unstale":"2024-09-19T06:05:46.902432+0000","last_undegraded":"2024-09-19T06:05:46.902432+0000","last_fullsized":"2024-09-19T06:05:46.902432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:52.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519721+0000","last_change":"2024-09-19T06:05:24.703456+0000","last_active":"2024-09-19T06:05:46.519721+0000","last_peered":"2024-09-19T06:05:46.519721+0000","last_clean":"2024-09-19T06:05:46.519721+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:05:46.519721+0000","last_undegraded":"2024-09-19T06:05:46.519721+0000","last_fullsized":"2024-09-19T06:05:46.519721+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:15.159843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520802+0000","last_change":"2024-09-19T06:05:22.683833+0000","last_active":"2024-09-19T06:05:46.520802+0000","last_peered":"2024-09-19T06:05:46.520802+0000","last_clean":"2024-09-19T06:05:46.520802+0000","last_became_active":"2024-09-19T06:05:22.683439+0000","last_became_peered":"2024-09-19T06:05:22.683439+0000","last_unstale":"2024-09-19T06:05:46.520802+0000","last_undegraded":"2024-09-19T06:05:46.520802+0000","last_fullsized":"2024-09-19T06:05:46.520802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:52.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.961492+0000","last_change":"2024-09-19T06:05:24.695905+0000","last_active":"2024-09-19T06:05:46.961492+0000","last_peered":"2024-09-19T06:05:46.961492+0000","last_clean":"2024-09-19T06:05:46.961492+0000","last_became_active":"2024-09-19T06:05:24.695570+0000","last_became_peered":"2024-09-19T06:05:24.695570+0000","last_unstale":"2024-09-19T06:05:46.961492+0000","last_undegraded":"2024-09-19T06:05:46.961492+0000","last_fullsized":"2024-09-19T06:05:46.961492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:00.167126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.520961+0000","last_change":"2024-09-19T06:05:22.686853+0000","last_active":"2024-09-19T06:05:46.520961+0000","last_peered":"2024-09-19T06:05:46.520961+0000","last_clean":"2024-09-19T06:05:46.520961+0000","last_became_active":"2024-09-19T06:05:22.686143+0000","last_became_peered":"2024-09-19T06:05:22.686143+0000","last_unstale":"2024-09-19T06:05:46.520961+0000","last_undegraded":"2024-09-19T06:05:46.520961+0000","last_fullsized":"2024-09-19T06:05:46.520961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:30.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.519841+0000","last_change":"2024-09-19T06:05:24.702420+0000","last_active":"2024-09-19T06:05:46.519841+0000","last_peered":"2024-09-19T06:05:46.519841+0000","last_clean":"2024-09-19T06:05:46.519841+0000","last_became_active":"2024-09-19T06:05:24.702140+0000","last_became_peered":"2024-09-19T06:05:24.702140+0000","last_unstale":"2024-09-19T06:05:46.519841+0000","last_undegraded":"2024-09-19T06:05:46.519841+0000","last_fullsized":"2024-09-19T06:05:46.519841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:27.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.517042+0000","last_change":"2024-09-19T06:05:23.059638+0000","last_active":"2024-09-19T06:05:46.517042+0000","last_peered":"2024-09-19T06:05:46.517042+0000","last_clean":"2024-09-19T06:05:46.517042+0000","last_became_active":"2024-09-19T06:05:23.059273+0000","last_became_peered":"2024-09-19T06:05:23.059273+0000","last_unstale":"2024-09-19T06:05:46.517042+0000","last_undegraded":"2024-09-19T06:05:46.517042+0000","last_fullsized":"2024-09-19T06:05:46.517042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:56.981598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.516857+0000","last_change":"2024-09-19T06:05:24.703608+0000","last_active":"2024-09-19T06:05:46.516857+0000","last_peered":"2024-09-19T06:05:46.516857+0000","last_clean":"2024-09-19T06:05:46.516857+0000","last_became_active":"2024-09-19T06:05:24.703300+0000","last_became_peered":"2024-09-19T06:05:24.703300+0000","last_unstale":"2024-09-19T06:05:46.516857+0000","last_undegraded":"2024-09-19T06:05:46.516857+0000","last_fullsized":"2024-09-19T06:05:46.516857+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.063545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T06:05:46.518702+0000","last_change":"2024-09-19T06:05:22.679379+0000","last_active":"2024-09-19T06:05:46.518702+0000","last_peered":"2024-09-19T06:05:46.518702+0000","last_clean":"2024-09-19T06:05:46.518702+0000","last_became_active":"2024-09-19T06:05:22.679091+0000","last_became_peered":"2024-09-19T06:05:22.679091+0000","last_unstale":"2024-09-19T06:05:46.518702+0000","last_undegraded":"2024-09-19T06:05:46.518702+0000","last_fullsized":"2024-09-19T06:05:46.518702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63374,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":392,"num_read_kb":262,"num_write":160,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645340,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":427934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874272,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1079145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037798,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":428136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266731,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":428056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32640,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712512,"statfs":{"total":95995035648,"available":95961612288,"internally_reserved":0,"allocated":1482752,"data_stored":1019595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":427525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888121,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1495040,"data_stored":1019279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":488398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":487082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":428796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:06:40.745 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:06:40.746 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T06:06:40.746 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T06:06:40.746 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T06:06:40.769 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:40 smithi103 ceph-mon[30925]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:40.991 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:41.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:40 smithi169 ceph-mon[34350]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:41.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:40 smithi174 ceph-mon[34488]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.464+0000 7fb5f23e0640 1 -- 172.21.15.103:0/423183613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5ec100a80 msgr2=0x7fb5ec100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.464+0000 7fb5f23e0640 1 --2- 172.21.15.103:0/423183613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5ec100a80 0x7fb5ec100ee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009930 tx=0x7fb5d402a420 comp rx=0 tx=0).stop 2024-09-19T06:06:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.464+0000 7fb5f23e0640 1 -- 172.21.15.103:0/423183613 shutdown_connections 2024-09-19T06:06:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.464+0000 7fb5f23e0640 1 --2- 172.21.15.103:0/423183613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5ec101420 0x7fb5ec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.464+0000 7fb5f23e0640 1 --2- 172.21.15.103:0/423183613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5ec100a80 0x7fb5ec100ee0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.464+0000 7fb5f23e0640 1 --2- 172.21.15.103:0/423183613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5ec106a80 0x7fb5ec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.464+0000 7fb5f23e0640 1 -- 172.21.15.103:0/423183613 >> 172.21.15.103:0/423183613 conn(0x7fb5ec0fc7a0 msgr2=0x7fb5ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.464+0000 7fb5f23e0640 1 -- 172.21.15.103:0/423183613 shutdown_connections 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.464+0000 7fb5f23e0640 1 -- 172.21.15.103:0/423183613 wait complete. 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f23e0640 1 Processor -- start 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f23e0640 1 -- start start 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f23e0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5ec100a80 0x7fb5ec1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f23e0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5ec101420 0x7fb5ec1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f23e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5ec106a80 0x7fb5ec1a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f23e0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec110d70 con 0x7fb5ec106a80 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f23e0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec110bf0 con 0x7fb5ec101420 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f23e0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec110ef0 con 0x7fb5ec100a80 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f097d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5ec106a80 0x7fb5ec1a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f097d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5ec106a80 0x7fb5ec1a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57042/0 (socket says 172.21.15.103:57042) 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f097d640 1 -- 172.21.15.103:0/3730850417 learned_addr learned my addr 172.21.15.103:0/3730850417 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5eb7fe640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5ec101420 0x7fb5ec1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5ebfff640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5ec100a80 0x7fb5ec1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f097d640 1 -- 172.21.15.103:0/3730850417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5ec100a80 msgr2=0x7fb5ec1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f097d640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5ec100a80 0x7fb5ec1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f097d640 1 -- 172.21.15.103:0/3730850417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5ec101420 msgr2=0x7fb5ec1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.465+0000 7fb5f097d640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5ec101420 0x7fb5ec1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.466+0000 7fb5f097d640 1 -- 172.21.15.103:0/3730850417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ec1a4860 con 0x7fb5ec106a80 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.466+0000 7fb5ebfff640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5ec100a80 0x7fb5ec1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.466+0000 7fb5eb7fe640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5ec101420 0x7fb5ec1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.466+0000 7fb5f097d640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5ec106a80 0x7fb5ec1a4320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400b970 tx=0x7fb5e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.466+0000 7fb5e97fa640 1 -- 172.21.15.103:0/3730850417 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4019070 con 0x7fb5ec106a80 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.466+0000 7fb5f23e0640 1 -- 172.21.15.103:0/3730850417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ec1a4a30 con 0x7fb5ec106a80 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.466+0000 7fb5e97fa640 1 -- 172.21.15.103:0/3730850417 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5e4014440 con 0x7fb5ec106a80 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.466+0000 7fb5e97fa640 1 -- 172.21.15.103:0/3730850417 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40075d0 con 0x7fb5ec106a80 2024-09-19T06:06:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.466+0000 7fb5f23e0640 1 -- 172.21.15.103:0/3730850417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ec1a4ef0 con 0x7fb5ec106a80 2024-09-19T06:06:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.467+0000 7fb5f23e0640 1 -- 172.21.15.103:0/3730850417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ec100ee0 con 0x7fb5ec106a80 2024-09-19T06:06:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.468+0000 7fb5e97fa640 1 -- 172.21.15.103:0/3730850417 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fb5e401c070 con 0x7fb5ec106a80 2024-09-19T06:06:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.469+0000 7fb5e97fa640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb5d80a32d0 0x7fb5d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.469+0000 7fb5ebfff640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb5d80a32d0 0x7fb5d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.469+0000 7fb5e97fa640 1 -- 172.21.15.103:0/3730850417 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb5e40ceff0 con 0x7fb5ec106a80 2024-09-19T06:06:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.469+0000 7fb5ebfff640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb5d80a32d0 0x7fb5d80a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009b40 tx=0x7fb5dc005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.473+0000 7fb5e97fa640 1 -- 172.21.15.103:0/3730850417 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb5e409bcf0 con 0x7fb5ec106a80 2024-09-19T06:06:41.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.677+0000 7fb5f23e0640 1 -- 172.21.15.103:0/3730850417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb5ec109010 con 0x7fb5ec106a80 2024-09-19T06:06:41.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.677+0000 7fb5e97fa640 1 -- 172.21.15.103:0/3730850417 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb5e409b5f0 con 0x7fb5ec106a80 2024-09-19T06:06:41.680 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:41.680 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T06:06:41.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 -- 172.21.15.103:0/3730850417 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb5d80a32d0 msgr2=0x7fb5d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:41.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb5d80a32d0 0x7fb5d80a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009b40 tx=0x7fb5dc005e50 comp rx=0 tx=0).stop 2024-09-19T06:06:41.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 -- 172.21.15.103:0/3730850417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5ec106a80 msgr2=0x7fb5ec1a4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:41.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5ec106a80 0x7fb5ec1a4320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400b970 tx=0x7fb5e400be30 comp rx=0 tx=0).stop 2024-09-19T06:06:41.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 -- 172.21.15.103:0/3730850417 shutdown_connections 2024-09-19T06:06:41.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb5d80a32d0 0x7fb5d80a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:41.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5ec106a80 0x7fb5ec1a4320 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:41.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5ec101420 0x7fb5ec1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:41.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 --2- 172.21.15.103:0/3730850417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5ec100a80 0x7fb5ec1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:41.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 -- 172.21.15.103:0/3730850417 >> 172.21.15.103:0/3730850417 conn(0x7fb5ec0fc7a0 msgr2=0x7fb5ec0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:41.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 -- 172.21.15.103:0/3730850417 shutdown_connections 2024-09-19T06:06:41.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:41.680+0000 7fb5f23e0640 1 -- 172.21.15.103:0/3730850417 wait complete. 2024-09-19T06:06:41.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:41 smithi103 ceph-mon[30925]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:06:41.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:41 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3730850417' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:06:42.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:41 smithi169 ceph-mon[34350]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:06:42.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:41 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3730850417' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:06:42.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:41 smithi174 ceph-mon[34488]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:06:42.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:41 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3730850417' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:06:42.355 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T06:06:42.355 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:06:42.644 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.125+0000 7f3adb308640 1 -- 172.21.15.103:0/2355150606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad4106f50 msgr2=0x7f3ad410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.125+0000 7f3adb308640 1 --2- 172.21.15.103:0/2355150606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad4106f50 0x7f3ad410eaf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009cd0 tx=0x7f3acc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.125+0000 7f3adb308640 1 -- 172.21.15.103:0/2355150606 shutdown_connections 2024-09-19T06:06:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.125+0000 7f3adb308640 1 --2- 172.21.15.103:0/2355150606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad4106f50 0x7f3ad410eaf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.125+0000 7f3adb308640 1 --2- 172.21.15.103:0/2355150606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ad4100ca0 0x7f3ad4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.125+0000 7f3adb308640 1 --2- 172.21.15.103:0/2355150606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ad41002f0 0x7f3ad41006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.125+0000 7f3adb308640 1 -- 172.21.15.103:0/2355150606 >> 172.21.15.103:0/2355150606 conn(0x7f3ad4077210 msgr2=0x7f3ad40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.125+0000 7f3adb308640 1 -- 172.21.15.103:0/2355150606 shutdown_connections 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.125+0000 7f3adb308640 1 -- 172.21.15.103:0/2355150606 wait complete. 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.125+0000 7f3adb308640 1 Processor -- start 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3adb308640 1 -- start start 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3adb308640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ad41002f0 0x7f3ad4101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3adb308640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ad4100ca0 0x7f3ad41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3adb308640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad4106f50 0x7f3ad4101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3adb308640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad4111e50 con 0x7f3ad4106f50 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3adb308640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad4111cd0 con 0x7f3ad4100ca0 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3adb308640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad4111fd0 con 0x7f3ad41002f0 2024-09-19T06:06:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad98a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad4106f50 0x7f3ad4101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad98a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad4106f50 0x7f3ad4101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57058/0 (socket says 172.21.15.103:57058) 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad98a5640 1 -- 172.21.15.103:0/2523766821 learned_addr learned my addr 172.21.15.103:0/2523766821 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad90a4640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ad41002f0 0x7f3ad4101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad88a3640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ad4100ca0 0x7f3ad41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad98a5640 1 -- 172.21.15.103:0/2523766821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ad41002f0 msgr2=0x7f3ad4101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad98a5640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ad41002f0 0x7f3ad4101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad98a5640 1 -- 172.21.15.103:0/2523766821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ad4100ca0 msgr2=0x7f3ad41017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad98a5640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ad4100ca0 0x7f3ad41017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad98a5640 1 -- 172.21.15.103:0/2523766821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad41a6850 con 0x7f3ad4106f50 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad88a3640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ad4100ca0 0x7f3ad41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3ad98a5640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad4106f50 0x7f3ad4101cf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3acc005cc0 tx=0x7f3acc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.126+0000 7f3aca7fc640 1 -- 172.21.15.103:0/2523766821 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc004450 con 0x7f3ad4106f50 2024-09-19T06:06:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.127+0000 7f3aca7fc640 1 -- 172.21.15.103:0/2523766821 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3acc031c90 con 0x7f3ad4106f50 2024-09-19T06:06:43.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.127+0000 7f3adb308640 1 -- 172.21.15.103:0/2523766821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad41a6ae0 con 0x7f3ad4106f50 2024-09-19T06:06:43.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.127+0000 7f3aca7fc640 1 -- 172.21.15.103:0/2523766821 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc03b400 con 0x7f3ad4106f50 2024-09-19T06:06:43.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.127+0000 7f3adb308640 1 -- 172.21.15.103:0/2523766821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad41a7070 con 0x7f3ad4106f50 2024-09-19T06:06:43.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.127+0000 7f3adb308640 1 -- 172.21.15.103:0/2523766821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad41006d0 con 0x7f3ad4106f50 2024-09-19T06:06:43.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.129+0000 7f3aca7fc640 1 -- 172.21.15.103:0/2523766821 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f3acc004680 con 0x7f3ad4106f50 2024-09-19T06:06:43.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.129+0000 7f3aca7fc640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ac00a3350 0x7f3ac00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:43.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.129+0000 7f3ad90a4640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ac00a3350 0x7f3ac00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:43.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.130+0000 7f3aca7fc640 1 -- 172.21.15.103:0/2523766821 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3acc02e030 con 0x7f3ad4106f50 2024-09-19T06:06:43.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.130+0000 7f3ad90a4640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ac00a3350 0x7f3ac00a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400bbe0 tx=0x7f3ac400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:43.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.132+0000 7f3aca7fc640 1 -- 172.21.15.103:0/2523766821 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3acc0bdc00 con 0x7f3ad4106f50 2024-09-19T06:06:43.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.334+0000 7f3adb308640 1 -- 172.21.15.103:0/2523766821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ad41027a0 con 0x7f3ad4106f50 2024-09-19T06:06:43.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.335+0000 7f3aca7fc640 1 -- 172.21.15.103:0/2523766821 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11933 (secure 0 0 0) 0x7f3ad41027a0 con 0x7f3ad4106f50 2024-09-19T06:06:43.338 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:43.338 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"btime":"2024-09-19T06:05:36:880542+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:05:36.431382+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24463,24475,24488]},"id":1}]} 2024-09-19T06:06:43.338 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 24 2024-09-19T06:06:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.337+0000 7f3adb308640 1 -- 172.21.15.103:0/2523766821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ac00a3350 msgr2=0x7f3ac00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.337+0000 7f3adb308640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ac00a3350 0x7f3ac00a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400bbe0 tx=0x7f3ac400b390 comp rx=0 tx=0).stop 2024-09-19T06:06:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.337+0000 7f3adb308640 1 -- 172.21.15.103:0/2523766821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad4106f50 msgr2=0x7f3ad4101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.337+0000 7f3adb308640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad4106f50 0x7f3ad4101cf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3acc005cc0 tx=0x7f3acc003c20 comp rx=0 tx=0).stop 2024-09-19T06:06:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.338+0000 7f3adb308640 1 -- 172.21.15.103:0/2523766821 shutdown_connections 2024-09-19T06:06:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.338+0000 7f3adb308640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3ac00a3350 0x7f3ac00a5810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.338+0000 7f3adb308640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad4106f50 0x7f3ad4101cf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.338+0000 7f3adb308640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ad4100ca0 0x7f3ad41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.338+0000 7f3adb308640 1 --2- 172.21.15.103:0/2523766821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ad41002f0 0x7f3ad4101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.338+0000 7f3adb308640 1 -- 172.21.15.103:0/2523766821 >> 172.21.15.103:0/2523766821 conn(0x7f3ad4077210 msgr2=0x7f3ad41052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:43.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.338+0000 7f3adb308640 1 -- 172.21.15.103:0/2523766821 shutdown_connections 2024-09-19T06:06:43.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:43.338+0000 7f3adb308640 1 -- 172.21.15.103:0/2523766821 wait complete. 2024-09-19T06:06:43.692 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:43 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2523766821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:43.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:43 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2523766821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:43 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2523766821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:44.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:44.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:44 smithi103 ceph-mon[30925]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:06:44.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:44 smithi174 ceph-mon[34488]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:06:44.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 -- 172.21.15.103:0/2291749568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d48100a80 msgr2=0x7f6d48100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 --2- 172.21.15.103:0/2291749568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d48100a80 0x7f6d48100ee0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009930 tx=0x7f6d3802a420 comp rx=0 tx=0).stop 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 -- 172.21.15.103:0/2291749568 shutdown_connections 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 --2- 172.21.15.103:0/2291749568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d48101420 0x7f6d4810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 --2- 172.21.15.103:0/2291749568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d48100a80 0x7f6d48100ee0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 --2- 172.21.15.103:0/2291749568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d48106a80 0x7f6d48106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 -- 172.21.15.103:0/2291749568 >> 172.21.15.103:0/2291749568 conn(0x7f6d480fc7a0 msgr2=0x7f6d480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 -- 172.21.15.103:0/2291749568 shutdown_connections 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 -- 172.21.15.103:0/2291749568 wait complete. 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 Processor -- start 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.717+0000 7f6d4f76b640 1 -- start start 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4f76b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d48100a80 0x7f6d48198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4f76b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d48101420 0x7f6d48198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4f76b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d48106a80 0x7f6d4819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4f76b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48110d50 con 0x7f6d48100a80 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4f76b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48110bd0 con 0x7f6d48101420 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4f76b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48110ed0 con 0x7f6d48106a80 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4d507640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d48100a80 0x7f6d48198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4d507640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d48100a80 0x7f6d48198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57068/0 (socket says 172.21.15.103:57068) 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4d507640 1 -- 172.21.15.103:0/874690852 learned_addr learned my addr 172.21.15.103:0/874690852 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4cd06640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d48101420 0x7f6d48198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4dd08640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d48106a80 0x7f6d4819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4d507640 1 -- 172.21.15.103:0/874690852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d48106a80 msgr2=0x7f6d4819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4d507640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d48106a80 0x7f6d4819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4d507640 1 -- 172.21.15.103:0/874690852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d48101420 msgr2=0x7f6d48198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4d507640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d48101420 0x7f6d48198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4d507640 1 -- 172.21.15.103:0/874690852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4819d3b0 con 0x7f6d48100a80 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4cd06640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d48101420 0x7f6d48198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4d507640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d48100a80 0x7f6d48198400 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400d950 tx=0x7f6d4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d3e7fc640 1 -- 172.21.15.103:0/874690852 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44017070 con 0x7f6d48100a80 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d3e7fc640 1 -- 172.21.15.103:0/874690852 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d44009c30 con 0x7f6d48100a80 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4f76b640 1 -- 172.21.15.103:0/874690852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4819d6a0 con 0x7f6d48100a80 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d3e7fc640 1 -- 172.21.15.103:0/874690852 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4400f620 con 0x7f6d48100a80 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.718+0000 7f6d4f76b640 1 -- 172.21.15.103:0/874690852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d481a4f80 con 0x7f6d48100a80 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.719+0000 7f6d4f76b640 1 -- 172.21.15.103:0/874690852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d48100ee0 con 0x7f6d48100a80 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.721+0000 7f6d3e7fc640 1 -- 172.21.15.103:0/874690852 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f6d440109a0 con 0x7f6d48100a80 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.721+0000 7f6d3e7fc640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6d340a32d0 0x7f6d340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.721+0000 7f6d4cd06640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6d340a32d0 0x7f6d340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.721+0000 7f6d3e7fc640 1 -- 172.21.15.103:0/874690852 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f6d440cf770 con 0x7f6d48100a80 2024-09-19T06:06:44.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.722+0000 7f6d4cd06640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6d340a32d0 0x7f6d340a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6d38000c00 tx=0x7f6d38009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:44.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.725+0000 7f6d3e7fc640 1 -- 172.21.15.103:0/874690852 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d44009de0 con 0x7f6d48100a80 2024-09-19T06:06:44.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:44 smithi169 ceph-mon[34350]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:06:44.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.928+0000 7f6d4f76b640 1 -- 172.21.15.103:0/874690852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d4810a020 con 0x7f6d48100a80 2024-09-19T06:06:44.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.929+0000 7f6d3e7fc640 1 -- 172.21.15.103:0/874690852 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11933 (secure 0 0 0) 0x7f6d4409c360 con 0x7f6d48100a80 2024-09-19T06:06:44.932 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:44.932 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"btime":"2024-09-19T06:05:36:880542+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:05:36.431382+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24463,24475,24488]},"id":1}]} 2024-09-19T06:06:44.932 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 24 2024-09-19T06:06:44.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 -- 172.21.15.103:0/874690852 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6d340a32d0 msgr2=0x7f6d340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6d340a32d0 0x7f6d340a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6d38000c00 tx=0x7f6d38009610 comp rx=0 tx=0).stop 2024-09-19T06:06:44.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 -- 172.21.15.103:0/874690852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d48100a80 msgr2=0x7f6d48198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d48100a80 0x7f6d48198400 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400d950 tx=0x7f6d4400de10 comp rx=0 tx=0).stop 2024-09-19T06:06:44.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 -- 172.21.15.103:0/874690852 shutdown_connections 2024-09-19T06:06:44.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f6d340a32d0 0x7f6d340a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d48106a80 0x7f6d4819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d48101420 0x7f6d48198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 --2- 172.21.15.103:0/874690852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d48100a80 0x7f6d48198400 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 -- 172.21.15.103:0/874690852 >> 172.21.15.103:0/874690852 conn(0x7f6d480fc7a0 msgr2=0x7f6d4806aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:44.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 -- 172.21.15.103:0/874690852 shutdown_connections 2024-09-19T06:06:44.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:44.932+0000 7f6d4f76b640 1 -- 172.21.15.103:0/874690852 wait complete. 2024-09-19T06:06:45.493 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:45 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/874690852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:45.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:06:45.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:45 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/874690852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:45.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:45 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/874690852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:45.875 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 -- 172.21.15.103:0/2001325551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa68100a80 msgr2=0x7faa68100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 --2- 172.21.15.103:0/2001325551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa68100a80 0x7faa68100ee0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faa54009930 tx=0x7faa5402a420 comp rx=0 tx=0).stop 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 -- 172.21.15.103:0/2001325551 shutdown_connections 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 --2- 172.21.15.103:0/2001325551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa68101420 0x7faa6810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 --2- 172.21.15.103:0/2001325551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa68100a80 0x7faa68100ee0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 --2- 172.21.15.103:0/2001325551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa68106a80 0x7faa68106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 -- 172.21.15.103:0/2001325551 >> 172.21.15.103:0/2001325551 conn(0x7faa680fc7a0 msgr2=0x7faa680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 -- 172.21.15.103:0/2001325551 shutdown_connections 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 -- 172.21.15.103:0/2001325551 wait complete. 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 Processor -- start 2024-09-19T06:06:46.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 -- start start 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa68100a80 0x7faa681983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa68101420 0x7faa681988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa68106a80 0x7faa6819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faa68110cf0 con 0x7faa68100a80 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa68110b70 con 0x7faa68106a80 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.349+0000 7faa6eb57640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faa68110e70 con 0x7faa68101420 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6c8f3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa68100a80 0x7faa681983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6c8f3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa68100a80 0x7faa681983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57090/0 (socket says 172.21.15.103:57090) 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6c8f3640 1 -- 172.21.15.103:0/433862346 learned_addr learned my addr 172.21.15.103:0/433862346 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa67fff640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa68101420 0x7faa681988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6d0f4640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa68106a80 0x7faa6819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6c8f3640 1 -- 172.21.15.103:0/433862346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa68101420 msgr2=0x7faa681988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6c8f3640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa68101420 0x7faa681988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:46.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6c8f3640 1 -- 172.21.15.103:0/433862346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa68106a80 msgr2=0x7faa6819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6c8f3640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa68106a80 0x7faa6819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6c8f3640 1 -- 172.21.15.103:0/433862346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6819d350 con 0x7faa68100a80 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6c8f3640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa68100a80 0x7faa681983a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00d950 tx=0x7faa5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa65ffb640 1 -- 172.21.15.103:0/433862346 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c017070 con 0x7faa68100a80 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa6eb57640 1 -- 172.21.15.103:0/433862346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6819d640 con 0x7faa68100a80 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa65ffb640 1 -- 172.21.15.103:0/433862346 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa5c009c30 con 0x7faa68100a80 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.350+0000 7faa65ffb640 1 -- 172.21.15.103:0/433862346 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00f620 con 0x7faa68100a80 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.351+0000 7faa6eb57640 1 -- 172.21.15.103:0/433862346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa681a4f20 con 0x7faa68100a80 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.351+0000 7faa6eb57640 1 -- 172.21.15.103:0/433862346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa68100ee0 con 0x7faa68100a80 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.352+0000 7faa65ffb640 1 -- 172.21.15.103:0/433862346 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7faa5c0109a0 con 0x7faa68100a80 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.353+0000 7faa65ffb640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faa580a32d0 0x7faa580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.353+0000 7faa65ffb640 1 -- 172.21.15.103:0/433862346 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7faa5c0cf590 con 0x7faa68100a80 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.353+0000 7faa67fff640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faa580a32d0 0x7faa580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.353+0000 7faa67fff640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faa580a32d0 0x7faa580a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faa54009900 tx=0x7faa54000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:46.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.357+0000 7faa65ffb640 1 -- 172.21.15.103:0/433862346 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa5c009de0 con 0x7faa68100a80 2024-09-19T06:06:46.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.412+0000 7faa65ffb640 1 -- 172.21.15.103:0/433862346 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7faa5c0981a0 con 0x7faa68100a80 2024-09-19T06:06:46.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.531+0000 7faa6eb57640 1 -- 172.21.15.103:0/433862346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa681a50f0 con 0x7faa68100a80 2024-09-19T06:06:46.533 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:46 smithi103 ceph-mon[30925]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:06:46.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.532+0000 7faa65ffb640 1 -- 172.21.15.103:0/433862346 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22681 (secure 0 0 0) 0x7faa5c08d800 con 0x7faa68100a80 2024-09-19T06:06:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:46.534 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:05:46.513696+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:05:21.617020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:05:23.597579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:06:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 -- 172.21.15.103:0/433862346 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faa580a32d0 msgr2=0x7faa580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faa580a32d0 0x7faa580a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faa54009900 tx=0x7faa54000bc0 comp rx=0 tx=0).stop 2024-09-19T06:06:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 -- 172.21.15.103:0/433862346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa68100a80 msgr2=0x7faa681983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa68100a80 0x7faa681983a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00d950 tx=0x7faa5c00de10 comp rx=0 tx=0).stop 2024-09-19T06:06:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 -- 172.21.15.103:0/433862346 shutdown_connections 2024-09-19T06:06:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7faa580a32d0 0x7faa580a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa68106a80 0x7faa6819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa68101420 0x7faa681988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 --2- 172.21.15.103:0/433862346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa68100a80 0x7faa681983a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:46.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 -- 172.21.15.103:0/433862346 >> 172.21.15.103:0/433862346 conn(0x7faa680fc7a0 msgr2=0x7faa681048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:46.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.534+0000 7faa6eb57640 1 -- 172.21.15.103:0/433862346 shutdown_connections 2024-09-19T06:06:46.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:46.535+0000 7faa6eb57640 1 -- 172.21.15.103:0/433862346 wait complete. 2024-09-19T06:06:46.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:46 smithi174 ceph-mon[34488]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:06:46.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:46 smithi169 ceph-mon[34350]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:06:47.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:06:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:47.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:47 smithi103 ceph-mon[30925]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:06:47.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:47 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/433862346' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:47.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:47 smithi174 ceph-mon[34488]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:06:47.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:47 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/433862346' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:47.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:47 smithi169 ceph-mon[34350]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:06:47.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:47 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/433862346' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:47.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.890+0000 7fda885fc640 1 -- 172.21.15.103:0/1444188228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda80103660 msgr2=0x7fda8010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.890+0000 7fda885fc640 1 --2- 172.21.15.103:0/1444188228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda80103660 0x7fda8010bb50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fda70009900 tx=0x7fda7002a480 comp rx=0 tx=0).stop 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.890+0000 7fda885fc640 1 -- 172.21.15.103:0/1444188228 shutdown_connections 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.890+0000 7fda885fc640 1 --2- 172.21.15.103:0/1444188228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda8010c170 0x7fda8010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.890+0000 7fda885fc640 1 --2- 172.21.15.103:0/1444188228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda80103660 0x7fda8010bb50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.890+0000 7fda885fc640 1 --2- 172.21.15.103:0/1444188228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda80102d40 0x7fda80103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.890+0000 7fda885fc640 1 -- 172.21.15.103:0/1444188228 >> 172.21.15.103:0/1444188228 conn(0x7fda800fc7a0 msgr2=0x7fda800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.890+0000 7fda885fc640 1 -- 172.21.15.103:0/1444188228 shutdown_connections 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.890+0000 7fda885fc640 1 -- 172.21.15.103:0/1444188228 wait complete. 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda885fc640 1 Processor -- start 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda885fc640 1 -- start start 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda885fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda80102d40 0x7fda80198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda885fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda80103660 0x7fda80198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda885fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda8010c170 0x7fda8019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda885fc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fda80111e20 con 0x7fda8010c170 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda885fc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda80111ca0 con 0x7fda80103660 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda885fc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fda80111fa0 con 0x7fda80102d40 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda86b99640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda8010c170 0x7fda8019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda86b99640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda8010c170 0x7fda8019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57110/0 (socket says 172.21.15.103:57110) 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda86b99640 1 -- 172.21.15.103:0/2279335152 learned_addr learned my addr 172.21.15.103:0/2279335152 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda85b97640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda80103660 0x7fda80198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda86398640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda80102d40 0x7fda80198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda86b99640 1 -- 172.21.15.103:0/2279335152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda80102d40 msgr2=0x7fda80198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda86b99640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda80102d40 0x7fda80198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda86b99640 1 -- 172.21.15.103:0/2279335152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda80103660 msgr2=0x7fda80198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda86b99640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda80103660 0x7fda80198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda86b99640 1 -- 172.21.15.103:0/2279335152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8019d2f0 con 0x7fda8010c170 2024-09-19T06:06:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.891+0000 7fda86398640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda80102d40 0x7fda80198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.892+0000 7fda86b99640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda8010c170 0x7fda8019cc10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fda7800cad0 tx=0x7fda7800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.892+0000 7fda777fe640 1 -- 172.21.15.103:0/2279335152 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7800ae20 con 0x7fda8010c170 2024-09-19T06:06:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.892+0000 7fda777fe640 1 -- 172.21.15.103:0/2279335152 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda78005020 con 0x7fda8010c170 2024-09-19T06:06:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.892+0000 7fda885fc640 1 -- 172.21.15.103:0/2279335152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8019d5e0 con 0x7fda8010c170 2024-09-19T06:06:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.892+0000 7fda777fe640 1 -- 172.21.15.103:0/2279335152 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7800f6b0 con 0x7fda8010c170 2024-09-19T06:06:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.892+0000 7fda885fc640 1 -- 172.21.15.103:0/2279335152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda801a4ec0 con 0x7fda8010c170 2024-09-19T06:06:47.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.893+0000 7fda885fc640 1 -- 172.21.15.103:0/2279335152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda80103120 con 0x7fda8010c170 2024-09-19T06:06:47.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.894+0000 7fda777fe640 1 -- 172.21.15.103:0/2279335152 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fda780051d0 con 0x7fda8010c170 2024-09-19T06:06:47.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.895+0000 7fda777fe640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fda6c0a3240 0x7fda6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:47.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.895+0000 7fda86398640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fda6c0a3240 0x7fda6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:47.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.895+0000 7fda777fe640 1 -- 172.21.15.103:0/2279335152 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fda780cf8d0 con 0x7fda8010c170 2024-09-19T06:06:47.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.895+0000 7fda86398640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fda6c0a3240 0x7fda6c0a5700 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00abe0 tx=0x7fda7c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:47.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:47.899+0000 7fda777fe640 1 -- 172.21.15.103:0/2279335152 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda78014030 con 0x7fda8010c170 2024-09-19T06:06:48.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.100+0000 7fda885fc640 1 -- 172.21.15.103:0/2279335152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda80107240 con 0x7fda8010c170 2024-09-19T06:06:48.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.101+0000 7fda777fe640 1 -- 172.21.15.103:0/2279335152 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11933 (secure 0 0 0) 0x7fda7809c620 con 0x7fda8010c170 2024-09-19T06:06:48.103 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:06:48.103 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"btime":"2024-09-19T06:05:36:880542+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:05:36.431382+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24463,24475,24488]},"id":1}]} 2024-09-19T06:06:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 24 2024-09-19T06:06:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 -- 172.21.15.103:0/2279335152 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fda6c0a3240 msgr2=0x7fda6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fda6c0a3240 0x7fda6c0a5700 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00abe0 tx=0x7fda7c00a5c0 comp rx=0 tx=0).stop 2024-09-19T06:06:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 -- 172.21.15.103:0/2279335152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda8010c170 msgr2=0x7fda8019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda8010c170 0x7fda8019cc10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fda7800cad0 tx=0x7fda7800cf90 comp rx=0 tx=0).stop 2024-09-19T06:06:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 -- 172.21.15.103:0/2279335152 shutdown_connections 2024-09-19T06:06:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fda6c0a3240 0x7fda6c0a5700 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda8010c170 0x7fda8019cc10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda80103660 0x7fda80198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 --2- 172.21.15.103:0/2279335152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda80102d40 0x7fda80198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 -- 172.21.15.103:0/2279335152 >> 172.21.15.103:0/2279335152 conn(0x7fda800fc7a0 msgr2=0x7fda800fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 -- 172.21.15.103:0/2279335152 shutdown_connections 2024-09-19T06:06:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:48.104+0000 7fda885fc640 1 -- 172.21.15.103:0/2279335152 wait complete. 2024-09-19T06:06:48.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:48 smithi174 ceph-mon[34488]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:06:48.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:48 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2279335152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:48 smithi103 ceph-mon[30925]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:06:48.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:48 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2279335152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:48.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:48 smithi169 ceph-mon[34350]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:06:48.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:48 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2279335152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:48.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:05:25.242328+0000', 'modified': '2024-09-19T06:05:36.431382+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24488, 'mds_1': 24475, 'mds_2': 24463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/3808769732', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 3808769732}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 3808769732}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6835/588815565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 588815565}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 588815565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24455': {'gid': 24455, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6837/2782103866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 2782103866}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 2782103866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.174:6837/2575162107', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 2575162107}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 2575162107}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.174:6839/1070224661', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 1070224661}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 1070224661}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.169:6839/3987841064', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 3987841064}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 3987841064}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24488, 'qdb_cluster': [24463, 24475, 24488]} 2024-09-19T06:06:48.820 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T06:06:48.820 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T06:06:49.065 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 -- 172.21.15.103:0/2591510805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd658100e20 msgr2=0x7fd658101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 --2- 172.21.15.103:0/2591510805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd658100e20 0x7fd658101200 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd648009900 tx=0x7fd64802a480 comp rx=0 tx=0).stop 2024-09-19T06:06:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 -- 172.21.15.103:0/2591510805 shutdown_connections 2024-09-19T06:06:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 --2- 172.21.15.103:0/2591510805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd658102ef0 0x7fd65810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 --2- 172.21.15.103:0/2591510805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd658102570 0x7fd6581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 --2- 172.21.15.103:0/2591510805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd658100e20 0x7fd658101200 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 -- 172.21.15.103:0/2591510805 >> 172.21.15.103:0/2591510805 conn(0x7fd6580fc7d0 msgr2=0x7fd6580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 -- 172.21.15.103:0/2591510805 shutdown_connections 2024-09-19T06:06:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 -- 172.21.15.103:0/2591510805 wait complete. 2024-09-19T06:06:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 Processor -- start 2024-09-19T06:06:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.552+0000 7fd65de05640 1 -- start start 2024-09-19T06:06:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd65de05640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd658100e20 0x7fd658198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd65de05640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd658102570 0x7fd658198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd65de05640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd658102ef0 0x7fd65819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd65de05640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd658110ed0 con 0x7fd658102570 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd65de05640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd658110d50 con 0x7fd658100e20 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd65de05640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd658111050 con 0x7fd658102ef0 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd656ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd658102570 0x7fd658198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd656ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd658102570 0x7fd658198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57138/0 (socket says 172.21.15.103:57138) 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd656ffd640 1 -- 172.21.15.103:0/2588706543 learned_addr learned my addr 172.21.15.103:0/2588706543 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd6577fe640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd658100e20 0x7fd658198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd657fff640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd658102ef0 0x7fd65819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd656ffd640 1 -- 172.21.15.103:0/2588706543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd658102ef0 msgr2=0x7fd65819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd656ffd640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd658102ef0 0x7fd65819ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd656ffd640 1 -- 172.21.15.103:0/2588706543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd658100e20 msgr2=0x7fd658198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd656ffd640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd658100e20 0x7fd658198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd656ffd640 1 -- 172.21.15.103:0/2588706543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65819d500 con 0x7fd658102570 2024-09-19T06:06:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd656ffd640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd658102570 0x7fd658198a90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd64000b4a0 tx=0x7fd64000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd654ff9640 1 -- 172.21.15.103:0/2588706543 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640014070 con 0x7fd658102570 2024-09-19T06:06:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd65de05640 1 -- 172.21.15.103:0/2588706543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65819d7f0 con 0x7fd658102570 2024-09-19T06:06:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd654ff9640 1 -- 172.21.15.103:0/2588706543 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd640010ac0 con 0x7fd658102570 2024-09-19T06:06:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd654ff9640 1 -- 172.21.15.103:0/2588706543 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640017c30 con 0x7fd658102570 2024-09-19T06:06:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.553+0000 7fd65de05640 1 -- 172.21.15.103:0/2588706543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6581a50d0 con 0x7fd658102570 2024-09-19T06:06:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd654ff9640 1 -- 172.21.15.103:0/2588706543 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fd640017070 con 0x7fd658102570 2024-09-19T06:06:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6601de740 1 Processor -- start 2024-09-19T06:06:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6601de740 1 -- start start 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6601de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc605db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6601de740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc610670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6601de740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc610bb0 0x5583fc612fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6601de740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5583fc56c090 con 0x5583fc6062f0 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6601de740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5583fc513a70 con 0x5583fc610bb0 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6601de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5583fc568050 con 0x5583fc6059d0 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6577fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc610670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd654ff9640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd6440a3240 0x7fd6440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6577fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc610670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57150/0 (socket says 172.21.15.103:57150) 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd6577fe640 1 -- 172.21.15.103:0/1165156801 learned_addr learned my addr 172.21.15.103:0/1165156801 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd657fff640 1 --2- 172.21.15.103:0/1165156801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc605db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd656ffd640 1 --2- 172.21.15.103:0/1165156801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc610bb0 0x5583fc612fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.556+0000 7fd657fff640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd6440a3240 0x7fd6440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd654ff9640 1 -- 172.21.15.103:0/2588706543 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd6400ced90 con 0x7fd658102570 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd6577fe640 1 -- 172.21.15.103:0/1165156801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 msgr2=0x5583fc605db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd6577fe640 1 --2- 172.21.15.103:0/1165156801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc605db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd6577fe640 1 -- 172.21.15.103:0/1165156801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc610bb0 msgr2=0x5583fc612fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd6577fe640 1 --2- 172.21.15.103:0/1165156801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc610bb0 0x5583fc612fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd6577fe640 1 -- 172.21.15.103:0/1165156801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fc520130 con 0x5583fc6062f0 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd657fff640 1 --2- 172.21.15.103:0/1165156801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc605db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd6577fe640 1 --2- 172.21.15.103:0/1165156801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc610670 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd648033000 tx=0x7fd648031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f12c4d17626775c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd657fff640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd6440a3240 0x7fd6440a5700 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd650014aa0 tx=0x7fd6500064f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd64dffb640 1 -- 172.21.15.103:0/1165156801 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648035030 con 0x5583fc6062f0 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd64dffb640 1 -- 172.21.15.103:0/1165156801 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd648031630 con 0x5583fc6062f0 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.557+0000 7fd64dffb640 1 -- 172.21.15.103:0/1165156801 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648003a50 con 0x5583fc6062f0 2024-09-19T06:06:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.558+0000 7fd6601de740 1 -- 172.21.15.103:0/1165156801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 msgr2=0x5583fc610670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.558+0000 7fd6601de740 1 --2- 172.21.15.103:0/1165156801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc610670 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd648033000 tx=0x7fd648031de0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.558+0000 7fd6601de740 1 -- 172.21.15.103:0/1165156801 shutdown_connections 2024-09-19T06:06:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.558+0000 7fd6601de740 1 --2- 172.21.15.103:0/1165156801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc610bb0 0x5583fc612fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.558+0000 7fd6601de740 1 --2- 172.21.15.103:0/1165156801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc610670 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.558+0000 7fd6601de740 1 --2- 172.21.15.103:0/1165156801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc605db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.558+0000 7fd6601de740 1 -- 172.21.15.103:0/1165156801 >> 172.21.15.103:0/1165156801 conn(0x5583fc601f60 msgr2=0x5583fc602340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.558+0000 7fd6601de740 1 -- 172.21.15.103:0/1165156801 shutdown_connections 2024-09-19T06:06:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.558+0000 7fd6601de740 1 -- 172.21.15.103:0/1165156801 wait complete. 2024-09-19T06:06:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.558+0000 7fd6601de740 1 -- start start 2024-09-19T06:06:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd6601de740 1 Processor -- start 2024-09-19T06:06:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd6601de740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6059d0 0x5583fc6103f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd6601de740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd6601de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc610bb0 0x5583fc60dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd6601de740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5583fc613780 con 0x5583fc6062f0 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd6601de740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5583fc526f20 con 0x5583fc6059d0 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd6601de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5583fc613900 con 0x5583fc610bb0 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd6601de740 10 client.0 _ll_register_callbacks cb 0x5583fc4f0030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd656ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd656ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57158/0 (socket says 172.21.15.103:57158) 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd656ffd640 1 -- 172.21.15.103:0/3635900777 learned_addr learned my addr 172.21.15.103:0/3635900777 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd6577fe640 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6059d0 0x5583fc6103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd657fff640 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc610bb0 0x5583fc60dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd656ffd640 1 -- 172.21.15.103:0/3635900777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc610bb0 msgr2=0x5583fc60dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd656ffd640 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc610bb0 0x5583fc60dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd656ffd640 1 -- 172.21.15.103:0/3635900777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6059d0 msgr2=0x5583fc6103f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd656ffd640 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6059d0 0x5583fc6103f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd656ffd640 1 -- 172.21.15.103:0/3635900777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583fc2dd2b0 con 0x5583fc6062f0 2024-09-19T06:06:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd657fff640 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc610bb0 0x5583fc60dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd656ffd640 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d740 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd640097db0 tx=0x7fd64006b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ea7d1907ceada8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd636ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.559+0000 7fd636ffd640 1 -- 172.21.15.103:0/3635900777 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64001e070 con 0x5583fc6062f0 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd636ffd640 1 -- 172.21.15.103:0/3635900777 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd640097a50 con 0x5583fc6062f0 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd6601de740 1 -- 172.21.15.103:0/3635900777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd648031630 con 0x5583fc6062f0 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd636ffd640 1 -- 172.21.15.103:0/3635900777 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd64009bae0 con 0x5583fc6062f0 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd6601de740 10 client.15009 fetch_fsmap learned FSMap version 24 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd6601de740 1 -- 172.21.15.103:0/3635900777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5583fc61f0f0 con 0x5583fc6062f0 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd636ffd640 1 -- 172.21.15.103:0/3635900777 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd648031630 con 0x5583fc6062f0 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd636ffd640 1 -- 172.21.15.103:0/3635900777 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd640010c70 con 0x5583fc6062f0 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd6601de740 10 client.15009 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd6601de740 10 client.15009 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd6601de740 20 client.15009 populate_metadata read hostname 'smithi103' 2024-09-19T06:06:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd6601de740 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x5583fc6216f0 0x5583fc622b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd6601de740 4 client.15009 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.560+0000 7fd6601de740 1 -- 172.21.15.103:0/3635900777 --> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583fc579600 con 0x5583fc6216f0 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.561+0000 7fd6577fe640 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x5583fc6216f0 0x5583fc622b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.561+0000 7fd6577fe640 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x5583fc6216f0 0x5583fc622b60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a98ecdf516cef2b server_cookie=e2b35bab4fc4bb1a in_seq=0 out_seq=0 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.561+0000 7fd636ffd640 10 client.15009 ms_handle_connect on v2:172.21.15.174:6836/2575162107 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd636ffd640 1 -- 172.21.15.103:0/3635900777 <== mds.2 v2:172.21.15.174:6836/2575162107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583fc579600 con 0x5583fc6216f0 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd636ffd640 10 client.15009 handle_command_reply: tid=0 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 client.15009 shutdown 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 -- 172.21.15.103:0/3635900777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 msgr2=0x5583fc60d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d740 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd640097db0 tx=0x7fd64006b050 comp rx=0 tx=0).stop 2024-09-19T06:06:49.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 -- 172.21.15.103:0/3635900777 shutdown_connections 2024-09-19T06:06:49.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc610bb0 0x5583fc60dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x5583fc6216f0 0x5583fc622b60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d740 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd636ffd640 0 client.15009 ms_handle_reset on v2:172.21.15.174:6836/2575162107 2024-09-19T06:06:49.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 --2- 172.21.15.103:0/3635900777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6059d0 0x5583fc6103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 -- 172.21.15.103:0/3635900777 >> 172.21.15.103:0/3635900777 conn(0x5583fc601f60 msgr2=0x5583fc607c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:49.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 -- 172.21.15.103:0/3635900777 shutdown_connections 2024-09-19T06:06:49.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 1 -- 172.21.15.103:0/3635900777 wait complete. 2024-09-19T06:06:49.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.562+0000 7fd6601de740 20 client.15009 trim_cache size 0 max 16384 2024-09-19T06:06:49.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.579+0000 7fd6601de740 1 Processor -- start 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.579+0000 7fd6601de740 1 -- start start 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd6601de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc622b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd6601de740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd6601de740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc610bb0 0x5583fc62b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd6601de740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5583fc620ea0 con 0x5583fc6062f0 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd6601de740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5583fc621570 con 0x5583fc610bb0 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd6601de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5583fc621c40 con 0x5583fc6059d0 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd656ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd656ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57166/0 (socket says 172.21.15.103:57166) 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd656ffd640 1 -- 172.21.15.103:0/2587528057 learned_addr learned my addr 172.21.15.103:0/2587528057 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd656ffd640 1 -- 172.21.15.103:0/2587528057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 msgr2=0x5583fc622b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd656ffd640 1 --2- 172.21.15.103:0/2587528057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc622b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd656ffd640 1 -- 172.21.15.103:0/2587528057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc610bb0 msgr2=0x5583fc62b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd656ffd640 1 --2- 172.21.15.103:0/2587528057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc610bb0 0x5583fc62b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd656ffd640 1 -- 172.21.15.103:0/2587528057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fc601d90 con 0x5583fc6062f0 2024-09-19T06:06:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd656ffd640 1 --2- 172.21.15.103:0/2587528057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd64009a920 tx=0x7fd6400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2eba0158b2f5b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd64d7fa640 1 -- 172.21.15.103:0/2587528057 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64001e070 con 0x5583fc6062f0 2024-09-19T06:06:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd64d7fa640 1 -- 172.21.15.103:0/2587528057 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd64009ab20 con 0x5583fc6062f0 2024-09-19T06:06:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.580+0000 7fd64d7fa640 1 -- 172.21.15.103:0/2587528057 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64009f790 con 0x5583fc6062f0 2024-09-19T06:06:49.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 -- 172.21.15.103:0/2587528057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 msgr2=0x5583fc60d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 --2- 172.21.15.103:0/2587528057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd64009a920 tx=0x7fd6400046c0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 -- 172.21.15.103:0/2587528057 shutdown_connections 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 --2- 172.21.15.103:0/2587528057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc610bb0 0x5583fc62b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 --2- 172.21.15.103:0/2587528057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc6062f0 0x5583fc60d000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 --2- 172.21.15.103:0/2587528057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc622b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 -- 172.21.15.103:0/2587528057 >> 172.21.15.103:0/2587528057 conn(0x5583fc601f60 msgr2=0x5583fc60d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 -- 172.21.15.103:0/2587528057 shutdown_connections 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 -- 172.21.15.103:0/2587528057 wait complete. 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 -- start start 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.581+0000 7fd6601de740 1 Processor -- start 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd6601de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc60a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd6601de740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6062f0 0x5583fc60a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd6601de740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc610bb0 0x5583fc686df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd6601de740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5583fc6229e0 con 0x5583fc610bb0 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd6601de740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5583fc622310 con 0x5583fc6062f0 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd6601de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5583fc6230b0 con 0x5583fc6059d0 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd6601de740 10 client.0 _ll_register_callbacks cb 0x7fd640095f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd657fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc610bb0 0x5583fc686df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd657fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc610bb0 0x5583fc686df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57174/0 (socket says 172.21.15.103:57174) 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd657fff640 1 -- 172.21.15.103:0/2380460169 learned_addr learned my addr 172.21.15.103:0/2380460169 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd656ffd640 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6062f0 0x5583fc60a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd6577fe640 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc60a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd657fff640 1 -- 172.21.15.103:0/2380460169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 msgr2=0x5583fc60a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd657fff640 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc60a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd657fff640 1 -- 172.21.15.103:0/2380460169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6062f0 msgr2=0x5583fc60a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd657fff640 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6062f0 0x5583fc60a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd657fff640 1 -- 172.21.15.103:0/2380460169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583fc687490 con 0x5583fc610bb0 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd656ffd640 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6062f0 0x5583fc60a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd657fff640 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc610bb0 0x5583fc686df0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd650014850 tx=0x7fd650004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5fd7459cde74aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd636ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd636ffd640 1 -- 172.21.15.103:0/2380460169 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65001e050 con 0x5583fc610bb0 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd636ffd640 1 -- 172.21.15.103:0/2380460169 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd6500177d0 con 0x5583fc610bb0 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.582+0000 7fd6601de740 1 -- 172.21.15.103:0/2380460169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd64009ab20 con 0x5583fc610bb0 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd636ffd640 1 -- 172.21.15.103:0/2380460169 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd6500067c0 con 0x5583fc610bb0 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd6601de740 10 client.15015 fetch_fsmap learned FSMap version 24 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd6601de740 1 -- 172.21.15.103:0/2380460169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5583fc68fa00 con 0x5583fc610bb0 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd636ffd640 1 -- 172.21.15.103:0/2380460169 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd64009ab20 con 0x5583fc610bb0 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd636ffd640 1 -- 172.21.15.103:0/2380460169 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd650023a50 con 0x5583fc610bb0 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd6601de740 10 client.15015 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd6601de740 10 client.15015 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:06:49.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd6601de740 20 client.15015 populate_metadata read hostname 'smithi103' 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd6601de740 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x5583fc6216f0 0x5583fc693370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd6601de740 4 client.15015 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd6601de740 1 -- 172.21.15.103:0/2380460169 --> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] -- command(tid 0: {"prefix": "status"}) -- 0x5583fc573b10 con 0x5583fc6216f0 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.583+0000 7fd6577fe640 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x5583fc6216f0 0x5583fc693370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6577fe640 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x5583fc6216f0 0x5583fc693370 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a96c0d6f441e6a0f server_cookie=521aa1eddc90f39d in_seq=0 out_seq=0 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd636ffd640 10 client.15015 ms_handle_connect on v2:172.21.15.174:6836/2575162107 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd636ffd640 1 -- 172.21.15.103:0/2380460169 <== mds.2 v2:172.21.15.174:6836/2575162107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5583fc573b10 con 0x5583fc6216f0 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd636ffd640 10 client.15015 handle_command_reply: tid=0 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 client.15015 shutdown 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 -- 172.21.15.103:0/2380460169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc610bb0 msgr2=0x5583fc686df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc610bb0 0x5583fc686df0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd650014850 tx=0x7fd650004a40 comp rx=0 tx=0).stop 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 -- 172.21.15.103:0/2380460169 shutdown_connections 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x5583fc6216f0 0x5583fc693370 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd636ffd640 0 client.15015 ms_handle_reset on v2:172.21.15.174:6836/2575162107 2024-09-19T06:06:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583fc610bb0 0x5583fc686df0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fc6062f0 0x5583fc60a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 --2- 172.21.15.103:0/2380460169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5583fc6059d0 0x5583fc60a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 -- 172.21.15.103:0/2380460169 >> 172.21.15.103:0/2380460169 conn(0x5583fc601f60 msgr2=0x5583fc60d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 -- 172.21.15.103:0/2380460169 shutdown_connections 2024-09-19T06:06:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 1 -- 172.21.15.103:0/2380460169 wait complete. 2024-09-19T06:06:49.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.584+0000 7fd6601de740 20 client.15015 trim_cache size 0 max 16384 2024-09-19T06:06:49.592 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:06:49.592 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "f3f6d2a8-764b-11ef-bceb-c7b262605968", 2024-09-19T06:06:49.592 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-19T06:06:49.593 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24463, 2024-09-19T06:06:49.593 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T06:06:49.593 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T06:06:49.593 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T06:06:49.593 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 75.717933029999998, 2024-09-19T06:06:49.593 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 24, 2024-09-19T06:06:49.593 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 80, 2024-09-19T06:06:49.593 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T06:06:49.593 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 108.26729781 2024-09-19T06:06:49.593 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:06:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 -- 172.21.15.103:0/2588706543 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd6440a3240 msgr2=0x7fd6440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd6440a3240 0x7fd6440a5700 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd650014aa0 tx=0x7fd6500064f0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 -- 172.21.15.103:0/2588706543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd658102570 msgr2=0x7fd658198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd658102570 0x7fd658198a90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd64000b4a0 tx=0x7fd64000b960 comp rx=0 tx=0).stop 2024-09-19T06:06:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 -- 172.21.15.103:0/2588706543 shutdown_connections 2024-09-19T06:06:49.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd6440a3240 0x7fd6440a5700 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd658102ef0 0x7fd65819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd658102570 0x7fd658198a90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 --2- 172.21.15.103:0/2588706543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd658100e20 0x7fd658198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:49.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 -- 172.21.15.103:0/2588706543 >> 172.21.15.103:0/2588706543 conn(0x7fd6580fc7d0 msgr2=0x7fd65806a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:49.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 -- 172.21.15.103:0/2588706543 shutdown_connections 2024-09-19T06:06:49.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:49.585+0000 7fd65de05640 1 -- 172.21.15.103:0/2588706543 wait complete. 2024-09-19T06:06:50.273 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:06:50.521 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:50 smithi169 ceph-mon[34350]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:06:50.785 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:50 smithi103 ceph-mon[30925]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:06:50.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:50 smithi174 ceph-mon[34488]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:06:51.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.005+0000 7fcbedc1c640 1 -- 172.21.15.103:0/3435832306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbe8101de0 msgr2=0x7fcbe81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:51.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.005+0000 7fcbedc1c640 1 --2- 172.21.15.103:0/3435832306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbe8101de0 0x7fcbe81021c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009900 tx=0x7fcbd802a410 comp rx=0 tx=0).stop 2024-09-19T06:06:51.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.005+0000 7fcbedc1c640 1 -- 172.21.15.103:0/3435832306 shutdown_connections 2024-09-19T06:06:51.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.005+0000 7fcbedc1c640 1 --2- 172.21.15.103:0/3435832306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbe8106f10 0x7fcbe810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.005+0000 7fcbedc1c640 1 --2- 172.21.15.103:0/3435832306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbe8102790 0x7fcbe81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.005+0000 7fcbedc1c640 1 --2- 172.21.15.103:0/3435832306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbe8101de0 0x7fcbe81021c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.005+0000 7fcbedc1c640 1 -- 172.21.15.103:0/3435832306 >> 172.21.15.103:0/3435832306 conn(0x7fcbe80fd8c0 msgr2=0x7fcbe80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:51.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.005+0000 7fcbedc1c640 1 -- 172.21.15.103:0/3435832306 shutdown_connections 2024-09-19T06:06:51.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.005+0000 7fcbedc1c640 1 -- 172.21.15.103:0/3435832306 wait complete. 2024-09-19T06:06:51.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbedc1c640 1 Processor -- start 2024-09-19T06:06:51.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbedc1c640 1 -- start start 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbedc1c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbe8101de0 0x7fcbe819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbedc1c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbe8102790 0x7fcbe819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbedc1c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbe8106f10 0x7fcbe819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbedc1c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8111e20 con 0x7fcbe8102790 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbedc1c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8111ca0 con 0x7fcbe8106f10 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbedc1c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8111fa0 con 0x7fcbe8101de0 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbdffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbe8102790 0x7fcbe819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbdffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbe8102790 0x7fcbe819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37042/0 (socket says 172.21.15.103:37042) 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbdffff640 1 -- 172.21.15.103:0/2730687489 learned_addr learned my addr 172.21.15.103:0/2730687489 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.006+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbe8106f10 0x7fcbe819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbe77fe640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbe8101de0 0x7fcbe819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbdffff640 1 -- 172.21.15.103:0/2730687489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbe8101de0 msgr2=0x7fcbe819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbdffff640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbe8101de0 0x7fcbe819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbdffff640 1 -- 172.21.15.103:0/2730687489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbe8106f10 msgr2=0x7fcbe819ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbdffff640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbe8106f10 0x7fcbe819ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbdffff640 1 -- 172.21.15.103:0/2730687489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe819f4f0 con 0x7fcbe8102790 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbdffff640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbe8102790 0x7fcbe819aa80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000d950 tx=0x7fcbd000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbe57fa640 1 -- 172.21.15.103:0/2730687489 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0017070 con 0x7fcbe8102790 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbe57fa640 1 -- 172.21.15.103:0/2730687489 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbd0009c30 con 0x7fcbe8102790 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbe57fa640 1 -- 172.21.15.103:0/2730687489 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000f620 con 0x7fcbe8102790 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbedc1c640 1 -- 172.21.15.103:0/2730687489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe819f7e0 con 0x7fcbe8102790 2024-09-19T06:06:51.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.007+0000 7fcbedc1c640 1 -- 172.21.15.103:0/2730687489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe81a70c0 con 0x7fcbe8102790 2024-09-19T06:06:51.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbe57fa640 1 -- 172.21.15.103:0/2730687489 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fcbd00109a0 con 0x7fcbe8102790 2024-09-19T06:06:51.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbefff5740 1 Processor -- start 2024-09-19T06:06:51.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbefff5740 1 -- start start 2024-09-19T06:06:51.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63929db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c6392a2f0 0x558c63934670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c63934bb0 0x558c63936fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbefff5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558c63890090 con 0x558c639299d0 2024-09-19T06:06:51.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbefff5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c63837a70 con 0x558c6392a2f0 2024-09-19T06:06:51.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbefff5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558c6388c050 con 0x558c63934bb0 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63929db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63929db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37048/0 (socket says 172.21.15.103:37048) 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbe7fff640 1 -- 172.21.15.103:0/2072084729 learned_addr learned my addr 172.21.15.103:0/2072084729 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.010+0000 7fcbe77fe640 1 --2- 172.21.15.103:0/2072084729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c6392a2f0 0x558c63934670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbdffff640 1 --2- 172.21.15.103:0/2072084729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c63934bb0 0x558c63936fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbe7fff640 1 -- 172.21.15.103:0/2072084729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c63934bb0 msgr2=0x558c63936fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/2072084729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c63934bb0 0x558c63936fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbe7fff640 1 -- 172.21.15.103:0/2072084729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c6392a2f0 msgr2=0x558c63934670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/2072084729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c6392a2f0 0x558c63934670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbe57fa640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcbd40a3340 0x7fcbd40a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbe7fff640 1 -- 172.21.15.103:0/2072084729 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c63844130 con 0x558c639299d0 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcbd40a3340 0x7fcbd40a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbe57fa640 1 -- 172.21.15.103:0/2730687489 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fcbd00cf5c0 con 0x7fcbe8102790 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/2072084729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63929db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0007dd0 tx=0x7fcbe000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b6f77ec58ae94f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbddffb640 1 -- 172.21.15.103:0/2072084729 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0020070 con 0x558c639299d0 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbddffb640 1 -- 172.21.15.103:0/2072084729 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbe000f3c0 con 0x558c639299d0 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.011+0000 7fcbddffb640 1 -- 172.21.15.103:0/2072084729 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0014070 con 0x558c639299d0 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbefff5740 1 -- 172.21.15.103:0/2072084729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 msgr2=0x558c63929db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcbd40a3340 0x7fcbd40a5800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcbe001d000 tx=0x7fcbe0020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbefff5740 1 --2- 172.21.15.103:0/2072084729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63929db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0007dd0 tx=0x7fcbe000e720 comp rx=0 tx=0).stop 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbefff5740 1 -- 172.21.15.103:0/2072084729 shutdown_connections 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbefff5740 1 --2- 172.21.15.103:0/2072084729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c63934bb0 0x558c63936fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbefff5740 1 --2- 172.21.15.103:0/2072084729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c6392a2f0 0x558c63934670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbefff5740 1 --2- 172.21.15.103:0/2072084729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63929db0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbefff5740 1 -- 172.21.15.103:0/2072084729 >> 172.21.15.103:0/2072084729 conn(0x558c63925f60 msgr2=0x558c63926340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbefff5740 1 -- 172.21.15.103:0/2072084729 shutdown_connections 2024-09-19T06:06:51.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbefff5740 1 -- 172.21.15.103:0/2072084729 wait complete. 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.012+0000 7fcbefff5740 1 -- start start 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbefff5740 1 Processor -- start 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c639299d0 0x558c63934400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c6392a2f0 0x558c63931750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 0x558c63931c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbefff5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558c63937780 con 0x558c6392a2f0 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbefff5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c6384af20 con 0x558c63934bb0 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbefff5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558c63937900 con 0x558c639299d0 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbefff5740 10 client.0 _ll_register_callbacks cb 0x558c63814030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbdffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c6392a2f0 0x558c63931750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbe77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c639299d0 0x558c63934400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbdffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c6392a2f0 0x558c63931750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37060/0 (socket says 172.21.15.103:37060) 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbdffff640 1 -- 172.21.15.103:0/332798996 learned_addr learned my addr 172.21.15.103:0/332798996 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 0x558c63931c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbdffff640 1 -- 172.21.15.103:0/332798996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c639299d0 msgr2=0x558c63934400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbdffff640 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c639299d0 0x558c63934400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbdffff640 1 -- 172.21.15.103:0/332798996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 msgr2=0x558c63931c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbdffff640 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 0x558c63931c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbdffff640 1 -- 172.21.15.103:0/332798996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c636012b0 con 0x558c6392a2f0 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.013+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 0x558c63931c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbdffff640 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c6392a2f0 0x558c63931750 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0098010 tx=0x7fcbd009ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1744cfd2f05e7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:06:51.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/332798996 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0020070 con 0x558c6392a2f0 2024-09-19T06:06:51.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/332798996 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fcbd0098220 con 0x558c6392a2f0 2024-09-19T06:06:51.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbefff5740 1 -- 172.21.15.103:0/332798996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbe000f3c0 con 0x558c6392a2f0 2024-09-19T06:06:51.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/332798996 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcbd00b2020 con 0x558c6392a2f0 2024-09-19T06:06:51.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbefff5740 10 client.15027 fetch_fsmap learned FSMap version 24 2024-09-19T06:06:51.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbefff5740 1 -- 172.21.15.103:0/332798996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558c639430a0 con 0x558c6392a2f0 2024-09-19T06:06:51.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/332798996 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbe000f3c0 con 0x558c6392a2f0 2024-09-19T06:06:51.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/332798996 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcbd00cf110 con 0x558c6392a2f0 2024-09-19T06:06:51.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbefff5740 10 client.15027 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:06:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbefff5740 10 client.15027 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:06:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbefff5740 20 client.15027 populate_metadata read hostname 'smithi103' 2024-09-19T06:06:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbefff5740 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x558c639456d0 0x558c63946b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbefff5740 4 client.15027 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:06:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.014+0000 7fcbefff5740 1 -- 172.21.15.103:0/332798996 --> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c6389d600 con 0x558c639456d0 2024-09-19T06:06:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.015+0000 7fcbe77fe640 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x558c639456d0 0x558c63946b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.015+0000 7fcbe77fe640 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x558c639456d0 0x558c63946b40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=14da8c03dcd2dc33 server_cookie=f4eb0b2892aac091 in_seq=0 out_seq=0 2024-09-19T06:06:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.015+0000 7fcbc6ffd640 10 client.15027 ms_handle_connect on v2:172.21.15.174:6838/1070224661 2024-09-19T06:06:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/332798996 <== mds.1 v2:172.21.15.174:6838/1070224661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c6389d600 con 0x558c639456d0 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbc6ffd640 10 client.15027 handle_command_reply: tid=0 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 client.15027 shutdown 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 -- 172.21.15.103:0/332798996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c6392a2f0 msgr2=0x558c63931750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c6392a2f0 0x558c63931750 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0098010 tx=0x7fcbd009ba00 comp rx=0 tx=0).stop 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 -- 172.21.15.103:0/332798996 shutdown_connections 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x558c639456d0 0x558c63946b40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 0x558c63931c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c6392a2f0 0x558c63931750 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 --2- 172.21.15.103:0/332798996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c639299d0 0x558c63934400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 -- 172.21.15.103:0/332798996 >> 172.21.15.103:0/332798996 conn(0x558c63925f60 msgr2=0x558c6392bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbc6ffd640 0 client.15027 ms_handle_reset on v2:172.21.15.174:6838/1070224661 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 -- 172.21.15.103:0/332798996 shutdown_connections 2024-09-19T06:06:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 1 -- 172.21.15.103:0/332798996 wait complete. 2024-09-19T06:06:51.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.016+0000 7fcbefff5740 20 client.15027 trim_cache size 0 max 16384 2024-09-19T06:06:51.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbefff5740 1 Processor -- start 2024-09-19T06:06:51.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbefff5740 1 -- start start 2024-09-19T06:06:51.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63945da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 0x558c63926340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 0x558c63926880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbefff5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558c63944e80 con 0x558c639299d0 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbefff5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c63945550 con 0x558c63934bb0 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbefff5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558c63945c20 con 0x558c6392a2f0 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbe77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63945da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbe77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63945da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37064/0 (socket says 172.21.15.103:37064) 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbe77fe640 1 -- 172.21.15.103:0/3958152209 learned_addr learned my addr 172.21.15.103:0/3958152209 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/3958152209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 0x558c63926880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbdffff640 1 --2- 172.21.15.103:0/3958152209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 0x558c63926340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbe77fe640 1 -- 172.21.15.103:0/3958152209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 msgr2=0x558c63926340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbe77fe640 1 --2- 172.21.15.103:0/3958152209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 0x558c63926340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbe77fe640 1 -- 172.21.15.103:0/3958152209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 msgr2=0x558c63926880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:51.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbe77fe640 1 --2- 172.21.15.103:0/3958152209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 0x558c63926880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.034+0000 7fcbe77fe640 1 -- 172.21.15.103:0/3958152209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c6392fca0 con 0x558c639299d0 2024-09-19T06:06:51.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.035+0000 7fcbe77fe640 1 --2- 172.21.15.103:0/3958152209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63945da0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8005ab0 tx=0x7fcbd8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcc163aec5ff474 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:51.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.035+0000 7fcbdd7fa640 1 -- 172.21.15.103:0/3958152209 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd804a070 con 0x558c639299d0 2024-09-19T06:06:51.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.035+0000 7fcbdd7fa640 1 -- 172.21.15.103:0/3958152209 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbd80054f0 con 0x558c639299d0 2024-09-19T06:06:51.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.035+0000 7fcbdd7fa640 1 -- 172.21.15.103:0/3958152209 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8035040 con 0x558c639299d0 2024-09-19T06:06:51.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.035+0000 7fcbefff5740 1 -- 172.21.15.103:0/3958152209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 msgr2=0x558c63945da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:51.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.035+0000 7fcbefff5740 1 --2- 172.21.15.103:0/3958152209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63945da0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8005ab0 tx=0x7fcbd8005a20 comp rx=0 tx=0).stop 2024-09-19T06:06:51.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 -- 172.21.15.103:0/3958152209 shutdown_connections 2024-09-19T06:06:51.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 --2- 172.21.15.103:0/3958152209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c63934bb0 0x558c63926880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 --2- 172.21.15.103:0/3958152209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 0x558c63926340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 --2- 172.21.15.103:0/3958152209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c639299d0 0x558c63945da0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 -- 172.21.15.103:0/3958152209 >> 172.21.15.103:0/3958152209 conn(0x558c63925f60 msgr2=0x558c63920ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:51.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 -- 172.21.15.103:0/3958152209 shutdown_connections 2024-09-19T06:06:51.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 -- 172.21.15.103:0/3958152209 wait complete. 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 -- start start 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 Processor -- start 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c639299d0 0x558c63949ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 0x558c6394a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c63934bb0 0x558c6394a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558c639469c0 con 0x558c63934bb0 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c639462f0 con 0x558c639299d0 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.036+0000 7fcbefff5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558c63947090 con 0x558c6392a2f0 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbefff5740 10 client.0 _ll_register_callbacks cb 0x7fcbd0097e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c63934bb0 0x558c6394a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c63934bb0 0x558c6394a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37072/0 (socket says 172.21.15.103:37072) 2024-09-19T06:06:51.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbe7fff640 1 -- 172.21.15.103:0/3252870995 learned_addr learned my addr 172.21.15.103:0/3252870995 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbe77fe640 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c639299d0 0x558c63949ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbdffff640 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 0x558c6394a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbe7fff640 1 -- 172.21.15.103:0/3252870995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 msgr2=0x558c6394a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 0x558c6394a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbe7fff640 1 -- 172.21.15.103:0/3252870995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c639299d0 msgr2=0x558c63949ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c639299d0 0x558c63949ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbe7fff640 1 -- 172.21.15.103:0/3252870995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c639adfd0 con 0x558c63934bb0 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbdffff640 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 0x558c6394a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbe7fff640 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c63934bb0 0x558c6394a760 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0007dd0 tx=0x7fcbe0007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0b734615503da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/3252870995 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0014040 con 0x558c63934bb0 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/3252870995 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fcbe0003970 con 0x558c63934bb0 2024-09-19T06:06:51.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbefff5740 1 -- 172.21.15.103:0/3252870995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbd80054f0 con 0x558c63934bb0 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/3252870995 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcbe0003b70 con 0x558c63934bb0 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbefff5740 10 client.15033 fetch_fsmap learned FSMap version 24 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.037+0000 7fcbefff5740 1 -- 172.21.15.103:0/3252870995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558c639af2b0 con 0x558c63934bb0 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.038+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/3252870995 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbd80054f0 con 0x558c63934bb0 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.038+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/3252870995 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcbe0038030 con 0x558c63934bb0 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.038+0000 7fcbefff5740 10 client.15033 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.038+0000 7fcbefff5740 10 client.15033 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.038+0000 7fcbefff5740 20 client.15033 populate_metadata read hostname 'smithi103' 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.038+0000 7fcbefff5740 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x558c639b3c30 0x558c639b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.038+0000 7fcbefff5740 4 client.15033 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:06:51.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.038+0000 7fcbefff5740 1 -- 172.21.15.103:0/3252870995 --> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] -- command(tid 0: {"prefix": "status"}) -- 0x558c63897b10 con 0x558c639b3c30 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.038+0000 7fcbe77fe640 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x558c639b3c30 0x558c639b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbe77fe640 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x558c639b3c30 0x558c639b2940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=14d8210f1f64925e server_cookie=fdb11d1f771d5ff7 in_seq=0 out_seq=0 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbc6ffd640 10 client.15033 ms_handle_connect on v2:172.21.15.174:6838/1070224661 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbc6ffd640 1 -- 172.21.15.103:0/3252870995 <== mds.1 v2:172.21.15.174:6838/1070224661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558c63897b10 con 0x558c639b3c30 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbc6ffd640 10 client.15033 handle_command_reply: tid=0 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 client.15033 shutdown 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 -- 172.21.15.103:0/3252870995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c63934bb0 msgr2=0x558c6394a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c63934bb0 0x558c6394a760 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0007dd0 tx=0x7fcbe0007af0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 -- 172.21.15.103:0/3252870995 shutdown_connections 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c63934bb0 0x558c6394a760 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c6392a2f0 0x558c6394a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x558c639b3c30 0x558c639b2940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 --2- 172.21.15.103:0/3252870995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c639299d0 0x558c63949ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 -- 172.21.15.103:0/3252870995 >> 172.21.15.103:0/3252870995 conn(0x558c63925f60 msgr2=0x558c63931710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:51.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbc6ffd640 0 client.15033 ms_handle_reset on v2:172.21.15.174:6838/1070224661 2024-09-19T06:06:51.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 -- 172.21.15.103:0/3252870995 shutdown_connections 2024-09-19T06:06:51.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 1 -- 172.21.15.103:0/3252870995 wait complete. 2024-09-19T06:06:51.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.039+0000 7fcbefff5740 20 client.15033 trim_cache size 0 max 16384 2024-09-19T06:06:51.048 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:06:51.048 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "f3f6d2a8-764b-11ef-bceb-c7b262605968", 2024-09-19T06:06:51.048 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-19T06:06:51.048 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24475, 2024-09-19T06:06:51.049 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T06:06:51.049 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T06:06:51.049 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T06:06:51.049 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 78.180535211000006, 2024-09-19T06:06:51.049 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 24, 2024-09-19T06:06:51.049 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 80, 2024-09-19T06:06:51.049 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T06:06:51.049 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 104.960734312 2024-09-19T06:06:51.049 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:06:51.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 -- 172.21.15.103:0/2730687489 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcbd40a3340 msgr2=0x7fcbd40a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:51.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcbd40a3340 0x7fcbd40a5800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcbe001d000 tx=0x7fcbe0020000 comp rx=0 tx=0).stop 2024-09-19T06:06:51.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 -- 172.21.15.103:0/2730687489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbe8102790 msgr2=0x7fcbe819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:51.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbe8102790 0x7fcbe819aa80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000d950 tx=0x7fcbd000de10 comp rx=0 tx=0).stop 2024-09-19T06:06:51.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 -- 172.21.15.103:0/2730687489 shutdown_connections 2024-09-19T06:06:51.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fcbd40a3340 0x7fcbd40a5800 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbe8106f10 0x7fcbe819ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbe8102790 0x7fcbe819aa80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 --2- 172.21.15.103:0/2730687489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbe8101de0 0x7fcbe819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:51.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 -- 172.21.15.103:0/2730687489 >> 172.21.15.103:0/2730687489 conn(0x7fcbe80fd8c0 msgr2=0x7fcbe80fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:51.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 -- 172.21.15.103:0/2730687489 shutdown_connections 2024-09-19T06:06:51.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:51.040+0000 7fcbedc1c640 1 -- 172.21.15.103:0/2730687489 wait complete. 2024-09-19T06:06:51.668 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:06:51.914 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:52.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.388+0000 7fb9b1365640 1 -- 172.21.15.103:0/1399336598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9ac100e20 msgr2=0x7fb9ac101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.388+0000 7fb9b1365640 1 --2- 172.21.15.103:0/1399336598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9ac100e20 0x7fb9ac101200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009ca0 tx=0x7fb99c02a950 comp rx=0 tx=0).stop 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.388+0000 7fb9b1365640 1 -- 172.21.15.103:0/1399336598 shutdown_connections 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.388+0000 7fb9b1365640 1 --2- 172.21.15.103:0/1399336598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ac102ef0 0x7fb9ac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.388+0000 7fb9b1365640 1 --2- 172.21.15.103:0/1399336598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9ac102570 0x7fb9ac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.388+0000 7fb9b1365640 1 --2- 172.21.15.103:0/1399336598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9ac100e20 0x7fb9ac101200 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.388+0000 7fb9b1365640 1 -- 172.21.15.103:0/1399336598 >> 172.21.15.103:0/1399336598 conn(0x7fb9ac0fc7d0 msgr2=0x7fb9ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.388+0000 7fb9b1365640 1 -- 172.21.15.103:0/1399336598 shutdown_connections 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.388+0000 7fb9b1365640 1 -- 172.21.15.103:0/1399336598 wait complete. 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.389+0000 7fb9b1365640 1 Processor -- start 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.389+0000 7fb9b1365640 1 -- start start 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9b1365640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ac100e20 0x7fb9ac198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9b1365640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9ac102570 0x7fb9ac1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9b1365640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9ac102ef0 0x7fb9ac19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9b1365640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac110e70 con 0x7fb9ac102ef0 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9b1365640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac110cf0 con 0x7fb9ac102570 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9b1365640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac110ff0 con 0x7fb9ac100e20 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9ab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9ac102ef0 0x7fb9ac19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9ab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9ac102ef0 0x7fb9ac19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37098/0 (socket says 172.21.15.103:37098) 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9ab7fe640 1 -- 172.21.15.103:0/2653186780 learned_addr learned my addr 172.21.15.103:0/2653186780 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ac100e20 0x7fb9ac198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9ac102570 0x7fb9ac1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9ab7fe640 1 -- 172.21.15.103:0/2653186780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ac100e20 msgr2=0x7fb9ac198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:52.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9ab7fe640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ac100e20 0x7fb9ac198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9ab7fe640 1 -- 172.21.15.103:0/2653186780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9ac102570 msgr2=0x7fb9ac1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9ab7fe640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9ac102570 0x7fb9ac1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9ab7fe640 1 -- 172.21.15.103:0/2653186780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac19d440 con 0x7fb9ac102ef0 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ac100e20 0x7fb9ac198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9ac102570 0x7fb9ac1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9ab7fe640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9ac102ef0 0x7fb9ac19cd60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400c970 tx=0x7fb9a400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9a3fff640 1 -- 172.21.15.103:0/2653186780 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4007bb0 con 0x7fb9ac102ef0 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9a3fff640 1 -- 172.21.15.103:0/2653186780 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb9a4007d50 con 0x7fb9ac102ef0 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9b1365640 1 -- 172.21.15.103:0/2653186780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ac19d730 con 0x7fb9ac102ef0 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9a3fff640 1 -- 172.21.15.103:0/2653186780 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4004e10 con 0x7fb9ac102ef0 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.390+0000 7fb9b1365640 1 -- 172.21.15.103:0/2653186780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ac1a5010 con 0x7fb9ac102ef0 2024-09-19T06:06:52.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.393+0000 7fb9a3fff640 1 -- 172.21.15.103:0/2653186780 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fb9a4005020 con 0x7fb9ac102ef0 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.393+0000 7fb9b373e740 1 Processor -- start 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.393+0000 7fb9b373e740 1 -- start start 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.393+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951414ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.393+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 0x55951415da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.393+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x5595141603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.393+0000 7fb9b373e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5595140b5090 con 0x55951414e8d0 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.393+0000 7fb9b373e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55951405ca70 con 0x55951414f1f0 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.393+0000 7fb9b373e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5595140b1050 con 0x55951415dfc0 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9a3fff640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9980a3240 0x7fb9980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aa7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951414ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aa7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951414ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37112/0 (socket says 172.21.15.103:37112) 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aa7fc640 1 -- 172.21.15.103:0/924743971 learned_addr learned my addr 172.21.15.103:0/924743971 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9ab7fe640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9980a3240 0x7fb9980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/924743971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 0x55951415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/924743971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x5595141603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9a3fff640 1 -- 172.21.15.103:0/2653186780 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb9a40cf950 con 0x7fb9ac102ef0 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aa7fc640 1 -- 172.21.15.103:0/924743971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 msgr2=0x5595141603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/924743971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x5595141603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aa7fc640 1 -- 172.21.15.103:0/924743971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 msgr2=0x55951415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/924743971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 0x55951415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aa7fc640 1 -- 172.21.15.103:0/924743971 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559514069130 con 0x55951414e8d0 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/924743971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951414ecb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb99400af40 tx=0x7fb99400a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd8d637aa500a4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9ab7fe640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9980a3240 0x7fb9980a5700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4098400 tx=0x7fb9a406ee20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:52.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9a17fa640 1 -- 172.21.15.103:0/924743971 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99401b070 con 0x55951414e8d0 2024-09-19T06:06:52.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9a17fa640 1 -- 172.21.15.103:0/924743971 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb9940168a0 con 0x55951414e8d0 2024-09-19T06:06:52.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.394+0000 7fb9a17fa640 1 -- 172.21.15.103:0/924743971 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99400f040 con 0x55951414e8d0 2024-09-19T06:06:52.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.395+0000 7fb9b373e740 1 -- 172.21.15.103:0/924743971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 msgr2=0x55951414ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:52.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.395+0000 7fb9b373e740 1 --2- 172.21.15.103:0/924743971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951414ecb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb99400af40 tx=0x7fb99400a410 comp rx=0 tx=0).stop 2024-09-19T06:06:52.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.395+0000 7fb9b373e740 1 -- 172.21.15.103:0/924743971 shutdown_connections 2024-09-19T06:06:52.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.395+0000 7fb9b373e740 1 --2- 172.21.15.103:0/924743971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x5595141603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.395+0000 7fb9b373e740 1 --2- 172.21.15.103:0/924743971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 0x55951415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.395+0000 7fb9b373e740 1 --2- 172.21.15.103:0/924743971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951414ecb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.395+0000 7fb9b373e740 1 -- 172.21.15.103:0/924743971 >> 172.21.15.103:0/924743971 conn(0x55951414af60 msgr2=0x55951414b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:52.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.395+0000 7fb9b373e740 1 -- 172.21.15.103:0/924743971 shutdown_connections 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.395+0000 7fb9b373e740 1 -- 172.21.15.103:0/924743971 wait complete. 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.395+0000 7fb9b373e740 1 -- start start 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9b373e740 1 Processor -- start 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951415d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 0x55951415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x55951415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9b373e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559514160b90 con 0x55951414e8d0 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9b373e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55951406ff20 con 0x55951414f1f0 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9b373e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559514160d10 con 0x55951415dfc0 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9b373e740 10 client.0 _ll_register_callbacks cb 0x559514039030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aa7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aa7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951415d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37124/0 (socket says 172.21.15.103:37124) 2024-09-19T06:06:52.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aa7fc640 1 -- 172.21.15.103:0/1896319497 learned_addr learned my addr 172.21.15.103:0/1896319497 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 0x55951415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aa7fc640 1 -- 172.21.15.103:0/1896319497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 msgr2=0x55951415b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x55951415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aa7fc640 1 -- 172.21.15.103:0/1896319497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 msgr2=0x55951415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 0x55951415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aa7fc640 1 -- 172.21.15.103:0/1896319497 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559513e262b0 con 0x55951414e8d0 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 0x55951415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951415d920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb99400afd0 tx=0x7fb99400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa48bd4571e40273 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9927fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.396+0000 7fb9927fc640 1 -- 172.21.15.103:0/1896319497 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994027060 con 0x55951414e8d0 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9927fc640 1 -- 172.21.15.103:0/1896319497 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb994016c50 con 0x55951414e8d0 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9b373e740 1 -- 172.21.15.103:0/1896319497 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9940168a0 con 0x55951414e8d0 2024-09-19T06:06:52.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9927fc640 1 -- 172.21.15.103:0/1896319497 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb99401b050 con 0x55951414e8d0 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9b373e740 10 client.15045 fetch_fsmap learned FSMap version 24 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9b373e740 1 -- 172.21.15.103:0/1896319497 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55951416c5a0 con 0x55951414e8d0 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9927fc640 1 -- 172.21.15.103:0/1896319497 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb9940168a0 con 0x55951414e8d0 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9927fc640 1 -- 172.21.15.103:0/1896319497 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb994015030 con 0x55951414e8d0 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9b373e740 10 client.15045 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9b373e740 10 client.15045 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9b373e740 20 client.15045 populate_metadata read hostname 'smithi103' 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9b373e740 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55951416e700 0x55951416fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9b373e740 4 client.15045 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9b373e740 1 -- 172.21.15.103:0/1896319497 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595140c2600 con 0x55951416e700 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.397+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55951416e700 0x55951416fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.398+0000 7fb9927fc640 10 client.15045 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:06:52.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.398+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55951416e700 0x55951416fb70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb49d78f6ca98b48 server_cookie=8cfc45465861760a in_seq=0 out_seq=0 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.398+0000 7fb9927fc640 1 -- 172.21.15.103:0/1896319497 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595140c2600 con 0x55951416e700 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.398+0000 7fb9927fc640 10 client.15045 handle_command_reply: tid=0 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 client.15045 shutdown 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 -- 172.21.15.103:0/1896319497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 msgr2=0x55951415d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951415d920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb99400afd0 tx=0x7fb99400a650 comp rx=0 tx=0).stop 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 -- 172.21.15.103:0/1896319497 shutdown_connections 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55951416e700 0x55951416fb70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x55951415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414f1f0 0x55951415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9927fc640 0 client.15045 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 --2- 172.21.15.103:0/1896319497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414e8d0 0x55951415d920 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 -- 172.21.15.103:0/1896319497 >> 172.21.15.103:0/1896319497 conn(0x55951414af60 msgr2=0x559514150cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 -- 172.21.15.103:0/1896319497 shutdown_connections 2024-09-19T06:06:52.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 1 -- 172.21.15.103:0/1896319497 wait complete. 2024-09-19T06:06:52.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.399+0000 7fb9b373e740 20 client.15045 trim_cache size 0 max 16384 2024-09-19T06:06:52.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.416+0000 7fb9b373e740 1 Processor -- start 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.416+0000 7fb9b373e740 1 -- start start 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414e8d0 0x55951416fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x559514157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x559514158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9b373e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55951416deb0 con 0x55951414f1f0 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9b373e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55951416e580 con 0x55951414e8d0 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9b373e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55951416ec50 con 0x55951415dfc0 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x559514157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x559514157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37140/0 (socket says 172.21.15.103:37140) 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aaffd640 1 -- 172.21.15.103:0/3682849515 learned_addr learned my addr 172.21.15.103:0/3682849515 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/3682849515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414e8d0 0x55951416fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/3682849515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x559514158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aaffd640 1 -- 172.21.15.103:0/3682849515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 msgr2=0x559514158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/3682849515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x559514158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aaffd640 1 -- 172.21.15.103:0/3682849515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414e8d0 msgr2=0x55951416fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/3682849515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414e8d0 0x55951416fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aaffd640 1 -- 172.21.15.103:0/3682849515 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559514160d00 con 0x55951414f1f0 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/3682849515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x559514158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/3682849515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x559514157ed0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb99c006010 tx=0x7fb99c02fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceee5164c48d9af2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.417+0000 7fb9a0ff9640 1 -- 172.21.15.103:0/3682849515 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c049020 con 0x55951414f1f0 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9a0ff9640 1 -- 172.21.15.103:0/3682849515 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb99c003e20 con 0x55951414f1f0 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9a0ff9640 1 -- 172.21.15.103:0/3682849515 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c034040 con 0x55951414f1f0 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9b373e740 1 -- 172.21.15.103:0/3682849515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 msgr2=0x559514157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:52.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9b373e740 1 --2- 172.21.15.103:0/3682849515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x559514157ed0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb99c006010 tx=0x7fb99c02fc10 comp rx=0 tx=0).stop 2024-09-19T06:06:52.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9b373e740 1 -- 172.21.15.103:0/3682849515 shutdown_connections 2024-09-19T06:06:52.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9b373e740 1 --2- 172.21.15.103:0/3682849515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x559514158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9b373e740 1 --2- 172.21.15.103:0/3682849515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x559514157ed0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9b373e740 1 --2- 172.21.15.103:0/3682849515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414e8d0 0x55951416fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9b373e740 1 -- 172.21.15.103:0/3682849515 >> 172.21.15.103:0/3682849515 conn(0x55951414af60 msgr2=0x559514159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:52.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9b373e740 1 -- 172.21.15.103:0/3682849515 shutdown_connections 2024-09-19T06:06:52.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.418+0000 7fb9b373e740 1 -- 172.21.15.103:0/3682849515 wait complete. 2024-09-19T06:06:52.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9b373e740 1 -- start start 2024-09-19T06:06:52.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9b373e740 1 Processor -- start 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414e8d0 0x559514178570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x5595141718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9b373e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x559514171e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9b373e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55951416f9f0 con 0x55951414f1f0 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9b373e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55951416f320 con 0x55951414e8d0 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9b373e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5595141700c0 con 0x55951415dfc0 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9b373e740 10 client.0 _ll_register_callbacks cb 0x7fb994019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9aaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x5595141718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9aaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x5595141718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37142/0 (socket says 172.21.15.103:37142) 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9aaffd640 1 -- 172.21.15.103:0/2819636495 learned_addr learned my addr 172.21.15.103:0/2819636495 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x559514171e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9aaffd640 1 -- 172.21.15.103:0/2819636495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 msgr2=0x559514171e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x559514171e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9aaffd640 1 -- 172.21.15.103:0/2819636495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414e8d0 msgr2=0x559514178570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414e8d0 0x559514178570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9aaffd640 1 -- 172.21.15.103:0/2819636495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559514172630 con 0x55951414f1f0 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.419+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x559514171e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9aaffd640 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x5595141718a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb99c02ae70 tx=0x7fb99c02f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894f157828daf513 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9927fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9927fc640 1 -- 172.21.15.103:0/2819636495 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c049070 con 0x55951414f1f0 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9927fc640 1 -- 172.21.15.103:0/2819636495 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb99c02f3a0 con 0x55951414f1f0 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9b373e740 1 -- 172.21.15.103:0/2819636495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb99c003e20 con 0x55951414f1f0 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9927fc640 1 -- 172.21.15.103:0/2819636495 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb99c05d050 con 0x55951414f1f0 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9b373e740 10 client.15051 fetch_fsmap learned FSMap version 24 2024-09-19T06:06:52.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9b373e740 1 -- 172.21.15.103:0/2819636495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5595141d8e10 con 0x55951414f1f0 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9927fc640 1 -- 172.21.15.103:0/2819636495 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb99c003e20 con 0x55951414f1f0 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9927fc640 1 -- 172.21.15.103:0/2819636495 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb99c0455c0 con 0x55951414f1f0 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9b373e740 10 client.15051 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9b373e740 10 client.15051 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9b373e740 20 client.15051 populate_metadata read hostname 'smithi103' 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9b373e740 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5595141dd4c0 0x5595141dc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9b373e740 4 client.15051 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.420+0000 7fb9b373e740 1 -- 172.21.15.103:0/2819636495 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "status"}) -- 0x5595140bcb10 con 0x5595141dd4c0 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.421+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5595141dd4c0 0x5595141dc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.421+0000 7fb9aa7fc640 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5595141dd4c0 0x5595141dc1d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9409f25761e53730 server_cookie=405d74ddedd26925 in_seq=0 out_seq=0 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.421+0000 7fb9927fc640 10 client.15051 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:06:52.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9927fc640 1 -- 172.21.15.103:0/2819636495 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5595140bcb10 con 0x5595141dd4c0 2024-09-19T06:06:52.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9927fc640 10 client.15051 handle_command_reply: tid=0 2024-09-19T06:06:52.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 client.15051 shutdown 2024-09-19T06:06:52.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 -- 172.21.15.103:0/2819636495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 msgr2=0x5595141718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:52.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x5595141718a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb99c02ae70 tx=0x7fb99c02f9d0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 -- 172.21.15.103:0/2819636495 shutdown_connections 2024-09-19T06:06:52.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5595141dd4c0 0x5595141dc1d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951415dfc0 0x559514171e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55951414f1f0 0x5595141718a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 --2- 172.21.15.103:0/2819636495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55951414e8d0 0x559514178570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 -- 172.21.15.103:0/2819636495 >> 172.21.15.103:0/2819636495 conn(0x55951414af60 msgr2=0x559514149800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:52.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9927fc640 0 client.15051 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:06:52.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 -- 172.21.15.103:0/2819636495 shutdown_connections 2024-09-19T06:06:52.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 1 -- 172.21.15.103:0/2819636495 wait complete. 2024-09-19T06:06:52.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b373e740 20 client.15051 trim_cache size 0 max 16384 2024-09-19T06:06:52.434 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:06:52.434 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "f3f6d2a8-764b-11ef-bceb-c7b262605968", 2024-09-19T06:06:52.434 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-19T06:06:52.434 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24488, 2024-09-19T06:06:52.434 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T06:06:52.434 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T06:06:52.435 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T06:06:52.435 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 86.728875673000005, 2024-09-19T06:06:52.435 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 24, 2024-09-19T06:06:52.435 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 80, 2024-09-19T06:06:52.435 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T06:06:52.435 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 97.117134844999995 2024-09-19T06:06:52.435 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:06:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b1365640 1 -- 172.21.15.103:0/2653186780 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9980a3240 msgr2=0x7fb9980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b1365640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9980a3240 0x7fb9980a5700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4098400 tx=0x7fb9a406ee20 comp rx=0 tx=0).stop 2024-09-19T06:06:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b1365640 1 -- 172.21.15.103:0/2653186780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9ac102ef0 msgr2=0x7fb9ac19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b1365640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9ac102ef0 0x7fb9ac19cd60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400c970 tx=0x7fb9a400ce30 comp rx=0 tx=0).stop 2024-09-19T06:06:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b1365640 1 -- 172.21.15.103:0/2653186780 shutdown_connections 2024-09-19T06:06:52.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b1365640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb9980a3240 0x7fb9980a5700 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b1365640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9ac102ef0 0x7fb9ac19cd60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b1365640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9ac102570 0x7fb9ac1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.422+0000 7fb9b1365640 1 --2- 172.21.15.103:0/2653186780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ac100e20 0x7fb9ac198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:52.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.423+0000 7fb9b1365640 1 -- 172.21.15.103:0/2653186780 >> 172.21.15.103:0/2653186780 conn(0x7fb9ac0fc7d0 msgr2=0x7fb9ac06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:52.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.423+0000 7fb9b1365640 1 -- 172.21.15.103:0/2653186780 shutdown_connections 2024-09-19T06:06:52.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:52.423+0000 7fb9b1365640 1 -- 172.21.15.103:0/2653186780 wait complete. 2024-09-19T06:06:52.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:52 smithi103 ceph-mon[30925]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:06:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:52 smithi174 ceph-mon[34488]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:06:53.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:52 smithi169 ceph-mon[34350]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:06:53.120 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T06:06:53.121 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:06:53.131 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T06:06:53.131 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T06:06:53.379 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 -- 172.21.15.103:0/727425590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0841026d0 msgr2=0x7fa084108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 --2- 172.21.15.103:0/727425590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0841026d0 0x7fa084108f60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009ca0 tx=0x7fa07c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 -- 172.21.15.103:0/727425590 shutdown_connections 2024-09-19T06:06:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 --2- 172.21.15.103:0/727425590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0841026d0 0x7fa084108f60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 --2- 172.21.15.103:0/727425590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa084101d10 0x7fa084102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 --2- 172.21.15.103:0/727425590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa084100b10 0x7fa084100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 -- 172.21.15.103:0/727425590 >> 172.21.15.103:0/727425590 conn(0x7fa0840fc2a0 msgr2=0x7fa0840fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 -- 172.21.15.103:0/727425590 shutdown_connections 2024-09-19T06:06:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 -- 172.21.15.103:0/727425590 wait complete. 2024-09-19T06:06:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 Processor -- start 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.916+0000 7fa08a7b5640 1 -- start start 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa08a7b5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa084100b10 0x7fa084196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa08a7b5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa084101d10 0x7fa084197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa08a7b5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0841026d0 0x7fa08419e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa08a7b5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa08410c740 con 0x7fa084100b10 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa08a7b5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa08410c5c0 con 0x7fa0841026d0 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa08a7b5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa08410c8c0 con 0x7fa084101d10 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa083fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa084100b10 0x7fa084196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa083fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa084100b10 0x7fa084196de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37162/0 (socket says 172.21.15.103:37162) 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa083fff640 1 -- 172.21.15.103:0/2181037839 learned_addr learned my addr 172.21.15.103:0/2181037839 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa088d52640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0841026d0 0x7fa08419e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa0837fe640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa084101d10 0x7fa084197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa083fff640 1 -- 172.21.15.103:0/2181037839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa084101d10 msgr2=0x7fa084197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa083fff640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa084101d10 0x7fa084197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa083fff640 1 -- 172.21.15.103:0/2181037839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0841026d0 msgr2=0x7fa08419e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa083fff640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0841026d0 0x7fa08419e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa083fff640 1 -- 172.21.15.103:0/2181037839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08419ea10 con 0x7fa084100b10 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa088d52640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0841026d0 0x7fa08419e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa0837fe640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa084101d10 0x7fa084197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa083fff640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa084100b10 0x7fa084196de0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa07400b450 tx=0x7fa07400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa0817fa640 1 -- 172.21.15.103:0/2181037839 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074015020 con 0x7fa084100b10 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa0817fa640 1 -- 172.21.15.103:0/2181037839 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa074011d40 con 0x7fa084100b10 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa08a7b5640 1 -- 172.21.15.103:0/2181037839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08419ed00 con 0x7fa084100b10 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.917+0000 7fa0817fa640 1 -- 172.21.15.103:0/2181037839 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07400f340 con 0x7fa084100b10 2024-09-19T06:06:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.918+0000 7fa08a7b5640 1 -- 172.21.15.103:0/2181037839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08419f210 con 0x7fa084100b10 2024-09-19T06:06:53.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.919+0000 7fa08a7b5640 1 -- 172.21.15.103:0/2181037839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa084107f10 con 0x7fa084100b10 2024-09-19T06:06:53.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.920+0000 7fa0817fa640 1 -- 172.21.15.103:0/2181037839 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fa074018020 con 0x7fa084100b10 2024-09-19T06:06:53.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.921+0000 7fa0817fa640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa06c0a3270 0x7fa06c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:53.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.921+0000 7fa0837fe640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa06c0a3270 0x7fa06c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:53.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.921+0000 7fa0817fa640 1 -- 172.21.15.103:0/2181037839 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fa0740cf9a0 con 0x7fa084100b10 2024-09-19T06:06:53.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.922+0000 7fa0837fe640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa06c0a3270 0x7fa06c0a5730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa078006fd0 tx=0x7fa078008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:53.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:53.924+0000 7fa0817fa640 1 -- 172.21.15.103:0/2181037839 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa07401f020 con 0x7fa084100b10 2024-09-19T06:06:54.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.106+0000 7fa08a7b5640 1 -- 172.21.15.103:0/2181037839 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fa084062630 con 0x7fa06c0a3270 2024-09-19T06:06:54.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.107+0000 7fa0817fa640 1 -- 172.21.15.103:0/2181037839 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa084062630 con 0x7fa06c0a3270 2024-09-19T06:06:54.109 INFO:teuthology.orchestra.run.smithi103.stdout:Backend: cephadm 2024-09-19T06:06:54.109 INFO:teuthology.orchestra.run.smithi103.stdout:Available: Yes 2024-09-19T06:06:54.109 INFO:teuthology.orchestra.run.smithi103.stdout:Paused: No 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 -- 172.21.15.103:0/2181037839 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa06c0a3270 msgr2=0x7fa06c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa06c0a3270 0x7fa06c0a5730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa078006fd0 tx=0x7fa078008040 comp rx=0 tx=0).stop 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 -- 172.21.15.103:0/2181037839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa084100b10 msgr2=0x7fa084196de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa084100b10 0x7fa084196de0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa07400b450 tx=0x7fa07400b910 comp rx=0 tx=0).stop 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 -- 172.21.15.103:0/2181037839 shutdown_connections 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fa06c0a3270 0x7fa06c0a5730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0841026d0 0x7fa08419e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa084101d10 0x7fa084197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 --2- 172.21.15.103:0/2181037839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa084100b10 0x7fa084196de0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 -- 172.21.15.103:0/2181037839 >> 172.21.15.103:0/2181037839 conn(0x7fa0840fc2a0 msgr2=0x7fa0841050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 -- 172.21.15.103:0/2181037839 shutdown_connections 2024-09-19T06:06:54.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:54.109+0000 7fa08a7b5640 1 -- 172.21.15.103:0/2181037839 wait complete. 2024-09-19T06:06:54.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:54 smithi103 ceph-mon[30925]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:06:54.830 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:54 smithi169 ceph-mon[34350]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:06:54.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T06:06:54.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:54 smithi174 ceph-mon[34488]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:06:55.080 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:55.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.565+0000 7f621c882640 1 -- 172.21.15.103:0/2504427173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62181037c0 msgr2=0x7f621810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.565+0000 7f621c882640 1 --2- 172.21.15.103:0/2504427173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62181037c0 0x7f621810a050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6210009ca0 tx=0x7f621002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.565+0000 7f621c882640 1 -- 172.21.15.103:0/2504427173 shutdown_connections 2024-09-19T06:06:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.565+0000 7f621c882640 1 --2- 172.21.15.103:0/2504427173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62181037c0 0x7f621810a050 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.565+0000 7f621c882640 1 --2- 172.21.15.103:0/2504427173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6218102e00 0x7f6218103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.565+0000 7f621c882640 1 --2- 172.21.15.103:0/2504427173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6218101c00 0x7f6218102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.565+0000 7f621c882640 1 -- 172.21.15.103:0/2504427173 >> 172.21.15.103:0/2504427173 conn(0x7f62180fd390 msgr2=0x7f62180ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.565+0000 7f621c882640 1 -- 172.21.15.103:0/2504427173 shutdown_connections 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.565+0000 7f621c882640 1 -- 172.21.15.103:0/2504427173 wait complete. 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f621c882640 1 Processor -- start 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f621c882640 1 -- start start 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f621c882640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6218101c00 0x7f6218197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f621c882640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6218102e00 0x7f6218198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f621c882640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62181037c0 0x7f621819f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f621c882640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f621810d760 con 0x7f6218102e00 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f621c882640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f621810d5e0 con 0x7f62181037c0 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f621c882640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f621810d8e0 con 0x7f6218101c00 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f6215d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6218102e00 0x7f6218198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f6215d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6218102e00 0x7f6218198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37168/0 (socket says 172.21.15.103:37168) 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f6215d9b640 1 -- 172.21.15.103:0/886068933 learned_addr learned my addr 172.21.15.103:0/886068933 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f621659c640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6218101c00 0x7f6218197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f6216d9d640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62181037c0 0x7f621819f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f6215d9b640 1 -- 172.21.15.103:0/886068933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6218101c00 msgr2=0x7f6218197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f6215d9b640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6218101c00 0x7f6218197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f6215d9b640 1 -- 172.21.15.103:0/886068933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62181037c0 msgr2=0x7f621819f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f6215d9b640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62181037c0 0x7f621819f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.566+0000 7f6215d9b640 1 -- 172.21.15.103:0/886068933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621819f940 con 0x7f6218102e00 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.567+0000 7f6215d9b640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6218102e00 0x7f6218198260 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c920 tx=0x7f620c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.567+0000 7f62077fe640 1 -- 172.21.15.103:0/886068933 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c007c70 con 0x7f6218102e00 2024-09-19T06:06:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.567+0000 7f62077fe640 1 -- 172.21.15.103:0/886068933 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f620c007e10 con 0x7f6218102e00 2024-09-19T06:06:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.567+0000 7f621c882640 1 -- 172.21.15.103:0/886068933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621819fc30 con 0x7f6218102e00 2024-09-19T06:06:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.567+0000 7f62077fe640 1 -- 172.21.15.103:0/886068933 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c018820 con 0x7f6218102e00 2024-09-19T06:06:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.567+0000 7f621c882640 1 -- 172.21.15.103:0/886068933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62181a0170 con 0x7f6218102e00 2024-09-19T06:06:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.568+0000 7f621c882640 1 -- 172.21.15.103:0/886068933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6218108f30 con 0x7f6218102e00 2024-09-19T06:06:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.569+0000 7f62077fe640 1 -- 172.21.15.103:0/886068933 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f620c0189c0 con 0x7f6218102e00 2024-09-19T06:06:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.569+0000 7f62077fe640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f62000a3240 0x7f62000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.570+0000 7f621659c640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f62000a3240 0x7f62000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.570+0000 7f62077fe640 1 -- 172.21.15.103:0/886068933 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f620c0cfa10 con 0x7f6218102e00 2024-09-19T06:06:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.570+0000 7f621659c640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f62000a3240 0x7f62000a5700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6218199200 tx=0x7f620800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.574+0000 7f62077fe640 1 -- 172.21.15.103:0/886068933 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f620c014030 con 0x7f6218102e00 2024-09-19T06:06:55.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:55 smithi103 ceph-mon[30925]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:55.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.749+0000 7f621c882640 1 -- 172.21.15.103:0/886068933 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6218062630 con 0x7f62000a3240 2024-09-19T06:06:55.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.761+0000 7f62077fe640 1 -- 172.21.15.103:0/886068933 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f6218062630 con 0x7f62000a3240 2024-09-19T06:06:55.762 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.a smithi103 running (103s) 21s ago 102s 16.4M - 19.1.1-361-g2f599a46 d2baa855c067 173f113680d9 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.b smithi169 running (100s) 33s ago 100s 28.5M - 19.1.1-361-g2f599a46 d2baa855c067 80292f349ebf 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.c smithi174 running (114s) 33s ago 114s 18.1M - 19.1.1-361-g2f599a46 d2baa855c067 ddcd11b28c2d 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.d smithi103 running (2m) 21s ago 2m 13.6M - 19.1.1-361-g2f599a46 d2baa855c067 948f79608e22 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.e smithi169 running (119s) 33s ago 119s 18.5M - 19.1.1-361-g2f599a46 d2baa855c067 1bc7a114a068 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.f smithi174 running (117s) 33s ago 116s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 c2f352d10ca0 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.g smithi103 running (106s) 21s ago 106s 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 2b7dba4064d9 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.h smithi169 running (112s) 33s ago 112s 20.1M - 19.1.1-361-g2f599a46 d2baa855c067 baeceb04780c 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.i smithi174 running (109s) 33s ago 109s 19.8M - 19.1.1-361-g2f599a46 d2baa855c067 89fcc9ea8a74 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.j smithi103 running (2m) 21s ago 2m 13.4M - 19.1.1-361-g2f599a46 d2baa855c067 24e6db657bdb 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.k smithi169 running (2m) 33s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 91505c6b4b34 2024-09-19T06:06:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:mds.l smithi174 running (2m) 33s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 34d7941af29b 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.x smithi103 *:9283,8765 running (8m) 21s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 d9f2da171f75 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.y smithi169 *:8443,8765 running (7m) 33s ago 7m 441M - 19.1.1-361-g2f599a46 d2baa855c067 9fb5c9b079c8 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.z smithi174 *:8443,8765 running (7m) 33s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 4675dd7737b4 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:mon.a smithi103 running (8m) 21s ago 8m 48.8M 2048M 19.1.1-361-g2f599a46 d2baa855c067 d758afa5ef0d 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:mon.b smithi169 running (7m) 33s ago 7m 40.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 c6fb73b8ce35 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:mon.c smithi174 running (7m) 33s ago 7m 40.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 e9c25c0a3fe4 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (6m) 21s ago 6m 47.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 6c83e26358fa 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi169 running (6m) 33s ago 6m 54.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 6a47aecd2fee 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi174 running (6m) 33s ago 6m 59.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 f77194d6f879 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi103 running (5m) 21s ago 5m 46.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 1d0e44c00aae 2024-09-19T06:06:55.764 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi169 running (5m) 33s ago 5m 45.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 9660653f36c4 2024-09-19T06:06:55.765 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi174 running (4m) 33s ago 4m 54.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 cc80dc64e2b2 2024-09-19T06:06:55.765 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 smithi103 running (4m) 21s ago 4m 50.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 07d7d70ceada 2024-09-19T06:06:55.765 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 smithi169 running (4m) 33s ago 4m 53.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 a91a98a993b3 2024-09-19T06:06:55.765 INFO:teuthology.orchestra.run.smithi103.stdout:osd.8 smithi174 running (3m) 33s ago 3m 56.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 726a28750534 2024-09-19T06:06:55.765 INFO:teuthology.orchestra.run.smithi103.stdout:osd.9 smithi103 running (3m) 21s ago 3m 44.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 223579b3af03 2024-09-19T06:06:55.765 INFO:teuthology.orchestra.run.smithi103.stdout:osd.10 smithi169 running (2m) 33s ago 2m 47.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 af3bcb201f3c 2024-09-19T06:06:55.766 INFO:teuthology.orchestra.run.smithi103.stdout:osd.11 smithi174 running (2m) 33s ago 2m 43.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 d84323b0964f 2024-09-19T06:06:55.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 -- 172.21.15.103:0/886068933 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f62000a3240 msgr2=0x7f62000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:55.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f62000a3240 0x7f62000a5700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6218199200 tx=0x7f620800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 -- 172.21.15.103:0/886068933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6218102e00 msgr2=0x7f6218198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6218102e00 0x7f6218198260 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c920 tx=0x7f620c00cde0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 -- 172.21.15.103:0/886068933 shutdown_connections 2024-09-19T06:06:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f62000a3240 0x7f62000a5700 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62181037c0 0x7f621819f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6218102e00 0x7f6218198260 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 --2- 172.21.15.103:0/886068933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6218101c00 0x7f6218197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 -- 172.21.15.103:0/886068933 >> 172.21.15.103:0/886068933 conn(0x7f62180fd390 msgr2=0x7f6218106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 -- 172.21.15.103:0/886068933 shutdown_connections 2024-09-19T06:06:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:55.763+0000 7f621c882640 1 -- 172.21.15.103:0/886068933 wait complete. 2024-09-19T06:06:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:55 smithi174 ceph-mon[34488]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:56.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:55 smithi169 ceph-mon[34350]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:56.360 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T06:06:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:56.730 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:56 smithi103 ceph-mon[30925]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:06:56.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:56 smithi174 ceph-mon[34488]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:06:57.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:56 smithi169 ceph-mon[34350]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:06:57.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.098+0000 7f3dd29af640 1 -- 172.21.15.103:0/685749004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dcc101cd0 msgr2=0x7f3dcc102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:57.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.098+0000 7f3dd29af640 1 --2- 172.21.15.103:0/685749004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dcc101cd0 0x7f3dcc102150 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009900 tx=0x7f3dc002a410 comp rx=0 tx=0).stop 2024-09-19T06:06:57.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.098+0000 7f3dd29af640 1 -- 172.21.15.103:0/685749004 shutdown_connections 2024-09-19T06:06:57.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.098+0000 7f3dd29af640 1 --2- 172.21.15.103:0/685749004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dcc102690 0x7f3dcc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:57.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.098+0000 7f3dd29af640 1 --2- 172.21.15.103:0/685749004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dcc101cd0 0x7f3dcc102150 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.098+0000 7f3dd29af640 1 --2- 172.21.15.103:0/685749004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dcc100ad0 0x7f3dcc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.098+0000 7f3dd29af640 1 -- 172.21.15.103:0/685749004 >> 172.21.15.103:0/685749004 conn(0x7f3dcc0fc280 msgr2=0x7f3dcc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.098+0000 7f3dd29af640 1 -- 172.21.15.103:0/685749004 shutdown_connections 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.098+0000 7f3dd29af640 1 -- 172.21.15.103:0/685749004 wait complete. 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dd29af640 1 Processor -- start 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dd29af640 1 -- start start 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dd29af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dcc100ad0 0x7f3dcc06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dd29af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dcc101cd0 0x7f3dcc19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dd29af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dcc102690 0x7f3dcc19f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dd29af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc10c670 con 0x7f3dcc100ad0 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dd29af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc10c4f0 con 0x7f3dcc101cd0 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dd29af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc10c7f0 con 0x7f3dcc102690 2024-09-19T06:06:57.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dcbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dcc100ad0 0x7f3dcc06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dcbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dcc100ad0 0x7f3dcc06aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37182/0 (socket says 172.21.15.103:37182) 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.099+0000 7f3dcbfff640 1 -- 172.21.15.103:0/759548019 learned_addr learned my addr 172.21.15.103:0/759548019 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dcb7fe640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dcc101cd0 0x7f3dcc19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dcbfff640 1 -- 172.21.15.103:0/759548019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dcc102690 msgr2=0x7f3dcc19f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dd0f4c640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dcc102690 0x7f3dcc19f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dcbfff640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dcc102690 0x7f3dcc19f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dcbfff640 1 -- 172.21.15.103:0/759548019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dcc101cd0 msgr2=0x7f3dcc19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dcbfff640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dcc101cd0 0x7f3dcc19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dcbfff640 1 -- 172.21.15.103:0/759548019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc19fac0 con 0x7f3dcc100ad0 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dcb7fe640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dcc101cd0 0x7f3dcc19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dd0f4c640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dcc102690 0x7f3dcc19f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dcbfff640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dcc100ad0 0x7f3dcc06aad0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00d950 tx=0x7f3dbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:57.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dc97fa640 1 -- 172.21.15.103:0/759548019 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc017070 con 0x7f3dcc100ad0 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dd29af640 1 -- 172.21.15.103:0/759548019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dcc19fd50 con 0x7f3dcc100ad0 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dc97fa640 1 -- 172.21.15.103:0/759548019 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3dbc009c30 con 0x7f3dcc100ad0 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dc97fa640 1 -- 172.21.15.103:0/759548019 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00f620 con 0x7f3dcc100ad0 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.100+0000 7f3dd29af640 1 -- 172.21.15.103:0/759548019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dcc1a01b0 con 0x7f3dcc100ad0 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.101+0000 7f3dd29af640 1 -- 172.21.15.103:0/759548019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dcc107f20 con 0x7f3dcc100ad0 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.102+0000 7f3dc97fa640 1 -- 172.21.15.103:0/759548019 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f3dbc01a070 con 0x7f3dcc100ad0 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.103+0000 7f3dc97fa640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3db40a3240 0x7f3db40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.103+0000 7f3dcb7fe640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3db40a3240 0x7f3db40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.103+0000 7f3dc97fa640 1 -- 172.21.15.103:0/759548019 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f3dbc0cf3f0 con 0x7f3dcc100ad0 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.103+0000 7f3dcb7fe640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3db40a3240 0x7f3db40a5700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0000c00 tx=0x7f3dc00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:57.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.107+0000 7f3dc97fa640 1 -- 172.21.15.103:0/759548019 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3dbc009de0 con 0x7f3dcc100ad0 2024-09-19T06:06:57.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.281+0000 7f3dd29af640 1 -- 172.21.15.103:0/759548019 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f3dcc062630 con 0x7f3db40a3240 2024-09-19T06:06:57.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.287+0000 7f3dc97fa640 1 -- 172.21.15.103:0/759548019 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f3dcc062630 con 0x7f3db40a3240 2024-09-19T06:06:57.289 INFO:teuthology.orchestra.run.smithi103.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T06:06:57.289 INFO:teuthology.orchestra.run.smithi103.stdout:mds.all 12/12 35s ago 2m smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-19T06:06:57.289 INFO:teuthology.orchestra.run.smithi103.stdout:mgr 3/3 35s ago 7m smithi103=x;smithi169=y;smithi174=z;count:3 2024-09-19T06:06:57.289 INFO:teuthology.orchestra.run.smithi103.stdout:mon 3/3 35s ago 7m smithi103:172.21.15.103=a;smithi169:172.21.15.169=b;smithi174:172.21.15.174=c;count:3 2024-09-19T06:06:57.289 INFO:teuthology.orchestra.run.smithi103.stdout:osd 12 35s ago - 2024-09-19T06:06:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.289+0000 7f3dd29af640 1 -- 172.21.15.103:0/759548019 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3db40a3240 msgr2=0x7f3db40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.289+0000 7f3dd29af640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3db40a3240 0x7f3db40a5700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0000c00 tx=0x7f3dc00314a0 comp rx=0 tx=0).stop 2024-09-19T06:06:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.289+0000 7f3dd29af640 1 -- 172.21.15.103:0/759548019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dcc100ad0 msgr2=0x7f3dcc06aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.289+0000 7f3dd29af640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dcc100ad0 0x7f3dcc06aad0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00d950 tx=0x7f3dbc00de10 comp rx=0 tx=0).stop 2024-09-19T06:06:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.289+0000 7f3dd29af640 1 -- 172.21.15.103:0/759548019 shutdown_connections 2024-09-19T06:06:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.289+0000 7f3dd29af640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f3db40a3240 0x7f3db40a5700 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.289+0000 7f3dd29af640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dcc102690 0x7f3dcc19f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.289+0000 7f3dd29af640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dcc101cd0 0x7f3dcc19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.290+0000 7f3dd29af640 1 --2- 172.21.15.103:0/759548019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dcc100ad0 0x7f3dcc06aad0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.290+0000 7f3dd29af640 1 -- 172.21.15.103:0/759548019 >> 172.21.15.103:0/759548019 conn(0x7f3dcc0fc280 msgr2=0x7f3dcc1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.290+0000 7f3dd29af640 1 -- 172.21.15.103:0/759548019 shutdown_connections 2024-09-19T06:06:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:57.290+0000 7f3dd29af640 1 -- 172.21.15.103:0/759548019 wait complete. 2024-09-19T06:06:57.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:57 smithi103 ceph-mon[30925]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:57.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T06:06:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:57 smithi174 ceph-mon[34488]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:58.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:57 smithi169 ceph-mon[34350]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:58.173 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:58.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.606+0000 7f5a97684640 1 -- 172.21.15.103:0/1516934017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a90101d10 msgr2=0x7f5a90102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:58.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.606+0000 7f5a97684640 1 --2- 172.21.15.103:0/1516934017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a90101d10 0x7f5a90102190 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009900 tx=0x7f5a8002a410 comp rx=0 tx=0).stop 2024-09-19T06:06:58.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.606+0000 7f5a97684640 1 -- 172.21.15.103:0/1516934017 shutdown_connections 2024-09-19T06:06:58.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.606+0000 7f5a97684640 1 --2- 172.21.15.103:0/1516934017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a901026d0 0x7f5a90108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.606+0000 7f5a97684640 1 --2- 172.21.15.103:0/1516934017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a90101d10 0x7f5a90102190 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.606+0000 7f5a97684640 1 --2- 172.21.15.103:0/1516934017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a90100b10 0x7f5a90100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.606+0000 7f5a97684640 1 -- 172.21.15.103:0/1516934017 >> 172.21.15.103:0/1516934017 conn(0x7f5a900fc2a0 msgr2=0x7f5a900fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.606+0000 7f5a97684640 1 -- 172.21.15.103:0/1516934017 shutdown_connections 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.606+0000 7f5a97684640 1 -- 172.21.15.103:0/1516934017 wait complete. 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a97684640 1 Processor -- start 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a97684640 1 -- start start 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a97684640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a90100b10 0x7f5a9006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a97684640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a90101d10 0x7f5a9019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a97684640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a901026d0 0x7f5a9019f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a97684640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9010c620 con 0x7f5a901026d0 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a97684640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9010c4a0 con 0x7f5a90101d10 2024-09-19T06:06:58.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a97684640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9010c7a0 con 0x7f5a90100b10 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a95c21640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a901026d0 0x7f5a9019f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a95c21640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a901026d0 0x7f5a9019f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37194/0 (socket says 172.21.15.103:37194) 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a95c21640 1 -- 172.21.15.103:0/2330914195 learned_addr learned my addr 172.21.15.103:0/2330914195 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a95420640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a90100b10 0x7f5a9006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a94c1f640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a90101d10 0x7f5a9019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a95c21640 1 -- 172.21.15.103:0/2330914195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a90100b10 msgr2=0x7f5a9006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a95c21640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a90100b10 0x7f5a9006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a95c21640 1 -- 172.21.15.103:0/2330914195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a90101d10 msgr2=0x7f5a9019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a95c21640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a90101d10 0x7f5a9019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a95c21640 1 -- 172.21.15.103:0/2330914195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9019fa40 con 0x7f5a901026d0 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.607+0000 7f5a94c1f640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a90101d10 0x7f5a9019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.608+0000 7f5a95c21640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a901026d0 0x7f5a9019f130 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800cce0 tx=0x7f5a8800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.608+0000 7f5a867fc640 1 -- 172.21.15.103:0/2330914195 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8800f450 con 0x7f5a901026d0 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.608+0000 7f5a97684640 1 -- 172.21.15.103:0/2330914195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9019fcd0 con 0x7f5a901026d0 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.608+0000 7f5a867fc640 1 -- 172.21.15.103:0/2330914195 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a8800faa0 con 0x7f5a901026d0 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.608+0000 7f5a867fc640 1 -- 172.21.15.103:0/2330914195 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88018b70 con 0x7f5a901026d0 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.608+0000 7f5a97684640 1 -- 172.21.15.103:0/2330914195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a901a01c0 con 0x7f5a901026d0 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.609+0000 7f5a97684640 1 -- 172.21.15.103:0/2330914195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a90107f60 con 0x7f5a901026d0 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.610+0000 7f5a867fc640 1 -- 172.21.15.103:0/2330914195 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f5a88018d10 con 0x7f5a901026d0 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.611+0000 7f5a867fc640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5a7c0a3240 0x7f5a7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.611+0000 7f5a95420640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5a7c0a3240 0x7f5a7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.611+0000 7f5a867fc640 1 -- 172.21.15.103:0/2330914195 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f5a880cfd30 con 0x7f5a901026d0 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.611+0000 7f5a95420640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5a7c0a3240 0x7f5a7c0a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a90101b70 tx=0x7f5a8c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.615+0000 7f5a867fc640 1 -- 172.21.15.103:0/2330914195 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a88014030 con 0x7f5a901026d0 2024-09-19T06:06:58.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.789+0000 7f5a97684640 1 -- 172.21.15.103:0/2330914195 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5a90062630 con 0x7f5a7c0a3240 2024-09-19T06:06:58.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.790+0000 7f5a867fc640 1 -- 172.21.15.103:0/2330914195 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f5a90062630 con 0x7f5a7c0a3240 2024-09-19T06:06:58.792 INFO:teuthology.orchestra.run.smithi103.stdout:HOST ADDR LABELS STATUS 2024-09-19T06:06:58.792 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103 172.21.15.103 2024-09-19T06:06:58.792 INFO:teuthology.orchestra.run.smithi103.stdout:smithi169 172.21.15.169 2024-09-19T06:06:58.792 INFO:teuthology.orchestra.run.smithi103.stdout:smithi174 172.21.15.174 2024-09-19T06:06:58.792 INFO:teuthology.orchestra.run.smithi103.stdout:3 hosts in cluster 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.792+0000 7f5a97684640 1 -- 172.21.15.103:0/2330914195 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5a7c0a3240 msgr2=0x7f5a7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.792+0000 7f5a97684640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5a7c0a3240 0x7f5a7c0a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a90101b70 tx=0x7f5a8c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.792+0000 7f5a97684640 1 -- 172.21.15.103:0/2330914195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a901026d0 msgr2=0x7f5a9019f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.792+0000 7f5a97684640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a901026d0 0x7f5a9019f130 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800cce0 tx=0x7f5a8800a620 comp rx=0 tx=0).stop 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.792+0000 7f5a97684640 1 -- 172.21.15.103:0/2330914195 shutdown_connections 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.792+0000 7f5a97684640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f5a7c0a3240 0x7f5a7c0a5700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.792+0000 7f5a97684640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a901026d0 0x7f5a9019f130 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.792+0000 7f5a97684640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a90101d10 0x7f5a9019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.792+0000 7f5a97684640 1 --2- 172.21.15.103:0/2330914195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a90100b10 0x7f5a9006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.793+0000 7f5a97684640 1 -- 172.21.15.103:0/2330914195 >> 172.21.15.103:0/2330914195 conn(0x7f5a900fc2a0 msgr2=0x7f5a90105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.793+0000 7f5a97684640 1 -- 172.21.15.103:0/2330914195 shutdown_connections 2024-09-19T06:06:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:06:58.793+0000 7f5a97684640 1 -- 172.21.15.103:0/2330914195 wait complete. 2024-09-19T06:06:58.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:58 smithi103 ceph-mon[30925]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:58.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:06:58 smithi103 ceph-mon[30925]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:06:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:58 smithi174 ceph-mon[34488]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:58.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:06:58 smithi174 ceph-mon[34488]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:06:59.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:58 smithi169 ceph-mon[34350]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:59.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:06:58 smithi169 ceph-mon[34350]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:06:59.631 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T06:06:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.281+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2674057662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c44101cd0 msgr2=0x7f1c44102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.281+0000 7f1c49ea7640 1 --2- 172.21.15.103:0/2674057662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c44101cd0 0x7f1c44102150 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009900 tx=0x7f1c2c02a410 comp rx=0 tx=0).stop 2024-09-19T06:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.281+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2674057662 shutdown_connections 2024-09-19T06:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.281+0000 7f1c49ea7640 1 --2- 172.21.15.103:0/2674057662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c44102690 0x7f1c44108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.281+0000 7f1c49ea7640 1 --2- 172.21.15.103:0/2674057662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c44101cd0 0x7f1c44102150 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.281+0000 7f1c49ea7640 1 --2- 172.21.15.103:0/2674057662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c44100ad0 0x7f1c44100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.281+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2674057662 >> 172.21.15.103:0/2674057662 conn(0x7f1c440fc280 msgr2=0x7f1c440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.281+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2674057662 shutdown_connections 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.281+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2674057662 wait complete. 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.281+0000 7f1c49ea7640 1 Processor -- start 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c49ea7640 1 -- start start 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c49ea7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c44100ad0 0x7f1c44197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c49ea7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c44101cd0 0x7f1c44198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c49ea7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c44102690 0x7f1c4419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c49ea7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4410d730 con 0x7f1c44101cd0 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c49ea7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4410d5b0 con 0x7f1c44100ad0 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c49ea7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4410d8b0 con 0x7f1c44102690 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c3bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c44101cd0 0x7f1c44198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:00.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c3bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c44101cd0 0x7f1c44198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39572/0 (socket says 172.21.15.103:39572) 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c3bfff640 1 -- 172.21.15.103:0/2140593012 learned_addr learned my addr 172.21.15.103:0/2140593012 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c43fff640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c44102690 0x7f1c4419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c437fe640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c44100ad0 0x7f1c44197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c3bfff640 1 -- 172.21.15.103:0/2140593012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c44102690 msgr2=0x7f1c4419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c3bfff640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c44102690 0x7f1c4419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c3bfff640 1 -- 172.21.15.103:0/2140593012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c44100ad0 msgr2=0x7f1c44197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c3bfff640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c44100ad0 0x7f1c44197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.282+0000 7f1c3bfff640 1 -- 172.21.15.103:0/2140593012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4419fa60 con 0x7f1c44101cd0 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.283+0000 7f1c3bfff640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c44101cd0 0x7f1c44198370 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c004770 tx=0x7f1c2c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.283+0000 7f1c417fa640 1 -- 172.21.15.103:0/2140593012 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c03f030 con 0x7f1c44101cd0 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.283+0000 7f1c417fa640 1 -- 172.21.15.103:0/2140593012 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c2c003cb0 con 0x7f1c44101cd0 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.283+0000 7f1c417fa640 1 -- 172.21.15.103:0/2140593012 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c035070 con 0x7f1c44101cd0 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.283+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2140593012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4419fcf0 con 0x7f1c44101cd0 2024-09-19T06:07:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.283+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2140593012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c441a0180 con 0x7f1c44101cd0 2024-09-19T06:07:00.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.284+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2140593012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c44108010 con 0x7f1c44101cd0 2024-09-19T06:07:00.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.285+0000 7f1c417fa640 1 -- 172.21.15.103:0/2140593012 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f1c2c042030 con 0x7f1c44101cd0 2024-09-19T06:07:00.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.286+0000 7f1c417fa640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1c300a3270 0x7f1c300a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:00.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.286+0000 7f1c437fe640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1c300a3270 0x7f1c300a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:00.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.286+0000 7f1c417fa640 1 -- 172.21.15.103:0/2140593012 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f1c2c0efdf0 con 0x7f1c44101cd0 2024-09-19T06:07:00.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.286+0000 7f1c437fe640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1c300a3270 0x7f1c300a5730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1c34005fd0 tx=0x7f1c3400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:00.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.290+0000 7f1c417fa640 1 -- 172.21.15.103:0/2140593012 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c2c0bc4f0 con 0x7f1c44101cd0 2024-09-19T06:07:00.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.467+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2140593012 --> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f1c44062630 con 0x7f1c300a3270 2024-09-19T06:07:00.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.469+0000 7f1c417fa640 1 -- 172.21.15.103:0/2140593012 <== mgr.14150 v2:172.21.15.103:6800/253046125 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f1c44062630 con 0x7f1c300a3270 2024-09-19T06:07:00.470 INFO:teuthology.orchestra.run.smithi103.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T06:07:00.470 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T06:07:00.470 INFO:teuthology.orchestra.run.smithi103.stdout:smithi169 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300LN400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:07:00.470 INFO:teuthology.orchestra.run.smithi103.stdout:smithi174 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050074400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:07:00.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2140593012 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1c300a3270 msgr2=0x7f1c300a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:00.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1c300a3270 0x7f1c300a5730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1c34005fd0 tx=0x7f1c3400b410 comp rx=0 tx=0).stop 2024-09-19T06:07:00.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2140593012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c44101cd0 msgr2=0x7f1c44198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:00.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c44101cd0 0x7f1c44198370 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c004770 tx=0x7f1c2c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2140593012 shutdown_connections 2024-09-19T06:07:00.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f1c300a3270 0x7f1c300a5730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c44102690 0x7f1c4419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c44101cd0 0x7f1c44198370 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 --2- 172.21.15.103:0/2140593012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c44100ad0 0x7f1c44197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2140593012 >> 172.21.15.103:0/2140593012 conn(0x7f1c440fc280 msgr2=0x7f1c441051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:00.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2140593012 shutdown_connections 2024-09-19T06:07:00.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:00.471+0000 7f1c49ea7640 1 -- 172.21.15.103:0/2140593012 wait complete. 2024-09-19T06:07:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:00 smithi174 ceph-mon[34488]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:00.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:00 smithi174 ceph-mon[34488]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T06:07:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:00 smithi103 ceph-mon[30925]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:00.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:00 smithi103 ceph-mon[30925]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T06:07:01.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:00 smithi169 ceph-mon[34350]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:01.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:00 smithi169 ceph-mon[34350]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T06:07:01.093 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:07:01.102 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T06:07:01.102 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T06:07:01.347 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:01.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:01 smithi103 ceph-mon[30925]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:01.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.763+0000 7f20dc566640 1 -- 172.21.15.103:0/2900651388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20d4100af0 msgr2=0x7f20d4100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:01.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.763+0000 7f20dc566640 1 --2- 172.21.15.103:0/2900651388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20d4100af0 0x7f20d4100ef0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009900 tx=0x7f20c802a410 comp rx=0 tx=0).stop 2024-09-19T06:07:01.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 -- 172.21.15.103:0/2900651388 shutdown_connections 2024-09-19T06:07:01.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 --2- 172.21.15.103:0/2900651388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d41026b0 0x7f20d4108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:01.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 --2- 172.21.15.103:0/2900651388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20d4101cf0 0x7f20d4102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:01.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 --2- 172.21.15.103:0/2900651388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20d4100af0 0x7f20d4100ef0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 -- 172.21.15.103:0/2900651388 >> 172.21.15.103:0/2900651388 conn(0x7f20d40fc2a0 msgr2=0x7f20d40fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 -- 172.21.15.103:0/2900651388 shutdown_connections 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 -- 172.21.15.103:0/2900651388 wait complete. 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 Processor -- start 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 -- start start 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20d4100af0 0x7f20d4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20d4101cf0 0x7f20d4198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d41026b0 0x7f20d419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f20d410c680 con 0x7f20d4100af0 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20d410c500 con 0x7f20d41026b0 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20dc566640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f20d410c800 con 0x7f20d4101cf0 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20da302640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20d4100af0 0x7f20d4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:01.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20da302640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20d4100af0 0x7f20d4197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39596/0 (socket says 172.21.15.103:39596) 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.764+0000 7f20da302640 1 -- 172.21.15.103:0/2905248610 learned_addr learned my addr 172.21.15.103:0/2905248610 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20da302640 1 -- 172.21.15.103:0/2905248610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20d4101cf0 msgr2=0x7f20d4198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20da302640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20d4101cf0 0x7f20d4198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20da302640 1 -- 172.21.15.103:0/2905248610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d41026b0 msgr2=0x7f20d419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20da302640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d41026b0 0x7f20d419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20da302640 1 -- 172.21.15.103:0/2905248610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d419faf0 con 0x7f20d4100af0 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20da302640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20d4100af0 0x7f20d4197ec0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009230 tx=0x7f20c8004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20c77fe640 1 -- 172.21.15.103:0/2905248610 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c803f030 con 0x7f20d4100af0 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20c77fe640 1 -- 172.21.15.103:0/2905248610 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20c8003cb0 con 0x7f20d4100af0 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20dc566640 1 -- 172.21.15.103:0/2905248610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d419fd80 con 0x7f20d4100af0 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20c77fe640 1 -- 172.21.15.103:0/2905248610 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8035070 con 0x7f20d4100af0 2024-09-19T06:07:01.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.765+0000 7f20dc566640 1 -- 172.21.15.103:0/2905248610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d41a0280 con 0x7f20d4100af0 2024-09-19T06:07:01.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.766+0000 7f20dc566640 1 -- 172.21.15.103:0/2905248610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d41a04b0 con 0x7f20d4100af0 2024-09-19T06:07:01.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.767+0000 7f20c77fe640 1 -- 172.21.15.103:0/2905248610 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f20c8042030 con 0x7f20d4100af0 2024-09-19T06:07:01.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.768+0000 7f20c77fe640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f20c00a3270 0x7f20c00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:01.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.768+0000 7f20d9b01640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f20c00a3270 0x7f20c00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:01.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.768+0000 7f20c77fe640 1 -- 172.21.15.103:0/2905248610 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f20c80f03d0 con 0x7f20d4100af0 2024-09-19T06:07:01.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.768+0000 7f20d9b01640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f20c00a3270 0x7f20c00a5730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f20d41993e0 tx=0x7f20d0006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:01.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.771+0000 7f20c77fe640 1 -- 172.21.15.103:0/2905248610 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f20c80bd120 con 0x7f20d4100af0 2024-09-19T06:07:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:01 smithi174 ceph-mon[34488]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.970+0000 7f20dc566640 1 -- 172.21.15.103:0/2905248610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f20d4108b40 con 0x7f20d4100af0 2024-09-19T06:07:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.971+0000 7f20c77fe640 1 -- 172.21.15.103:0/2905248610 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3101 (secure 0 0 0) 0x7f20c80bca20 con 0x7f20d4100af0 2024-09-19T06:07:01.973 INFO:teuthology.orchestra.run.smithi103.stdout:e24 2024-09-19T06:07:01.973 INFO:teuthology.orchestra.run.smithi103.stdout:btime 2024-09-19T06:05:36:880542+0000 2024-09-19T06:07:01.973 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:07:01.973 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:07:01.973 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-19T06:07:01.973 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:01.973 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:07:01.973 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-19T06:07:01.973 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 24 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-19T06:05:25.242328+0000 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-19T06:05:36.431382+0000 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 300 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-19T06:07:01.974 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 3 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:in 0,1,2 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=24488,1=24475,2=24463} 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-19T06:07:01.975 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 0 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 24488 members: 24463,24475,24488 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b{0:24488} state up:active seq 4 addr [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.h{0:24455} state up:standby-replay seq 1 addr [v2:172.21.15.169:6836/2782103866,v1:172.21.15.169:6837/2782103866] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.i{1:24475} state up:active seq 8 addr [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.f{1:24454} state up:standby-replay seq 1 addr [v2:172.21.15.174:6834/588815565,v1:172.21.15.174:6835/588815565] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c{2:24463} state up:active seq 10 addr [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.e{2:24437} state up:standby-replay seq 1 addr [v2:172.21.15.169:6834/3808769732,v1:172.21.15.169:6835/3808769732] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.j{-1:14547} state up:standby seq 1 addr [v2:172.21.15.103:6834/1313035056,v1:172.21.15.103:6835/1313035056] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.977 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d{-1:14559} state up:standby seq 1 addr [v2:172.21.15.103:6836/1090426593,v1:172.21.15.103:6837/1090426593] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.977 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.g{-1:14616} state up:standby seq 1 addr [v2:172.21.15.103:6838/208937195,v1:172.21.15.103:6839/208937195] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.977 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a{-1:14628} state up:standby seq 1 addr [v2:172.21.15.103:6840/3658112833,v1:172.21.15.103:6841/3658112833] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.977 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.k{-1:24407} state up:standby seq 1 addr [v2:172.21.15.169:6832/4189079406,v1:172.21.15.169:6833/4189079406] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.977 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.l{-1:24421} state up:standby seq 1 addr [v2:172.21.15.174:6832/1347140059,v1:172.21.15.174:6833/1347140059] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:07:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 24 2024-09-19T06:07:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 -- 172.21.15.103:0/2905248610 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f20c00a3270 msgr2=0x7f20c00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f20c00a3270 0x7f20c00a5730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f20d41993e0 tx=0x7f20d0006c90 comp rx=0 tx=0).stop 2024-09-19T06:07:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 -- 172.21.15.103:0/2905248610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20d4100af0 msgr2=0x7f20d4197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20d4100af0 0x7f20d4197ec0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009230 tx=0x7f20c8004340 comp rx=0 tx=0).stop 2024-09-19T06:07:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 -- 172.21.15.103:0/2905248610 shutdown_connections 2024-09-19T06:07:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f20c00a3270 0x7f20c00a5730 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d41026b0 0x7f20d419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20d4101cf0 0x7f20d4198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 --2- 172.21.15.103:0/2905248610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20d4100af0 0x7f20d4197ec0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 -- 172.21.15.103:0/2905248610 >> 172.21.15.103:0/2905248610 conn(0x7f20d40fc2a0 msgr2=0x7f20d40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 -- 172.21.15.103:0/2905248610 shutdown_connections 2024-09-19T06:07:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:01.973+0000 7f20dc566640 1 -- 172.21.15.103:0/2905248610 wait complete. 2024-09-19T06:07:02.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:01 smithi169 ceph-mon[34350]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:02.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:02 smithi103 ceph-mon[30925]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-19T06:07:02.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:02 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2905248610' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:07:02.678 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T06:07:02.922 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:02 smithi174 ceph-mon[34488]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-19T06:07:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:02 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2905248610' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:07:03.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:02 smithi169 ceph-mon[34350]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-19T06:07:03.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:02 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2905248610' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:07:03.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.397+0000 7fabb5e32640 1 -- 172.21.15.103:0/3507530632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb0102690 msgr2=0x7fabb0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:03.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.397+0000 7fabb5e32640 1 --2- 172.21.15.103:0/3507530632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb0102690 0x7fabb0108f20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faba8009ca0 tx=0x7faba802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:07:03.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.397+0000 7fabb5e32640 1 -- 172.21.15.103:0/3507530632 shutdown_connections 2024-09-19T06:07:03.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.397+0000 7fabb5e32640 1 --2- 172.21.15.103:0/3507530632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb0102690 0x7fabb0108f20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:03.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.397+0000 7fabb5e32640 1 --2- 172.21.15.103:0/3507530632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0101cd0 0x7fabb0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:03.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.397+0000 7fabb5e32640 1 --2- 172.21.15.103:0/3507530632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb0100ad0 0x7fabb0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.397+0000 7fabb5e32640 1 -- 172.21.15.103:0/3507530632 >> 172.21.15.103:0/3507530632 conn(0x7fabb00fc280 msgr2=0x7fabb00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.397+0000 7fabb5e32640 1 -- 172.21.15.103:0/3507530632 shutdown_connections 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.397+0000 7fabb5e32640 1 -- 172.21.15.103:0/3507530632 wait complete. 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.397+0000 7fabb5e32640 1 Processor -- start 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabb5e32640 1 -- start start 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabb5e32640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb0100ad0 0x7fabb0199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabb5e32640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb0101cd0 0x7fabb019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabb5e32640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0102690 0x7fabb01a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabb5e32640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010c600 con 0x7fabb0101cd0 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabb5e32640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010c480 con 0x7fabb0102690 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabb5e32640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010c780 con 0x7fabb0100ad0 2024-09-19T06:07:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb0101cd0 0x7fabb019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb0101cd0 0x7fabb019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39606/0 (socket says 172.21.15.103:39606) 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaeffd640 1 -- 172.21.15.103:0/753548232 learned_addr learned my addr 172.21.15.103:0/753548232 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaffff640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0102690 0x7fabb01a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaf7fe640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb0100ad0 0x7fabb0199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaeffd640 1 -- 172.21.15.103:0/753548232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb0100ad0 msgr2=0x7fabb0199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaeffd640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb0100ad0 0x7fabb0199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaeffd640 1 -- 172.21.15.103:0/753548232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0102690 msgr2=0x7fabb01a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaeffd640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0102690 0x7fabb01a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaeffd640 1 -- 172.21.15.103:0/753548232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb01a1c00 con 0x7fabb0101cd0 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaf7fe640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb0100ad0 0x7fabb0199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.398+0000 7fabaeffd640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb0101cd0 0x7fabb019a510 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faba400d950 tx=0x7faba400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.399+0000 7fabacff9640 1 -- 172.21.15.103:0/753548232 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4017030 con 0x7fabb0101cd0 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.399+0000 7fabacff9640 1 -- 172.21.15.103:0/753548232 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faba4004020 con 0x7fabb0101cd0 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.399+0000 7fabb5e32640 1 -- 172.21.15.103:0/753548232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb01a1ef0 con 0x7fabb0101cd0 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.399+0000 7fabacff9640 1 -- 172.21.15.103:0/753548232 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba40047a0 con 0x7fabb0101cd0 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.399+0000 7fabb5e32640 1 -- 172.21.15.103:0/753548232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb01a23a0 con 0x7fabb0101cd0 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.400+0000 7fabb5e32640 1 -- 172.21.15.103:0/753548232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb01a2690 con 0x7fabb0101cd0 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.402+0000 7fabacff9640 1 -- 172.21.15.103:0/753548232 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7faba40041d0 con 0x7fabb0101cd0 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.402+0000 7fabacff9640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab980a3270 0x7fab980a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.403+0000 7fabaf7fe640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab980a3270 0x7fab980a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.403+0000 7fabacff9640 1 -- 172.21.15.103:0/753548232 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7faba40cf9d0 con 0x7fabb0101cd0 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.403+0000 7fabaf7fe640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab980a3270 0x7fab980a5730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faba00058c0 tx=0x7faba0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.406+0000 7fabacff9640 1 -- 172.21.15.103:0/753548232 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faba409c6c0 con 0x7fabb0101cd0 2024-09-19T06:07:03.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.581+0000 7fabb5e32640 1 -- 172.21.15.103:0/753548232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fabb01a2860 con 0x7fabb0101cd0 2024-09-19T06:07:03.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.582+0000 7fabacff9640 1 -- 172.21.15.103:0/753548232 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v80) ==== 56+0+5285 (secure 0 0 0) 0x7faba409bfc0 con 0x7fabb0101cd0 2024-09-19T06:07:03.583 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 80 2024-09-19T06:07:03.583 INFO:teuthology.orchestra.run.smithi103.stdout:fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T06:07:03.583 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-19T05:58:00.204662+0000 2024-09-19T06:07:03.583 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-19T06:05:46.513696+0000 2024-09-19T06:07:03.583 INFO:teuthology.orchestra.run.smithi103.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:crush_version 26 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:full_ratio 0.95 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:backfillfull_ratio 0.9 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:nearfull_ratio 0.85 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:require_min_compat_client luminous 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:min_compat_client luminous 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:require_osd_release squid 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:stretch_mode_enabled false 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T06:07:03.584 INFO:teuthology.orchestra.run.smithi103.stdout:max_osd 12 2024-09-19T06:07:03.585 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 up in weight 1 up_from 8 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6802/123668985,v1:172.21.15.103:6803/123668985] [v2:172.21.15.103:6804/123668985,v1:172.21.15.103:6805/123668985] exists,up fd4c0151-c2ca-486c-b60a-50a235f0d10b 2024-09-19T06:07:03.585 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 up in weight 1 up_from 13 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/528006707,v1:172.21.15.169:6801/528006707] [v2:172.21.15.169:6802/528006707,v1:172.21.15.169:6803/528006707] exists,up e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5 2024-09-19T06:07:03.585 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 up in weight 1 up_from 17 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6800/3967741036,v1:172.21.15.174:6801/3967741036] [v2:172.21.15.174:6802/3967741036,v1:172.21.15.174:6803/3967741036] exists,up 1e8e4188-7656-44b4-9064-cf52b6b5d2d1 2024-09-19T06:07:03.585 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 up in weight 1 up_from 23 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6810/1485292164,v1:172.21.15.103:6811/1485292164] [v2:172.21.15.103:6812/1485292164,v1:172.21.15.103:6813/1485292164] exists,up 7afabe9f-7421-423a-ba92-f2c6c9e57d18 2024-09-19T06:07:03.585 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 up in weight 1 up_from 30 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6808/1020121864,v1:172.21.15.169:6809/1020121864] [v2:172.21.15.169:6810/1020121864,v1:172.21.15.169:6811/1020121864] exists,up 64f13201-dc73-4167-ba72-82b720f23503 2024-09-19T06:07:03.585 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 up in weight 1 up_from 34 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6808/2373718681,v1:172.21.15.174:6809/2373718681] [v2:172.21.15.174:6810/2373718681,v1:172.21.15.174:6811/2373718681] exists,up ab67f7da-dbde-496e-9a67-cf4fc7be01a9 2024-09-19T06:07:03.585 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 up in weight 1 up_from 41 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6818/2136065370,v1:172.21.15.103:6819/2136065370] [v2:172.21.15.103:6820/2136065370,v1:172.21.15.103:6821/2136065370] exists,up 751db20c-1173-4ab2-99fd-29882790017f 2024-09-19T06:07:03.585 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 up in weight 1 up_from 46 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6816/337716664,v1:172.21.15.169:6817/337716664] [v2:172.21.15.169:6818/337716664,v1:172.21.15.169:6819/337716664] exists,up 4bff8a33-9e53-43f6-be75-e3d1483adc68 2024-09-19T06:07:03.585 INFO:teuthology.orchestra.run.smithi103.stdout:osd.8 up in weight 1 up_from 53 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6816/1949689360,v1:172.21.15.174:6817/1949689360] [v2:172.21.15.174:6818/1949689360,v1:172.21.15.174:6819/1949689360] exists,up b2a01657-b797-40d9-9837-dd8475335c05 2024-09-19T06:07:03.585 INFO:teuthology.orchestra.run.smithi103.stdout:osd.9 up in weight 1 up_from 60 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6826/1803309974,v1:172.21.15.103:6827/1803309974] [v2:172.21.15.103:6828/1803309974,v1:172.21.15.103:6829/1803309974] exists,up a0c75553-c854-445a-9eed-de0409117cd9 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:osd.10 up in weight 1 up_from 65 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6824/1441835592,v1:172.21.15.169:6825/1441835592] [v2:172.21.15.169:6826/1441835592,v1:172.21.15.169:6827/1441835592] exists,up 0725ebf6-d24b-4683-a82d-ac043bc775a6 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:osd.11 up in weight 1 up_from 72 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6824/1501737377,v1:172.21.15.174:6825/1501737377] [v2:172.21.15.174:6826/1501737377,v1:172.21.15.174:6827/1501737377] exists,up 32e645a1-8f34-4719-a667-5279a3669279 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 2.13 [2,11] 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.2 [3,9] 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.e [5,9] 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.17 [4,8] 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.1b [4,6] 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.36 [4,9] 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/1099848692 expires 2024-09-20T05:58:45.371786+0000 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6800/1007431406 expires 2024-09-20T05:58:45.371786+0000 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/3490453176 expires 2024-09-20T05:58:45.371786+0000 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/4011994567 expires 2024-09-20T05:58:21.953764+0000 2024-09-19T06:07:03.586 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/4227764370 expires 2024-09-20T05:58:21.953764+0000 2024-09-19T06:07:03.587 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6801/3148507486 expires 2024-09-20T05:58:21.953764+0000 2024-09-19T06:07:03.587 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6801/1007431406 expires 2024-09-20T05:58:45.371786+0000 2024-09-19T06:07:03.587 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/1922728800 expires 2024-09-20T05:58:45.371786+0000 2024-09-19T06:07:03.587 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6800/3148507486 expires 2024-09-20T05:58:21.953764+0000 2024-09-19T06:07:03.587 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/3630145046 expires 2024-09-20T05:58:21.953764+0000 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 -- 172.21.15.103:0/753548232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab980a3270 msgr2=0x7fab980a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab980a3270 0x7fab980a5730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faba00058c0 tx=0x7faba0005850 comp rx=0 tx=0).stop 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 -- 172.21.15.103:0/753548232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb0101cd0 msgr2=0x7fabb019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb0101cd0 0x7fabb019a510 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faba400d950 tx=0x7faba400de10 comp rx=0 tx=0).stop 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 -- 172.21.15.103:0/753548232 shutdown_connections 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fab980a3270 0x7fab980a5730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0102690 0x7fabb01a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb0101cd0 0x7fabb019a510 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 --2- 172.21.15.103:0/753548232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb0100ad0 0x7fabb0199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 -- 172.21.15.103:0/753548232 >> 172.21.15.103:0/753548232 conn(0x7fabb00fc280 msgr2=0x7fabb006a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 -- 172.21.15.103:0/753548232 shutdown_connections 2024-09-19T06:07:03.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:03.584+0000 7fabb5e32640 1 -- 172.21.15.103:0/753548232 wait complete. 2024-09-19T06:07:04.250 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T06:07:04.261 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:07:04.520 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:04.788 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:04 smithi103 ceph-mon[30925]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:07:04.788 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:04 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/753548232' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:07:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:04 smithi174 ceph-mon[34488]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:07:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:04 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/753548232' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:07:05.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.986+0000 7f7b45be0640 1 -- 172.21.15.103:0/3586260387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b40100480 msgr2=0x7f7b40100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.986+0000 7f7b45be0640 1 --2- 172.21.15.103:0/3586260387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b40100480 0x7f7b40100860 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009900 tx=0x7f7b3002a410 comp rx=0 tx=0).stop 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.986+0000 7f7b45be0640 1 -- 172.21.15.103:0/3586260387 shutdown_connections 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.986+0000 7f7b45be0640 1 --2- 172.21.15.103:0/3586260387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b401055b0 0x7f7b4010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.986+0000 7f7b45be0640 1 --2- 172.21.15.103:0/3586260387 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b40100e30 0x7f7b40104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.986+0000 7f7b45be0640 1 --2- 172.21.15.103:0/3586260387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b40100480 0x7f7b40100860 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.986+0000 7f7b45be0640 1 -- 172.21.15.103:0/3586260387 >> 172.21.15.103:0/3586260387 conn(0x7f7b40077210 msgr2=0x7f7b400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.986+0000 7f7b45be0640 1 -- 172.21.15.103:0/3586260387 shutdown_connections 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.986+0000 7f7b45be0640 1 -- 172.21.15.103:0/3586260387 wait complete. 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b45be0640 1 Processor -- start 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b45be0640 1 -- start start 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b45be0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b40100480 0x7f7b401983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b45be0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b40100e30 0x7f7b40198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b45be0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b401055b0 0x7f7b4019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b45be0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40110d60 con 0x7f7b40100480 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b45be0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40110be0 con 0x7f7b40100e30 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b45be0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40110ee0 con 0x7f7b401055b0 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b3f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b40100480 0x7f7b401983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b3f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b40100480 0x7f7b401983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39622/0 (socket says 172.21.15.103:39622) 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.987+0000 7f7b3f7fe640 1 -- 172.21.15.103:0/3566514253 learned_addr learned my addr 172.21.15.103:0/3566514253 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3effd640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b40100e30 0x7f7b40198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3ffff640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b401055b0 0x7f7b4019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3f7fe640 1 -- 172.21.15.103:0/3566514253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b401055b0 msgr2=0x7f7b4019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3f7fe640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b401055b0 0x7f7b4019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3f7fe640 1 -- 172.21.15.103:0/3566514253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b40100e30 msgr2=0x7f7b40198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3f7fe640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b40100e30 0x7f7b40198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3f7fe640 1 -- 172.21.15.103:0/3566514253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4019d3a0 con 0x7f7b40100480 2024-09-19T06:07:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3ffff640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b401055b0 0x7f7b4019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3effd640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b40100e30 0x7f7b40198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3f7fe640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b40100480 0x7f7b401983f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7b30006010 tx=0x7f7b30004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3cff9640 1 -- 172.21.15.103:0/3566514253 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3003f030 con 0x7f7b40100480 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b45be0640 1 -- 172.21.15.103:0/3566514253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4019d630 con 0x7f7b40100480 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3cff9640 1 -- 172.21.15.103:0/3566514253 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b300035f0 con 0x7f7b40100480 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b3cff9640 1 -- 172.21.15.103:0/3566514253 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30035070 con 0x7f7b40100480 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.988+0000 7f7b45be0640 1 -- 172.21.15.103:0/3566514253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b401a4f70 con 0x7f7b40100480 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.989+0000 7f7b45be0640 1 -- 172.21.15.103:0/3566514253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b40101960 con 0x7f7b40100480 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.990+0000 7f7b3cff9640 1 -- 172.21.15.103:0/3566514253 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f7b30003b10 con 0x7f7b40100480 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.991+0000 7f7b3cff9640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7b280a3240 0x7f7b280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.991+0000 7f7b3cff9640 1 -- 172.21.15.103:0/3566514253 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f7b300f0510 con 0x7f7b40100480 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.991+0000 7f7b3effd640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7b280a3240 0x7f7b280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.991+0000 7f7b3effd640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7b280a3240 0x7f7b280a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b34006fd0 tx=0x7f7b34008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:04.995+0000 7f7b3cff9640 1 -- 172.21.15.103:0/3566514253 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b300bd260 con 0x7f7b40100480 2024-09-19T06:07:05.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:04 smithi169 ceph-mon[34350]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:07:05.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:04 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/753548232' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:07:05.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.194+0000 7f7b45be0640 1 -- 172.21.15.103:0/3566514253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b4010a7a0 con 0x7f7b40100480 2024-09-19T06:07:05.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.194+0000 7f7b3cff9640 1 -- 172.21.15.103:0/3566514253 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11933 (secure 0 0 0) 0x7f7b300bcb60 con 0x7f7b40100480 2024-09-19T06:07:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:05.196 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"btime":"2024-09-19T06:05:36:880542+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:05:36.431382+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24463,24475,24488]},"id":1}]} 2024-09-19T06:07:05.196 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 24 2024-09-19T06:07:05.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.196+0000 7f7b45be0640 1 -- 172.21.15.103:0/3566514253 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7b280a3240 msgr2=0x7f7b280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:05.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.196+0000 7f7b45be0640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7b280a3240 0x7f7b280a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b34006fd0 tx=0x7f7b34008040 comp rx=0 tx=0).stop 2024-09-19T06:07:05.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.196+0000 7f7b45be0640 1 -- 172.21.15.103:0/3566514253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b40100480 msgr2=0x7f7b401983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:05.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.196+0000 7f7b45be0640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b40100480 0x7f7b401983f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7b30006010 tx=0x7f7b30004270 comp rx=0 tx=0).stop 2024-09-19T06:07:05.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.196+0000 7f7b45be0640 1 -- 172.21.15.103:0/3566514253 shutdown_connections 2024-09-19T06:07:05.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.196+0000 7f7b45be0640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7b280a3240 0x7f7b280a5700 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:05.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.196+0000 7f7b45be0640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b401055b0 0x7f7b4019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:05.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.196+0000 7f7b45be0640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b40100e30 0x7f7b40198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:05.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.196+0000 7f7b45be0640 1 --2- 172.21.15.103:0/3566514253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b40100480 0x7f7b401983f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:05.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.196+0000 7f7b45be0640 1 -- 172.21.15.103:0/3566514253 >> 172.21.15.103:0/3566514253 conn(0x7f7b40077210 msgr2=0x7f7b40103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:05.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.197+0000 7f7b45be0640 1 -- 172.21.15.103:0/3566514253 shutdown_connections 2024-09-19T06:07:05.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:05.197+0000 7f7b45be0640 1 -- 172.21.15.103:0/3566514253 wait complete. 2024-09-19T06:07:05.921 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:05 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3566514253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:05.949 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:07:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:05 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3566514253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:06.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:05 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3566514253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:06.195 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:06.584 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:06 smithi103 ceph-mon[30925]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:07:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.661+0000 7f143bb5f640 1 -- 172.21.15.103:0/575532150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1434074f40 msgr2=0x7f143410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.661+0000 7f143bb5f640 1 --2- 172.21.15.103:0/575532150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1434074f40 0x7f143410de80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1430009900 tx=0x7f143002a480 comp rx=0 tx=0).stop 2024-09-19T06:07:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.661+0000 7f143bb5f640 1 -- 172.21.15.103:0/575532150 shutdown_connections 2024-09-19T06:07:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.661+0000 7f143bb5f640 1 --2- 172.21.15.103:0/575532150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f143410e3c0 0x7f1434110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.661+0000 7f143bb5f640 1 --2- 172.21.15.103:0/575532150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1434074f40 0x7f143410de80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.661+0000 7f143bb5f640 1 --2- 172.21.15.103:0/575532150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1434074620 0x7f1434074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.661+0000 7f143bb5f640 1 -- 172.21.15.103:0/575532150 >> 172.21.15.103:0/575532150 conn(0x7f14340fd8c0 msgr2=0x7f14340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143bb5f640 1 -- 172.21.15.103:0/575532150 shutdown_connections 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143bb5f640 1 -- 172.21.15.103:0/575532150 wait complete. 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143bb5f640 1 Processor -- start 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143bb5f640 1 -- start start 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143bb5f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1434074620 0x7f143419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143bb5f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1434074f40 0x7f143419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143bb5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f143410e3c0 0x7f143419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143bb5f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f14341140e0 con 0x7f143410e3c0 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143bb5f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1434113f60 con 0x7f1434074f40 2024-09-19T06:07:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143bb5f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1434114260 con 0x7f1434074620 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143a0fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f143410e3c0 0x7f143419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143a0fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f143410e3c0 0x7f143419f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39634/0 (socket says 172.21.15.103:39634) 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.662+0000 7f143a0fc640 1 -- 172.21.15.103:0/2315625125 learned_addr learned my addr 172.21.15.103:0/2315625125 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f14398fb640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1434074620 0x7f143419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f14390fa640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1434074f40 0x7f143419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f143a0fc640 1 -- 172.21.15.103:0/2315625125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1434074620 msgr2=0x7f143419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f143a0fc640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1434074620 0x7f143419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f143a0fc640 1 -- 172.21.15.103:0/2315625125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1434074f40 msgr2=0x7f143419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f143a0fc640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1434074f40 0x7f143419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f143a0fc640 1 -- 172.21.15.103:0/2315625125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143419f6f0 con 0x7f143410e3c0 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f14398fb640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1434074620 0x7f143419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f143a0fc640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f143410e3c0 0x7f143419f010 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b970 tx=0x7f142c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f1426ffd640 1 -- 172.21.15.103:0/2315625125 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c019070 con 0x7f143410e3c0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f143bb5f640 1 -- 172.21.15.103:0/2315625125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143419f9e0 con 0x7f143410e3c0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f1426ffd640 1 -- 172.21.15.103:0/2315625125 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f142c014440 con 0x7f143410e3c0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f1426ffd640 1 -- 172.21.15.103:0/2315625125 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c0075d0 con 0x7f143410e3c0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.663+0000 7f143bb5f640 1 -- 172.21.15.103:0/2315625125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14341a72c0 con 0x7f143410e3c0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.664+0000 7f143bb5f640 1 -- 172.21.15.103:0/2315625125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1434074a80 con 0x7f143410e3c0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.665+0000 7f1426ffd640 1 -- 172.21.15.103:0/2315625125 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f142c01c070 con 0x7f143410e3c0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.666+0000 7f1426ffd640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f14200a3240 0x7f14200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.666+0000 7f14398fb640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f14200a3240 0x7f14200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.666+0000 7f1426ffd640 1 -- 172.21.15.103:0/2315625125 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f142c0ceee0 con 0x7f143410e3c0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.666+0000 7f14398fb640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f14200a3240 0x7f14200a5700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1428006fd0 tx=0x7f1428008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.670+0000 7f1426ffd640 1 -- 172.21.15.103:0/2315625125 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f142c09bc30 con 0x7f143410e3c0 2024-09-19T06:07:06.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.873+0000 7f143bb5f640 1 -- 172.21.15.103:0/2315625125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1434109540 con 0x7f143410e3c0 2024-09-19T06:07:06.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.873+0000 7f1426ffd640 1 -- 172.21.15.103:0/2315625125 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11933 (secure 0 0 0) 0x7f142c09b530 con 0x7f143410e3c0 2024-09-19T06:07:06.875 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:06.875 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"btime":"2024-09-19T06:05:36:880542+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:05:36.431382+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24463,24475,24488]},"id":1}]} 2024-09-19T06:07:06.875 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 24 2024-09-19T06:07:06.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.875+0000 7f143bb5f640 1 -- 172.21.15.103:0/2315625125 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f14200a3240 msgr2=0x7f14200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:06.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.875+0000 7f143bb5f640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f14200a3240 0x7f14200a5700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1428006fd0 tx=0x7f1428008040 comp rx=0 tx=0).stop 2024-09-19T06:07:06.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.875+0000 7f143bb5f640 1 -- 172.21.15.103:0/2315625125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f143410e3c0 msgr2=0x7f143419f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:06.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.875+0000 7f143bb5f640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f143410e3c0 0x7f143419f010 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b970 tx=0x7f142c00be30 comp rx=0 tx=0).stop 2024-09-19T06:07:06.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.875+0000 7f143bb5f640 1 -- 172.21.15.103:0/2315625125 shutdown_connections 2024-09-19T06:07:06.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.875+0000 7f143bb5f640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f14200a3240 0x7f14200a5700 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:06.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.875+0000 7f143bb5f640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f143410e3c0 0x7f143419f010 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:06.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.875+0000 7f143bb5f640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1434074f40 0x7f143419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:06.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.875+0000 7f143bb5f640 1 --2- 172.21.15.103:0/2315625125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1434074620 0x7f143419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:06.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.875+0000 7f143bb5f640 1 -- 172.21.15.103:0/2315625125 >> 172.21.15.103:0/2315625125 conn(0x7f14340fd8c0 msgr2=0x7f14340ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:06.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.876+0000 7f143bb5f640 1 -- 172.21.15.103:0/2315625125 shutdown_connections 2024-09-19T06:07:06.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:06.876+0000 7f143bb5f640 1 -- 172.21.15.103:0/2315625125 wait complete. 2024-09-19T06:07:06.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:06 smithi174 ceph-mon[34488]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:07:07.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:06 smithi169 ceph-mon[34350]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:07:07.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:07:07.844 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:07 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2315625125' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:07.961 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:07 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2315625125' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:08.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:07 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2315625125' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:08.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.265+0000 7f907838c640 1 -- 172.21.15.103:0/3077987078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9070105a90 msgr2=0x7f9070105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:08.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.265+0000 7f907838c640 1 --2- 172.21.15.103:0/3077987078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9070105a90 0x7f9070105e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9064009900 tx=0x7f906402a410 comp rx=0 tx=0).stop 2024-09-19T06:07:08.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.265+0000 7f907838c640 1 -- 172.21.15.103:0/3077987078 shutdown_connections 2024-09-19T06:07:08.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.265+0000 7f907838c640 1 --2- 172.21.15.103:0/3077987078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9070101bc0 0x7f907010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.265+0000 7f907838c640 1 --2- 172.21.15.103:0/3077987078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9070101240 0x7f9070101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.265+0000 7f907838c640 1 --2- 172.21.15.103:0/3077987078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9070105a90 0x7f9070105e70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.265+0000 7f907838c640 1 -- 172.21.15.103:0/3077987078 >> 172.21.15.103:0/3077987078 conn(0x7f9070077210 msgr2=0x7f90700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.265+0000 7f907838c640 1 -- 172.21.15.103:0/3077987078 shutdown_connections 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.265+0000 7f907838c640 1 -- 172.21.15.103:0/3077987078 wait complete. 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f907838c640 1 Processor -- start 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f907838c640 1 -- start start 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f907838c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9070101240 0x7f9070197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f907838c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9070101bc0 0x7f9070197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f907838c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9070105a90 0x7f907019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f907838c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9070110e60 con 0x7f9070105a90 2024-09-19T06:07:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f907838c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9070110ce0 con 0x7f9070101bc0 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f907838c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9070110fe0 con 0x7f9070101240 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f9076929640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9070105a90 0x7f907019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f9076929640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9070105a90 0x7f907019bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39652/0 (socket says 172.21.15.103:39652) 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f9076929640 1 -- 172.21.15.103:0/2685872695 learned_addr learned my addr 172.21.15.103:0/2685872695 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f9075927640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9070101bc0 0x7f9070197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f9076128640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9070101240 0x7f9070197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f9076929640 1 -- 172.21.15.103:0/2685872695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9070101240 msgr2=0x7f9070197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f9076929640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9070101240 0x7f9070197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f9076929640 1 -- 172.21.15.103:0/2685872695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9070101bc0 msgr2=0x7f9070197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f9076929640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9070101bc0 0x7f9070197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.266+0000 7f9076929640 1 -- 172.21.15.103:0/2685872695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907019c2f0 con 0x7f9070105a90 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.267+0000 7f9076929640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9070105a90 0x7f907019bc10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f906800b970 tx=0x7f906800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.267+0000 7f90637fe640 1 -- 172.21.15.103:0/2685872695 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068019070 con 0x7f9070105a90 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.267+0000 7f907838c640 1 -- 172.21.15.103:0/2685872695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907019c5e0 con 0x7f9070105a90 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.267+0000 7f90637fe640 1 -- 172.21.15.103:0/2685872695 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9068014440 con 0x7f9070105a90 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.267+0000 7f90637fe640 1 -- 172.21.15.103:0/2685872695 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90680075d0 con 0x7f9070105a90 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.267+0000 7f907838c640 1 -- 172.21.15.103:0/2685872695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90701a3ec0 con 0x7f9070105a90 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.268+0000 7f907838c640 1 -- 172.21.15.103:0/2685872695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9070101680 con 0x7f9070105a90 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.269+0000 7f90637fe640 1 -- 172.21.15.103:0/2685872695 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f906801c070 con 0x7f9070105a90 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.270+0000 7f90637fe640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f905c0a3240 0x7f905c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.270+0000 7f9076128640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f905c0a3240 0x7f905c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.270+0000 7f90637fe640 1 -- 172.21.15.103:0/2685872695 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f90680cee30 con 0x7f9070105a90 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.270+0000 7f9076128640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f905c0a3240 0x7f905c0a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9064005ab0 tx=0x7f9064005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:08.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.274+0000 7f90637fe640 1 -- 172.21.15.103:0/2685872695 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f906809b530 con 0x7f9070105a90 2024-09-19T06:07:08.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.441+0000 7f907838c640 1 -- 172.21.15.103:0/2685872695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9070108fb0 con 0x7f9070105a90 2024-09-19T06:07:08.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.442+0000 7f90637fe640 1 -- 172.21.15.103:0/2685872695 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22681 (secure 0 0 0) 0x7f906809f830 con 0x7f9070105a90 2024-09-19T06:07:08.444 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:08.444 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:05:46.513696+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:05:21.617020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:05:23.597579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.444+0000 7f907838c640 1 -- 172.21.15.103:0/2685872695 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f905c0a3240 msgr2=0x7f905c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.444+0000 7f907838c640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f905c0a3240 0x7f905c0a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9064005ab0 tx=0x7f9064005a20 comp rx=0 tx=0).stop 2024-09-19T06:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.444+0000 7f907838c640 1 -- 172.21.15.103:0/2685872695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9070105a90 msgr2=0x7f907019bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.444+0000 7f907838c640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9070105a90 0x7f907019bc10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f906800b970 tx=0x7f906800be30 comp rx=0 tx=0).stop 2024-09-19T06:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.444+0000 7f907838c640 1 -- 172.21.15.103:0/2685872695 shutdown_connections 2024-09-19T06:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.444+0000 7f907838c640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f905c0a3240 0x7f905c0a5700 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.444+0000 7f907838c640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9070105a90 0x7f907019bc10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.444+0000 7f907838c640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9070101bc0 0x7f9070197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.444+0000 7f907838c640 1 --2- 172.21.15.103:0/2685872695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9070101240 0x7f9070197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.444+0000 7f907838c640 1 -- 172.21.15.103:0/2685872695 >> 172.21.15.103:0/2685872695 conn(0x7f9070077210 msgr2=0x7f9070103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.445+0000 7f907838c640 1 -- 172.21.15.103:0/2685872695 shutdown_connections 2024-09-19T06:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:08.445+0000 7f907838c640 1 -- 172.21.15.103:0/2685872695 wait complete. 2024-09-19T06:07:08.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:08 smithi103 ceph-mon[30925]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:07:08.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:08 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2685872695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:07:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:08 smithi174 ceph-mon[34488]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:07:08.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:08 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2685872695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:07:09.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:08 smithi169 ceph-mon[34350]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:07:09.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:08 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2685872695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:07:09.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:05:25.242328+0000', 'modified': '2024-09-19T06:05:36.431382+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24488, 'mds_1': 24475, 'mds_2': 24463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/3808769732', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 3808769732}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 3808769732}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6835/588815565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 588815565}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 588815565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24455': {'gid': 24455, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6837/2782103866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 2782103866}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 2782103866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.174:6837/2575162107', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 2575162107}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 2575162107}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.174:6839/1070224661', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 1070224661}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 1070224661}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.169:6839/3987841064', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 3987841064}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 3987841064}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24488, 'qdb_cluster': [24463, 24475, 24488]} 2024-09-19T06:07:09.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T06:07:09.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T06:07:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:09.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.818+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/2753994586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c8102dd0 msgr2=0x7fd4c81031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.818+0000 7fd4cd4f4640 1 --2- 172.21.15.103:0/2753994586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c8102dd0 0x7fd4c81031b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009cd0 tx=0x7fd4b802a8d0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.818+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/2753994586 shutdown_connections 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.818+0000 7fd4cd4f4640 1 --2- 172.21.15.103:0/2753994586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c8108300 0x7fd4c810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.818+0000 7fd4cd4f4640 1 --2- 172.21.15.103:0/2753994586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c8103780 0x7fd4c8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.818+0000 7fd4cd4f4640 1 --2- 172.21.15.103:0/2753994586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c8102dd0 0x7fd4c81031b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.818+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/2753994586 >> 172.21.15.103:0/2753994586 conn(0x7fd4c80fc7d0 msgr2=0x7fd4c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.818+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/2753994586 shutdown_connections 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.818+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/2753994586 wait complete. 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4cd4f4640 1 Processor -- start 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4cd4f4640 1 -- start start 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4cd4f4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c8102dd0 0x7fd4c8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4cd4f4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c8103780 0x7fd4c8198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4cd4f4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c8108300 0x7fd4c819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4cd4f4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8111fe0 con 0x7fd4c8102dd0 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4cd4f4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8111e60 con 0x7fd4c8108300 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4cd4f4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8112160 con 0x7fd4c8103780 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4c6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c8102dd0 0x7fd4c8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4c6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c8102dd0 0x7fd4c8198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39662/0 (socket says 172.21.15.103:39662) 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.819+0000 7fd4c6ffd640 1 -- 172.21.15.103:0/4175299232 learned_addr learned my addr 172.21.15.103:0/4175299232 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4c67fc640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c8103780 0x7fd4c8198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c8108300 0x7fd4c819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4c6ffd640 1 -- 172.21.15.103:0/4175299232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c8103780 msgr2=0x7fd4c8198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c8103780 0x7fd4c8198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4c6ffd640 1 -- 172.21.15.103:0/4175299232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c8108300 msgr2=0x7fd4c819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c8108300 0x7fd4c819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4c6ffd640 1 -- 172.21.15.103:0/4175299232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c819d510 con 0x7fd4c8102dd0 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c8108300 0x7fd4c819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c8102dd0 0x7fd4c8198560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8006010 tx=0x7fd4b8032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4affff640 1 -- 172.21.15.103:0/4175299232 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8003970 con 0x7fd4c8102dd0 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4affff640 1 -- 172.21.15.103:0/4175299232 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4b8004040 con 0x7fd4c8102dd0 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4affff640 1 -- 172.21.15.103:0/4175299232 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8030860 con 0x7fd4c8102dd0 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/4175299232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c819d7a0 con 0x7fd4c8102dd0 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.820+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/4175299232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c81a50e0 con 0x7fd4c8102dd0 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.822+0000 7fd4affff640 1 -- 172.21.15.103:0/4175299232 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fd4b8004560 con 0x7fd4c8102dd0 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4cf8cd740 1 Processor -- start 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4cf8cd740 1 -- start start 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4affff640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a3240 0x7fd4b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 0x55b0131c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b013128090 con 0x55b0131ccbb0 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b0130cfa70 con 0x55b0131c19d0 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b013124050 con 0x55b0131c22f0 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a3240 0x7fd4b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4affff640 1 -- 172.21.15.103:0/4175299232 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd4b80f0900 con 0x7fd4c8102dd0 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39674/0 (socket says 172.21.15.103:39674) 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4c77fe640 1 -- 172.21.15.103:0/1133131668 learned_addr learned my addr 172.21.15.103:0/1133131668 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4c67fc640 1 --2- 172.21.15.103:0/1133131668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.823+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/1133131668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 0x55b0131c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.824+0000 7fd4c77fe640 1 -- 172.21.15.103:0/1133131668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 msgr2=0x55b0131cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.824+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/1133131668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.824+0000 7fd4c77fe640 1 -- 172.21.15.103:0/1133131668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 msgr2=0x55b0131c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.824+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/1133131668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 0x55b0131c1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.824+0000 7fd4c77fe640 1 -- 172.21.15.103:0/1133131668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0130dc130 con 0x55b0131ccbb0 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.824+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/1133131668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131cefa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00156d0 tx=0x7fd4c0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e18e8e8b287383 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.824+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a3240 0x7fd4b00a5700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0013650 tx=0x7fd4c0019000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.824+0000 7fd4ad7fa640 1 -- 172.21.15.103:0/1133131668 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0024070 con 0x55b0131ccbb0 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.824+0000 7fd4ad7fa640 1 -- 172.21.15.103:0/1133131668 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4c0009090 con 0x55b0131ccbb0 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.824+0000 7fd4ad7fa640 1 -- 172.21.15.103:0/1133131668 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c000f040 con 0x55b0131ccbb0 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/1133131668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 msgr2=0x55b0131cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/1133131668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131cefa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00156d0 tx=0x7fd4c0009f90 comp rx=0 tx=0).stop 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/1133131668 shutdown_connections 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/1133131668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131cefa0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/1133131668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/1133131668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 0x55b0131c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/1133131668 >> 172.21.15.103:0/1133131668 conn(0x55b0131bdf60 msgr2=0x55b0131be340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/1133131668 shutdown_connections 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/1133131668 wait complete. 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 -- start start 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 Processor -- start 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c19d0 0x55b0131cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c22f0 0x55b0131c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131ccbb0 0x55b0131c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b0131cf780 con 0x55b0131c22f0 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b0130e2f20 con 0x55b0131ccbb0 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b0131cf900 con 0x55b0131c19d0 2024-09-19T06:07:09.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4cf8cd740 10 client.0 _ll_register_callbacks cb 0x55b0130ac030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4c67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c22f0 0x55b0131c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.825+0000 7fd4c67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c22f0 0x55b0131c9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39682/0 (socket says 172.21.15.103:39682) 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4c67fc640 1 -- 172.21.15.103:0/3387279176 learned_addr learned my addr 172.21.15.103:0/3387279176 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131ccbb0 0x55b0131c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c19d0 0x55b0131cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4c67fc640 1 -- 172.21.15.103:0/3387279176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c19d0 msgr2=0x55b0131cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4c67fc640 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c19d0 0x55b0131cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4c67fc640 1 -- 172.21.15.103:0/3387279176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131ccbb0 msgr2=0x55b0131c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4c67fc640 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131ccbb0 0x55b0131c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4c67fc640 1 -- 172.21.15.103:0/3387279176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b012e992b0 con 0x55b0131c22f0 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c19d0 0x55b0131cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4c67fc640 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c22f0 0x55b0131c9800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc011730 tx=0x7fd4bc011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5874874b347a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:09.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4aaff5640 1 -- 172.21.15.103:0/3387279176 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc01e060 con 0x55b0131c22f0 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4aaff5640 1 -- 172.21.15.103:0/3387279176 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd4bc00fe10 con 0x55b0131c22f0 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3387279176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4c0009090 con 0x55b0131c22f0 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4aaff5640 1 -- 172.21.15.103:0/3387279176 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd4bc0193f0 con 0x55b0131c22f0 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4cf8cd740 10 client.15123 fetch_fsmap learned FSMap version 24 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.826+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3387279176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b0131db150 con 0x55b0131c22f0 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4aaff5640 1 -- 172.21.15.103:0/3387279176 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4c0009090 con 0x55b0131c22f0 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4aaff5640 1 -- 172.21.15.103:0/3387279176 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd4bc018030 con 0x55b0131c22f0 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4cf8cd740 10 client.15123 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4cf8cd740 10 client.15123 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4cf8cd740 20 client.15123 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b0131dd790 0x55b0131dec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4cf8cd740 4 client.15123 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:07:09.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3387279176 --> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b013135600 con 0x55b0131dd790 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b0131dd790 0x55b0131dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b0131dd790 0x55b0131dec00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93d78d5f89a91f4c server_cookie=d9d892bacbb38b00 in_seq=0 out_seq=0 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.827+0000 7fd4aaff5640 10 client.15123 ms_handle_connect on v2:172.21.15.174:6836/2575162107 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4aaff5640 1 -- 172.21.15.103:0/3387279176 <== mds.2 v2:172.21.15.174:6836/2575162107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b013135600 con 0x55b0131dd790 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4aaff5640 10 client.15123 handle_command_reply: tid=0 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4cf8cd740 1 client.15123 shutdown 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3387279176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c22f0 msgr2=0x55b0131c9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c22f0 0x55b0131c9800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc011730 tx=0x7fd4bc011bf0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3387279176 shutdown_connections 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131ccbb0 0x55b0131c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b0131dd790 0x55b0131dec00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c22f0 0x55b0131c9800 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/3387279176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c19d0 0x55b0131cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3387279176 >> 172.21.15.103:0/3387279176 conn(0x55b0131bdf60 msgr2=0x55b0131c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:09.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.828+0000 7fd4aaff5640 0 client.15123 ms_handle_reset on v2:172.21.15.174:6836/2575162107 2024-09-19T06:07:09.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.829+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3387279176 shutdown_connections 2024-09-19T06:07:09.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.829+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3387279176 wait complete. 2024-09-19T06:07:09.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.829+0000 7fd4cf8cd740 20 client.15123 trim_cache size 0 max 16384 2024-09-19T06:07:09.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4cf8cd740 1 Processor -- start 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4cf8cd740 1 -- start start 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c19d0 0x55b0131dd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131ccbb0 0x55b0131caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b0131dcf40 con 0x55b0131c19d0 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b0131dd610 con 0x55b0131ccbb0 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b0131ddce0 con 0x55b0131c22f0 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4c6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c19d0 0x55b0131dd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4c6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c19d0 0x55b0131dd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39688/0 (socket says 172.21.15.103:39688) 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.846+0000 7fd4c6ffd640 1 -- 172.21.15.103:0/3414399020 learned_addr learned my addr 172.21.15.103:0/3414399020 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4c6ffd640 1 -- 172.21.15.103:0/3414399020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 msgr2=0x55b0131c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/3414399020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/3414399020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131ccbb0 0x55b0131caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4c6ffd640 1 -- 172.21.15.103:0/3414399020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131ccbb0 msgr2=0x55b0131caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/3414399020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131ccbb0 0x55b0131caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4c6ffd640 1 -- 172.21.15.103:0/3414399020 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0131ca340 con 0x55b0131c19d0 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/3414399020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c19d0 0x55b0131dd790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80b9920 tx=0x7fd4b803e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c3215fb07f3fde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4acff9640 1 -- 172.21.15.103:0/3414399020 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b80bcf50 con 0x55b0131c19d0 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4acff9640 1 -- 172.21.15.103:0/3414399020 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4b8036040 con 0x55b0131c19d0 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4acff9640 1 -- 172.21.15.103:0/3414399020 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b80bb250 con 0x55b0131c19d0 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3414399020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c19d0 msgr2=0x55b0131dd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.847+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/3414399020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c19d0 0x55b0131dd790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80b9920 tx=0x7fd4b803e040 comp rx=0 tx=0).stop 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3414399020 shutdown_connections 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/3414399020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131ccbb0 0x55b0131caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/3414399020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/3414399020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131c19d0 0x55b0131dd790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3414399020 >> 172.21.15.103:0/3414399020 conn(0x55b0131bdf60 msgr2=0x55b0131c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3414399020 shutdown_connections 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/3414399020 wait complete. 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 -- start start 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 Processor -- start 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 0x55b0131e7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131c6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b0131dea80 con 0x55b0131ccbb0 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b0131de3b0 con 0x55b0131c19d0 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b0131df150 con 0x55b0131c22f0 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4cf8cd740 10 client.0 _ll_register_callbacks cb 0x7fd4bc00c690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39696/0 (socket says 172.21.15.103:39696) 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4c77fe640 1 -- 172.21.15.103:0/2262271975 learned_addr learned my addr 172.21.15.103:0/2262271975 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.848+0000 7fd4c67fc640 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 0x55b0131e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4c77fe640 1 -- 172.21.15.103:0/2262271975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 msgr2=0x55b0131c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4c77fe640 1 -- 172.21.15.103:0/2262271975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 msgr2=0x55b0131e7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 0x55b0131e7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4c77fe640 1 -- 172.21.15.103:0/2262271975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0131c6dd0 con 0x55b0131ccbb0 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 0x55b0131e7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4c77fe640 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131c6890 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00156a0 tx=0x7fd4c0018cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb2f73c3e41dc58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4aaff5640 1 -- 172.21.15.103:0/2262271975 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c002e070 con 0x55b0131ccbb0 2024-09-19T06:07:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4aaff5640 1 -- 172.21.15.103:0/2262271975 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd4c002a3f0 con 0x55b0131ccbb0 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/2262271975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4b8036040 con 0x55b0131ccbb0 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4aaff5640 1 -- 172.21.15.103:0/2262271975 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd4c003a050 con 0x55b0131ccbb0 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4cf8cd740 10 client.15129 fetch_fsmap learned FSMap version 24 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/2262271975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b0131e5b50 con 0x55b0131ccbb0 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4aaff5640 1 -- 172.21.15.103:0/2262271975 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4b8036040 con 0x55b0131ccbb0 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.849+0000 7fd4aaff5640 1 -- 172.21.15.103:0/2262271975 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd4c0015040 con 0x55b0131ccbb0 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.850+0000 7fd4cf8cd740 10 client.15129 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.850+0000 7fd4cf8cd740 10 client.15129 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.850+0000 7fd4cf8cd740 20 client.15129 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.850+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b013254c50 0x55b013253960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.850+0000 7fd4cf8cd740 4 client.15129 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.850+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/2262271975 --> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] -- command(tid 0: {"prefix": "status"}) -- 0x55b01312fb10 con 0x55b013254c50 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.850+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b013254c50 0x55b013253960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.850+0000 7fd4c6ffd640 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b013254c50 0x55b013253960 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d7a3493ce3b0d050 server_cookie=f7086c97b804fb78 in_seq=0 out_seq=0 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.850+0000 7fd4aaff5640 10 client.15129 ms_handle_connect on v2:172.21.15.174:6836/2575162107 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4aaff5640 1 -- 172.21.15.103:0/2262271975 <== mds.2 v2:172.21.15.174:6836/2575162107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b01312fb10 con 0x55b013254c50 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4aaff5640 10 client.15129 handle_command_reply: tid=0 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 client.15129 shutdown 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/2262271975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 msgr2=0x55b0131c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131c6890 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00156a0 tx=0x7fd4c0018cf0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/2262271975 shutdown_connections 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b013254c50 0x55b013253960 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b0131ccbb0 0x55b0131c6890 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0131c22f0 0x55b0131c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4aaff5640 0 client.15129 ms_handle_reset on v2:172.21.15.174:6836/2575162107 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 --2- 172.21.15.103:0/2262271975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0131c19d0 0x55b0131e7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/2262271975 >> 172.21.15.103:0/2262271975 conn(0x55b0131bdf60 msgr2=0x55b0131c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:09.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/2262271975 shutdown_connections 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 1 -- 172.21.15.103:0/2262271975 wait complete. 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cf8cd740 20 client.15129 trim_cache size 0 max 16384 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "f3f6d2a8-764b-11ef-bceb-c7b262605968", 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24463, 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 95.984647367999997, 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 24, 2024-09-19T06:07:09.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 80, 2024-09-19T06:07:09.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T06:07:09.860 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 128.53401020699999 2024-09-19T06:07:09.860 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:07:09.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/4175299232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a3240 msgr2=0x7fd4b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cd4f4640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a3240 0x7fd4b00a5700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0013650 tx=0x7fd4c0019000 comp rx=0 tx=0).stop 2024-09-19T06:07:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/4175299232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c8102dd0 msgr2=0x7fd4c8198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.851+0000 7fd4cd4f4640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c8102dd0 0x7fd4c8198560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8006010 tx=0x7fd4b8032c50 comp rx=0 tx=0).stop 2024-09-19T06:07:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.852+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/4175299232 shutdown_connections 2024-09-19T06:07:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.852+0000 7fd4cd4f4640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fd4b00a3240 0x7fd4b00a5700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.852+0000 7fd4cd4f4640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4c8108300 0x7fd4c819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.852+0000 7fd4cd4f4640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c8103780 0x7fd4c8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.852+0000 7fd4cd4f4640 1 --2- 172.21.15.103:0/4175299232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c8102dd0 0x7fd4c8198560 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.852+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/4175299232 >> 172.21.15.103:0/4175299232 conn(0x7fd4c80fc7d0 msgr2=0x7fd4c8105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.852+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/4175299232 shutdown_connections 2024-09-19T06:07:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:09.852+0000 7fd4cd4f4640 1 -- 172.21.15.103:0/4175299232 wait complete. 2024-09-19T06:07:10.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:10 smithi103 ceph-mon[30925]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:07:10.773 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:07:10.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:10 smithi174 ceph-mon[34488]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:07:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:11.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:10 smithi169 ceph-mon[34350]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:07:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.506+0000 7fb25b948640 1 -- 172.21.15.103:0/4106038057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb254102570 msgr2=0x7fb2541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.506+0000 7fb25b948640 1 --2- 172.21.15.103:0/4106038057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb254102570 0x7fb2541029b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb244009900 tx=0x7fb24402a480 comp rx=0 tx=0).stop 2024-09-19T06:07:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.506+0000 7fb25b948640 1 -- 172.21.15.103:0/4106038057 shutdown_connections 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.506+0000 7fb25b948640 1 --2- 172.21.15.103:0/4106038057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254102ef0 0x7fb25410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.506+0000 7fb25b948640 1 --2- 172.21.15.103:0/4106038057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb254102570 0x7fb2541029b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.506+0000 7fb25b948640 1 --2- 172.21.15.103:0/4106038057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb254100e20 0x7fb254101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.506+0000 7fb25b948640 1 -- 172.21.15.103:0/4106038057 >> 172.21.15.103:0/4106038057 conn(0x7fb2540fc7d0 msgr2=0x7fb2540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.506+0000 7fb25b948640 1 -- 172.21.15.103:0/4106038057 shutdown_connections 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.506+0000 7fb25b948640 1 -- 172.21.15.103:0/4106038057 wait complete. 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb25b948640 1 Processor -- start 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb25b948640 1 -- start start 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb25b948640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254100e20 0x7fb2540fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb25b948640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb254102570 0x7fb2540fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb25b948640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb254102ef0 0x7fb2540fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb25b948640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb254110e00 con 0x7fb254102ef0 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb25b948640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb254110c80 con 0x7fb254102570 2024-09-19T06:07:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb25b948640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb254110f80 con 0x7fb254100e20 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb259ee5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb254102ef0 0x7fb2540fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb259ee5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb254102ef0 0x7fb2540fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58930/0 (socket says 172.21.15.103:58930) 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb259ee5640 1 -- 172.21.15.103:0/3587314266 learned_addr learned my addr 172.21.15.103:0/3587314266 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb2596e4640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254100e20 0x7fb2540fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb258ee3640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb254102570 0x7fb2540fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb259ee5640 1 -- 172.21.15.103:0/3587314266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254100e20 msgr2=0x7fb2540fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb259ee5640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254100e20 0x7fb2540fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb259ee5640 1 -- 172.21.15.103:0/3587314266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb254102570 msgr2=0x7fb2540fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb259ee5640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb254102570 0x7fb2540fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb259ee5640 1 -- 172.21.15.103:0/3587314266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2541a6860 con 0x7fb254102ef0 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb2596e4640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254100e20 0x7fb2540fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:11.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.507+0000 7fb259ee5640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb254102ef0 0x7fb2540fd700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00eaa0 tx=0x7fb24c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:11.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.508+0000 7fb24a7fc640 1 -- 172.21.15.103:0/3587314266 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00cdb0 con 0x7fb254102ef0 2024-09-19T06:07:11.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.508+0000 7fb24a7fc640 1 -- 172.21.15.103:0/3587314266 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb24c005020 con 0x7fb254102ef0 2024-09-19T06:07:11.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.508+0000 7fb25b948640 1 -- 172.21.15.103:0/3587314266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2541a6b50 con 0x7fb254102ef0 2024-09-19T06:07:11.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.508+0000 7fb24a7fc640 1 -- 172.21.15.103:0/3587314266 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0116d0 con 0x7fb254102ef0 2024-09-19T06:07:11.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.508+0000 7fb25b948640 1 -- 172.21.15.103:0/3587314266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2541a7040 con 0x7fb254102ef0 2024-09-19T06:07:11.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.510+0000 7fb24a7fc640 1 -- 172.21.15.103:0/3587314266 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fb24c0051d0 con 0x7fb254102ef0 2024-09-19T06:07:11.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.510+0000 7fb25dd21740 1 Processor -- start 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.510+0000 7fb25dd21740 1 -- start start 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb24a7fc640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2400a3240 0x7fb2400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d67db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d682f0 0x562cb2d72670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d72bb0 0x562cb2d74fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb25dd21740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562cb2cce090 con 0x562cb2d72bb0 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb25dd21740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562cb2c75a70 con 0x562cb2d679d0 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb25dd21740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562cb2cca050 con 0x562cb2d682f0 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb258ee3640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2400a3240 0x7fb2400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb24a7fc640 1 -- 172.21.15.103:0/3587314266 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb24c0cfb20 con 0x7fb254102ef0 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb259ee5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d72bb0 0x562cb2d74fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb259ee5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d72bb0 0x562cb2d74fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58932/0 (socket says 172.21.15.103:58932) 2024-09-19T06:07:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb259ee5640 1 -- 172.21.15.103:0/570998251 learned_addr learned my addr 172.21.15.103:0/570998251 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb2596e4640 1 --2- 172.21.15.103:0/570998251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d67db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb258ee3640 1 --2- 172.21.15.103:0/570998251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d682f0 0x562cb2d72670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb259ee5640 1 -- 172.21.15.103:0/570998251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d682f0 msgr2=0x562cb2d72670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb259ee5640 1 --2- 172.21.15.103:0/570998251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d682f0 0x562cb2d72670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb259ee5640 1 -- 172.21.15.103:0/570998251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 msgr2=0x562cb2d67db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb259ee5640 1 --2- 172.21.15.103:0/570998251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d67db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb259ee5640 1 -- 172.21.15.103:0/570998251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cb2c82130 con 0x562cb2d72bb0 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb2596e4640 1 --2- 172.21.15.103:0/570998251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d67db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb259ee5640 1 --2- 172.21.15.103:0/570998251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d72bb0 0x562cb2d74fa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb24c09be70 tx=0x7fb24c09bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49514287c6c5a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb258ee3640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2400a3240 0x7fb2400a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb2540fe710 tx=0x7fb244031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb23f7fe640 1 -- 172.21.15.103:0/570998251 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c01f070 con 0x562cb2d72bb0 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.511+0000 7fb23f7fe640 1 -- 172.21.15.103:0/570998251 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb24c09c170 con 0x562cb2d72bb0 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.512+0000 7fb23f7fe640 1 -- 172.21.15.103:0/570998251 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c005640 con 0x562cb2d72bb0 2024-09-19T06:07:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.512+0000 7fb25dd21740 1 -- 172.21.15.103:0/570998251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d72bb0 msgr2=0x562cb2d74fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.512+0000 7fb25dd21740 1 --2- 172.21.15.103:0/570998251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d72bb0 0x562cb2d74fa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb24c09be70 tx=0x7fb24c09bb90 comp rx=0 tx=0).stop 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.512+0000 7fb25dd21740 1 -- 172.21.15.103:0/570998251 shutdown_connections 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.512+0000 7fb25dd21740 1 --2- 172.21.15.103:0/570998251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d72bb0 0x562cb2d74fa0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.512+0000 7fb25dd21740 1 --2- 172.21.15.103:0/570998251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d682f0 0x562cb2d72670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.512+0000 7fb25dd21740 1 --2- 172.21.15.103:0/570998251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d67db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.512+0000 7fb25dd21740 1 -- 172.21.15.103:0/570998251 >> 172.21.15.103:0/570998251 conn(0x562cb2d63f60 msgr2=0x562cb2d64340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.512+0000 7fb25dd21740 1 -- 172.21.15.103:0/570998251 shutdown_connections 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.512+0000 7fb25dd21740 1 -- 172.21.15.103:0/570998251 wait complete. 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb25dd21740 1 -- start start 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb25dd21740 1 Processor -- start 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d679d0 0x562cb2d723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d6f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d72bb0 0x562cb2d6fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb25dd21740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562cb2d75780 con 0x562cb2d682f0 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb25dd21740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562cb2c88f20 con 0x562cb2d72bb0 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb25dd21740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562cb2d75900 con 0x562cb2d679d0 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb25dd21740 10 client.0 _ll_register_callbacks cb 0x562cb2c52030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb258ee3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d6f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb258ee3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d6f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58940/0 (socket says 172.21.15.103:58940) 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.513+0000 7fb258ee3640 1 -- 172.21.15.103:0/1854571684 learned_addr learned my addr 172.21.15.103:0/1854571684 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb259ee5640 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d72bb0 0x562cb2d6fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb2596e4640 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d679d0 0x562cb2d723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb258ee3640 1 -- 172.21.15.103:0/1854571684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d679d0 msgr2=0x562cb2d723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:11.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb258ee3640 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d679d0 0x562cb2d723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb258ee3640 1 -- 172.21.15.103:0/1854571684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d72bb0 msgr2=0x562cb2d6fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb258ee3640 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d72bb0 0x562cb2d6fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb258ee3640 1 -- 172.21.15.103:0/1854571684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cb2a3f2b0 con 0x562cb2d682f0 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb259ee5640 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d72bb0 0x562cb2d6fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb2596e4640 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d679d0 0x562cb2d723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb258ee3640 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d6f760 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb244033000 tx=0x7fb24402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8300fa7b6179d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb23cff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb23cff9640 1 -- 172.21.15.103:0/1854571684 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24404d070 con 0x562cb2d682f0 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb23cff9640 1 -- 172.21.15.103:0/1854571684 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb2440046c0 con 0x562cb2d682f0 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb25dd21740 1 -- 172.21.15.103:0/1854571684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb24c09c170 con 0x562cb2d682f0 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb23cff9640 1 -- 172.21.15.103:0/1854571684 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb244059050 con 0x562cb2d682f0 2024-09-19T06:07:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb25dd21740 10 client.15141 fetch_fsmap learned FSMap version 24 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb25dd21740 1 -- 172.21.15.103:0/1854571684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562cb2d81070 con 0x562cb2d682f0 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb23cff9640 1 -- 172.21.15.103:0/1854571684 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb24c09c170 con 0x562cb2d682f0 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.514+0000 7fb23cff9640 1 -- 172.21.15.103:0/1854571684 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb244003920 con 0x562cb2d682f0 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.515+0000 7fb25dd21740 10 client.15141 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.515+0000 7fb25dd21740 10 client.15141 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.515+0000 7fb25dd21740 20 client.15141 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.515+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x562cb2d83730 0x562cb2d84ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.515+0000 7fb25dd21740 4 client.15141 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.515+0000 7fb25dd21740 1 -- 172.21.15.103:0/1854571684 --> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cb2cdb600 con 0x562cb2d83730 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.515+0000 7fb2596e4640 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x562cb2d83730 0x562cb2d84ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.515+0000 7fb23cff9640 10 client.15141 ms_handle_connect on v2:172.21.15.174:6838/1070224661 2024-09-19T06:07:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.515+0000 7fb2596e4640 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x562cb2d83730 0x562cb2d84ba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=125f0ee9f41c6223 server_cookie=3fda70043c777399 in_seq=0 out_seq=0 2024-09-19T06:07:11.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.516+0000 7fb23cff9640 1 -- 172.21.15.103:0/1854571684 <== mds.1 v2:172.21.15.174:6838/1070224661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562cb2cdb600 con 0x562cb2d83730 2024-09-19T06:07:11.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.516+0000 7fb23cff9640 10 client.15141 handle_command_reply: tid=0 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.516+0000 7fb25dd21740 1 client.15141 shutdown 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 1 -- 172.21.15.103:0/1854571684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 msgr2=0x562cb2d6f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d6f760 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb244033000 tx=0x7fb24402a480 comp rx=0 tx=0).stop 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 1 -- 172.21.15.103:0/1854571684 shutdown_connections 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x562cb2d83730 0x562cb2d84ba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d72bb0 0x562cb2d6fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d6f760 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1854571684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d679d0 0x562cb2d723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb23cff9640 0 client.15141 ms_handle_reset on v2:172.21.15.174:6838/1070224661 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 1 -- 172.21.15.103:0/1854571684 >> 172.21.15.103:0/1854571684 conn(0x562cb2d63f60 msgr2=0x562cb2d69c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 1 -- 172.21.15.103:0/1854571684 shutdown_connections 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 1 -- 172.21.15.103:0/1854571684 wait complete. 2024-09-19T06:07:11.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.517+0000 7fb25dd21740 20 client.15141 trim_cache size 0 max 16384 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.534+0000 7fb25dd21740 1 Processor -- start 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.534+0000 7fb25dd21740 1 -- start start 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.534+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d6f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d64340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d72bb0 0x562cb2d64880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb25dd21740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562cb2d82ee0 con 0x562cb2d682f0 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb25dd21740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562cb2d835b0 con 0x562cb2d679d0 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb25dd21740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562cb2d83c80 con 0x562cb2d72bb0 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb258ee3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d64340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb258ee3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d64340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58956/0 (socket says 172.21.15.103:58956) 2024-09-19T06:07:11.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb258ee3640 1 -- 172.21.15.103:0/524266996 learned_addr learned my addr 172.21.15.103:0/524266996 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:11.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb2596e4640 1 --2- 172.21.15.103:0/524266996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d6f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb258ee3640 1 -- 172.21.15.103:0/524266996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d72bb0 msgr2=0x562cb2d64880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:11.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb258ee3640 1 --2- 172.21.15.103:0/524266996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d72bb0 0x562cb2d64880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb258ee3640 1 -- 172.21.15.103:0/524266996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 msgr2=0x562cb2d6f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:11.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb258ee3640 1 --2- 172.21.15.103:0/524266996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d6f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb258ee3640 1 -- 172.21.15.103:0/524266996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cb2d63d90 con 0x562cb2d682f0 2024-09-19T06:07:11.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb258ee3640 1 --2- 172.21.15.103:0/524266996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d64340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb244000c00 tx=0x7fb2440098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df561ed6a0b064ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:11.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb23effd640 1 -- 172.21.15.103:0/524266996 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244056020 con 0x562cb2d682f0 2024-09-19T06:07:11.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb23effd640 1 -- 172.21.15.103:0/524266996 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb244003aa0 con 0x562cb2d682f0 2024-09-19T06:07:11.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.535+0000 7fb23effd640 1 -- 172.21.15.103:0/524266996 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24404d040 con 0x562cb2d682f0 2024-09-19T06:07:11.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 -- 172.21.15.103:0/524266996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 msgr2=0x562cb2d64340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:11.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 --2- 172.21.15.103:0/524266996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d64340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb244000c00 tx=0x7fb2440098c0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 -- 172.21.15.103:0/524266996 shutdown_connections 2024-09-19T06:07:11.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 --2- 172.21.15.103:0/524266996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d72bb0 0x562cb2d64880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 --2- 172.21.15.103:0/524266996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d64340 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 --2- 172.21.15.103:0/524266996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d6f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 -- 172.21.15.103:0/524266996 >> 172.21.15.103:0/524266996 conn(0x562cb2d63f60 msgr2=0x562cb2d6e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 -- 172.21.15.103:0/524266996 shutdown_connections 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 -- 172.21.15.103:0/524266996 wait complete. 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 -- start start 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.536+0000 7fb25dd21740 1 Processor -- start 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d8d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d8d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb25dd21740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d72bb0 0x562cb2d6c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb25dd21740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562cb2d84a20 con 0x562cb2d682f0 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb25dd21740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562cb2d84350 con 0x562cb2d679d0 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb25dd21740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562cb2d850f0 con 0x562cb2d72bb0 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb25dd21740 10 client.0 _ll_register_callbacks cb 0x7fb244009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb258ee3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d8d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb258ee3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d8d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58958/0 (socket says 172.21.15.103:58958) 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb258ee3640 1 -- 172.21.15.103:0/1826064806 learned_addr learned my addr 172.21.15.103:0/1826064806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb2596e4640 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d8d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb259ee5640 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d72bb0 0x562cb2d6c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb258ee3640 1 -- 172.21.15.103:0/1826064806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d72bb0 msgr2=0x562cb2d6c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb258ee3640 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d72bb0 0x562cb2d6c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb258ee3640 1 -- 172.21.15.103:0/1826064806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 msgr2=0x562cb2d8d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb258ee3640 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d8d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb258ee3640 1 -- 172.21.15.103:0/1826064806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cb2d6c880 con 0x562cb2d682f0 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb259ee5640 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d72bb0 0x562cb2d6c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb258ee3640 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d8d620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb244009600 tx=0x7fb244004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e4064d6b299c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.537+0000 7fb23cff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb23cff9640 1 -- 172.21.15.103:0/1826064806 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24404d040 con 0x562cb2d682f0 2024-09-19T06:07:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb25dd21740 1 -- 172.21.15.103:0/1826064806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb244003aa0 con 0x562cb2d682f0 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb23cff9640 1 -- 172.21.15.103:0/1826064806 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb2440037f0 con 0x562cb2d682f0 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb23cff9640 1 -- 172.21.15.103:0/1826064806 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb244035050 con 0x562cb2d682f0 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb25dd21740 10 client.15147 fetch_fsmap learned FSMap version 24 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb25dd21740 1 -- 172.21.15.103:0/1826064806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562cb2d8c9e0 con 0x562cb2d682f0 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb23cff9640 1 -- 172.21.15.103:0/1826064806 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb244003aa0 con 0x562cb2d682f0 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb23cff9640 1 -- 172.21.15.103:0/1826064806 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb244049b60 con 0x562cb2d682f0 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb25dd21740 10 client.15147 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb25dd21740 10 client.15147 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb25dd21740 20 client.15147 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x562cb2df2150 0x562cb2df0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb25dd21740 4 client.15147 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.538+0000 7fb25dd21740 1 -- 172.21.15.103:0/1826064806 --> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] -- command(tid 0: {"prefix": "status"}) -- 0x562cb2cd5b10 con 0x562cb2df2150 2024-09-19T06:07:11.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb2596e4640 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x562cb2df2150 0x562cb2df0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb2596e4640 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x562cb2df2150 0x562cb2df0e60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3d1448af090f5189 server_cookie=b79a9b2e301c7077 in_seq=0 out_seq=0 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb23cff9640 10 client.15147 ms_handle_connect on v2:172.21.15.174:6838/1070224661 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb23cff9640 1 -- 172.21.15.103:0/1826064806 <== mds.1 v2:172.21.15.174:6838/1070224661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562cb2cd5b10 con 0x562cb2df2150 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb23cff9640 10 client.15147 handle_command_reply: tid=0 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb25dd21740 1 client.15147 shutdown 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb25dd21740 1 -- 172.21.15.103:0/1826064806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 msgr2=0x562cb2d8d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d8d620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb244009600 tx=0x7fb244004560 comp rx=0 tx=0).stop 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb25dd21740 1 -- 172.21.15.103:0/1826064806 shutdown_connections 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562cb2d72bb0 0x562cb2d6c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562cb2d682f0 0x562cb2d8d620 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x562cb2df2150 0x562cb2df0e60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb25dd21740 1 --2- 172.21.15.103:0/1826064806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562cb2d679d0 0x562cb2d8d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb23cff9640 0 client.15147 ms_handle_reset on v2:172.21.15.174:6838/1070224661 2024-09-19T06:07:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb25dd21740 1 -- 172.21.15.103:0/1826064806 >> 172.21.15.103:0/1826064806 conn(0x562cb2d63f60 msgr2=0x562cb2d64340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:11.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.539+0000 7fb25dd21740 1 -- 172.21.15.103:0/1826064806 shutdown_connections 2024-09-19T06:07:11.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25dd21740 1 -- 172.21.15.103:0/1826064806 wait complete. 2024-09-19T06:07:11.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25dd21740 20 client.15147 trim_cache size 0 max 16384 2024-09-19T06:07:11.548 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:07:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "f3f6d2a8-764b-11ef-bceb-c7b262605968", 2024-09-19T06:07:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-19T06:07:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24475, 2024-09-19T06:07:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T06:07:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T06:07:11.549 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T06:07:11.549 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 98.681911443999994, 2024-09-19T06:07:11.549 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 24, 2024-09-19T06:07:11.549 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 80, 2024-09-19T06:07:11.549 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T06:07:11.549 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 125.462109946 2024-09-19T06:07:11.549 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 -- 172.21.15.103:0/3587314266 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2400a3240 msgr2=0x7fb2400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2400a3240 0x7fb2400a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb2540fe710 tx=0x7fb244031510 comp rx=0 tx=0).stop 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 -- 172.21.15.103:0/3587314266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb254102ef0 msgr2=0x7fb2540fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb254102ef0 0x7fb2540fd700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00eaa0 tx=0x7fb24c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 -- 172.21.15.103:0/3587314266 shutdown_connections 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb2400a3240 0x7fb2400a5700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb254102ef0 0x7fb2540fd700 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb254102570 0x7fb2540fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 --2- 172.21.15.103:0/3587314266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254100e20 0x7fb2540fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 -- 172.21.15.103:0/3587314266 >> 172.21.15.103:0/3587314266 conn(0x7fb2540fc7d0 msgr2=0x7fb25406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 -- 172.21.15.103:0/3587314266 shutdown_connections 2024-09-19T06:07:11.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:11.540+0000 7fb25b948640 1 -- 172.21.15.103:0/3587314266 wait complete. 2024-09-19T06:07:12.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:07:12.478 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:12.876 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:12 smithi103 ceph-mon[30925]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:07:12.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:12 smithi174 ceph-mon[34488]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 -- 172.21.15.103:0/2990984451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca8102ef0 msgr2=0x7f7ca810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 --2- 172.21.15.103:0/2990984451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca8102ef0 0x7f7ca810da40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009ca0 tx=0x7f7ca002a950 comp rx=0 tx=0).stop 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 -- 172.21.15.103:0/2990984451 shutdown_connections 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 --2- 172.21.15.103:0/2990984451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca8102ef0 0x7f7ca810da40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 --2- 172.21.15.103:0/2990984451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ca8102570 0x7f7ca81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 --2- 172.21.15.103:0/2990984451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ca8100e20 0x7f7ca8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 -- 172.21.15.103:0/2990984451 >> 172.21.15.103:0/2990984451 conn(0x7f7ca80fc7d0 msgr2=0x7f7ca80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 -- 172.21.15.103:0/2990984451 shutdown_connections 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 -- 172.21.15.103:0/2990984451 wait complete. 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 Processor -- start 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.953+0000 7f7caed48640 1 -- start start 2024-09-19T06:07:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7caed48640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca8100e20 0x7f7ca8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7caed48640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ca8102570 0x7f7ca8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7caed48640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ca8102ef0 0x7f7ca819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7caed48640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8110ea0 con 0x7f7ca8100e20 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7caed48640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8110d20 con 0x7f7ca8102570 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7caed48640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8111020 con 0x7f7ca8102ef0 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cacae4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca8100e20 0x7f7ca8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cacae4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca8100e20 0x7f7ca8198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58964/0 (socket says 172.21.15.103:58964) 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cacae4640 1 -- 172.21.15.103:0/953718416 learned_addr learned my addr 172.21.15.103:0/953718416 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cad2e5640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ca8102ef0 0x7f7ca819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cacae4640 1 -- 172.21.15.103:0/953718416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ca8102ef0 msgr2=0x7f7ca819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cacae4640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ca8102ef0 0x7f7ca819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cacae4640 1 -- 172.21.15.103:0/953718416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ca8102570 msgr2=0x7f7ca8198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ca8102570 0x7f7ca8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cacae4640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ca8102570 0x7f7ca8198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cacae4640 1 -- 172.21.15.103:0/953718416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca819d3d0 con 0x7f7ca8100e20 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cad2e5640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ca8102ef0 0x7f7ca819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7cacae4640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca8100e20 0x7f7ca8198420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00b4a0 tx=0x7f7c9c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7ca5ffb640 1 -- 172.21.15.103:0/953718416 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c014070 con 0x7f7ca8100e20 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7caed48640 1 -- 172.21.15.103:0/953718416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca819d6c0 con 0x7f7ca8100e20 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7ca5ffb640 1 -- 172.21.15.103:0/953718416 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c9c010ac0 con 0x7f7ca8100e20 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.954+0000 7f7ca5ffb640 1 -- 172.21.15.103:0/953718416 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c017c30 con 0x7f7ca8100e20 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.955+0000 7f7caed48640 1 -- 172.21.15.103:0/953718416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca81a4fa0 con 0x7f7ca8100e20 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7ca5ffb640 1 -- 172.21.15.103:0/953718416 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f7c9c017070 con 0x7f7ca8100e20 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7cb1121740 1 Processor -- start 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7cb1121740 1 -- start start 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7ca5ffb640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7c980a3240 0x7f7c980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f79d0 0x56171a0f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f82f0 0x56171a102670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a102bb0 0x56171a104fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7cb1121740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56171a05e090 con 0x56171a0f82f0 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7cb1121740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56171a005a70 con 0x56171a102bb0 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7cb1121740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56171a05a050 con 0x56171a0f79d0 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7ca7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f82f0 0x56171a102670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7cad2e5640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7c980a3240 0x7f7c980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7ca7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f82f0 0x56171a102670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58976/0 (socket says 172.21.15.103:58976) 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7ca7fff640 1 -- 172.21.15.103:0/2881846541 learned_addr learned my addr 172.21.15.103:0/2881846541 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7ca5ffb640 1 -- 172.21.15.103:0/953718416 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f7c9c0cf070 con 0x7f7ca8100e20 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.957+0000 7f7cacae4640 1 --2- 172.21.15.103:0/2881846541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f79d0 0x56171a0f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.958+0000 7f7ca7fff640 1 -- 172.21.15.103:0/2881846541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f79d0 msgr2=0x56171a0f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.958+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/2881846541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f79d0 0x56171a0f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.958+0000 7f7ca7fff640 1 -- 172.21.15.103:0/2881846541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a102bb0 msgr2=0x56171a104fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.958+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/2881846541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a102bb0 0x56171a104fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.958+0000 7f7ca7fff640 1 -- 172.21.15.103:0/2881846541 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171a012130 con 0x56171a0f82f0 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.958+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/2881846541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f82f0 0x56171a102670 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400ba70 tx=0x7f7c9400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cd107210b1d37d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.958+0000 7f7cad2e5640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7c980a3240 0x7f7c980a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0006010 tx=0x7f7ca0009890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.958+0000 7f7c92ffd640 1 -- 172.21.15.103:0/2881846541 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94017420 con 0x56171a0f82f0 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.958+0000 7f7c92ffd640 1 -- 172.21.15.103:0/2881846541 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c94017a70 con 0x56171a0f82f0 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.958+0000 7f7c92ffd640 1 -- 172.21.15.103:0/2881846541 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400faf0 con 0x56171a0f82f0 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 -- 172.21.15.103:0/2881846541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f82f0 msgr2=0x56171a102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 --2- 172.21.15.103:0/2881846541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f82f0 0x56171a102670 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400ba70 tx=0x7f7c9400bf30 comp rx=0 tx=0).stop 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 -- 172.21.15.103:0/2881846541 shutdown_connections 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 --2- 172.21.15.103:0/2881846541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a102bb0 0x56171a104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 --2- 172.21.15.103:0/2881846541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f82f0 0x56171a102670 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 --2- 172.21.15.103:0/2881846541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f79d0 0x56171a0f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 -- 172.21.15.103:0/2881846541 >> 172.21.15.103:0/2881846541 conn(0x56171a0f3f60 msgr2=0x56171a0f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 -- 172.21.15.103:0/2881846541 shutdown_connections 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 -- 172.21.15.103:0/2881846541 wait complete. 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 -- start start 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.959+0000 7f7cb1121740 1 Processor -- start 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f79d0 0x56171a102400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f82f0 0x56171a0ff750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a102bb0 0x56171a0ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cb1121740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56171a105780 con 0x56171a102bb0 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cb1121740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56171a018f20 con 0x56171a0f79d0 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cb1121740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56171a105900 con 0x56171a0f82f0 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cb1121740 10 client.0 _ll_register_callbacks cb 0x561719fe2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cad2e5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a102bb0 0x56171a0ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cad2e5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a102bb0 0x56171a0ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58980/0 (socket says 172.21.15.103:58980) 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cad2e5640 1 -- 172.21.15.103:0/209985761 learned_addr learned my addr 172.21.15.103:0/209985761 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cacae4640 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f79d0 0x56171a102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f82f0 0x56171a0ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cad2e5640 1 -- 172.21.15.103:0/209985761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f82f0 msgr2=0x56171a0ff750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cad2e5640 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f82f0 0x56171a0ff750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cad2e5640 1 -- 172.21.15.103:0/209985761 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f79d0 msgr2=0x56171a102400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cad2e5640 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f79d0 0x56171a102400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cad2e5640 1 -- 172.21.15.103:0/209985761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561719dcf2b0 con 0x56171a102bb0 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f82f0 0x56171a0ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cad2e5640 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a102bb0 0x56171a0ffc90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009ca0 tx=0x7f7ca002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa2b7e137255ee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7c87fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7c87fff640 1 -- 172.21.15.103:0/209985761 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0034050 con 0x56171a102bb0 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7c87fff640 1 -- 172.21.15.103:0/209985761 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f7ca0004240 con 0x56171a102bb0 2024-09-19T06:07:12.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.960+0000 7f7cb1121740 1 -- 172.21.15.103:0/209985761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c94017a70 con 0x56171a102bb0 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7c87fff640 1 -- 172.21.15.103:0/209985761 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7ca0056050 con 0x56171a102bb0 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7cb1121740 10 client.15159 fetch_fsmap learned FSMap version 24 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7cb1121740 1 -- 172.21.15.103:0/209985761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56171a111050 con 0x56171a102bb0 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7c87fff640 1 -- 172.21.15.103:0/209985761 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c94017a70 con 0x56171a102bb0 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7c87fff640 1 -- 172.21.15.103:0/209985761 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7ca0046040 con 0x56171a102bb0 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7cb1121740 10 client.15159 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7cb1121740 10 client.15159 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7cb1121740 20 client.15159 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7cb1121740 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x56171a113700 0x56171a114b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7cb1121740 4 client.15159 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7cb1121740 1 -- 172.21.15.103:0/209985761 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56171a06b600 con 0x56171a113700 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.961+0000 7f7cacae4640 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x56171a113700 0x56171a114b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.962+0000 7f7cacae4640 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x56171a113700 0x56171a114b70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a8bf03d68649fd0 server_cookie=5d134420c36ffa9c in_seq=0 out_seq=0 2024-09-19T06:07:12.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.962+0000 7f7c87fff640 10 client.15159 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7c87fff640 1 -- 172.21.15.103:0/209985761 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56171a06b600 con 0x56171a113700 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7c87fff640 10 client.15159 handle_command_reply: tid=0 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 client.15159 shutdown 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 -- 172.21.15.103:0/209985761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a102bb0 msgr2=0x56171a0ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a102bb0 0x56171a0ffc90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009ca0 tx=0x7f7ca002a950 comp rx=0 tx=0).stop 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 -- 172.21.15.103:0/209985761 shutdown_connections 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x56171a113700 0x56171a114b70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a102bb0 0x56171a0ffc90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7c87fff640 0 client.15159 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a0f82f0 0x56171a0ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 --2- 172.21.15.103:0/209985761 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f79d0 0x56171a102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 -- 172.21.15.103:0/209985761 >> 172.21.15.103:0/209985761 conn(0x56171a0f3f60 msgr2=0x56171a0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:12.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 -- 172.21.15.103:0/209985761 shutdown_connections 2024-09-19T06:07:12.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 1 -- 172.21.15.103:0/209985761 wait complete. 2024-09-19T06:07:12.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.963+0000 7f7cb1121740 20 client.15159 trim_cache size 0 max 16384 2024-09-19T06:07:12.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.980+0000 7f7cb1121740 1 Processor -- start 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.980+0000 7f7cb1121740 1 -- start start 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a0fec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 0x56171a0fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 0x56171a0fcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cb1121740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56171a112eb0 con 0x56171a0f79d0 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cb1121740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56171a113580 con 0x56171a0f82f0 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cb1121740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56171a113c50 con 0x56171a102bb0 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cacae4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a0fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cacae4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a0fec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58982/0 (socket says 172.21.15.103:58982) 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cacae4640 1 -- 172.21.15.103:0/979659816 learned_addr learned my addr 172.21.15.103:0/979659816 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cad2e5640 1 --2- 172.21.15.103:0/979659816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 0x56171a0fcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/979659816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 0x56171a0fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cacae4640 1 -- 172.21.15.103:0/979659816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 msgr2=0x56171a0fcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:12.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cacae4640 1 --2- 172.21.15.103:0/979659816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 0x56171a0fcf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cacae4640 1 -- 172.21.15.103:0/979659816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 msgr2=0x56171a0fc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:12.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cacae4640 1 --2- 172.21.15.103:0/979659816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 0x56171a0fc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cacae4640 1 -- 172.21.15.103:0/979659816 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171a0f3d90 con 0x56171a0f79d0 2024-09-19T06:07:12.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cad2e5640 1 --2- 172.21.15.103:0/979659816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 0x56171a0fcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:12.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7cacae4640 1 --2- 172.21.15.103:0/979659816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a0fec90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0ccba0 tx=0x7f7c9c0bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60be83377438be60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:12.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7c927fc640 1 -- 172.21.15.103:0/979659816 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c01e040 con 0x56171a0f79d0 2024-09-19T06:07:12.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7c927fc640 1 -- 172.21.15.103:0/979659816 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c9c0a4330 con 0x56171a0f79d0 2024-09-19T06:07:12.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.981+0000 7f7c927fc640 1 -- 172.21.15.103:0/979659816 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c097d30 con 0x56171a0f79d0 2024-09-19T06:07:12.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.982+0000 7f7cb1121740 1 -- 172.21.15.103:0/979659816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 msgr2=0x56171a0fec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:12.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.982+0000 7f7cb1121740 1 --2- 172.21.15.103:0/979659816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a0fec90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0ccba0 tx=0x7f7c9c0bd040 comp rx=0 tx=0).stop 2024-09-19T06:07:12.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.982+0000 7f7cb1121740 1 -- 172.21.15.103:0/979659816 shutdown_connections 2024-09-19T06:07:12.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.982+0000 7f7cb1121740 1 --2- 172.21.15.103:0/979659816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 0x56171a0fcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.982+0000 7f7cb1121740 1 --2- 172.21.15.103:0/979659816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 0x56171a0fc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.982+0000 7f7cb1121740 1 --2- 172.21.15.103:0/979659816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a0fec90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.982+0000 7f7cb1121740 1 -- 172.21.15.103:0/979659816 >> 172.21.15.103:0/979659816 conn(0x56171a0f3f60 msgr2=0x56171a0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.982+0000 7f7cb1121740 1 -- 172.21.15.103:0/979659816 shutdown_connections 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.982+0000 7f7cb1121740 1 -- 172.21.15.103:0/979659816 wait complete. 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.982+0000 7f7cb1121740 1 -- start start 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cb1121740 1 Processor -- start 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a11d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 0x56171a1189e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cb1121740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 0x56171a118ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cb1121740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56171a1149f0 con 0x56171a0f79d0 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cb1121740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56171a114320 con 0x56171a0f82f0 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cb1121740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56171a1150c0 con 0x56171a102bb0 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cb1121740 10 client.0 _ll_register_callbacks cb 0x7f7ca0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cacae4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a11d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cacae4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a11d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58994/0 (socket says 172.21.15.103:58994) 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cacae4640 1 -- 172.21.15.103:0/856838080 learned_addr learned my addr 172.21.15.103:0/856838080 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cad2e5640 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 0x56171a118ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 0x56171a1189e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cacae4640 1 -- 172.21.15.103:0/856838080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 msgr2=0x56171a118ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cacae4640 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 0x56171a118ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cacae4640 1 -- 172.21.15.103:0/856838080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 msgr2=0x56171a1189e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cacae4640 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 0x56171a1189e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7cacae4640 1 -- 172.21.15.103:0/856838080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171a119820 con 0x56171a0f79d0 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.983+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 0x56171a1189e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7cacae4640 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a11d6b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00be60 tx=0x7f7c9c09bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31d56e469f52288 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7c87fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7c87fff640 1 -- 172.21.15.103:0/856838080 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c01e070 con 0x56171a0f79d0 2024-09-19T06:07:12.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7c87fff640 1 -- 172.21.15.103:0/856838080 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f7c9c0ba560 con 0x56171a0f79d0 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7cb1121740 1 -- 172.21.15.103:0/856838080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c9c0a4330 con 0x56171a0f79d0 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7c87fff640 1 -- 172.21.15.103:0/856838080 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7c9c097d30 con 0x56171a0f79d0 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7cb1121740 10 client.15165 fetch_fsmap learned FSMap version 24 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7cb1121740 1 -- 172.21.15.103:0/856838080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56171a17deb0 con 0x56171a0f79d0 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7c87fff640 1 -- 172.21.15.103:0/856838080 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c9c0a4330 con 0x56171a0f79d0 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7c87fff640 1 -- 172.21.15.103:0/856838080 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7c9c080e80 con 0x56171a0f79d0 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7cb1121740 10 client.15165 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7cb1121740 10 client.15165 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7cb1121740 20 client.15165 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7cb1121740 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x56171a1825a0 0x56171a1812b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7cb1121740 4 client.15165 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.984+0000 7f7cb1121740 1 -- 172.21.15.103:0/856838080 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "status"}) -- 0x56171a065b10 con 0x56171a1825a0 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x56171a1825a0 0x56171a1812b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7ca7fff640 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x56171a1825a0 0x56171a1812b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca22ca003b88e56 server_cookie=f27547f999bf4575 in_seq=0 out_seq=0 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7c87fff640 10 client.15165 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7c87fff640 1 -- 172.21.15.103:0/856838080 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x56171a065b10 con 0x56171a1825a0 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7c87fff640 10 client.15165 handle_command_reply: tid=0 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7cb1121740 1 client.15165 shutdown 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7cb1121740 1 -- 172.21.15.103:0/856838080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 msgr2=0x56171a11d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7cb1121740 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a11d6b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00be60 tx=0x7f7c9c09bf30 comp rx=0 tx=0).stop 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7cb1121740 1 -- 172.21.15.103:0/856838080 shutdown_connections 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7cb1121740 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x56171a1825a0 0x56171a1812b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7cb1121740 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56171a102bb0 0x56171a118ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7cb1121740 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56171a0f82f0 0x56171a1189e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7c87fff640 0 client.15165 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7cb1121740 1 --2- 172.21.15.103:0/856838080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56171a0f79d0 0x56171a11d6b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.985+0000 7f7cb1121740 1 -- 172.21.15.103:0/856838080 >> 172.21.15.103:0/856838080 conn(0x56171a0f3f60 msgr2=0x56171a0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:12.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7cb1121740 1 -- 172.21.15.103:0/856838080 shutdown_connections 2024-09-19T06:07:12.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7cb1121740 1 -- 172.21.15.103:0/856838080 wait complete. 2024-09-19T06:07:12.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7cb1121740 20 client.15165 trim_cache size 0 max 16384 2024-09-19T06:07:12.994 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:07:12.994 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "f3f6d2a8-764b-11ef-bceb-c7b262605968", 2024-09-19T06:07:12.994 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-19T06:07:12.994 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24488, 2024-09-19T06:07:12.994 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T06:07:12.994 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T06:07:12.994 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T06:07:12.995 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 107.29353051, 2024-09-19T06:07:12.995 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 24, 2024-09-19T06:07:12.995 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 80, 2024-09-19T06:07:12.995 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T06:07:12.995 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 117.681789573 2024-09-19T06:07:12.995 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:07:12.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 -- 172.21.15.103:0/953718416 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7c980a3240 msgr2=0x7f7c980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:12.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7c980a3240 0x7f7c980a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0006010 tx=0x7f7ca0009890 comp rx=0 tx=0).stop 2024-09-19T06:07:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 -- 172.21.15.103:0/953718416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca8100e20 msgr2=0x7f7ca8198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca8100e20 0x7f7ca8198420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00b4a0 tx=0x7f7c9c00b960 comp rx=0 tx=0).stop 2024-09-19T06:07:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 -- 172.21.15.103:0/953718416 shutdown_connections 2024-09-19T06:07:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f7c980a3240 0x7f7c980a5700 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ca8102ef0 0x7f7ca819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ca8102570 0x7f7ca8198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 --2- 172.21.15.103:0/953718416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca8100e20 0x7f7ca8198420 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 -- 172.21.15.103:0/953718416 >> 172.21.15.103:0/953718416 conn(0x7f7ca80fc7d0 msgr2=0x7f7ca806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 -- 172.21.15.103:0/953718416 shutdown_connections 2024-09-19T06:07:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:12.986+0000 7f7caed48640 1 -- 172.21.15.103:0/953718416 wait complete. 2024-09-19T06:07:13.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:12 smithi169 ceph-mon[34350]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:07:13.651 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T06:07:13.661 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T06:07:13.661 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T06:07:13.662 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T06:07:13.662 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T06:07:13.663 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:07:13.663 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T06:07:13.663 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T06:07:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 -- 172.21.15.103:0/3526101390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8894102670 msgr2=0x7f8894104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 --2- 172.21.15.103:0/3526101390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8894102670 0x7f8894104a60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8890009900 tx=0x7f889002a410 comp rx=0 tx=0).stop 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 -- 172.21.15.103:0/3526101390 shutdown_connections 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 --2- 172.21.15.103:0/3526101390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88941078d0 0x7f8894109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 --2- 172.21.15.103:0/3526101390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8894104fa0 0x7f8894107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 --2- 172.21.15.103:0/3526101390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8894102670 0x7f8894104a60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 -- 172.21.15.103:0/3526101390 >> 172.21.15.103:0/3526101390 conn(0x7f88940fc1b0 msgr2=0x7f88940fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 -- 172.21.15.103:0/3526101390 shutdown_connections 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 -- 172.21.15.103:0/3526101390 wait complete. 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 Processor -- start 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.762+0000 7f889bf6d640 1 -- start start 2024-09-19T06:07:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f889bf6d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8894102670 0x7f8894101fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f889bf6d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8894104fa0 0x7f8894100620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f889bf6d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88941078d0 0x7f8894100b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f889bf6d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f889410d710 con 0x7f8894102670 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f889bf6d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f889410d590 con 0x7f88941078d0 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f889bf6d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f889410d890 con 0x7f8894104fa0 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f8899d09640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8894102670 0x7f8894101fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f8899d09640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8894102670 0x7f8894101fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59020/0 (socket says 172.21.15.103:59020) 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f8899d09640 1 -- 172.21.15.103:0/2993595075 learned_addr learned my addr 172.21.15.103:0/2993595075 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f889a50a640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88941078d0 0x7f8894100b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f8899d09640 1 -- 172.21.15.103:0/2993595075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8894104fa0 msgr2=0x7f8894100620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f8899508640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8894104fa0 0x7f8894100620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f8899d09640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8894104fa0 0x7f8894100620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f8899d09640 1 -- 172.21.15.103:0/2993595075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88941078d0 msgr2=0x7f8894100b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f8899d09640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88941078d0 0x7f8894100b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f8899d09640 1 -- 172.21.15.103:0/2993595075 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88941013f0 con 0x7f8894102670 2024-09-19T06:07:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f889a50a640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88941078d0 0x7f8894100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f8899d09640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8894102670 0x7f8894101fe0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f88900314e0 tx=0x7f8890003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f888affd640 1 -- 172.21.15.103:0/2993595075 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889003f070 con 0x7f8894102670 2024-09-19T06:07:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f888affd640 1 -- 172.21.15.103:0/2993595075 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8890031e40 con 0x7f8894102670 2024-09-19T06:07:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f889bf6d640 1 -- 172.21.15.103:0/2993595075 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88941a1e50 con 0x7f8894102670 2024-09-19T06:07:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f888affd640 1 -- 172.21.15.103:0/2993595075 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890035030 con 0x7f8894102670 2024-09-19T06:07:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.763+0000 7f889bf6d640 1 -- 172.21.15.103:0/2993595075 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88941a2260 con 0x7f8894102670 2024-09-19T06:07:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.764+0000 7f889bf6d640 1 -- 172.21.15.103:0/2993595075 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88940fdca0 con 0x7f8894102670 2024-09-19T06:07:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.765+0000 7f888affd640 1 -- 172.21.15.103:0/2993595075 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f8890042070 con 0x7f8894102670 2024-09-19T06:07:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.766+0000 7f888affd640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f88800a32f0 0x7f88800a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.766+0000 7f8899508640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f88800a32f0 0x7f88800a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.766+0000 7f888affd640 1 -- 172.21.15.103:0/2993595075 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f88900f0220 con 0x7f8894102670 2024-09-19T06:07:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.766+0000 7f8899508640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f88800a32f0 0x7f88800a57b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8884005fd0 tx=0x7f8884005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.770+0000 7f888affd640 1 -- 172.21.15.103:0/2993595075 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f88900bcf70 con 0x7f8894102670 2024-09-19T06:07:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:13.984+0000 7f889bf6d640 1 -- 172.21.15.103:0/2993595075 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f8894062630 con 0x7f8894102670 2024-09-19T06:07:14.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.581+0000 7f888affd640 1 -- 172.21.15.103:0/2993595075 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f88900bc870 con 0x7f8894102670 2024-09-19T06:07:14.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.583+0000 7f889bf6d640 1 -- 172.21.15.103:0/2993595075 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f88800a32f0 msgr2=0x7f88800a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:14.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.583+0000 7f889bf6d640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f88800a32f0 0x7f88800a57b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8884005fd0 tx=0x7f8884005850 comp rx=0 tx=0).stop 2024-09-19T06:07:14.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.583+0000 7f889bf6d640 1 -- 172.21.15.103:0/2993595075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8894102670 msgr2=0x7f8894101fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:14.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.583+0000 7f889bf6d640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8894102670 0x7f8894101fe0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f88900314e0 tx=0x7f8890003c80 comp rx=0 tx=0).stop 2024-09-19T06:07:14.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.583+0000 7f889bf6d640 1 -- 172.21.15.103:0/2993595075 shutdown_connections 2024-09-19T06:07:14.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.583+0000 7f889bf6d640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f88800a32f0 0x7f88800a57b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:14.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.583+0000 7f889bf6d640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88941078d0 0x7f8894100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:14.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.583+0000 7f889bf6d640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8894104fa0 0x7f8894100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:14.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.583+0000 7f889bf6d640 1 --2- 172.21.15.103:0/2993595075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8894102670 0x7f8894101fe0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:14.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.583+0000 7f889bf6d640 1 -- 172.21.15.103:0/2993595075 >> 172.21.15.103:0/2993595075 conn(0x7f88940fc1b0 msgr2=0x7f8894103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:14.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.586+0000 7f889bf6d640 1 -- 172.21.15.103:0/2993595075 shutdown_connections 2024-09-19T06:07:14.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:14.586+0000 7f889bf6d640 1 -- 172.21.15.103:0/2993595075 wait complete. 2024-09-19T06:07:14.607 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T06:07:14.633 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T06:07:14.633 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-19T06:07:14.633 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-19T06:07:14.633 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:07:14.633 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:07:14.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:14.634 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-19T06:07:14.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:14.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-19T06:07:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:Cannot find device "ceph-brx" 2024-09-19T06:07:14.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:07:14.720 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T06:07:14.720 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T06:07:14.721 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T06:07:14.942 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:14 smithi169 ceph-mon[34350]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:07:14.942 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:14 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2993595075' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:07:14.942 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:14 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: ignoring --setuser ceph since I am not root 2024-09-19T06:07:14.943 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:14 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: ignoring --setgroup ceph since I am not root 2024-09-19T06:07:14.943 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:14 smithi169 ceph-mgr[35719]: -- 172.21.15.169:0/3149446509 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56016644f0e0 con 0x56016642d400 2024-09-19T06:07:14.943 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:14 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:14.738+0000 7f5271593040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:07:14.943 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:14 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:14.795+0000 7f5271593040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:07:14.943 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:14 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:14.940+0000 7f5271593040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:07:14.948 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:14 smithi174 ceph-mon[34488]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:07:14.948 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:14 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2993595075' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:07:14.948 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: ignoring --setuser ceph since I am not root 2024-09-19T06:07:14.948 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: ignoring --setgroup ceph since I am not root 2024-09-19T06:07:14.948 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:14 smithi174 ceph-mgr[36297]: -- 172.21.15.174:0/2655171723 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55861c0570e0 con 0x55861c035400 2024-09-19T06:07:14.948 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:14.740+0000 7f74d5812040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:07:14.948 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:14.797+0000 7f74d5812040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:07:14.949 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:14.945+0000 7f74d5812040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:07:14.966 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:14 smithi103 ceph-mon[30925]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T06:07:14.966 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:14 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2993595075' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:07:14.966 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:14 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: ignoring --setuser ceph since I am not root 2024-09-19T06:07:14.967 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:14 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: ignoring --setgroup ceph since I am not root 2024-09-19T06:07:14.967 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:14 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:14.746+0000 7fcf9a793040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:07:14.967 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:14 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:14.807+0000 7fcf9a793040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:07:14.967 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:14 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:14.963+0000 7fcf9a793040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:07:15.023 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:15.204 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:15.012+0000 7f74d5812040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:07:15.204 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:15.159+0000 7f74d5812040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:07:15.243 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:15.043+0000 7fcf9a793040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:07:15.244 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:15.195+0000 7fcf9a793040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:07:15.277 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:15.006+0000 7f5271593040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:07:15.277 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:15.152+0000 7f5271593040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:07:15.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.525+0000 7fb8f028a640 1 -- 172.21.15.103:0/1824130910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8e8101dd0 msgr2=0x7fb8e81021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:15.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.525+0000 7fb8f028a640 1 --2- 172.21.15.103:0/1824130910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8e8101dd0 0x7fb8e81021b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009900 tx=0x7fb8e402a410 comp rx=0 tx=0).stop 2024-09-19T06:07:15.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.525+0000 7fb8f028a640 1 -- 172.21.15.103:0/1824130910 shutdown_connections 2024-09-19T06:07:15.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.525+0000 7fb8f028a640 1 --2- 172.21.15.103:0/1824130910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8e8106f00 0x7fb8e810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.525+0000 7fb8f028a640 1 --2- 172.21.15.103:0/1824130910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e8102780 0x7fb8e81067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.525+0000 7fb8f028a640 1 --2- 172.21.15.103:0/1824130910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8e8101dd0 0x7fb8e81021b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.525+0000 7fb8f028a640 1 -- 172.21.15.103:0/1824130910 >> 172.21.15.103:0/1824130910 conn(0x7fb8e80fd8b0 msgr2=0x7fb8e80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:15.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.525+0000 7fb8f028a640 1 -- 172.21.15.103:0/1824130910 shutdown_connections 2024-09-19T06:07:15.528 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:15.345+0000 7fcf9a793040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:07:15.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.525+0000 7fb8f028a640 1 -- 172.21.15.103:0/1824130910 wait complete. 2024-09-19T06:07:15.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8f028a640 1 Processor -- start 2024-09-19T06:07:15.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8f028a640 1 -- start start 2024-09-19T06:07:15.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8f028a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e8101dd0 0x7fb8e8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8f028a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8e8102780 0x7fb8e81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8f028a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8e8106f00 0x7fb8e819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8f028a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8111e10 con 0x7fb8e8102780 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8f028a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8111c90 con 0x7fb8e8101dd0 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8f028a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8111f90 con 0x7fb8e8106f00 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8ed825640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8e8102780 0x7fb8e81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8ee026640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e8101dd0 0x7fb8e8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8ee827640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8e8106f00 0x7fb8e819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8ee026640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e8101dd0 0x7fb8e8198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:34068/0 (socket says 172.21.15.103:34068) 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.526+0000 7fb8ee026640 1 -- 172.21.15.103:0/1867184693 learned_addr learned my addr 172.21.15.103:0/1867184693 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8ee026640 1 -- 172.21.15.103:0/1867184693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8e8106f00 msgr2=0x7fb8e819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8ee026640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8e8106f00 0x7fb8e819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8ee026640 1 -- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8e8102780 msgr2=0x7fb8e81988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8ee026640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8e8102780 0x7fb8e81988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8ee026640 1 -- 172.21.15.103:0/1867184693 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e819d320 con 0x7fb8e8101dd0 2024-09-19T06:07:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8ee026640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e8101dd0 0x7fb8e8198370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4005940 tx=0x7fb8e40040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8df7fe640 1 -- 172.21.15.103:0/1867184693 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e403f030 con 0x7fb8e8101dd0 2024-09-19T06:07:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8f028a640 1 -- 172.21.15.103:0/1867184693 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e819d5b0 con 0x7fb8e8101dd0 2024-09-19T06:07:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8df7fe640 1 -- 172.21.15.103:0/1867184693 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb8e40044c0 con 0x7fb8e8101dd0 2024-09-19T06:07:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8df7fe640 1 -- 172.21.15.103:0/1867184693 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4035070 con 0x7fb8e8101dd0 2024-09-19T06:07:15.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.527+0000 7fb8f028a640 1 -- 172.21.15.103:0/1867184693 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e81a4ef0 con 0x7fb8e8101dd0 2024-09-19T06:07:15.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.529+0000 7fb8f028a640 1 -- 172.21.15.103:0/1867184693 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e81032b0 con 0x7fb8e8101dd0 2024-09-19T06:07:15.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.529+0000 7fb8df7fe640 1 -- 172.21.15.103:0/1867184693 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 19) ==== 138373+0+0 (secure 0 0 0) 0x7fb8e4042030 con 0x7fb8e8101dd0 2024-09-19T06:07:15.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.530+0000 7fb8df7fe640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8d40a3290 0x7fb8d40a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:15.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.530+0000 7fb8ed825640 1 -- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8d40a3290 msgr2=0x7fb8d40a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/253046125 2024-09-19T06:07:15.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.530+0000 7fb8df7fe640 1 -- 172.21.15.103:0/1867184693 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb8e40efc60 con 0x7fb8e8101dd0 2024-09-19T06:07:15.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.530+0000 7fb8ed825640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8d40a3290 0x7fb8d40a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:07:15.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.534+0000 7fb8df7fe640 1 -- 172.21.15.103:0/1867184693 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8e40bc360 con 0x7fb8e8101dd0 2024-09-19T06:07:15.598 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:15.291+0000 7f5271593040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:07:15.598 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:15.298+0000 7f74d5812040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:07:15.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.731+0000 7fb8ed825640 1 -- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8d40a3290 msgr2=0x7fb8d40a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/253046125 2024-09-19T06:07:15.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.731+0000 7fb8ed825640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8d40a3290 0x7fb8d40a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:07:15.778 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:15 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2993595075' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:07:15.778 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:15 smithi103 ceph-mon[30925]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T06:07:15.778 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:15.712+0000 7fcf9a793040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:07:15.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.793+0000 7fb8f028a640 1 -- 172.21.15.103:0/1867184693 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb8e810a0e0 con 0x7fb8e8101dd0 2024-09-19T06:07:15.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.794+0000 7fb8df7fe640 1 -- 172.21.15.103:0/1867184693 <== mon.2 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fb8e40c0660 con 0x7fb8e8101dd0 2024-09-19T06:07:15.796 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T06:07:15.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 -- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8d40a3290 msgr2=0x7fb8d40a5750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:07:15.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8d40a3290 0x7fb8d40a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 -- 172.21.15.103:0/1867184693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e8101dd0 msgr2=0x7fb8e8198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:15.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e8101dd0 0x7fb8e8198370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4005940 tx=0x7fb8e40040c0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 -- 172.21.15.103:0/1867184693 shutdown_connections 2024-09-19T06:07:15.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7fb8d40a3290 0x7fb8d40a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8e8106f00 0x7fb8e819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8e8102780 0x7fb8e81988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 --2- 172.21.15.103:0/1867184693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e8101dd0 0x7fb8e8198370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:15.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 -- 172.21.15.103:0/1867184693 >> 172.21.15.103:0/1867184693 conn(0x7fb8e80fd8b0 msgr2=0x7fb8e80fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:15.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 -- 172.21.15.103:0/1867184693 shutdown_connections 2024-09-19T06:07:15.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:15.796+0000 7fb8f028a640 1 -- 172.21.15.103:0/1867184693 wait complete. 2024-09-19T06:07:15.855 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:15 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2993595075' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:07:15.855 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:15 smithi174 ceph-mon[34488]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T06:07:15.855 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:15.608+0000 7f74d5812040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:07:15.856 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:15.669+0000 7f74d5812040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:07:16.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:15 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2993595075' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:07:16.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:15 smithi169 ceph-mon[34350]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T06:07:16.028 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:15.599+0000 7f5271593040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:07:16.028 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:15.660+0000 7f5271593040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:07:16.028 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:15.842+0000 7f5271593040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:07:16.123 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:15.775+0000 7fcf9a793040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:07:16.123 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:15.969+0000 7fcf9a793040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:07:16.204 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:15.853+0000 7f74d5812040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:07:16.506 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T06:07:16.506 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:07:16.506 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-19T06:07:16.506 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T06:07:16.506 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:07:16.506 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T06:07:16.506 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:07:16.506 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:07:16.506 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:07:16.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:16.507 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-19T06:07:16.523 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:07:16.524 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:07:16.524 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:07:16.524 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:07:16.524 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-19T06:07:16.524 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:07:16.524 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:07:16.524 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:07:16.524 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-19T06:07:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:07:16.525 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:07:16.525 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-19T06:07:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:07:16.525 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T06:07:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:07:16.525 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T06:07:16.525 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T06:07:16.525 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42219sec preferred_lft 42219sec 2024-09-19T06:07:16.526 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-19T06:07:16.526 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:07:16.526 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:07:16.527 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:07:16.527 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T06:07:16.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:07:16.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-19T06:07:16.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-19T06:07:16.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:07:16.527 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T06:07:16.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:07:16.727 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:16 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1867184693' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:07:16.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:07:16.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:16.738 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:07:16.763 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-19T06:07:16.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:16.764 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-19T06:07:16.839 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-19T06:07:16.839 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:07:16.839 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T06:07:16.839 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T06:07:16.839 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:07:16.840 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:07:16.840 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T06:07:16.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T06:07:16.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T06:07:16.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T06:07:16.840 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T06:07:16.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:07:16.940 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:16 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:16.897+0000 7fcf9a793040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:07:16.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:16 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1867184693' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:07:16.955 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:16.734+0000 7f74d5812040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:07:16.955 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:16.800+0000 7f74d5812040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:07:16.994 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:16 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:16.969+0000 7fcf9a793040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:07:17.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:16 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1867184693' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:07:17.028 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:16 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:16.721+0000 7f5271593040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:07:17.028 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:16 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:16.788+0000 7f5271593040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:07:17.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:07:17.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:17.147 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-19T06:07:17.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:17.162 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-19T06:07:17.218 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:07:17.219 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T06:07:17.219 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:07:17.219 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T06:07:17.219 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T06:07:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:07:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:07:17.339 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T06:07:17.339 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:07:17.339 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T06:07:17.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T06:07:17.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:07:17.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T06:07:17.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T06:07:17.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T06:07:17.340 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T06:07:17.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:07:17.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:07:17.466 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:07:17.466 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T06:07:17.466 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-19T06:07:17.466 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:07:17.466 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T06:07:17.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:07:17.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:07:17.545 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-19T06:07:17.545 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:07:17.545 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T06:07:17.574 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:07:17.574 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:07:17.574 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:07:17.630 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-19T06:07:17.697 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:07:17.747 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:17.489+0000 7f5271593040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:07:17.747 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:17.603+0000 7f5271593040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:07:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-19T06:07:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-19T06:07:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-19T06:07:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-19T06:07:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-19T06:07:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-19T06:07:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/22695eb182d816a6f7db41829412abbcf948cda0731a5807f75319fd481fe394/merged 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/90907ab56feeaaced96780f9552dd31f354299e26f7f9b9e76c173eb1b033778/merged 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/c67e307983f4c004c5e3dfae7f531dbe5b26d4f9ba22f9720faa902e1b9f4595/merged 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/da8726b9e56daf664bc8d3eddbc5b8cfa9f3b4e4ae10cd51a7c466c8f5259d44/merged 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/1988afacd91c62aaaa376c568e192e10149b82d07801baf37644a8caa9b49abe/merged 2024-09-19T06:07:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3c2fea843ca836ae66d6f4cea9a7364e94074d050f8bec1798d30acbc518dce3/merged 2024-09-19T06:07:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/ee2ae6ed2dc17304762d607566a314b63db899b31209de325573917f96694af2/merged 2024-09-19T06:07:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/628eb4a17448437b23aa640ff9442215689f55510b957489e48214438eb7c59b/merged 2024-09-19T06:07:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/9d1e3dd5f81317f1965001ddaad2fe8adb08dcd1ad14c2cce0b9fd12024be156/merged 2024-09-19T06:07:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/942fdde6a7097b055ba6e5212efcaa4cd7372ec54ca6d075e5f75f72fb9184dc/merged 2024-09-19T06:07:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-19T06:07:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:07:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:07:17.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:17.757 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-19T06:07:17.764 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:17.504+0000 7f74d5812040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:07:17.764 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:17.619+0000 7f74d5812040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:07:17.813 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T06:07:17.813 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071 --client_fs=cephfs) 2024-09-19T06:07:17.855 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-19T06:07:17.881 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:07:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-19T06:07:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-19T06:07:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-19T06:07:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/22695eb182d816a6f7db41829412abbcf948cda0731a5807f75319fd481fe394/merged 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/90907ab56feeaaced96780f9552dd31f354299e26f7f9b9e76c173eb1b033778/merged 2024-09-19T06:07:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/c67e307983f4c004c5e3dfae7f531dbe5b26d4f9ba22f9720faa902e1b9f4595/merged 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/da8726b9e56daf664bc8d3eddbc5b8cfa9f3b4e4ae10cd51a7c466c8f5259d44/merged 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/1988afacd91c62aaaa376c568e192e10149b82d07801baf37644a8caa9b49abe/merged 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3c2fea843ca836ae66d6f4cea9a7364e94074d050f8bec1798d30acbc518dce3/merged 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/ee2ae6ed2dc17304762d607566a314b63db899b31209de325573917f96694af2/merged 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/628eb4a17448437b23aa640ff9442215689f55510b957489e48214438eb7c59b/merged 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/9d1e3dd5f81317f1965001ddaad2fe8adb08dcd1ad14c2cce0b9fd12024be156/merged 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/942fdde6a7097b055ba6e5212efcaa4cd7372ec54ca6d075e5f75f72fb9184dc/merged 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:07:17.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:17.942 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-19T06:07:17.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-19T06:07:17.961+0000 7f9f1c11f480 -1 init, newargv = 0x56143eab49a0 newargc=15 2024-09-19T06:07:17.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[83404]: starting ceph client 2024-09-19T06:07:17.977 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[83404]: starting fuse 2024-09-19T06:07:17.981 INFO:teuthology.orchestra.run.smithi103.stdout:120 2024-09-19T06:07:17.981 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T06:07:17.982 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-19T06:07:17.983 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-19T06:07:17.994 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:17.739+0000 7fcf9a793040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:07:17.994 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:17.860+0000 7fcf9a793040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:07:18.025 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:17.745+0000 7f5271593040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:07:18.026 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:17.806+0000 7f5271593040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:07:18.026 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:17.954+0000 7f5271593040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:07:18.026 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:18.024+0000 7f5271593040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:07:18.045 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:17.762+0000 7f74d5812040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:07:18.045 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:17.824+0000 7f74d5812040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:07:18.045 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:17.975+0000 7f74d5812040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:07:18.045 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:18.043+0000 7f74d5812040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:07:18.074 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.83404.asok 2024-09-19T06:07:18.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:07:18.085 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.83404.asok 2024-09-19T06:07:18.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:18.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.83404.asok status 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "83404", 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071" 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:07:18.222 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 15201, 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 15201 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 283186530 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T06:07:18.223 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 283186530 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.15201 192.168.0.1:0/283186530", 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/283186530", 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 5, 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 24, 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 80, 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-19T06:07:18.224 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:07:18.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:18.231 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-19T06:07:18.231 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T06:07:18.247 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-19T06:07:18.247 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T06:07:18.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:07:18.247 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:07:18.277 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:18.084+0000 7f5271593040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:07:18.277 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:18.241+0000 7f5271593040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:07:18.309 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.020+0000 7fcf9a793040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:07:18.309 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.086+0000 7fcf9a793040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:07:18.309 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.245+0000 7fcf9a793040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:07:18.314 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T06:07:18.324 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:07:18.324 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T06:07:18.324 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T06:07:18.329 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:18.104+0000 7f74d5812040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:07:18.330 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:18.263+0000 7f74d5812040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:07:18.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.454+0000 7f76d96c9640 1 -- 172.21.15.103:0/901857936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d4100a40 msgr2=0x7f76d4100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:18.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.454+0000 7f76d96c9640 1 --2- 172.21.15.103:0/901857936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d4100a40 0x7f76d4100e40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009900 tx=0x7f76c402a410 comp rx=0 tx=0).stop 2024-09-19T06:07:18.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.454+0000 7f76d96c9640 1 -- 172.21.15.103:0/901857936 shutdown_connections 2024-09-19T06:07:18.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.454+0000 7f76d96c9640 1 --2- 172.21.15.103:0/901857936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d41025f0 0x7f76d4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.454+0000 7f76d96c9640 1 --2- 172.21.15.103:0/901857936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76d4101c30 0x7f76d41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.454+0000 7f76d96c9640 1 --2- 172.21.15.103:0/901857936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d4100a40 0x7f76d4100e40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.454+0000 7f76d96c9640 1 -- 172.21.15.103:0/901857936 >> 172.21.15.103:0/901857936 conn(0x7f76d40fc1e0 msgr2=0x7f76d40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.454+0000 7f76d96c9640 1 -- 172.21.15.103:0/901857936 shutdown_connections 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.454+0000 7f76d96c9640 1 -- 172.21.15.103:0/901857936 wait complete. 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.455+0000 7f76d96c9640 1 Processor -- start 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.455+0000 7f76d96c9640 1 -- start start 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.455+0000 7f76d96c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d4100a40 0x7f76d41049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.455+0000 7f76d96c9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d4101c30 0x7f76d4103010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.455+0000 7f76d96c9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76d41025f0 0x7f76d4103550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.455+0000 7f76d96c9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f76d410c5a0 con 0x7f76d4101c30 2024-09-19T06:07:18.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.455+0000 7f76d96c9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f76d410c420 con 0x7f76d4100a40 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.455+0000 7f76d96c9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f76d410c720 con 0x7f76d41025f0 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.455+0000 7f76d27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d4101c30 0x7f76d4103010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d2ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d4100a40 0x7f76d41049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d2ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d4100a40 0x7f76d41049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:34092/0 (socket says 172.21.15.103:34092) 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d37fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76d41025f0 0x7f76d4103550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d2ffd640 1 -- 172.21.15.103:0/3231919427 learned_addr learned my addr 172.21.15.103:0/3231919427 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d2ffd640 1 -- 172.21.15.103:0/3231919427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76d41025f0 msgr2=0x7f76d4103550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d2ffd640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76d41025f0 0x7f76d4103550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d2ffd640 1 -- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d4101c30 msgr2=0x7f76d4103010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d2ffd640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d4101c30 0x7f76d4103010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d2ffd640 1 -- 172.21.15.103:0/3231919427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d4103de0 con 0x7f76d4100a40 2024-09-19T06:07:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d2ffd640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d4100a40 0x7f76d41049d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f76c40314e0 tx=0x7f76c4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:18.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76cbfff640 1 -- 172.21.15.103:0/3231919427 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c403f070 con 0x7f76d4100a40 2024-09-19T06:07:18.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d96c9640 1 -- 172.21.15.103:0/3231919427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d41a1db0 con 0x7f76d4100a40 2024-09-19T06:07:18.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76cbfff640 1 -- 172.21.15.103:0/3231919427 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f76c4031c40 con 0x7f76d4100a40 2024-09-19T06:07:18.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76cbfff640 1 -- 172.21.15.103:0/3231919427 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4035030 con 0x7f76d4100a40 2024-09-19T06:07:18.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.456+0000 7f76d96c9640 1 -- 172.21.15.103:0/3231919427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d41a2220 con 0x7f76d4100a40 2024-09-19T06:07:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.457+0000 7f76d96c9640 1 -- 172.21.15.103:0/3231919427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d41a2450 con 0x7f76d4100a40 2024-09-19T06:07:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.459+0000 7f76cbfff640 1 -- 172.21.15.103:0/3231919427 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 19) ==== 138373+0+0 (secure 0 0 0) 0x7f76c4042070 con 0x7f76d4100a40 2024-09-19T06:07:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.460+0000 7f76cbfff640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f76c00a3340 0x7f76c00a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.460+0000 7f76d27fc640 1 -- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f76c00a3340 msgr2=0x7f76c00a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/253046125 2024-09-19T06:07:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.460+0000 7f76cbfff640 1 -- 172.21.15.103:0/3231919427 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f76c40f0410 con 0x7f76d4100a40 2024-09-19T06:07:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.460+0000 7f76d27fc640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f76c00a3340 0x7f76c00a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:07:18.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.462+0000 7f76cbfff640 1 -- 172.21.15.103:0/3231919427 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f76c40bcb10 con 0x7f76d4100a40 2024-09-19T06:07:18.572 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:18.306+0000 7f5271593040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:07:18.572 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:18.371+0000 7f5271593040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:07:18.572 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:18.453+0000 7f5271593040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:07:18.572 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:18.512+0000 7f5271593040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:07:18.572 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:18.570+0000 7f5271593040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:07:18.596 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:18.328+0000 7f74d5812040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:07:18.596 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:18.394+0000 7f74d5812040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:07:18.596 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:18.476+0000 7f74d5812040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:07:18.596 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:18.536+0000 7f74d5812040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:07:18.596 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:18.594+0000 7f74d5812040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:07:18.616 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.317+0000 7fcf9a793040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:07:18.616 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.380+0000 7fcf9a793040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:07:18.617 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.547+0000 7fcf9a793040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:07:18.617 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.614+0000 7fcf9a793040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:07:18.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.661+0000 7f76d27fc640 1 -- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f76c00a3340 msgr2=0x7f76c00a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/253046125 2024-09-19T06:07:18.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.661+0000 7f76d27fc640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f76c00a3340 0x7f76c00a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:07:18.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.669+0000 7f76d96c9640 1 -- 172.21.15.103:0/3231919427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f76d41a27e0 con 0x7f76d4100a40 2024-09-19T06:07:18.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.724+0000 7f76cbfff640 1 -- 172.21.15.103:0/3231919427 <== mon.2 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f76c40c0e10 con 0x7f76d4100a40 2024-09-19T06:07:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.726+0000 7f76d96c9640 1 -- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f76c00a3340 msgr2=0x7f76c00a5800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:07:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.726+0000 7f76d96c9640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f76c00a3340 0x7f76c00a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.726+0000 7f76d96c9640 1 -- 172.21.15.103:0/3231919427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d4100a40 msgr2=0x7f76d41049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.726+0000 7f76d96c9640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d4100a40 0x7f76d41049d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f76c40314e0 tx=0x7f76c4003c10 comp rx=0 tx=0).stop 2024-09-19T06:07:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.727+0000 7f76d96c9640 1 -- 172.21.15.103:0/3231919427 shutdown_connections 2024-09-19T06:07:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.727+0000 7f76d96c9640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f76c00a3340 0x7f76c00a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.727+0000 7f76d96c9640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76d41025f0 0x7f76d4103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.727+0000 7f76d96c9640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d4101c30 0x7f76d4103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.727+0000 7f76d96c9640 1 --2- 172.21.15.103:0/3231919427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76d4100a40 0x7f76d41049d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.727+0000 7f76d96c9640 1 -- 172.21.15.103:0/3231919427 >> 172.21.15.103:0/3231919427 conn(0x7f76d40fc1e0 msgr2=0x7f76d40fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.727+0000 7f76d96c9640 1 -- 172.21.15.103:0/3231919427 shutdown_connections 2024-09-19T06:07:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.727+0000 7f76d96c9640 1 -- 172.21.15.103:0/3231919427 wait complete. 2024-09-19T06:07:18.740 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T06:07:18.750 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T06:07:18.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:07:18.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.860+0000 7f8609a42640 1 -- 172.21.15.103:0/3953640433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86041025b0 msgr2=0x7f86041049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:18.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.860+0000 7f8609a42640 1 --2- 172.21.15.103:0/3953640433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86041025b0 0x7f86041049a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009860 tx=0x7f85f402a340 comp rx=0 tx=0).stop 2024-09-19T06:07:18.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.860+0000 7f8609a42640 1 -- 172.21.15.103:0/3953640433 shutdown_connections 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.860+0000 7f8609a42640 1 --2- 172.21.15.103:0/3953640433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8604107810 0x7f8604109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.860+0000 7f8609a42640 1 --2- 172.21.15.103:0/3953640433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8604104ee0 0x7f86041072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.860+0000 7f8609a42640 1 --2- 172.21.15.103:0/3953640433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86041025b0 0x7f86041049a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.860+0000 7f8609a42640 1 -- 172.21.15.103:0/3953640433 >> 172.21.15.103:0/3953640433 conn(0x7f86040fc1b0 msgr2=0x7f86040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.860+0000 7f8609a42640 1 -- 172.21.15.103:0/3953640433 shutdown_connections 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.860+0000 7f8609a42640 1 -- 172.21.15.103:0/3953640433 wait complete. 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f8609a42640 1 Processor -- start 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f8609a42640 1 -- start start 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f8609a42640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86041025b0 0x7f8604197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f8609a42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8604104ee0 0x7f86041983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f8609a42640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8604107810 0x7f860419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f8609a42640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f860410d6c0 con 0x7f8604104ee0 2024-09-19T06:07:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f8609a42640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f860410d540 con 0x7f8604107810 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f8609a42640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f860410d840 con 0x7f86041025b0 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f86027fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8604104ee0 0x7f86041983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f86027fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8604104ee0 0x7f86041983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59084/0 (socket says 172.21.15.103:59084) 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f86027fc640 1 -- 172.21.15.103:0/3670189224 learned_addr learned my addr 172.21.15.103:0/3670189224 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f86037fe640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8604107810 0x7f860419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.861+0000 7f8602ffd640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86041025b0 0x7f8604197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f86027fc640 1 -- 172.21.15.103:0/3670189224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86041025b0 msgr2=0x7f8604197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f86027fc640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86041025b0 0x7f8604197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f86027fc640 1 -- 172.21.15.103:0/3670189224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8604107810 msgr2=0x7f860419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f86027fc640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8604107810 0x7f860419f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f86027fc640 1 -- 172.21.15.103:0/3670189224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860419fab0 con 0x7f8604104ee0 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f86037fe640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8604107810 0x7f860419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:07:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f86027fc640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8604104ee0 0x7f86041983d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f85f800e9f0 tx=0x7f85f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f8608a40640 1 -- 172.21.15.103:0/3670189224 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f800ccc0 con 0x7f8604104ee0 2024-09-19T06:07:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f8609a42640 1 -- 172.21.15.103:0/3670189224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860419fda0 con 0x7f8604104ee0 2024-09-19T06:07:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f8608a40640 1 -- 172.21.15.103:0/3670189224 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85f80054d0 con 0x7f8604104ee0 2024-09-19T06:07:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f8608a40640 1 -- 172.21.15.103:0/3670189224 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8010430 con 0x7f8604104ee0 2024-09-19T06:07:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.862+0000 7f8609a42640 1 -- 172.21.15.103:0/3670189224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86041a0260 con 0x7f8604104ee0 2024-09-19T06:07:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.863+0000 7f8609a42640 1 -- 172.21.15.103:0/3670189224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86040fdca0 con 0x7f8604104ee0 2024-09-19T06:07:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.865+0000 7f8608a40640 1 -- 172.21.15.103:0/3670189224 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 138373+0+0 (secure 0 0 0) 0x7f85f8005020 con 0x7f8604104ee0 2024-09-19T06:07:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.865+0000 7f8608a40640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f85ec0a32a0 0x7f85ec0a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.865+0000 7f8602ffd640 1 -- 172.21.15.103:0/3670189224 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f85ec0a32a0 msgr2=0x7f85ec0a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/253046125 2024-09-19T06:07:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.866+0000 7f8608a40640 1 -- 172.21.15.103:0/3670189224 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f85f80cfcc0 con 0x7f8604104ee0 2024-09-19T06:07:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.866+0000 7f8602ffd640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f85ec0a32a0 0x7f85ec0a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:07:18.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:18.870+0000 7f8608a40640 1 -- 172.21.15.103:0/3670189224 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f85f809ca10 con 0x7f8604104ee0 2024-09-19T06:07:18.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3231919427' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:07:18.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-mon[30925]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:07:18.901 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.683+0000 7fcf9a793040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:07:18.902 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.770+0000 7fcf9a793040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:07:18.902 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.834+0000 7fcf9a793040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:07:18.902 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:18.899+0000 7fcf9a793040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:07:18.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:18 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3231919427' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:07:18.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:18 smithi174 ceph-mon[34488]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:07:19.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:18 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3231919427' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:07:19.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:18 smithi169 ceph-mon[34350]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:07:19.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.044+0000 7f8609a42640 1 -- 172.21.15.103:0/3670189224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8604062e90 con 0x7f8604104ee0 2024-09-19T06:07:19.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.045+0000 7f8608a40640 1 -- 172.21.15.103:0/3670189224 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22681 (secure 0 0 0) 0x7f85f809c310 con 0x7f8604104ee0 2024-09-19T06:07:19.048 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:19.048 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:05:46.513696+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:05:21.617020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:05:23.597579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:07:19.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.047+0000 7f8609a42640 1 -- 172.21.15.103:0/3670189224 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f85ec0a32a0 msgr2=0x7f85ec0a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:07:19.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.047+0000 7f8609a42640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f85ec0a32a0 0x7f85ec0a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.048+0000 7f8609a42640 1 -- 172.21.15.103:0/3670189224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8604104ee0 msgr2=0x7f86041983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.048+0000 7f8609a42640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8604104ee0 0x7f86041983d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f85f800e9f0 tx=0x7f85f800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.048+0000 7f8609a42640 1 -- 172.21.15.103:0/3670189224 shutdown_connections 2024-09-19T06:07:19.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.048+0000 7f8609a42640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f85ec0a32a0 0x7f85ec0a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.048+0000 7f8609a42640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8604107810 0x7f860419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.048+0000 7f8609a42640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8604104ee0 0x7f86041983d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.048+0000 7f8609a42640 1 --2- 172.21.15.103:0/3670189224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86041025b0 0x7f8604197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.048+0000 7f8609a42640 1 -- 172.21.15.103:0/3670189224 >> 172.21.15.103:0/3670189224 conn(0x7f86040fc1b0 msgr2=0x7f8604102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:19.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.048+0000 7f8609a42640 1 -- 172.21.15.103:0/3670189224 shutdown_connections 2024-09-19T06:07:19.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.048+0000 7f8609a42640 1 -- 172.21.15.103:0/3670189224 wait complete. 2024-09-19T06:07:19.061 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:00:59.680195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:05:21.617020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:05:23.597579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:07:19.062 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:07:19.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.163+0000 7f768796d640 1 -- 172.21.15.103:0/325961224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7680100a00 msgr2=0x7f7680100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 --2- 172.21.15.103:0/325961224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7680100a00 0x7f7680100e00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f767c009900 tx=0x7f767c02a410 comp rx=0 tx=0).stop 2024-09-19T06:07:19.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 -- 172.21.15.103:0/325961224 shutdown_connections 2024-09-19T06:07:19.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 --2- 172.21.15.103:0/325961224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76801025b0 0x7f7680108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 --2- 172.21.15.103:0/325961224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7680101bf0 0x7f7680102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 --2- 172.21.15.103:0/325961224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7680100a00 0x7f7680100e00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 -- 172.21.15.103:0/325961224 >> 172.21.15.103:0/325961224 conn(0x7f76800fc140 msgr2=0x7f76800fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 -- 172.21.15.103:0/325961224 shutdown_connections 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 -- 172.21.15.103:0/325961224 wait complete. 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 Processor -- start 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 -- start start 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7680100a00 0x7f7680197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7680101bf0 0x7f76801982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76801025b0 0x7f768019f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f768010c510 con 0x7f7680101bf0 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f768010c390 con 0x7f7680100a00 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.164+0000 7f768796d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f768010c690 con 0x7f76801025b0 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7684f08640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7680101bf0 0x7f76801982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7684f08640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7680101bf0 0x7f76801982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59094/0 (socket says 172.21.15.103:59094) 2024-09-19T06:07:19.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7684f08640 1 -- 172.21.15.103:0/3515086134 learned_addr learned my addr 172.21.15.103:0/3515086134 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7685709640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7680100a00 0x7f7680197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7685f0a640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76801025b0 0x7f768019f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7684f08640 1 -- 172.21.15.103:0/3515086134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76801025b0 msgr2=0x7f768019f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7684f08640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76801025b0 0x7f768019f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7684f08640 1 -- 172.21.15.103:0/3515086134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7680100a00 msgr2=0x7f7680197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7684f08640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7680100a00 0x7f7680197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7684f08640 1 -- 172.21.15.103:0/3515086134 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768019f9d0 con 0x7f7680101bf0 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7685f0a640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76801025b0 0x7f768019f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f7684f08640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7680101bf0 0x7f76801982f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f767000d950 tx=0x7f767000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f76767fc640 1 -- 172.21.15.103:0/3515086134 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670017030 con 0x7f7680101bf0 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f76767fc640 1 -- 172.21.15.103:0/3515086134 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7670004020 con 0x7f7680101bf0 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f768796d640 1 -- 172.21.15.103:0/3515086134 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768019fcc0 con 0x7f7680101bf0 2024-09-19T06:07:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f76767fc640 1 -- 172.21.15.103:0/3515086134 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76700047a0 con 0x7f7680101bf0 2024-09-19T06:07:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.165+0000 7f768796d640 1 -- 172.21.15.103:0/3515086134 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76801a0200 con 0x7f7680101bf0 2024-09-19T06:07:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.166+0000 7f768796d640 1 -- 172.21.15.103:0/3515086134 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76801a0490 con 0x7f7680101bf0 2024-09-19T06:07:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.168+0000 7f76767fc640 1 -- 172.21.15.103:0/3515086134 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 138373+0+0 (secure 0 0 0) 0x7f76700041d0 con 0x7f7680101bf0 2024-09-19T06:07:19.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.168+0000 7f76767fc640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f766c0a3320 0x7f766c0a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.168+0000 7f7685709640 1 -- 172.21.15.103:0/3515086134 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f766c0a3320 msgr2=0x7f766c0a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/253046125 2024-09-19T06:07:19.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.169+0000 7f76767fc640 1 -- 172.21.15.103:0/3515086134 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f76700cf3e0 con 0x7f7680101bf0 2024-09-19T06:07:19.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.169+0000 7f7685709640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f766c0a3320 0x7f766c0a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:07:19.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.172+0000 7f76767fc640 1 -- 172.21.15.103:0/3515086134 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f767009c130 con 0x7f7680101bf0 2024-09-19T06:07:19.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.342+0000 7f768796d640 1 -- 172.21.15.103:0/3515086134 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f76801a0660 con 0x7f7680101bf0 2024-09-19T06:07:19.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.343+0000 7f76767fc640 1 -- 172.21.15.103:0/3515086134 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f767009ba30 con 0x7f7680101bf0 2024-09-19T06:07:19.345 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-19T06:07:19.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 -- 172.21.15.103:0/3515086134 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f766c0a3320 msgr2=0x7f766c0a57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:07:19.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f766c0a3320 0x7f766c0a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 -- 172.21.15.103:0/3515086134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7680101bf0 msgr2=0x7f76801982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7680101bf0 0x7f76801982f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f767000d950 tx=0x7f767000de10 comp rx=0 tx=0).stop 2024-09-19T06:07:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 -- 172.21.15.103:0/3515086134 shutdown_connections 2024-09-19T06:07:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7f766c0a3320 0x7f766c0a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76801025b0 0x7f768019f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7680101bf0 0x7f76801982f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 --2- 172.21.15.103:0/3515086134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7680100a00 0x7f7680197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 -- 172.21.15.103:0/3515086134 >> 172.21.15.103:0/3515086134 conn(0x7f76800fc140 msgr2=0x7f76800693b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 -- 172.21.15.103:0/3515086134 shutdown_connections 2024-09-19T06:07:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.345+0000 7f768796d640 1 -- 172.21.15.103:0/3515086134 wait complete. 2024-09-19T06:07:19.358 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:07:19.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.461+0000 7febbcc47640 1 -- 172.21.15.103:0/993456662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febb8100a10 msgr2=0x7febb8100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.461+0000 7febbcc47640 1 --2- 172.21.15.103:0/993456662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febb8100a10 0x7febb8100e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feba8009860 tx=0x7feba802a340 comp rx=0 tx=0).stop 2024-09-19T06:07:19.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.462+0000 7febbcc47640 1 -- 172.21.15.103:0/993456662 shutdown_connections 2024-09-19T06:07:19.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.462+0000 7febbcc47640 1 --2- 172.21.15.103:0/993456662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb81025c0 0x7febb8108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.462+0000 7febbcc47640 1 --2- 172.21.15.103:0/993456662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb8101c00 0x7febb8102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.462+0000 7febbcc47640 1 --2- 172.21.15.103:0/993456662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febb8100a10 0x7febb8100e10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.462+0000 7febbcc47640 1 -- 172.21.15.103:0/993456662 >> 172.21.15.103:0/993456662 conn(0x7febb80fc190 msgr2=0x7febb80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:19.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.462+0000 7febbcc47640 1 -- 172.21.15.103:0/993456662 shutdown_connections 2024-09-19T06:07:19.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.462+0000 7febbcc47640 1 -- 172.21.15.103:0/993456662 wait complete. 2024-09-19T06:07:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.462+0000 7febbcc47640 1 Processor -- start 2024-09-19T06:07:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.462+0000 7febbcc47640 1 -- start start 2024-09-19T06:07:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.462+0000 7febbcc47640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb8100a10 0x7febb8196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febbcc47640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb8101c00 0x7febb8197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febbcc47640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febb81025c0 0x7febb819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febbcc47640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7febb810c520 con 0x7febb8101c00 2024-09-19T06:07:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febbcc47640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7febb810c3a0 con 0x7febb81025c0 2024-09-19T06:07:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febbcc47640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7febb810c6a0 con 0x7febb8100a10 2024-09-19T06:07:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febaffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb8101c00 0x7febb8197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febb659c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb8100a10 0x7febb8196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febb659c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb8100a10 0x7febb8196cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:33666/0 (socket says 172.21.15.103:33666) 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febaffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb8101c00 0x7febb8197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59114/0 (socket says 172.21.15.103:59114) 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febb659c640 1 -- 172.21.15.103:0/1652892221 learned_addr learned my addr 172.21.15.103:0/1652892221 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febb6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febb81025c0 0x7febb819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febb659c640 1 -- 172.21.15.103:0/1652892221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febb81025c0 msgr2=0x7febb819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febb659c640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febb81025c0 0x7febb819e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febb659c640 1 -- 172.21.15.103:0/1652892221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb8101c00 msgr2=0x7febb8197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febb659c640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb8101c00 0x7febb8197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febb659c640 1 -- 172.21.15.103:0/1652892221 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb819e900 con 0x7febb8100a10 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febaffff640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb8101c00 0x7febb8197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febb659c640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb8100a10 0x7febb8196cc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feba8005940 tx=0x7feba8030e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febaf7fe640 1 -- 172.21.15.103:0/1652892221 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8037050 con 0x7febb8100a10 2024-09-19T06:07:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febbcc47640 1 -- 172.21.15.103:0/1652892221 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb806a300 con 0x7febb8100a10 2024-09-19T06:07:19.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febaf7fe640 1 -- 172.21.15.103:0/1652892221 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feba8043070 con 0x7febb8100a10 2024-09-19T06:07:19.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.463+0000 7febaf7fe640 1 -- 172.21.15.103:0/1652892221 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8003d30 con 0x7febb8100a10 2024-09-19T06:07:19.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.464+0000 7febbcc47640 1 -- 172.21.15.103:0/1652892221 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb806a840 con 0x7febb8100a10 2024-09-19T06:07:19.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.465+0000 7febbcc47640 1 -- 172.21.15.103:0/1652892221 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb8100e10 con 0x7febb8100a10 2024-09-19T06:07:19.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.466+0000 7febaf7fe640 1 -- 172.21.15.103:0/1652892221 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 138373+0+0 (secure 0 0 0) 0x7feba8004040 con 0x7febb8100a10 2024-09-19T06:07:19.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.466+0000 7febaf7fe640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feba40a32a0 0x7feba40a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.466+0000 7febaffff640 1 -- 172.21.15.103:0/1652892221 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feba40a32a0 msgr2=0x7feba40a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/253046125 2024-09-19T06:07:19.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.466+0000 7febaf7fe640 1 -- 172.21.15.103:0/1652892221 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7feba80efde0 con 0x7febb8100a10 2024-09-19T06:07:19.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.466+0000 7febaffff640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feba40a32a0 0x7feba40a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:07:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.471+0000 7febaf7fe640 1 -- 172.21.15.103:0/1652892221 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feba804c020 con 0x7febb8100a10 2024-09-19T06:07:19.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.642+0000 7febbcc47640 1 -- 172.21.15.103:0/1652892221 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7febb8107f60 con 0x7febb8100a10 2024-09-19T06:07:19.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.642+0000 7febaf7fe640 1 -- 172.21.15.103:0/1652892221 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7feba80bcb30 con 0x7febb8100a10 2024-09-19T06:07:19.645 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-09-19T06:07:19.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 -- 172.21.15.103:0/1652892221 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feba40a32a0 msgr2=0x7feba40a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:07:19.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feba40a32a0 0x7feba40a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 -- 172.21.15.103:0/1652892221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb8100a10 msgr2=0x7febb8196cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb8100a10 0x7febb8196cc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feba8005940 tx=0x7feba8030e00 comp rx=0 tx=0).stop 2024-09-19T06:07:19.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 -- 172.21.15.103:0/1652892221 shutdown_connections 2024-09-19T06:07:19.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.103:6800/253046125,v1:172.21.15.103:6801/253046125] conn(0x7feba40a32a0 0x7feba40a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febb81025c0 0x7febb819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb8101c00 0x7febb8197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 --2- 172.21.15.103:0/1652892221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb8100a10 0x7febb8196cc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 -- 172.21.15.103:0/1652892221 >> 172.21.15.103:0/1652892221 conn(0x7febb80fc190 msgr2=0x7febb8105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:19.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 -- 172.21.15.103:0/1652892221 shutdown_connections 2024-09-19T06:07:19.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.645+0000 7febbcc47640 1 -- 172.21.15.103:0/1652892221 wait complete. 2024-09-19T06:07:19.658 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:07:19.704 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z[36293]: 2024-09-19T06:07:19.388+0000 7f74d5812040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:07:19.729 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y[35715]: 2024-09-19T06:07:19.361+0000 7f5271593040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:07:19.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.771+0000 7f4e068af640 1 -- 172.21.15.103:0/3167855088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e001078b0 msgr2=0x7f4e00109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.771+0000 7f4e068af640 1 --2- 172.21.15.103:0/3167855088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e001078b0 0x7f4e00109ca0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009ca0 tx=0x7f4df802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.771+0000 7f4e068af640 1 -- 172.21.15.103:0/3167855088 shutdown_connections 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.771+0000 7f4e068af640 1 --2- 172.21.15.103:0/3167855088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e001078b0 0x7f4e00109ca0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.771+0000 7f4e068af640 1 --2- 172.21.15.103:0/3167855088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e00104f80 0x7f4e00107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.771+0000 7f4e068af640 1 --2- 172.21.15.103:0/3167855088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e00102650 0x7f4e00104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.771+0000 7f4e068af640 1 -- 172.21.15.103:0/3167855088 >> 172.21.15.103:0/3167855088 conn(0x7f4e000fc1b0 msgr2=0x7f4e000fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.771+0000 7f4e068af640 1 -- 172.21.15.103:0/3167855088 shutdown_connections 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.771+0000 7f4e068af640 1 -- 172.21.15.103:0/3167855088 wait complete. 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4e068af640 1 Processor -- start 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4e068af640 1 -- start start 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4e068af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e00102650 0x7f4e00197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4e068af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e00104f80 0x7f4e001982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4e068af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e001078b0 0x7f4e0019f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4e068af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0010d6f0 con 0x7f4e00102650 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4e068af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0010d570 con 0x7f4e001078b0 2024-09-19T06:07:19.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4e068af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0010d870 con 0x7f4e00104f80 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4dfffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e00102650 0x7f4e00197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4dfffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e00102650 0x7f4e00197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59176/0 (socket says 172.21.15.103:59176) 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4dfffff640 1 -- 172.21.15.103:0/4035899420 learned_addr learned my addr 172.21.15.103:0/4035899420 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4dff7fe640 1 --2- 172.21.15.103:0/4035899420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e00104f80 0x7f4e001982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4e04e4c640 1 --2- 172.21.15.103:0/4035899420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e001078b0 0x7f4e0019f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4dfffff640 1 -- 172.21.15.103:0/4035899420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e00104f80 msgr2=0x7f4e001982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4dfffff640 1 --2- 172.21.15.103:0/4035899420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e00104f80 0x7f4e001982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4dfffff640 1 -- 172.21.15.103:0/4035899420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e001078b0 msgr2=0x7f4e0019f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4dfffff640 1 --2- 172.21.15.103:0/4035899420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e001078b0 0x7f4e0019f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4dfffff640 1 -- 172.21.15.103:0/4035899420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0019f9d0 con 0x7f4e00102650 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.772+0000 7f4e04e4c640 1 --2- 172.21.15.103:0/4035899420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e001078b0 0x7f4e0019f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.773+0000 7f4dfffff640 1 --2- 172.21.15.103:0/4035899420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e00102650 0x7f4e00197db0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4df000d950 tx=0x7f4df000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:19.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.773+0000 7f4dfd7fa640 1 -- 172.21.15.103:0/4035899420 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0017070 con 0x7f4e00102650 2024-09-19T06:07:19.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.773+0000 7f4dfd7fa640 1 -- 172.21.15.103:0/4035899420 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4df0009c30 con 0x7f4e00102650 2024-09-19T06:07:19.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.773+0000 7f4e068af640 1 -- 172.21.15.103:0/4035899420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0019fcc0 con 0x7f4e00102650 2024-09-19T06:07:19.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.773+0000 7f4dfd7fa640 1 -- 172.21.15.103:0/4035899420 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df000f620 con 0x7f4e00102650 2024-09-19T06:07:19.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.773+0000 7f4e068af640 1 -- 172.21.15.103:0/4035899420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e001a01c0 con 0x7f4e00102650 2024-09-19T06:07:19.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.774+0000 7f4e068af640 1 -- 172.21.15.103:0/4035899420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e000fdca0 con 0x7f4e00102650 2024-09-19T06:07:19.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.776+0000 7f4dfd7fa640 1 -- 172.21.15.103:0/4035899420 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 21) ==== 138040+0+0 (secure 0 0 0) 0x7f4df00109a0 con 0x7f4e00102650 2024-09-19T06:07:19.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.776+0000 7f4dfd7fa640 1 -- 172.21.15.103:0/4035899420 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f4df00cf0a0 con 0x7f4e00102650 2024-09-19T06:07:19.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:19.781+0000 7f4dfd7fa640 1 -- 172.21.15.103:0/4035899420 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4df0009de0 con 0x7f4e00102650 2024-09-19T06:07:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T06:07:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:07:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3670189224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:07:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3515086134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:07:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: Standby manager daemon y restarted 2024-09-19T06:07:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: Standby manager daemon y started 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: Standby manager daemon z restarted 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: Standby manager daemon z started 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1652892221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:07:19.995 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:19.729+0000 7fcf9a793040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:07:20.019 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T06:07:20.019 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:07:20.019 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3670189224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:07:20.019 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3515086134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:07:20.019 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: Standby manager daemon y restarted 2024-09-19T06:07:20.019 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: Standby manager daemon y started 2024-09-19T06:07:20.019 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:07:20.019 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:20.019 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:07:20.020 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:20.020 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: Standby manager daemon z restarted 2024-09-19T06:07:20.020 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: Standby manager daemon z started 2024-09-19T06:07:20.020 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:07:20.020 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:20.020 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:07:20.020 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:20.020 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:19 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1652892221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:07:20.061 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T06:07:20.061 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:07:20.061 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3670189224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:07:20.061 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3515086134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:07:20.061 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: Standby manager daemon y restarted 2024-09-19T06:07:20.061 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: Standby manager daemon y started 2024-09-19T06:07:20.061 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:07:20.061 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:20.061 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:07:20.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.169:0/3836409416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:20.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: Standby manager daemon z restarted 2024-09-19T06:07:20.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: Standby manager daemon z started 2024-09-19T06:07:20.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:07:20.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:20.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:07:20.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='mgr.? 172.21.15.174:0/4238575556' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:20.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:19 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1652892221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:07:20.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.070+0000 7f4e068af640 1 -- 172.21.15.103:0/4035899420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4e00062df0 con 0x7f4e00102650 2024-09-19T06:07:20.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.070+0000 7f4dfd7fa640 1 -- 172.21.15.103:0/4035899420 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7f4df009c0f0 con 0x7f4e00102650 2024-09-19T06:07:20.073 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-09-19T06:07:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.073+0000 7f4e068af640 1 -- 172.21.15.103:0/4035899420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e00102650 msgr2=0x7f4e00197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.073+0000 7f4e068af640 1 --2- 172.21.15.103:0/4035899420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e00102650 0x7f4e00197db0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4df000d950 tx=0x7f4df000de10 comp rx=0 tx=0).stop 2024-09-19T06:07:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.074+0000 7f4e068af640 1 -- 172.21.15.103:0/4035899420 shutdown_connections 2024-09-19T06:07:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.074+0000 7f4e068af640 1 --2- 172.21.15.103:0/4035899420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e001078b0 0x7f4e0019f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:20.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.074+0000 7f4e068af640 1 --2- 172.21.15.103:0/4035899420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e00104f80 0x7f4e001982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:20.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.074+0000 7f4e068af640 1 --2- 172.21.15.103:0/4035899420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e00102650 0x7f4e00197db0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:20.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.074+0000 7f4e068af640 1 -- 172.21.15.103:0/4035899420 >> 172.21.15.103:0/4035899420 conn(0x7f4e000fc1b0 msgr2=0x7f4e00103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:20.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.074+0000 7f4e068af640 1 -- 172.21.15.103:0/4035899420 shutdown_connections 2024-09-19T06:07:20.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.074+0000 7f4e068af640 1 -- 172.21.15.103:0/4035899420 wait complete. 2024-09-19T06:07:20.088 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T06:07:20.088 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:07:20.275 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:20.012+0000 7fcf045aa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:07:20.275 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:20.012+0000 7fcf045aa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:07:20.275 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:20.012+0000 7fcf045aa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:07:20.275 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:20.012+0000 7fcf045aa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:07:20.275 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:20.012+0000 7fcf045aa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:07:20.275 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:20.012+0000 7fcf01da5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:07:20.275 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:20.012+0000 7fcf01da5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:07:20.275 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:20.012+0000 7fcf01da5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:07:20.275 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:20.012+0000 7fcf01da5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:07:20.275 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:20.012+0000 7fcf01da5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:07:20.360 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:20.800 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: Active manager daemon x restarted 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: Activating manager daemon x 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: mgrmap e20: x(active, since 8m), standbys: y, z 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: mgrmap e21: x(active, starting, since 0.0110978s), standbys: y, z 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:07:20.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:07:20.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:07:20.803 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: Manager daemon x is now available 2024-09-19T06:07:20.804 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:20.804 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:07:20.804 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:07:20.804 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:20 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/4035899420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:07:20.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.879+0000 7f2c6128a640 1 -- 172.21.15.103:0/616233853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c102ef0 msgr2=0x7f2c5c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.879+0000 7f2c6128a640 1 --2- 172.21.15.103:0/616233853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c102ef0 0x7f2c5c10da40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009ca0 tx=0x7f2c5402a950 comp rx=0 tx=0).stop 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.879+0000 7f2c6128a640 1 -- 172.21.15.103:0/616233853 shutdown_connections 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.879+0000 7f2c6128a640 1 --2- 172.21.15.103:0/616233853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c102ef0 0x7f2c5c10da40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.879+0000 7f2c6128a640 1 --2- 172.21.15.103:0/616233853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c5c102570 0x7f2c5c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.879+0000 7f2c6128a640 1 --2- 172.21.15.103:0/616233853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c5c100e20 0x7f2c5c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.879+0000 7f2c6128a640 1 -- 172.21.15.103:0/616233853 >> 172.21.15.103:0/616233853 conn(0x7f2c5c0fc7d0 msgr2=0x7f2c5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.879+0000 7f2c6128a640 1 -- 172.21.15.103:0/616233853 shutdown_connections 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.879+0000 7f2c6128a640 1 -- 172.21.15.103:0/616233853 wait complete. 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.880+0000 7f2c6128a640 1 Processor -- start 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.880+0000 7f2c6128a640 1 -- start start 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c6128a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c5c100e20 0x7f2c5c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c6128a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c5c102570 0x7f2c5c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c6128a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c102ef0 0x7f2c5c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c6128a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c110e30 con 0x7f2c5c102ef0 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c6128a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c110cb0 con 0x7f2c5c100e20 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c6128a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c110fb0 con 0x7f2c5c102570 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c102ef0 0x7f2c5c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5affd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c5c100e20 0x7f2c5c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c102ef0 0x7f2c5c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40188/0 (socket says 172.21.15.103:40188) 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5b7fe640 1 -- 172.21.15.103:0/3300022449 learned_addr learned my addr 172.21.15.103:0/3300022449 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5a7fc640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c5c102570 0x7f2c5c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5b7fe640 1 -- 172.21.15.103:0/3300022449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c5c102570 msgr2=0x7f2c5c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5b7fe640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c5c102570 0x7f2c5c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5b7fe640 1 -- 172.21.15.103:0/3300022449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c5c100e20 msgr2=0x7f2c5c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5b7fe640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c5c100e20 0x7f2c5c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5b7fe640 1 -- 172.21.15.103:0/3300022449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c1a68b0 con 0x7f2c5c102ef0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.881+0000 7f2c5b7fe640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c102ef0 0x7f2c5c0fd700 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2c5402ae70 tx=0x7f2c5402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.882+0000 7f2c43fff640 1 -- 172.21.15.103:0/3300022449 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c54034040 con 0x7f2c5c102ef0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.882+0000 7f2c43fff640 1 -- 172.21.15.103:0/3300022449 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c540308f0 con 0x7f2c5c102ef0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.882+0000 7f2c6128a640 1 -- 172.21.15.103:0/3300022449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5c1a6b40 con 0x7f2c5c102ef0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.882+0000 7f2c43fff640 1 -- 172.21.15.103:0/3300022449 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c54004780 con 0x7f2c5c102ef0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.882+0000 7f2c6128a640 1 -- 172.21.15.103:0/3300022449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5c1a7020 con 0x7f2c5c102ef0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.883+0000 7f2c6128a640 1 -- 172.21.15.103:0/3300022449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5c101200 con 0x7f2c5c102ef0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.884+0000 7f2c43fff640 1 -- 172.21.15.103:0/3300022449 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7f2c54037020 con 0x7f2c5c102ef0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.884+0000 7f2c43fff640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2c440a3030 0x7f2c440a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.885+0000 7f2c5affd640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2c440a3030 0x7f2c440a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.885+0000 7f2c43fff640 1 -- 172.21.15.103:0/3300022449 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f2c540f0630 con 0x7f2c5c102ef0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.885+0000 7f2c5affd640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2c440a3030 0x7f2c440a54f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00bbe0 tx=0x7f2c4c00b390 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:20.888+0000 7f2c43fff640 1 -- 172.21.15.103:0/3300022449 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c540bd570 con 0x7f2c5c102ef0 2024-09-19T06:07:21.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: Active manager daemon x restarted 2024-09-19T06:07:21.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: Activating manager daemon x 2024-09-19T06:07:21.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: mgrmap e20: x(active, since 8m), standbys: y, z 2024-09-19T06:07:21.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: mgrmap e21: x(active, starting, since 0.0110978s), standbys: y, z 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:07:21.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:07:21.030 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: Manager daemon x is now available 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:07:21.031 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:20 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/4035899420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:07:21.088 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: Active manager daemon x restarted 2024-09-19T06:07:21.088 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: Activating manager daemon x 2024-09-19T06:07:21.088 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: mgrmap e20: x(active, since 8m), standbys: y, z 2024-09-19T06:07:21.088 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: mgrmap e21: x(active, starting, since 0.0110978s), standbys: y, z 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:07:21.089 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:07:21.090 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: Manager daemon x is now available 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:07:21.091 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:20 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/4035899420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:07:21.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.141+0000 7f2c6128a640 1 -- 172.21.15.103:0/3300022449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c5c10a0a0 con 0x7f2c5c102ef0 2024-09-19T06:07:21.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.142+0000 7f2c43fff640 1 -- 172.21.15.103:0/3300022449 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11933 (secure 0 0 0) 0x7f2c540bce70 con 0x7f2c5c102ef0 2024-09-19T06:07:21.145 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-09-19T06:07:18:721714+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:07:18.671540+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24488,24475,24463]},"id":1}]} 2024-09-19T06:07:21.145 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-19T06:07:21.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 -- 172.21.15.103:0/3300022449 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2c440a3030 msgr2=0x7f2c440a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2c440a3030 0x7f2c440a54f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00bbe0 tx=0x7f2c4c00b390 comp rx=0 tx=0).stop 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 -- 172.21.15.103:0/3300022449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c102ef0 msgr2=0x7f2c5c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c102ef0 0x7f2c5c0fd700 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2c5402ae70 tx=0x7f2c5402f5d0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 -- 172.21.15.103:0/3300022449 shutdown_connections 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2c440a3030 0x7f2c440a54f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c102ef0 0x7f2c5c0fd700 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c5c102570 0x7f2c5c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 --2- 172.21.15.103:0/3300022449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c5c100e20 0x7f2c5c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 -- 172.21.15.103:0/3300022449 >> 172.21.15.103:0/3300022449 conn(0x7f2c5c0fc7d0 msgr2=0x7f2c5c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 -- 172.21.15.103:0/3300022449 shutdown_connections 2024-09-19T06:07:21.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:21.144+0000 7f2c6128a640 1 -- 172.21.15.103:0/3300022449 wait complete. 2024-09-19T06:07:21.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:21.435+0000 7fcee87b3640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:07:21] ENGINE Error in HTTPServer.serve 2024-09-19T06:07:21.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: Traceback (most recent call last): 2024-09-19T06:07:21.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:07:21.744 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self._connections.run(self.expiration_interval) 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self._run(expiration_interval) 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: s = self.context.wrap_socket( 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: return self.sslsocket_class._create( 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self.do_handshake() 2024-09-19T06:07:21.745 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:07:21.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: self._sslobj.do_handshake() 2024-09-19T06:07:21.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:07:21.746 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:07:22.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:21 smithi169 ceph-mon[34350]: mgrmap e22: x(active, since 1.01879s), standbys: y, z 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:21 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3300022449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:21 smithi169 ceph-mon[34350]: [19/Sep/2024:06:07:21] ENGINE Bus STARTING 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:21 smithi169 ceph-mon[34350]: [19/Sep/2024:06:07:21] ENGINE Serving on http://172.21.15.103:8765 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:21 smithi169 ceph-mon[34350]: [19/Sep/2024:06:07:21] ENGINE Serving on https://172.21.15.103:7150 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:21 smithi169 ceph-mon[34350]: [19/Sep/2024:06:07:21] ENGINE Bus STARTED 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:21 smithi169 ceph-mon[34350]: [19/Sep/2024:06:07:21] ENGINE Error in HTTPServer.serve 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout: Traceback (most recent call last): 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout: self._run(expiration_interval) 2024-09-19T06:07:22.028 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: s = self.context.wrap_socket( 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: return self.sslsocket_class._create( 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: self.do_handshake() 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: self._sslobj.do_handshake() 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:21 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:22.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:21 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:22.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-mon[30925]: mgrmap e22: x(active, since 1.01879s), standbys: y, z 2024-09-19T06:07:22.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3300022449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:22.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-mon[30925]: [19/Sep/2024:06:07:21] ENGINE Bus STARTING 2024-09-19T06:07:22.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-mon[30925]: [19/Sep/2024:06:07:21] ENGINE Serving on http://172.21.15.103:8765 2024-09-19T06:07:22.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-mon[30925]: [19/Sep/2024:06:07:21] ENGINE Serving on https://172.21.15.103:7150 2024-09-19T06:07:22.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-mon[30925]: [19/Sep/2024:06:07:21] ENGINE Bus STARTED 2024-09-19T06:07:22.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-mon[30925]: [19/Sep/2024:06:07:21] ENGINE Error in HTTPServer.serve 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: Traceback (most recent call last): 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._run(expiration_interval) 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: s = self.context.wrap_socket( 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:07:22.101 INFO:journalctl@ceph.mon.a.smithi103.stdout: return self.sslsocket_class._create( 2024-09-19T06:07:22.102 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:07:22.102 INFO:journalctl@ceph.mon.a.smithi103.stdout: self.do_handshake() 2024-09-19T06:07:22.102 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:07:22.102 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._sslobj.do_handshake() 2024-09-19T06:07:22.102 INFO:journalctl@ceph.mon.a.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:07:22.102 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:22.102 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:21 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:22.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:21 smithi174 ceph-mon[34488]: mgrmap e22: x(active, since 1.01879s), standbys: y, z 2024-09-19T06:07:22.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:21 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3300022449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:22.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:21 smithi174 ceph-mon[34488]: [19/Sep/2024:06:07:21] ENGINE Bus STARTING 2024-09-19T06:07:22.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:21 smithi174 ceph-mon[34488]: [19/Sep/2024:06:07:21] ENGINE Serving on http://172.21.15.103:8765 2024-09-19T06:07:22.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:21 smithi174 ceph-mon[34488]: [19/Sep/2024:06:07:21] ENGINE Serving on https://172.21.15.103:7150 2024-09-19T06:07:22.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:21 smithi174 ceph-mon[34488]: [19/Sep/2024:06:07:21] ENGINE Bus STARTED 2024-09-19T06:07:22.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:21 smithi174 ceph-mon[34488]: [19/Sep/2024:06:07:21] ENGINE Error in HTTPServer.serve 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: Traceback (most recent call last): 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: self._run(expiration_interval) 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: s = self.context.wrap_socket( 2024-09-19T06:07:22.206 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:07:22.207 INFO:journalctl@ceph.mon.c.smithi174.stdout: return self.sslsocket_class._create( 2024-09-19T06:07:22.207 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:07:22.207 INFO:journalctl@ceph.mon.c.smithi174.stdout: self.do_handshake() 2024-09-19T06:07:22.207 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:07:22.207 INFO:journalctl@ceph.mon.c.smithi174.stdout: self._sslobj.do_handshake() 2024-09-19T06:07:22.207 INFO:journalctl@ceph.mon.c.smithi174.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:07:22.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:21 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:22.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:21 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:22.479 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T06:07:22.479 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T06:07:22.479 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:07:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.598+0000 7fdd31749640 1 -- 172.21.15.103:0/263685296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd2c1036e0 msgr2=0x7fdd2c109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.598+0000 7fdd31749640 1 --2- 172.21.15.103:0/263685296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd2c1036e0 0x7fdd2c109f70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009ca0 tx=0x7fdd2402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.598+0000 7fdd31749640 1 -- 172.21.15.103:0/263685296 shutdown_connections 2024-09-19T06:07:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.598+0000 7fdd31749640 1 --2- 172.21.15.103:0/263685296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd2c1036e0 0x7fdd2c109f70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.598+0000 7fdd31749640 1 --2- 172.21.15.103:0/263685296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd2c102d20 0x7fdd2c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.598+0000 7fdd31749640 1 --2- 172.21.15.103:0/263685296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd2c101b30 0x7fdd2c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.598+0000 7fdd31749640 1 -- 172.21.15.103:0/263685296 >> 172.21.15.103:0/263685296 conn(0x7fdd2c0fd2b0 msgr2=0x7fdd2c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.598+0000 7fdd31749640 1 -- 172.21.15.103:0/263685296 shutdown_connections 2024-09-19T06:07:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.598+0000 7fdd31749640 1 -- 172.21.15.103:0/263685296 wait complete. 2024-09-19T06:07:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd31749640 1 Processor -- start 2024-09-19T06:07:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd31749640 1 -- start start 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd31749640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd2c101b30 0x7fdd2c197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd31749640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd2c102d20 0x7fdd2c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd31749640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd2c1036e0 0x7fdd2c19f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd31749640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c10d660 con 0x7fdd2c102d20 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd31749640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c10d4e0 con 0x7fdd2c1036e0 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd31749640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c10d7e0 con 0x7fdd2c101b30 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd2a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd2c102d20 0x7fdd2c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd2a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd2c102d20 0x7fdd2c198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40224/0 (socket says 172.21.15.103:40224) 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd2a7fc640 1 -- 172.21.15.103:0/3239566656 learned_addr learned my addr 172.21.15.103:0/3239566656 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.599+0000 7fdd2affd640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd2c101b30 0x7fdd2c197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd2b7fe640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd2c1036e0 0x7fdd2c19f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd2a7fc640 1 -- 172.21.15.103:0/3239566656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd2c101b30 msgr2=0x7fdd2c197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd2a7fc640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd2c101b30 0x7fdd2c197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd2a7fc640 1 -- 172.21.15.103:0/3239566656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd2c1036e0 msgr2=0x7fdd2c19f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd2a7fc640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd2c1036e0 0x7fdd2c19f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd2a7fc640 1 -- 172.21.15.103:0/3239566656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c19f940 con 0x7fdd2c102d20 2024-09-19T06:07:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd2a7fc640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd2c102d20 0x7fdd2c198270 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000d950 tx=0x7fdd2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd13fff640 1 -- 172.21.15.103:0/3239566656 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd20017070 con 0x7fdd2c102d20 2024-09-19T06:07:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd13fff640 1 -- 172.21.15.103:0/3239566656 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd20009c30 con 0x7fdd2c102d20 2024-09-19T06:07:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd31749640 1 -- 172.21.15.103:0/3239566656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2c19fc30 con 0x7fdd2c102d20 2024-09-19T06:07:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd13fff640 1 -- 172.21.15.103:0/3239566656 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000f620 con 0x7fdd2c102d20 2024-09-19T06:07:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.600+0000 7fdd31749640 1 -- 172.21.15.103:0/3239566656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd2c1a0180 con 0x7fdd2c102d20 2024-09-19T06:07:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.601+0000 7fdd31749640 1 -- 172.21.15.103:0/3239566656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd2c108ef0 con 0x7fdd2c102d20 2024-09-19T06:07:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.603+0000 7fdd13fff640 1 -- 172.21.15.103:0/3239566656 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7fdd200109a0 con 0x7fdd2c102d20 2024-09-19T06:07:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.604+0000 7fdd13fff640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fdd140a3050 0x7fdd140a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.604+0000 7fdd2affd640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fdd140a3050 0x7fdd140a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.604+0000 7fdd13fff640 1 -- 172.21.15.103:0/3239566656 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fdd200cf210 con 0x7fdd2c102d20 2024-09-19T06:07:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.604+0000 7fdd2affd640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fdd140a3050 0x7fdd140a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c199200 tx=0x7fdd1c005f90 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.608+0000 7fdd13fff640 1 -- 172.21.15.103:0/3239566656 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdd20009de0 con 0x7fdd2c102d20 2024-09-19T06:07:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.656+0000 7fdd13fff640 1 -- 172.21.15.103:0/3239566656 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 23) ==== 138476+0+0 (secure 0 0 0) 0x7fdd200980a0 con 0x7fdd2c102d20 2024-09-19T06:07:22.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.800+0000 7fdd31749640 1 -- 172.21.15.103:0/3239566656 --> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd2c062630 con 0x7fdd140a3050 2024-09-19T06:07:22.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.807+0000 7fdd13fff640 1 -- 172.21.15.103:0/3239566656 <== mgr.15189 v2:172.21.15.103:6800/266758959 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257729 (secure 0 0 0) 0x7fdd2c062630 con 0x7fdd140a3050 2024-09-19T06:07:22.814 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T06:07:22.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 -- 172.21.15.103:0/3239566656 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fdd140a3050 msgr2=0x7fdd140a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fdd140a3050 0x7fdd140a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c199200 tx=0x7fdd1c005f90 comp rx=0 tx=0).stop 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 -- 172.21.15.103:0/3239566656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd2c102d20 msgr2=0x7fdd2c198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd2c102d20 0x7fdd2c198270 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000d950 tx=0x7fdd2000de10 comp rx=0 tx=0).stop 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 -- 172.21.15.103:0/3239566656 shutdown_connections 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fdd140a3050 0x7fdd140a5510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd2c1036e0 0x7fdd2c19f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd2c102d20 0x7fdd2c198270 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 --2- 172.21.15.103:0/3239566656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd2c101b30 0x7fdd2c197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 -- 172.21.15.103:0/3239566656 >> 172.21.15.103:0/3239566656 conn(0x7fdd2c0fd2b0 msgr2=0x7fdd2c1060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 -- 172.21.15.103:0/3239566656 shutdown_connections 2024-09-19T06:07:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.810+0000 7fdd31749640 1 -- 172.21.15.103:0/3239566656 wait complete. 2024-09-19T06:07:22.826 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T06:07:21.760511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186805,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":896,"num_read_kb":602,"num_write":471,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363400,"kb_used_data":14064,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578424,"statfs":{"total":1151940427776,"available":1151568306176,"internally_reserved":0,"allocated":14401536,"data_stored":8770539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.994240"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748742+0000","last_change":"2024-09-19T06:05:24.703290+0000","last_active":"2024-09-19T06:07:19.748742+0000","last_peered":"2024-09-19T06:07:19.748742+0000","last_clean":"2024-09-19T06:07:19.748742+0000","last_became_active":"2024-09-19T06:05:24.702343+0000","last_became_peered":"2024-09-19T06:05:24.702343+0000","last_unstale":"2024-09-19T06:07:19.748742+0000","last_undegraded":"2024-09-19T06:07:19.748742+0000","last_fullsized":"2024-09-19T06:07:19.748742+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.594004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983423+0000","last_change":"2024-09-19T06:05:24.700363+0000","last_active":"2024-09-19T06:07:19.983423+0000","last_peered":"2024-09-19T06:07:19.983423+0000","last_clean":"2024-09-19T06:07:19.983423+0000","last_became_active":"2024-09-19T06:05:24.700066+0000","last_became_peered":"2024-09-19T06:05:24.700066+0000","last_unstale":"2024-09-19T06:07:19.983423+0000","last_undegraded":"2024-09-19T06:07:19.983423+0000","last_fullsized":"2024-09-19T06:07:19.983423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:26.094195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983216+0000","last_change":"2024-09-19T06:05:24.702458+0000","last_active":"2024-09-19T06:07:19.983216+0000","last_peered":"2024-09-19T06:07:19.983216+0000","last_clean":"2024-09-19T06:07:19.983216+0000","last_became_active":"2024-09-19T06:05:24.702029+0000","last_became_peered":"2024-09-19T06:05:24.702029+0000","last_unstale":"2024-09-19T06:07:19.983216+0000","last_undegraded":"2024-09-19T06:07:19.983216+0000","last_fullsized":"2024-09-19T06:07:19.983216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983262+0000","last_change":"2024-09-19T06:05:24.699402+0000","last_active":"2024-09-19T06:07:19.983262+0000","last_peered":"2024-09-19T06:07:19.983262+0000","last_clean":"2024-09-19T06:07:19.983262+0000","last_became_active":"2024-09-19T06:05:24.698191+0000","last_became_peered":"2024-09-19T06:05:24.698191+0000","last_unstale":"2024-09-19T06:07:19.983262+0000","last_undegraded":"2024-09-19T06:07:19.983262+0000","last_fullsized":"2024-09-19T06:07:19.983262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.056347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831523+0000","last_change":"2024-09-19T06:05:24.699821+0000","last_active":"2024-09-19T06:07:19.831523+0000","last_peered":"2024-09-19T06:07:19.831523+0000","last_clean":"2024-09-19T06:07:19.831523+0000","last_became_active":"2024-09-19T06:05:24.699493+0000","last_became_peered":"2024-09-19T06:05:24.699493+0000","last_unstale":"2024-09-19T06:07:19.831523+0000","last_undegraded":"2024-09-19T06:07:19.831523+0000","last_fullsized":"2024-09-19T06:07:19.831523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:34.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.750647+0000","last_change":"2024-09-19T06:05:24.697821+0000","last_active":"2024-09-19T06:07:19.750647+0000","last_peered":"2024-09-19T06:07:19.750647+0000","last_clean":"2024-09-19T06:07:19.750647+0000","last_became_active":"2024-09-19T06:05:24.697495+0000","last_became_peered":"2024-09-19T06:05:24.697495+0000","last_unstale":"2024-09-19T06:07:19.750647+0000","last_undegraded":"2024-09-19T06:07:19.750647+0000","last_fullsized":"2024-09-19T06:07:19.750647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:03.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982865+0000","last_change":"2024-09-19T06:05:24.704610+0000","last_active":"2024-09-19T06:07:19.982865+0000","last_peered":"2024-09-19T06:07:19.982865+0000","last_clean":"2024-09-19T06:07:19.982865+0000","last_became_active":"2024-09-19T06:05:24.704288+0000","last_became_peered":"2024-09-19T06:05:24.704288+0000","last_unstale":"2024-09-19T06:07:19.982865+0000","last_undegraded":"2024-09-19T06:07:19.982865+0000","last_fullsized":"2024-09-19T06:07:19.982865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.530553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831687+0000","last_change":"2024-09-19T06:05:24.693662+0000","last_active":"2024-09-19T06:07:19.831687+0000","last_peered":"2024-09-19T06:07:19.831687+0000","last_clean":"2024-09-19T06:07:19.831687+0000","last_became_active":"2024-09-19T06:05:24.693327+0000","last_became_peered":"2024-09-19T06:05:24.693327+0000","last_unstale":"2024-09-19T06:07:19.831687+0000","last_undegraded":"2024-09-19T06:07:19.831687+0000","last_fullsized":"2024-09-19T06:07:19.831687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:39.646907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983592+0000","last_change":"2024-09-19T06:05:24.702552+0000","last_active":"2024-09-19T06:07:19.983592+0000","last_peered":"2024-09-19T06:07:19.983592+0000","last_clean":"2024-09-19T06:07:19.983592+0000","last_became_active":"2024-09-19T06:05:24.701090+0000","last_became_peered":"2024-09-19T06:05:24.701090+0000","last_unstale":"2024-09-19T06:07:19.983592+0000","last_undegraded":"2024-09-19T06:07:19.983592+0000","last_fullsized":"2024-09-19T06:07:19.983592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:44.361368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.751254+0000","last_change":"2024-09-19T06:05:46.524330+0000","last_active":"2024-09-19T06:07:19.751254+0000","last_peered":"2024-09-19T06:07:19.751254+0000","last_clean":"2024-09-19T06:07:19.751254+0000","last_became_active":"2024-09-19T06:05:46.523934+0000","last_became_peered":"2024-09-19T06:05:46.523934+0000","last_unstale":"2024-09-19T06:07:19.751254+0000","last_undegraded":"2024-09-19T06:07:19.751254+0000","last_fullsized":"2024-09-19T06:07:19.751254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:11:12.301698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983702+0000","last_change":"2024-09-19T06:05:24.703118+0000","last_active":"2024-09-19T06:07:19.983702+0000","last_peered":"2024-09-19T06:07:19.983702+0000","last_clean":"2024-09-19T06:07:19.983702+0000","last_became_active":"2024-09-19T06:05:24.702561+0000","last_became_peered":"2024-09-19T06:05:24.702561+0000","last_unstale":"2024-09-19T06:07:19.983702+0000","last_undegraded":"2024-09-19T06:07:19.983702+0000","last_fullsized":"2024-09-19T06:07:19.983702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:51.063256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983406+0000","last_change":"2024-09-19T06:05:24.698704+0000","last_active":"2024-09-19T06:07:19.983406+0000","last_peered":"2024-09-19T06:07:19.983406+0000","last_clean":"2024-09-19T06:07:19.983406+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:07:19.983406+0000","last_undegraded":"2024-09-19T06:07:19.983406+0000","last_fullsized":"2024-09-19T06:07:19.983406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:35.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747930+0000","last_change":"2024-09-19T06:05:24.696236+0000","last_active":"2024-09-19T06:07:19.747930+0000","last_peered":"2024-09-19T06:07:19.747930+0000","last_clean":"2024-09-19T06:07:19.747930+0000","last_became_active":"2024-09-19T06:05:24.695952+0000","last_became_peered":"2024-09-19T06:05:24.695952+0000","last_unstale":"2024-09-19T06:07:19.747930+0000","last_undegraded":"2024-09-19T06:07:19.747930+0000","last_fullsized":"2024-09-19T06:07:19.747930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:17.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982598+0000","last_change":"2024-09-19T06:05:24.699962+0000","last_active":"2024-09-19T06:07:19.982598+0000","last_peered":"2024-09-19T06:07:19.982598+0000","last_clean":"2024-09-19T06:07:19.982598+0000","last_became_active":"2024-09-19T06:05:24.699625+0000","last_became_peered":"2024-09-19T06:05:24.699625+0000","last_unstale":"2024-09-19T06:07:19.982598+0000","last_undegraded":"2024-09-19T06:07:19.982598+0000","last_fullsized":"2024-09-19T06:07:19.982598+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:34.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982302+0000","last_change":"2024-09-19T06:05:24.701310+0000","last_active":"2024-09-19T06:07:19.982302+0000","last_peered":"2024-09-19T06:07:19.982302+0000","last_clean":"2024-09-19T06:07:19.982302+0000","last_became_active":"2024-09-19T06:05:24.701032+0000","last_became_peered":"2024-09-19T06:05:24.701032+0000","last_unstale":"2024-09-19T06:07:19.982302+0000","last_undegraded":"2024-09-19T06:07:19.982302+0000","last_fullsized":"2024-09-19T06:07:19.982302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:29.557533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982549+0000","last_change":"2024-09-19T06:05:24.699803+0000","last_active":"2024-09-19T06:07:19.982549+0000","last_peered":"2024-09-19T06:07:19.982549+0000","last_clean":"2024-09-19T06:07:19.982549+0000","last_became_active":"2024-09-19T06:05:24.699506+0000","last_became_peered":"2024-09-19T06:05:24.699506+0000","last_unstale":"2024-09-19T06:07:19.982549+0000","last_undegraded":"2024-09-19T06:07:19.982549+0000","last_fullsized":"2024-09-19T06:07:19.982549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:32.669231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748756+0000","last_change":"2024-09-19T06:05:24.703805+0000","last_active":"2024-09-19T06:07:19.748756+0000","last_peered":"2024-09-19T06:07:19.748756+0000","last_clean":"2024-09-19T06:07:19.748756+0000","last_became_active":"2024-09-19T06:05:24.702728+0000","last_became_peered":"2024-09-19T06:05:24.702728+0000","last_unstale":"2024-09-19T06:07:19.748756+0000","last_undegraded":"2024-09-19T06:07:19.748756+0000","last_fullsized":"2024-09-19T06:07:19.748756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:20.807530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.829583+0000","last_change":"2024-09-19T06:05:24.691055+0000","last_active":"2024-09-19T06:07:19.829583+0000","last_peered":"2024-09-19T06:07:19.829583+0000","last_clean":"2024-09-19T06:07:19.829583+0000","last_became_active":"2024-09-19T06:05:24.690165+0000","last_became_peered":"2024-09-19T06:05:24.690165+0000","last_unstale":"2024-09-19T06:07:19.829583+0000","last_undegraded":"2024-09-19T06:07:19.829583+0000","last_fullsized":"2024-09-19T06:07:19.829583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:48.656335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.981942+0000","last_change":"2024-09-19T06:05:24.697955+0000","last_active":"2024-09-19T06:07:19.981942+0000","last_peered":"2024-09-19T06:07:19.981942+0000","last_clean":"2024-09-19T06:07:19.981942+0000","last_became_active":"2024-09-19T06:05:24.697598+0000","last_became_peered":"2024-09-19T06:05:24.697598+0000","last_unstale":"2024-09-19T06:07:19.981942+0000","last_undegraded":"2024-09-19T06:07:19.981942+0000","last_fullsized":"2024-09-19T06:07:19.981942+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.458647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748385+0000","last_change":"2024-09-19T06:05:24.705110+0000","last_active":"2024-09-19T06:07:19.748385+0000","last_peered":"2024-09-19T06:07:19.748385+0000","last_clean":"2024-09-19T06:07:19.748385+0000","last_became_active":"2024-09-19T06:05:24.704783+0000","last_became_peered":"2024-09-19T06:05:24.704783+0000","last_unstale":"2024-09-19T06:07:19.748385+0000","last_undegraded":"2024-09-19T06:07:19.748385+0000","last_fullsized":"2024-09-19T06:07:19.748385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:43.092969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747958+0000","last_change":"2024-09-19T06:05:24.693845+0000","last_active":"2024-09-19T06:07:19.747958+0000","last_peered":"2024-09-19T06:07:19.747958+0000","last_clean":"2024-09-19T06:07:19.747958+0000","last_became_active":"2024-09-19T06:05:24.693385+0000","last_became_peered":"2024-09-19T06:05:24.693385+0000","last_unstale":"2024-09-19T06:07:19.747958+0000","last_undegraded":"2024-09-19T06:07:19.747958+0000","last_fullsized":"2024-09-19T06:07:19.747958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:05.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982905+0000","last_change":"2024-09-19T06:05:24.697903+0000","last_active":"2024-09-19T06:07:19.982905+0000","last_peered":"2024-09-19T06:07:19.982905+0000","last_clean":"2024-09-19T06:07:19.982905+0000","last_became_active":"2024-09-19T06:05:24.697566+0000","last_became_peered":"2024-09-19T06:05:24.697566+0000","last_unstale":"2024-09-19T06:07:19.982905+0000","last_undegraded":"2024-09-19T06:07:19.982905+0000","last_fullsized":"2024-09-19T06:07:19.982905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:10.340401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831767+0000","last_change":"2024-09-19T06:05:24.696888+0000","last_active":"2024-09-19T06:07:19.831767+0000","last_peered":"2024-09-19T06:07:19.831767+0000","last_clean":"2024-09-19T06:07:19.831767+0000","last_became_active":"2024-09-19T06:05:24.696554+0000","last_became_peered":"2024-09-19T06:05:24.696554+0000","last_unstale":"2024-09-19T06:07:19.831767+0000","last_undegraded":"2024-09-19T06:07:19.831767+0000","last_fullsized":"2024-09-19T06:07:19.831767+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838648+0000","last_change":"2024-09-19T06:05:24.692443+0000","last_active":"2024-09-19T06:07:19.838648+0000","last_peered":"2024-09-19T06:07:19.838648+0000","last_clean":"2024-09-19T06:07:19.838648+0000","last_became_active":"2024-09-19T06:05:24.690555+0000","last_became_peered":"2024-09-19T06:05:24.690555+0000","last_unstale":"2024-09-19T06:07:19.838648+0000","last_undegraded":"2024-09-19T06:07:19.838648+0000","last_fullsized":"2024-09-19T06:07:19.838648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:29.340744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833473+0000","last_change":"2024-09-19T06:05:24.699379+0000","last_active":"2024-09-19T06:07:19.833473+0000","last_peered":"2024-09-19T06:07:19.833473+0000","last_clean":"2024-09-19T06:07:19.833473+0000","last_became_active":"2024-09-19T06:05:24.699056+0000","last_became_peered":"2024-09-19T06:05:24.699056+0000","last_unstale":"2024-09-19T06:07:19.833473+0000","last_undegraded":"2024-09-19T06:07:19.833473+0000","last_fullsized":"2024-09-19T06:07:19.833473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:30.337080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982063+0000","last_change":"2024-09-19T06:05:24.698672+0000","last_active":"2024-09-19T06:07:19.982063+0000","last_peered":"2024-09-19T06:07:19.982063+0000","last_clean":"2024-09-19T06:07:19.982063+0000","last_became_active":"2024-09-19T06:05:24.698229+0000","last_became_peered":"2024-09-19T06:05:24.698229+0000","last_unstale":"2024-09-19T06:07:19.982063+0000","last_undegraded":"2024-09-19T06:07:19.982063+0000","last_fullsized":"2024-09-19T06:07:19.982063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.082538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748635+0000","last_change":"2024-09-19T06:05:24.707830+0000","last_active":"2024-09-19T06:07:19.748635+0000","last_peered":"2024-09-19T06:07:19.748635+0000","last_clean":"2024-09-19T06:07:19.748635+0000","last_became_active":"2024-09-19T06:05:24.707478+0000","last_became_peered":"2024-09-19T06:05:24.707478+0000","last_unstale":"2024-09-19T06:07:19.748635+0000","last_undegraded":"2024-09-19T06:07:19.748635+0000","last_fullsized":"2024-09-19T06:07:19.748635+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:33.484877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747788+0000","last_change":"2024-09-19T06:05:24.697232+0000","last_active":"2024-09-19T06:07:19.747788+0000","last_peered":"2024-09-19T06:07:19.747788+0000","last_clean":"2024-09-19T06:07:19.747788+0000","last_became_active":"2024-09-19T06:05:24.696727+0000","last_became_peered":"2024-09-19T06:05:24.696727+0000","last_unstale":"2024-09-19T06:07:19.747788+0000","last_undegraded":"2024-09-19T06:07:19.747788+0000","last_fullsized":"2024-09-19T06:07:19.747788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:36.168493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982918+0000","last_change":"2024-09-19T06:05:24.695489+0000","last_active":"2024-09-19T06:07:19.982918+0000","last_peered":"2024-09-19T06:07:19.982918+0000","last_clean":"2024-09-19T06:07:19.982918+0000","last_became_active":"2024-09-19T06:05:24.695012+0000","last_became_peered":"2024-09-19T06:05:24.695012+0000","last_unstale":"2024-09-19T06:07:19.982918+0000","last_undegraded":"2024-09-19T06:07:19.982918+0000","last_fullsized":"2024-09-19T06:07:19.982918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:41.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.981770+0000","last_change":"2024-09-19T06:05:24.697294+0000","last_active":"2024-09-19T06:07:19.981770+0000","last_peered":"2024-09-19T06:07:19.981770+0000","last_clean":"2024-09-19T06:07:19.981770+0000","last_became_active":"2024-09-19T06:05:24.696563+0000","last_became_peered":"2024-09-19T06:05:24.696563+0000","last_unstale":"2024-09-19T06:07:19.981770+0000","last_undegraded":"2024-09-19T06:07:19.981770+0000","last_fullsized":"2024-09-19T06:07:19.981770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:41.861120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.981838+0000","last_change":"2024-09-19T06:05:24.702710+0000","last_active":"2024-09-19T06:07:19.981838+0000","last_peered":"2024-09-19T06:07:19.981838+0000","last_clean":"2024-09-19T06:07:19.981838+0000","last_became_active":"2024-09-19T06:05:24.702039+0000","last_became_peered":"2024-09-19T06:05:24.702039+0000","last_unstale":"2024-09-19T06:07:19.981838+0000","last_undegraded":"2024-09-19T06:07:19.981838+0000","last_fullsized":"2024-09-19T06:07:19.981838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:23.831807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748351+0000","last_change":"2024-09-19T06:05:24.707671+0000","last_active":"2024-09-19T06:07:19.748351+0000","last_peered":"2024-09-19T06:07:19.748351+0000","last_clean":"2024-09-19T06:07:19.748351+0000","last_became_active":"2024-09-19T06:05:24.707325+0000","last_became_peered":"2024-09-19T06:05:24.707325+0000","last_unstale":"2024-09-19T06:07:19.748351+0000","last_undegraded":"2024-09-19T06:07:19.748351+0000","last_fullsized":"2024-09-19T06:07:19.748351+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:32.149103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831508+0000","last_change":"2024-09-19T06:05:24.704875+0000","last_active":"2024-09-19T06:07:19.831508+0000","last_peered":"2024-09-19T06:07:19.831508+0000","last_clean":"2024-09-19T06:07:19.831508+0000","last_became_active":"2024-09-19T06:05:24.704501+0000","last_became_peered":"2024-09-19T06:05:24.704501+0000","last_unstale":"2024-09-19T06:07:19.831508+0000","last_undegraded":"2024-09-19T06:07:19.831508+0000","last_fullsized":"2024-09-19T06:07:19.831508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'8","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:20.029873+0000","last_change":"2024-09-19T06:05:22.687857+0000","last_active":"2024-09-19T06:07:20.029873+0000","last_peered":"2024-09-19T06:07:20.029873+0000","last_clean":"2024-09-19T06:07:20.029873+0000","last_became_active":"2024-09-19T06:05:22.687573+0000","last_became_peered":"2024-09-19T06:05:22.687573+0000","last_unstale":"2024-09-19T06:07:20.029873+0000","last_undegraded":"2024-09-19T06:07:20.029873+0000","last_fullsized":"2024-09-19T06:07:20.029873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:31.972444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838777+0000","last_change":"2024-09-19T06:05:46.904521+0000","last_active":"2024-09-19T06:07:19.838777+0000","last_peered":"2024-09-19T06:07:19.838777+0000","last_clean":"2024-09-19T06:07:19.838777+0000","last_became_active":"2024-09-19T06:05:46.904146+0000","last_became_peered":"2024-09-19T06:05:46.904146+0000","last_unstale":"2024-09-19T06:07:19.838777+0000","last_undegraded":"2024-09-19T06:07:19.838777+0000","last_fullsized":"2024-09-19T06:07:19.838777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:48.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.750690+0000","last_change":"2024-09-19T06:05:22.680500+0000","last_active":"2024-09-19T06:07:19.750690+0000","last_peered":"2024-09-19T06:07:19.750690+0000","last_clean":"2024-09-19T06:07:19.750690+0000","last_became_active":"2024-09-19T06:05:22.679947+0000","last_became_peered":"2024-09-19T06:05:22.679947+0000","last_unstale":"2024-09-19T06:07:19.750690+0000","last_undegraded":"2024-09-19T06:07:19.750690+0000","last_fullsized":"2024-09-19T06:07:19.750690+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:34.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747505+0000","last_change":"2024-09-19T06:05:22.680962+0000","last_active":"2024-09-19T06:07:19.747505+0000","last_peered":"2024-09-19T06:07:19.747505+0000","last_clean":"2024-09-19T06:07:19.747505+0000","last_became_active":"2024-09-19T06:05:22.680662+0000","last_became_peered":"2024-09-19T06:05:22.680662+0000","last_unstale":"2024-09-19T06:07:19.747505+0000","last_undegraded":"2024-09-19T06:07:19.747505+0000","last_fullsized":"2024-09-19T06:07:19.747505+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.296422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831912+0000","last_change":"2024-09-19T06:05:24.695214+0000","last_active":"2024-09-19T06:07:19.831912+0000","last_peered":"2024-09-19T06:07:19.831912+0000","last_clean":"2024-09-19T06:07:19.831912+0000","last_became_active":"2024-09-19T06:05:24.694930+0000","last_became_peered":"2024-09-19T06:05:24.694930+0000","last_unstale":"2024-09-19T06:07:19.831912+0000","last_undegraded":"2024-09-19T06:07:19.831912+0000","last_fullsized":"2024-09-19T06:07:19.831912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:51.382934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838861+0000","last_change":"2024-09-19T06:05:22.684504+0000","last_active":"2024-09-19T06:07:19.838861+0000","last_peered":"2024-09-19T06:07:19.838861+0000","last_clean":"2024-09-19T06:07:19.838861+0000","last_became_active":"2024-09-19T06:05:22.684169+0000","last_became_peered":"2024-09-19T06:05:22.684169+0000","last_unstale":"2024-09-19T06:07:19.838861+0000","last_undegraded":"2024-09-19T06:07:19.838861+0000","last_fullsized":"2024-09-19T06:07:19.838861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:29.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.828826+0000","last_change":"2024-09-19T06:05:24.693056+0000","last_active":"2024-09-19T06:07:19.828826+0000","last_peered":"2024-09-19T06:07:19.828826+0000","last_clean":"2024-09-19T06:07:19.828826+0000","last_became_active":"2024-09-19T06:05:24.692544+0000","last_became_peered":"2024-09-19T06:05:24.692544+0000","last_unstale":"2024-09-19T06:07:19.828826+0000","last_undegraded":"2024-09-19T06:07:19.828826+0000","last_fullsized":"2024-09-19T06:07:19.828826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:45.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.751255+0000","last_change":"2024-09-19T06:05:22.682854+0000","last_active":"2024-09-19T06:07:19.751255+0000","last_peered":"2024-09-19T06:07:19.751255+0000","last_clean":"2024-09-19T06:07:19.751255+0000","last_became_active":"2024-09-19T06:05:22.682406+0000","last_became_peered":"2024-09-19T06:05:22.682406+0000","last_unstale":"2024-09-19T06:07:19.751255+0000","last_undegraded":"2024-09-19T06:07:19.751255+0000","last_fullsized":"2024-09-19T06:07:19.751255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.206144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983271+0000","last_change":"2024-09-19T06:05:24.699408+0000","last_active":"2024-09-19T06:07:19.983271+0000","last_peered":"2024-09-19T06:07:19.983271+0000","last_clean":"2024-09-19T06:07:19.983271+0000","last_became_active":"2024-09-19T06:05:24.699106+0000","last_became_peered":"2024-09-19T06:05:24.699106+0000","last_unstale":"2024-09-19T06:07:19.983271+0000","last_undegraded":"2024-09-19T06:07:19.983271+0000","last_fullsized":"2024-09-19T06:07:19.983271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:37.487458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983708+0000","last_change":"2024-09-19T06:05:22.686106+0000","last_active":"2024-09-19T06:07:19.983708+0000","last_peered":"2024-09-19T06:07:19.983708+0000","last_clean":"2024-09-19T06:07:19.983708+0000","last_became_active":"2024-09-19T06:05:22.685763+0000","last_became_peered":"2024-09-19T06:05:22.685763+0000","last_unstale":"2024-09-19T06:07:19.983708+0000","last_undegraded":"2024-09-19T06:07:19.983708+0000","last_fullsized":"2024-09-19T06:07:19.983708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:57.889128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983989+0000","last_change":"2024-09-19T06:05:46.524038+0000","last_active":"2024-09-19T06:07:19.983989+0000","last_peered":"2024-09-19T06:07:19.983989+0000","last_clean":"2024-09-19T06:07:19.983989+0000","last_became_active":"2024-09-19T06:05:46.523746+0000","last_became_peered":"2024-09-19T06:05:46.523746+0000","last_unstale":"2024-09-19T06:07:19.983989+0000","last_undegraded":"2024-09-19T06:07:19.983989+0000","last_fullsized":"2024-09-19T06:07:19.983989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:17.361840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.839043+0000","last_change":"2024-09-19T06:05:23.060545+0000","last_active":"2024-09-19T06:07:19.839043+0000","last_peered":"2024-09-19T06:07:19.839043+0000","last_clean":"2024-09-19T06:07:19.839043+0000","last_became_active":"2024-09-19T06:05:23.060187+0000","last_became_peered":"2024-09-19T06:05:23.060187+0000","last_unstale":"2024-09-19T06:07:19.839043+0000","last_undegraded":"2024-09-19T06:07:19.839043+0000","last_fullsized":"2024-09-19T06:07:19.839043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.604284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983213+0000","last_change":"2024-09-19T06:05:24.702535+0000","last_active":"2024-09-19T06:07:19.983213+0000","last_peered":"2024-09-19T06:07:19.983213+0000","last_clean":"2024-09-19T06:07:19.983213+0000","last_became_active":"2024-09-19T06:05:24.701616+0000","last_became_peered":"2024-09-19T06:05:24.701616+0000","last_unstale":"2024-09-19T06:07:19.983213+0000","last_undegraded":"2024-09-19T06:07:19.983213+0000","last_fullsized":"2024-09-19T06:07:19.983213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:43.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'35","reported_seq":281,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:20.031390+0000","last_change":"2024-09-19T06:05:22.685460+0000","last_active":"2024-09-19T06:07:20.031390+0000","last_peered":"2024-09-19T06:07:20.031390+0000","last_clean":"2024-09-19T06:07:20.031390+0000","last_became_active":"2024-09-19T06:05:22.685086+0000","last_became_peered":"2024-09-19T06:05:22.685086+0000","last_unstale":"2024-09-19T06:07:20.031390+0000","last_undegraded":"2024-09-19T06:07:20.031390+0000","last_fullsized":"2024-09-19T06:07:20.031390+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:10.373783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65608,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":170,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831730+0000","last_change":"2024-09-19T06:05:24.700431+0000","last_active":"2024-09-19T06:07:19.831730+0000","last_peered":"2024-09-19T06:07:19.831730+0000","last_clean":"2024-09-19T06:07:19.831730+0000","last_became_active":"2024-09-19T06:05:24.700092+0000","last_became_peered":"2024-09-19T06:05:24.700092+0000","last_unstale":"2024-09-19T06:07:19.831730+0000","last_undegraded":"2024-09-19T06:07:19.831730+0000","last_fullsized":"2024-09-19T06:07:19.831730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:17.208392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748475+0000","last_change":"2024-09-19T06:05:46.530433+0000","last_active":"2024-09-19T06:07:19.748475+0000","last_peered":"2024-09-19T06:07:19.748475+0000","last_clean":"2024-09-19T06:07:19.748475+0000","last_became_active":"2024-09-19T06:05:46.521700+0000","last_became_peered":"2024-09-19T06:05:46.521700+0000","last_unstale":"2024-09-19T06:07:19.748475+0000","last_undegraded":"2024-09-19T06:07:19.748475+0000","last_fullsized":"2024-09-19T06:07:19.748475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:40.489547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747529+0000","last_change":"2024-09-19T06:05:24.699149+0000","last_active":"2024-09-19T06:07:19.747529+0000","last_peered":"2024-09-19T06:07:19.747529+0000","last_clean":"2024-09-19T06:07:19.747529+0000","last_became_active":"2024-09-19T06:05:24.698846+0000","last_became_peered":"2024-09-19T06:05:24.698846+0000","last_unstale":"2024-09-19T06:07:19.747529+0000","last_undegraded":"2024-09-19T06:07:19.747529+0000","last_fullsized":"2024-09-19T06:07:19.747529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:19.416169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838769+0000","last_change":"2024-09-19T06:05:22.682157+0000","last_active":"2024-09-19T06:07:19.838769+0000","last_peered":"2024-09-19T06:07:19.838769+0000","last_clean":"2024-09-19T06:07:19.838769+0000","last_became_active":"2024-09-19T06:05:22.681816+0000","last_became_peered":"2024-09-19T06:05:22.681816+0000","last_unstale":"2024-09-19T06:07:19.838769+0000","last_undegraded":"2024-09-19T06:07:19.838769+0000","last_fullsized":"2024-09-19T06:07:19.838769+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:05.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983151+0000","last_change":"2024-09-19T06:05:24.699233+0000","last_active":"2024-09-19T06:07:19.983151+0000","last_peered":"2024-09-19T06:07:19.983151+0000","last_clean":"2024-09-19T06:07:19.983151+0000","last_became_active":"2024-09-19T06:05:24.698918+0000","last_became_peered":"2024-09-19T06:05:24.698918+0000","last_unstale":"2024-09-19T06:07:19.983151+0000","last_undegraded":"2024-09-19T06:07:19.983151+0000","last_fullsized":"2024-09-19T06:07:19.983151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:20.037927+0000","last_change":"2024-09-19T06:05:22.682161+0000","last_active":"2024-09-19T06:07:20.037927+0000","last_peered":"2024-09-19T06:07:20.037927+0000","last_clean":"2024-09-19T06:07:20.037927+0000","last_became_active":"2024-09-19T06:05:22.681805+0000","last_became_peered":"2024-09-19T06:05:22.681805+0000","last_unstale":"2024-09-19T06:07:20.037927+0000","last_undegraded":"2024-09-19T06:07:20.037927+0000","last_fullsized":"2024-09-19T06:07:20.037927+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:27.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1476,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983620+0000","last_change":"2024-09-19T06:05:24.703668+0000","last_active":"2024-09-19T06:07:19.983620+0000","last_peered":"2024-09-19T06:07:19.983620+0000","last_clean":"2024-09-19T06:07:19.983620+0000","last_became_active":"2024-09-19T06:05:24.703342+0000","last_became_peered":"2024-09-19T06:05:24.703342+0000","last_unstale":"2024-09-19T06:07:19.983620+0000","last_undegraded":"2024-09-19T06:07:19.983620+0000","last_fullsized":"2024-09-19T06:07:19.983620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:30.399187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831473+0000","last_change":"2024-09-19T06:05:23.060458+0000","last_active":"2024-09-19T06:07:19.831473+0000","last_peered":"2024-09-19T06:07:19.831473+0000","last_clean":"2024-09-19T06:07:19.831473+0000","last_became_active":"2024-09-19T06:05:23.060098+0000","last_became_peered":"2024-09-19T06:05:23.060098+0000","last_unstale":"2024-09-19T06:07:19.831473+0000","last_undegraded":"2024-09-19T06:07:19.831473+0000","last_fullsized":"2024-09-19T06:07:19.831473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:58.800162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838711+0000","last_change":"2024-09-19T06:05:24.699832+0000","last_active":"2024-09-19T06:07:19.838711+0000","last_peered":"2024-09-19T06:07:19.838711+0000","last_clean":"2024-09-19T06:07:19.838711+0000","last_became_active":"2024-09-19T06:05:24.697600+0000","last_became_peered":"2024-09-19T06:05:24.697600+0000","last_unstale":"2024-09-19T06:07:19.838711+0000","last_undegraded":"2024-09-19T06:07:19.838711+0000","last_fullsized":"2024-09-19T06:07:19.838711+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:15.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831904+0000","last_change":"2024-09-19T06:05:22.682962+0000","last_active":"2024-09-19T06:07:19.831904+0000","last_peered":"2024-09-19T06:07:19.831904+0000","last_clean":"2024-09-19T06:07:19.831904+0000","last_became_active":"2024-09-19T06:05:22.682573+0000","last_became_peered":"2024-09-19T06:05:22.682573+0000","last_unstale":"2024-09-19T06:07:19.831904+0000","last_undegraded":"2024-09-19T06:07:19.831904+0000","last_fullsized":"2024-09-19T06:07:19.831904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:31.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748646+0000","last_change":"2024-09-19T06:05:46.907103+0000","last_active":"2024-09-19T06:07:19.748646+0000","last_peered":"2024-09-19T06:07:19.748646+0000","last_clean":"2024-09-19T06:07:19.748646+0000","last_became_active":"2024-09-19T06:05:46.906741+0000","last_became_peered":"2024-09-19T06:05:46.906741+0000","last_unstale":"2024-09-19T06:07:19.748646+0000","last_undegraded":"2024-09-19T06:07:19.748646+0000","last_fullsized":"2024-09-19T06:07:19.748646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:42.275594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748126+0000","last_change":"2024-09-19T06:05:22.684007+0000","last_active":"2024-09-19T06:07:19.748126+0000","last_peered":"2024-09-19T06:07:19.748126+0000","last_clean":"2024-09-19T06:07:19.748126+0000","last_became_active":"2024-09-19T06:05:22.683606+0000","last_became_peered":"2024-09-19T06:05:22.683606+0000","last_unstale":"2024-09-19T06:07:19.748126+0000","last_undegraded":"2024-09-19T06:07:19.748126+0000","last_fullsized":"2024-09-19T06:07:19.748126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:29.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983666+0000","last_change":"2024-09-19T06:05:24.698057+0000","last_active":"2024-09-19T06:07:19.983666+0000","last_peered":"2024-09-19T06:07:19.983666+0000","last_clean":"2024-09-19T06:07:19.983666+0000","last_became_active":"2024-09-19T06:05:24.697604+0000","last_became_peered":"2024-09-19T06:05:24.697604+0000","last_unstale":"2024-09-19T06:07:19.983666+0000","last_undegraded":"2024-09-19T06:07:19.983666+0000","last_fullsized":"2024-09-19T06:07:19.983666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:33.246096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.959611+0000","last_change":"2024-09-19T06:05:22.680641+0000","last_active":"2024-09-19T06:07:19.959611+0000","last_peered":"2024-09-19T06:07:19.959611+0000","last_clean":"2024-09-19T06:07:19.959611+0000","last_became_active":"2024-09-19T06:05:22.680282+0000","last_became_peered":"2024-09-19T06:05:22.680282+0000","last_unstale":"2024-09-19T06:07:19.959611+0000","last_undegraded":"2024-09-19T06:07:19.959611+0000","last_fullsized":"2024-09-19T06:07:19.959611+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:07.171581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983468+0000","last_change":"2024-09-19T06:05:24.705525+0000","last_active":"2024-09-19T06:07:19.983468+0000","last_peered":"2024-09-19T06:07:19.983468+0000","last_clean":"2024-09-19T06:07:19.983468+0000","last_became_active":"2024-09-19T06:05:24.705226+0000","last_became_peered":"2024-09-19T06:05:24.705226+0000","last_unstale":"2024-09-19T06:07:19.983468+0000","last_undegraded":"2024-09-19T06:07:19.983468+0000","last_fullsized":"2024-09-19T06:07:19.983468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:51.020525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982028+0000","last_change":"2024-09-19T06:05:23.060628+0000","last_active":"2024-09-19T06:07:19.982028+0000","last_peered":"2024-09-19T06:07:19.982028+0000","last_clean":"2024-09-19T06:07:19.982028+0000","last_became_active":"2024-09-19T06:05:23.060066+0000","last_became_peered":"2024-09-19T06:05:23.060066+0000","last_unstale":"2024-09-19T06:07:19.982028+0000","last_undegraded":"2024-09-19T06:07:19.982028+0000","last_fullsized":"2024-09-19T06:07:19.982028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:55.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983885+0000","last_change":"2024-09-19T06:05:24.701994+0000","last_active":"2024-09-19T06:07:19.983885+0000","last_peered":"2024-09-19T06:07:19.983885+0000","last_clean":"2024-09-19T06:07:19.983885+0000","last_became_active":"2024-09-19T06:05:24.701648+0000","last_became_peered":"2024-09-19T06:05:24.701648+0000","last_unstale":"2024-09-19T06:07:19.983885+0000","last_undegraded":"2024-09-19T06:07:19.983885+0000","last_fullsized":"2024-09-19T06:07:19.983885+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:16.475339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983778+0000","last_change":"2024-09-19T06:04:14.186274+0000","last_active":"2024-09-19T06:07:19.983778+0000","last_peered":"2024-09-19T06:07:19.983778+0000","last_clean":"2024-09-19T06:07:19.983778+0000","last_became_active":"2024-09-19T06:04:14.185907+0000","last_became_peered":"2024-09-19T06:04:14.185907+0000","last_unstale":"2024-09-19T06:07:19.983778+0000","last_undegraded":"2024-09-19T06:07:19.983778+0000","last_fullsized":"2024-09-19T06:07:19.983778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_clean_scrub_stamp":"2024-09-19T06:00:59.680614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:01.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982897+0000","last_change":"2024-09-19T06:05:22.682242+0000","last_active":"2024-09-19T06:07:19.982897+0000","last_peered":"2024-09-19T06:07:19.982897+0000","last_clean":"2024-09-19T06:07:19.982897+0000","last_became_active":"2024-09-19T06:05:22.681896+0000","last_became_peered":"2024-09-19T06:05:22.681896+0000","last_unstale":"2024-09-19T06:07:19.982897+0000","last_undegraded":"2024-09-19T06:07:19.982897+0000","last_fullsized":"2024-09-19T06:07:19.982897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.119422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.828930+0000","last_change":"2024-09-19T06:05:46.962541+0000","last_active":"2024-09-19T06:07:19.828930+0000","last_peered":"2024-09-19T06:07:19.828930+0000","last_clean":"2024-09-19T06:07:19.828930+0000","last_became_active":"2024-09-19T06:05:46.962261+0000","last_became_peered":"2024-09-19T06:05:46.962261+0000","last_unstale":"2024-09-19T06:07:19.828930+0000","last_undegraded":"2024-09-19T06:07:19.828930+0000","last_fullsized":"2024-09-19T06:07:19.828930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:36.355129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983752+0000","last_change":"2024-09-19T06:05:22.685809+0000","last_active":"2024-09-19T06:07:19.983752+0000","last_peered":"2024-09-19T06:07:19.983752+0000","last_clean":"2024-09-19T06:07:19.983752+0000","last_became_active":"2024-09-19T06:05:22.685466+0000","last_became_peered":"2024-09-19T06:05:22.685466+0000","last_unstale":"2024-09-19T06:07:19.983752+0000","last_undegraded":"2024-09-19T06:07:19.983752+0000","last_fullsized":"2024-09-19T06:07:19.983752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:43.793845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747729+0000","last_change":"2024-09-19T06:05:24.701105+0000","last_active":"2024-09-19T06:07:19.747729+0000","last_peered":"2024-09-19T06:07:19.747729+0000","last_clean":"2024-09-19T06:07:19.747729+0000","last_became_active":"2024-09-19T06:05:24.700825+0000","last_became_peered":"2024-09-19T06:05:24.700825+0000","last_unstale":"2024-09-19T06:07:19.747729+0000","last_undegraded":"2024-09-19T06:07:19.747729+0000","last_fullsized":"2024-09-19T06:07:19.747729+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:35.707437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747671+0000","last_change":"2024-09-19T06:05:23.059587+0000","last_active":"2024-09-19T06:07:19.747671+0000","last_peered":"2024-09-19T06:07:19.747671+0000","last_clean":"2024-09-19T06:07:19.747671+0000","last_became_active":"2024-09-19T06:05:23.059248+0000","last_became_peered":"2024-09-19T06:05:23.059248+0000","last_unstale":"2024-09-19T06:07:19.747671+0000","last_undegraded":"2024-09-19T06:07:19.747671+0000","last_fullsized":"2024-09-19T06:07:19.747671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:25.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838746+0000","last_change":"2024-09-19T06:05:24.701610+0000","last_active":"2024-09-19T06:07:19.838746+0000","last_peered":"2024-09-19T06:07:19.838746+0000","last_clean":"2024-09-19T06:07:19.838746+0000","last_became_active":"2024-09-19T06:05:24.697296+0000","last_became_peered":"2024-09-19T06:05:24.697296+0000","last_unstale":"2024-09-19T06:07:19.838746+0000","last_undegraded":"2024-09-19T06:07:19.838746+0000","last_fullsized":"2024-09-19T06:07:19.838746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:52.256284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983775+0000","last_change":"2024-09-19T06:05:22.684818+0000","last_active":"2024-09-19T06:07:19.983775+0000","last_peered":"2024-09-19T06:07:19.983775+0000","last_clean":"2024-09-19T06:07:19.983775+0000","last_became_active":"2024-09-19T06:05:22.684211+0000","last_became_peered":"2024-09-19T06:05:22.684211+0000","last_unstale":"2024-09-19T06:07:19.983775+0000","last_undegraded":"2024-09-19T06:07:19.983775+0000","last_fullsized":"2024-09-19T06:07:19.983775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:50.711805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.750888+0000","last_change":"2024-09-19T06:05:24.702992+0000","last_active":"2024-09-19T06:07:19.750888+0000","last_peered":"2024-09-19T06:07:19.750888+0000","last_clean":"2024-09-19T06:07:19.750888+0000","last_became_active":"2024-09-19T06:05:24.702643+0000","last_became_peered":"2024-09-19T06:05:24.702643+0000","last_unstale":"2024-09-19T06:07:19.750888+0000","last_undegraded":"2024-09-19T06:07:19.750888+0000","last_fullsized":"2024-09-19T06:07:19.750888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:40.651861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.829239+0000","last_change":"2024-09-19T06:05:23.060444+0000","last_active":"2024-09-19T06:07:19.829239+0000","last_peered":"2024-09-19T06:07:19.829239+0000","last_clean":"2024-09-19T06:07:19.829239+0000","last_became_active":"2024-09-19T06:05:23.059879+0000","last_became_peered":"2024-09-19T06:05:23.059879+0000","last_unstale":"2024-09-19T06:07:19.829239+0000","last_undegraded":"2024-09-19T06:07:19.829239+0000","last_fullsized":"2024-09-19T06:07:19.829239+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:39.013096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.751068+0000","last_change":"2024-09-19T06:05:24.694892+0000","last_active":"2024-09-19T06:07:19.751068+0000","last_peered":"2024-09-19T06:07:19.751068+0000","last_clean":"2024-09-19T06:07:19.751068+0000","last_became_active":"2024-09-19T06:05:24.694534+0000","last_became_peered":"2024-09-19T06:05:24.694534+0000","last_unstale":"2024-09-19T06:07:19.751068+0000","last_undegraded":"2024-09-19T06:07:19.751068+0000","last_fullsized":"2024-09-19T06:07:19.751068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:50.633035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831903+0000","last_change":"2024-09-19T06:05:23.060597+0000","last_active":"2024-09-19T06:07:19.831903+0000","last_peered":"2024-09-19T06:07:19.831903+0000","last_clean":"2024-09-19T06:07:19.831903+0000","last_became_active":"2024-09-19T06:05:23.060235+0000","last_became_peered":"2024-09-19T06:05:23.060235+0000","last_unstale":"2024-09-19T06:07:19.831903+0000","last_undegraded":"2024-09-19T06:07:19.831903+0000","last_fullsized":"2024-09-19T06:07:19.831903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:54.517780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747923+0000","last_change":"2024-09-19T06:05:24.698131+0000","last_active":"2024-09-19T06:07:19.747923+0000","last_peered":"2024-09-19T06:07:19.747923+0000","last_clean":"2024-09-19T06:07:19.747923+0000","last_became_active":"2024-09-19T06:05:24.697784+0000","last_became_peered":"2024-09-19T06:05:24.697784+0000","last_unstale":"2024-09-19T06:07:19.747923+0000","last_undegraded":"2024-09-19T06:07:19.747923+0000","last_fullsized":"2024-09-19T06:07:19.747923+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:49.563908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'46","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.963022+0000","last_change":"2024-09-19T06:05:22.679532+0000","last_active":"2024-09-19T06:07:19.963022+0000","last_peered":"2024-09-19T06:07:19.963022+0000","last_clean":"2024-09-19T06:07:19.963022+0000","last_became_active":"2024-09-19T06:05:22.679156+0000","last_became_peered":"2024-09-19T06:05:22.679156+0000","last_unstale":"2024-09-19T06:07:19.963022+0000","last_undegraded":"2024-09-19T06:07:19.963022+0000","last_fullsized":"2024-09-19T06:07:19.963022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:31.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":83,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833475+0000","last_change":"2024-09-19T06:05:24.698383+0000","last_active":"2024-09-19T06:07:19.833475+0000","last_peered":"2024-09-19T06:07:19.833475+0000","last_clean":"2024-09-19T06:07:19.833475+0000","last_became_active":"2024-09-19T06:05:24.698044+0000","last_became_peered":"2024-09-19T06:05:24.698044+0000","last_unstale":"2024-09-19T06:07:19.833475+0000","last_undegraded":"2024-09-19T06:07:19.833475+0000","last_fullsized":"2024-09-19T06:07:19.833475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:53.388847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983321+0000","last_change":"2024-09-19T06:05:22.684799+0000","last_active":"2024-09-19T06:07:19.983321+0000","last_peered":"2024-09-19T06:07:19.983321+0000","last_clean":"2024-09-19T06:07:19.983321+0000","last_became_active":"2024-09-19T06:05:22.684376+0000","last_became_peered":"2024-09-19T06:05:22.684376+0000","last_unstale":"2024-09-19T06:07:19.983321+0000","last_undegraded":"2024-09-19T06:07:19.983321+0000","last_fullsized":"2024-09-19T06:07:19.983321+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.124960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983541+0000","last_change":"2024-09-19T06:05:24.693751+0000","last_active":"2024-09-19T06:07:19.983541+0000","last_peered":"2024-09-19T06:07:19.983541+0000","last_clean":"2024-09-19T06:07:19.983541+0000","last_became_active":"2024-09-19T06:05:24.693442+0000","last_became_peered":"2024-09-19T06:05:24.693442+0000","last_unstale":"2024-09-19T06:07:19.983541+0000","last_undegraded":"2024-09-19T06:07:19.983541+0000","last_fullsized":"2024-09-19T06:07:19.983541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:46.491860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982675+0000","last_change":"2024-09-19T06:05:23.060522+0000","last_active":"2024-09-19T06:07:19.982675+0000","last_peered":"2024-09-19T06:07:19.982675+0000","last_clean":"2024-09-19T06:07:19.982675+0000","last_became_active":"2024-09-19T06:05:23.060170+0000","last_became_peered":"2024-09-19T06:05:23.060170+0000","last_unstale":"2024-09-19T06:07:19.982675+0000","last_undegraded":"2024-09-19T06:07:19.982675+0000","last_fullsized":"2024-09-19T06:07:19.982675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:54.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831493+0000","last_change":"2024-09-19T06:05:24.701242+0000","last_active":"2024-09-19T06:07:19.831493+0000","last_peered":"2024-09-19T06:07:19.831493+0000","last_clean":"2024-09-19T06:07:19.831493+0000","last_became_active":"2024-09-19T06:05:24.700813+0000","last_became_peered":"2024-09-19T06:05:24.700813+0000","last_unstale":"2024-09-19T06:07:19.831493+0000","last_undegraded":"2024-09-19T06:07:19.831493+0000","last_fullsized":"2024-09-19T06:07:19.831493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:42.706448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831877+0000","last_change":"2024-09-19T06:05:22.677502+0000","last_active":"2024-09-19T06:07:19.831877+0000","last_peered":"2024-09-19T06:07:19.831877+0000","last_clean":"2024-09-19T06:07:19.831877+0000","last_became_active":"2024-09-19T06:05:22.677082+0000","last_became_peered":"2024-09-19T06:05:22.677082+0000","last_unstale":"2024-09-19T06:07:19.831877+0000","last_undegraded":"2024-09-19T06:07:19.831877+0000","last_fullsized":"2024-09-19T06:07:19.831877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:30.991778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748429+0000","last_change":"2024-09-19T06:05:24.703155+0000","last_active":"2024-09-19T06:07:19.748429+0000","last_peered":"2024-09-19T06:07:19.748429+0000","last_clean":"2024-09-19T06:07:19.748429+0000","last_became_active":"2024-09-19T06:05:24.702570+0000","last_became_peered":"2024-09-19T06:05:24.702570+0000","last_unstale":"2024-09-19T06:07:19.748429+0000","last_undegraded":"2024-09-19T06:07:19.748429+0000","last_fullsized":"2024-09-19T06:07:19.748429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:36.016886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'2","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748368+0000","last_change":"2024-09-19T06:05:46.532666+0000","last_active":"2024-09-19T06:07:19.748368+0000","last_peered":"2024-09-19T06:07:19.748368+0000","last_clean":"2024-09-19T06:07:19.748368+0000","last_became_active":"2024-09-19T06:05:46.523271+0000","last_became_peered":"2024-09-19T06:05:46.523271+0000","last_unstale":"2024-09-19T06:07:19.748368+0000","last_undegraded":"2024-09-19T06:07:19.748368+0000","last_fullsized":"2024-09-19T06:07:19.748368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:04.627727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.832300+0000","last_change":"2024-09-19T06:05:24.694476+0000","last_active":"2024-09-19T06:07:19.832300+0000","last_peered":"2024-09-19T06:07:19.832300+0000","last_clean":"2024-09-19T06:07:19.832300+0000","last_became_active":"2024-09-19T06:05:24.694147+0000","last_became_peered":"2024-09-19T06:05:24.694147+0000","last_unstale":"2024-09-19T06:07:19.832300+0000","last_undegraded":"2024-09-19T06:07:19.832300+0000","last_fullsized":"2024-09-19T06:07:19.832300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:48.830522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831587+0000","last_change":"2024-09-19T06:05:22.687422+0000","last_active":"2024-09-19T06:07:19.831587+0000","last_peered":"2024-09-19T06:07:19.831587+0000","last_clean":"2024-09-19T06:07:19.831587+0000","last_became_active":"2024-09-19T06:05:22.686950+0000","last_became_peered":"2024-09-19T06:05:22.686950+0000","last_unstale":"2024-09-19T06:07:19.831587+0000","last_undegraded":"2024-09-19T06:07:19.831587+0000","last_fullsized":"2024-09-19T06:07:19.831587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:49.279769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983692+0000","last_change":"2024-09-19T06:05:24.695701+0000","last_active":"2024-09-19T06:07:19.983692+0000","last_peered":"2024-09-19T06:07:19.983692+0000","last_clean":"2024-09-19T06:07:19.983692+0000","last_became_active":"2024-09-19T06:05:24.695341+0000","last_became_peered":"2024-09-19T06:05:24.695341+0000","last_unstale":"2024-09-19T06:07:19.983692+0000","last_undegraded":"2024-09-19T06:07:19.983692+0000","last_fullsized":"2024-09-19T06:07:19.983692+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:52.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838983+0000","last_change":"2024-09-19T06:05:24.703456+0000","last_active":"2024-09-19T06:07:19.838983+0000","last_peered":"2024-09-19T06:07:19.838983+0000","last_clean":"2024-09-19T06:07:19.838983+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:07:19.838983+0000","last_undegraded":"2024-09-19T06:07:19.838983+0000","last_fullsized":"2024-09-19T06:07:19.838983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:15.159843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831759+0000","last_change":"2024-09-19T06:05:22.683833+0000","last_active":"2024-09-19T06:07:19.831759+0000","last_peered":"2024-09-19T06:07:19.831759+0000","last_clean":"2024-09-19T06:07:19.831759+0000","last_became_active":"2024-09-19T06:05:22.683439+0000","last_became_peered":"2024-09-19T06:05:22.683439+0000","last_unstale":"2024-09-19T06:07:19.831759+0000","last_undegraded":"2024-09-19T06:07:19.831759+0000","last_fullsized":"2024-09-19T06:07:19.831759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:52.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983107+0000","last_change":"2024-09-19T06:05:24.695905+0000","last_active":"2024-09-19T06:07:19.983107+0000","last_peered":"2024-09-19T06:07:19.983107+0000","last_clean":"2024-09-19T06:07:19.983107+0000","last_became_active":"2024-09-19T06:05:24.695570+0000","last_became_peered":"2024-09-19T06:05:24.695570+0000","last_unstale":"2024-09-19T06:07:19.983107+0000","last_undegraded":"2024-09-19T06:07:19.983107+0000","last_fullsized":"2024-09-19T06:07:19.983107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:00.167126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831795+0000","last_change":"2024-09-19T06:05:22.686853+0000","last_active":"2024-09-19T06:07:19.831795+0000","last_peered":"2024-09-19T06:07:19.831795+0000","last_clean":"2024-09-19T06:07:19.831795+0000","last_became_active":"2024-09-19T06:05:22.686143+0000","last_became_peered":"2024-09-19T06:05:22.686143+0000","last_unstale":"2024-09-19T06:07:19.831795+0000","last_undegraded":"2024-09-19T06:07:19.831795+0000","last_fullsized":"2024-09-19T06:07:19.831795+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:30.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983866+0000","last_change":"2024-09-19T06:05:24.702420+0000","last_active":"2024-09-19T06:07:19.983866+0000","last_peered":"2024-09-19T06:07:19.983866+0000","last_clean":"2024-09-19T06:07:19.983866+0000","last_became_active":"2024-09-19T06:05:24.702140+0000","last_became_peered":"2024-09-19T06:05:24.702140+0000","last_unstale":"2024-09-19T06:07:19.983866+0000","last_undegraded":"2024-09-19T06:07:19.983866+0000","last_fullsized":"2024-09-19T06:07:19.983866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:27.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833352+0000","last_change":"2024-09-19T06:05:23.059638+0000","last_active":"2024-09-19T06:07:19.833352+0000","last_peered":"2024-09-19T06:07:19.833352+0000","last_clean":"2024-09-19T06:07:19.833352+0000","last_became_active":"2024-09-19T06:05:23.059273+0000","last_became_peered":"2024-09-19T06:05:23.059273+0000","last_unstale":"2024-09-19T06:07:19.833352+0000","last_undegraded":"2024-09-19T06:07:19.833352+0000","last_fullsized":"2024-09-19T06:07:19.833352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:56.981598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833048+0000","last_change":"2024-09-19T06:05:24.703608+0000","last_active":"2024-09-19T06:07:19.833048+0000","last_peered":"2024-09-19T06:07:19.833048+0000","last_clean":"2024-09-19T06:07:19.833048+0000","last_became_active":"2024-09-19T06:05:24.703300+0000","last_became_peered":"2024-09-19T06:05:24.703300+0000","last_unstale":"2024-09-19T06:07:19.833048+0000","last_undegraded":"2024-09-19T06:07:19.833048+0000","last_fullsized":"2024-09-19T06:07:19.833048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.063545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.829583+0000","last_change":"2024-09-19T06:05:22.679379+0000","last_active":"2024-09-19T06:07:19.829583+0000","last_peered":"2024-09-19T06:07:19.829583+0000","last_clean":"2024-09-19T06:07:19.829583+0000","last_became_active":"2024-09-19T06:05:22.679091+0000","last_became_peered":"2024-09-19T06:05:22.679091+0000","last_unstale":"2024-09-19T06:07:19.829583+0000","last_undegraded":"2024-09-19T06:07:19.829583+0000","last_fullsized":"2024-09-19T06:07:19.829583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596203,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":760,"num_read_kb":483,"num_write":288,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2015232,"data_stored":1788609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":436832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28768,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716384,"statfs":{"total":95995035648,"available":95965577216,"internally_reserved":0,"allocated":1724416,"data_stored":1226375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037806,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1298432,"data_stored":830250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32456,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712696,"statfs":{"total":95995035648,"available":95961800704,"internally_reserved":0,"allocated":1298432,"data_stored":830170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32652,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712500,"statfs":{"total":95995035648,"available":95961600000,"internally_reserved":0,"allocated":1499136,"data_stored":1030662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":436423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32792,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712360,"statfs":{"total":95995035648,"available":95961456640,"internally_reserved":0,"allocated":1646592,"data_stored":1160272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":437748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1437696,"data_stored":961550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":489637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":501824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":428796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":199674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:07:22.830 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.965+0000 7f9668ea5640 1 -- 172.21.15.103:0/3853999689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96641077f0 msgr2=0x7f9664109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.965+0000 7f9668ea5640 1 --2- 172.21.15.103:0/3853999689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96641077f0 0x7f9664109c60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f965c009ca0 tx=0x7f965c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.965+0000 7f9668ea5640 1 -- 172.21.15.103:0/3853999689 shutdown_connections 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.965+0000 7f9668ea5640 1 --2- 172.21.15.103:0/3853999689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96641077f0 0x7f9664109c60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.965+0000 7f9668ea5640 1 --2- 172.21.15.103:0/3853999689 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9664104ec0 0x7f96641072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.965+0000 7f9668ea5640 1 --2- 172.21.15.103:0/3853999689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102590 0x7f9664104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.965+0000 7f9668ea5640 1 -- 172.21.15.103:0/3853999689 >> 172.21.15.103:0/3853999689 conn(0x7f96640fc170 msgr2=0x7f96640fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.965+0000 7f9668ea5640 1 -- 172.21.15.103:0/3853999689 shutdown_connections 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.965+0000 7f9668ea5640 1 -- 172.21.15.103:0/3853999689 wait complete. 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9668ea5640 1 Processor -- start 2024-09-19T06:07:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9668ea5640 1 -- start start 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9668ea5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102590 0x7f9664197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9668ea5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9664104ec0 0x7f9664198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9668ea5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96641077f0 0x7f966419f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9668ea5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f966410d680 con 0x7f9664104ec0 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9668ea5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f966410d500 con 0x7f96641077f0 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9668ea5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f966410d800 con 0x7f9664102590 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9661d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9664104ec0 0x7f9664198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9661d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9664104ec0 0x7f9664198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40244/0 (socket says 172.21.15.103:40244) 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9661d9b640 1 -- 172.21.15.103:0/1029905009 learned_addr learned my addr 172.21.15.103:0/1029905009 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f966259c640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102590 0x7f9664197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9662d9d640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96641077f0 0x7f966419f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9661d9b640 1 -- 172.21.15.103:0/1029905009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102590 msgr2=0x7f9664197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9661d9b640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102590 0x7f9664197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9661d9b640 1 -- 172.21.15.103:0/1029905009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96641077f0 msgr2=0x7f966419f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:22.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9661d9b640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96641077f0 0x7f966419f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:22.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9661d9b640 1 -- 172.21.15.103:0/1029905009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966419f9d0 con 0x7f9664104ec0 2024-09-19T06:07:22.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.966+0000 7f9662d9d640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96641077f0 0x7f966419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:22.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.967+0000 7f9661d9b640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9664104ec0 0x7f9664198300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f965800e9c0 tx=0x7f965800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:22.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.967+0000 7f96537fe640 1 -- 172.21.15.103:0/1029905009 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965800cd80 con 0x7f9664104ec0 2024-09-19T06:07:22.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.967+0000 7f9668ea5640 1 -- 172.21.15.103:0/1029905009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966419fcc0 con 0x7f9664104ec0 2024-09-19T06:07:22.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.967+0000 7f96537fe640 1 -- 172.21.15.103:0/1029905009 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96580054d0 con 0x7f9664104ec0 2024-09-19T06:07:22.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.967+0000 7f96537fe640 1 -- 172.21.15.103:0/1029905009 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658010430 con 0x7f9664104ec0 2024-09-19T06:07:22.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.967+0000 7f9668ea5640 1 -- 172.21.15.103:0/1029905009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96641a01b0 con 0x7f9664104ec0 2024-09-19T06:07:22.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.968+0000 7f9668ea5640 1 -- 172.21.15.103:0/1029905009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96640fdc60 con 0x7f9664104ec0 2024-09-19T06:07:22.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.970+0000 7f96537fe640 1 -- 172.21.15.103:0/1029905009 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 23) ==== 138476+0+0 (secure 0 0 0) 0x7f9658004fb0 con 0x7f9664104ec0 2024-09-19T06:07:22.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.970+0000 7f96537fe640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f964c0a33c0 0x7f964c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:22.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.971+0000 7f96537fe640 1 -- 172.21.15.103:0/1029905009 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f96580d0210 con 0x7f9664104ec0 2024-09-19T06:07:22.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.971+0000 7f966259c640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f964c0a33c0 0x7f964c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:22.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.971+0000 7f966259c640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f964c0a33c0 0x7f964c0a5880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9664199290 tx=0x7f965400b390 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:22.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:22.975+0000 7f96537fe640 1 -- 172.21.15.103:0/1029905009 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f965809cc40 con 0x7f9664104ec0 2024-09-19T06:07:23.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.149+0000 7f9668ea5640 1 -- 172.21.15.103:0/1029905009 --> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9664062630 con 0x7f964c0a33c0 2024-09-19T06:07:23.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.155+0000 7f96537fe640 1 -- 172.21.15.103:0/1029905009 <== mgr.15189 v2:172.21.15.103:6800/266758959 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257729 (secure 0 0 0) 0x7f9664062630 con 0x7f964c0a33c0 2024-09-19T06:07:23.160 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:23.162 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T06:07:23.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.158+0000 7f9668ea5640 1 -- 172.21.15.103:0/1029905009 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f964c0a33c0 msgr2=0x7f964c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f964c0a33c0 0x7f964c0a5880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9664199290 tx=0x7f965400b390 comp rx=0 tx=0).stop 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 -- 172.21.15.103:0/1029905009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9664104ec0 msgr2=0x7f9664198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9664104ec0 0x7f9664198300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f965800e9c0 tx=0x7f965800ee80 comp rx=0 tx=0).stop 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 -- 172.21.15.103:0/1029905009 shutdown_connections 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f964c0a33c0 0x7f964c0a5880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96641077f0 0x7f966419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9664104ec0 0x7f9664198300 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 --2- 172.21.15.103:0/1029905009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102590 0x7f9664197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 -- 172.21.15.103:0/1029905009 >> 172.21.15.103:0/1029905009 conn(0x7f96640fc170 msgr2=0x7f9664102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 -- 172.21.15.103:0/1029905009 shutdown_connections 2024-09-19T06:07:23.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.159+0000 7f9668ea5640 1 -- 172.21.15.103:0/1029905009 wait complete. 2024-09-19T06:07:23.172 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:07:23.172 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.172 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.172 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.172 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.172 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.172 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: Unable to set osd_memory_target on smithi169 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: Unable to set osd_memory_target on smithi174 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.173 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:22 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.174 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T06:07:21.760511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186805,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":896,"num_read_kb":602,"num_write":471,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363400,"kb_used_data":14064,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578424,"statfs":{"total":1151940427776,"available":1151568306176,"internally_reserved":0,"allocated":14401536,"data_stored":8770539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.994240"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748742+0000","last_change":"2024-09-19T06:05:24.703290+0000","last_active":"2024-09-19T06:07:19.748742+0000","last_peered":"2024-09-19T06:07:19.748742+0000","last_clean":"2024-09-19T06:07:19.748742+0000","last_became_active":"2024-09-19T06:05:24.702343+0000","last_became_peered":"2024-09-19T06:05:24.702343+0000","last_unstale":"2024-09-19T06:07:19.748742+0000","last_undegraded":"2024-09-19T06:07:19.748742+0000","last_fullsized":"2024-09-19T06:07:19.748742+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.594004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983423+0000","last_change":"2024-09-19T06:05:24.700363+0000","last_active":"2024-09-19T06:07:19.983423+0000","last_peered":"2024-09-19T06:07:19.983423+0000","last_clean":"2024-09-19T06:07:19.983423+0000","last_became_active":"2024-09-19T06:05:24.700066+0000","last_became_peered":"2024-09-19T06:05:24.700066+0000","last_unstale":"2024-09-19T06:07:19.983423+0000","last_undegraded":"2024-09-19T06:07:19.983423+0000","last_fullsized":"2024-09-19T06:07:19.983423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:26.094195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983216+0000","last_change":"2024-09-19T06:05:24.702458+0000","last_active":"2024-09-19T06:07:19.983216+0000","last_peered":"2024-09-19T06:07:19.983216+0000","last_clean":"2024-09-19T06:07:19.983216+0000","last_became_active":"2024-09-19T06:05:24.702029+0000","last_became_peered":"2024-09-19T06:05:24.702029+0000","last_unstale":"2024-09-19T06:07:19.983216+0000","last_undegraded":"2024-09-19T06:07:19.983216+0000","last_fullsized":"2024-09-19T06:07:19.983216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983262+0000","last_change":"2024-09-19T06:05:24.699402+0000","last_active":"2024-09-19T06:07:19.983262+0000","last_peered":"2024-09-19T06:07:19.983262+0000","last_clean":"2024-09-19T06:07:19.983262+0000","last_became_active":"2024-09-19T06:05:24.698191+0000","last_became_peered":"2024-09-19T06:05:24.698191+0000","last_unstale":"2024-09-19T06:07:19.983262+0000","last_undegraded":"2024-09-19T06:07:19.983262+0000","last_fullsized":"2024-09-19T06:07:19.983262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.056347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831523+0000","last_change":"2024-09-19T06:05:24.699821+0000","last_active":"2024-09-19T06:07:19.831523+0000","last_peered":"2024-09-19T06:07:19.831523+0000","last_clean":"2024-09-19T06:07:19.831523+0000","last_became_active":"2024-09-19T06:05:24.699493+0000","last_became_peered":"2024-09-19T06:05:24.699493+0000","last_unstale":"2024-09-19T06:07:19.831523+0000","last_undegraded":"2024-09-19T06:07:19.831523+0000","last_fullsized":"2024-09-19T06:07:19.831523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:34.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.750647+0000","last_change":"2024-09-19T06:05:24.697821+0000","last_active":"2024-09-19T06:07:19.750647+0000","last_peered":"2024-09-19T06:07:19.750647+0000","last_clean":"2024-09-19T06:07:19.750647+0000","last_became_active":"2024-09-19T06:05:24.697495+0000","last_became_peered":"2024-09-19T06:05:24.697495+0000","last_unstale":"2024-09-19T06:07:19.750647+0000","last_undegraded":"2024-09-19T06:07:19.750647+0000","last_fullsized":"2024-09-19T06:07:19.750647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:03.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982865+0000","last_change":"2024-09-19T06:05:24.704610+0000","last_active":"2024-09-19T06:07:19.982865+0000","last_peered":"2024-09-19T06:07:19.982865+0000","last_clean":"2024-09-19T06:07:19.982865+0000","last_became_active":"2024-09-19T06:05:24.704288+0000","last_became_peered":"2024-09-19T06:05:24.704288+0000","last_unstale":"2024-09-19T06:07:19.982865+0000","last_undegraded":"2024-09-19T06:07:19.982865+0000","last_fullsized":"2024-09-19T06:07:19.982865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.530553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831687+0000","last_change":"2024-09-19T06:05:24.693662+0000","last_active":"2024-09-19T06:07:19.831687+0000","last_peered":"2024-09-19T06:07:19.831687+0000","last_clean":"2024-09-19T06:07:19.831687+0000","last_became_active":"2024-09-19T06:05:24.693327+0000","last_became_peered":"2024-09-19T06:05:24.693327+0000","last_unstale":"2024-09-19T06:07:19.831687+0000","last_undegraded":"2024-09-19T06:07:19.831687+0000","last_fullsized":"2024-09-19T06:07:19.831687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:39.646907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983592+0000","last_change":"2024-09-19T06:05:24.702552+0000","last_active":"2024-09-19T06:07:19.983592+0000","last_peered":"2024-09-19T06:07:19.983592+0000","last_clean":"2024-09-19T06:07:19.983592+0000","last_became_active":"2024-09-19T06:05:24.701090+0000","last_became_peered":"2024-09-19T06:05:24.701090+0000","last_unstale":"2024-09-19T06:07:19.983592+0000","last_undegraded":"2024-09-19T06:07:19.983592+0000","last_fullsized":"2024-09-19T06:07:19.983592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:44.361368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.751254+0000","last_change":"2024-09-19T06:05:46.524330+0000","last_active":"2024-09-19T06:07:19.751254+0000","last_peered":"2024-09-19T06:07:19.751254+0000","last_clean":"2024-09-19T06:07:19.751254+0000","last_became_active":"2024-09-19T06:05:46.523934+0000","last_became_peered":"2024-09-19T06:05:46.523934+0000","last_unstale":"2024-09-19T06:07:19.751254+0000","last_undegraded":"2024-09-19T06:07:19.751254+0000","last_fullsized":"2024-09-19T06:07:19.751254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:11:12.301698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983702+0000","last_change":"2024-09-19T06:05:24.703118+0000","last_active":"2024-09-19T06:07:19.983702+0000","last_peered":"2024-09-19T06:07:19.983702+0000","last_clean":"2024-09-19T06:07:19.983702+0000","last_became_active":"2024-09-19T06:05:24.702561+0000","last_became_peered":"2024-09-19T06:05:24.702561+0000","last_unstale":"2024-09-19T06:07:19.983702+0000","last_undegraded":"2024-09-19T06:07:19.983702+0000","last_fullsized":"2024-09-19T06:07:19.983702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:51.063256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983406+0000","last_change":"2024-09-19T06:05:24.698704+0000","last_active":"2024-09-19T06:07:19.983406+0000","last_peered":"2024-09-19T06:07:19.983406+0000","last_clean":"2024-09-19T06:07:19.983406+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:07:19.983406+0000","last_undegraded":"2024-09-19T06:07:19.983406+0000","last_fullsized":"2024-09-19T06:07:19.983406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:35.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747930+0000","last_change":"2024-09-19T06:05:24.696236+0000","last_active":"2024-09-19T06:07:19.747930+0000","last_peered":"2024-09-19T06:07:19.747930+0000","last_clean":"2024-09-19T06:07:19.747930+0000","last_became_active":"2024-09-19T06:05:24.695952+0000","last_became_peered":"2024-09-19T06:05:24.695952+0000","last_unstale":"2024-09-19T06:07:19.747930+0000","last_undegraded":"2024-09-19T06:07:19.747930+0000","last_fullsized":"2024-09-19T06:07:19.747930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:17.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982598+0000","last_change":"2024-09-19T06:05:24.699962+0000","last_active":"2024-09-19T06:07:19.982598+0000","last_peered":"2024-09-19T06:07:19.982598+0000","last_clean":"2024-09-19T06:07:19.982598+0000","last_became_active":"2024-09-19T06:05:24.699625+0000","last_became_peered":"2024-09-19T06:05:24.699625+0000","last_unstale":"2024-09-19T06:07:19.982598+0000","last_undegraded":"2024-09-19T06:07:19.982598+0000","last_fullsized":"2024-09-19T06:07:19.982598+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:34.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982302+0000","last_change":"2024-09-19T06:05:24.701310+0000","last_active":"2024-09-19T06:07:19.982302+0000","last_peered":"2024-09-19T06:07:19.982302+0000","last_clean":"2024-09-19T06:07:19.982302+0000","last_became_active":"2024-09-19T06:05:24.701032+0000","last_became_peered":"2024-09-19T06:05:24.701032+0000","last_unstale":"2024-09-19T06:07:19.982302+0000","last_undegraded":"2024-09-19T06:07:19.982302+0000","last_fullsized":"2024-09-19T06:07:19.982302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:29.557533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982549+0000","last_change":"2024-09-19T06:05:24.699803+0000","last_active":"2024-09-19T06:07:19.982549+0000","last_peered":"2024-09-19T06:07:19.982549+0000","last_clean":"2024-09-19T06:07:19.982549+0000","last_became_active":"2024-09-19T06:05:24.699506+0000","last_became_peered":"2024-09-19T06:05:24.699506+0000","last_unstale":"2024-09-19T06:07:19.982549+0000","last_undegraded":"2024-09-19T06:07:19.982549+0000","last_fullsized":"2024-09-19T06:07:19.982549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:32.669231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748756+0000","last_change":"2024-09-19T06:05:24.703805+0000","last_active":"2024-09-19T06:07:19.748756+0000","last_peered":"2024-09-19T06:07:19.748756+0000","last_clean":"2024-09-19T06:07:19.748756+0000","last_became_active":"2024-09-19T06:05:24.702728+0000","last_became_peered":"2024-09-19T06:05:24.702728+0000","last_unstale":"2024-09-19T06:07:19.748756+0000","last_undegraded":"2024-09-19T06:07:19.748756+0000","last_fullsized":"2024-09-19T06:07:19.748756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:20.807530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.829583+0000","last_change":"2024-09-19T06:05:24.691055+0000","last_active":"2024-09-19T06:07:19.829583+0000","last_peered":"2024-09-19T06:07:19.829583+0000","last_clean":"2024-09-19T06:07:19.829583+0000","last_became_active":"2024-09-19T06:05:24.690165+0000","last_became_peered":"2024-09-19T06:05:24.690165+0000","last_unstale":"2024-09-19T06:07:19.829583+0000","last_undegraded":"2024-09-19T06:07:19.829583+0000","last_fullsized":"2024-09-19T06:07:19.829583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:48.656335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.981942+0000","last_change":"2024-09-19T06:05:24.697955+0000","last_active":"2024-09-19T06:07:19.981942+0000","last_peered":"2024-09-19T06:07:19.981942+0000","last_clean":"2024-09-19T06:07:19.981942+0000","last_became_active":"2024-09-19T06:05:24.697598+0000","last_became_peered":"2024-09-19T06:05:24.697598+0000","last_unstale":"2024-09-19T06:07:19.981942+0000","last_undegraded":"2024-09-19T06:07:19.981942+0000","last_fullsized":"2024-09-19T06:07:19.981942+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.458647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748385+0000","last_change":"2024-09-19T06:05:24.705110+0000","last_active":"2024-09-19T06:07:19.748385+0000","last_peered":"2024-09-19T06:07:19.748385+0000","last_clean":"2024-09-19T06:07:19.748385+0000","last_became_active":"2024-09-19T06:05:24.704783+0000","last_became_peered":"2024-09-19T06:05:24.704783+0000","last_unstale":"2024-09-19T06:07:19.748385+0000","last_undegraded":"2024-09-19T06:07:19.748385+0000","last_fullsized":"2024-09-19T06:07:19.748385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:43.092969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747958+0000","last_change":"2024-09-19T06:05:24.693845+0000","last_active":"2024-09-19T06:07:19.747958+0000","last_peered":"2024-09-19T06:07:19.747958+0000","last_clean":"2024-09-19T06:07:19.747958+0000","last_became_active":"2024-09-19T06:05:24.693385+0000","last_became_peered":"2024-09-19T06:05:24.693385+0000","last_unstale":"2024-09-19T06:07:19.747958+0000","last_undegraded":"2024-09-19T06:07:19.747958+0000","last_fullsized":"2024-09-19T06:07:19.747958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:05.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982905+0000","last_change":"2024-09-19T06:05:24.697903+0000","last_active":"2024-09-19T06:07:19.982905+0000","last_peered":"2024-09-19T06:07:19.982905+0000","last_clean":"2024-09-19T06:07:19.982905+0000","last_became_active":"2024-09-19T06:05:24.697566+0000","last_became_peered":"2024-09-19T06:05:24.697566+0000","last_unstale":"2024-09-19T06:07:19.982905+0000","last_undegraded":"2024-09-19T06:07:19.982905+0000","last_fullsized":"2024-09-19T06:07:19.982905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:10.340401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831767+0000","last_change":"2024-09-19T06:05:24.696888+0000","last_active":"2024-09-19T06:07:19.831767+0000","last_peered":"2024-09-19T06:07:19.831767+0000","last_clean":"2024-09-19T06:07:19.831767+0000","last_became_active":"2024-09-19T06:05:24.696554+0000","last_became_peered":"2024-09-19T06:05:24.696554+0000","last_unstale":"2024-09-19T06:07:19.831767+0000","last_undegraded":"2024-09-19T06:07:19.831767+0000","last_fullsized":"2024-09-19T06:07:19.831767+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838648+0000","last_change":"2024-09-19T06:05:24.692443+0000","last_active":"2024-09-19T06:07:19.838648+0000","last_peered":"2024-09-19T06:07:19.838648+0000","last_clean":"2024-09-19T06:07:19.838648+0000","last_became_active":"2024-09-19T06:05:24.690555+0000","last_became_peered":"2024-09-19T06:05:24.690555+0000","last_unstale":"2024-09-19T06:07:19.838648+0000","last_undegraded":"2024-09-19T06:07:19.838648+0000","last_fullsized":"2024-09-19T06:07:19.838648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:29.340744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833473+0000","last_change":"2024-09-19T06:05:24.699379+0000","last_active":"2024-09-19T06:07:19.833473+0000","last_peered":"2024-09-19T06:07:19.833473+0000","last_clean":"2024-09-19T06:07:19.833473+0000","last_became_active":"2024-09-19T06:05:24.699056+0000","last_became_peered":"2024-09-19T06:05:24.699056+0000","last_unstale":"2024-09-19T06:07:19.833473+0000","last_undegraded":"2024-09-19T06:07:19.833473+0000","last_fullsized":"2024-09-19T06:07:19.833473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:30.337080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982063+0000","last_change":"2024-09-19T06:05:24.698672+0000","last_active":"2024-09-19T06:07:19.982063+0000","last_peered":"2024-09-19T06:07:19.982063+0000","last_clean":"2024-09-19T06:07:19.982063+0000","last_became_active":"2024-09-19T06:05:24.698229+0000","last_became_peered":"2024-09-19T06:05:24.698229+0000","last_unstale":"2024-09-19T06:07:19.982063+0000","last_undegraded":"2024-09-19T06:07:19.982063+0000","last_fullsized":"2024-09-19T06:07:19.982063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.082538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748635+0000","last_change":"2024-09-19T06:05:24.707830+0000","last_active":"2024-09-19T06:07:19.748635+0000","last_peered":"2024-09-19T06:07:19.748635+0000","last_clean":"2024-09-19T06:07:19.748635+0000","last_became_active":"2024-09-19T06:05:24.707478+0000","last_became_peered":"2024-09-19T06:05:24.707478+0000","last_unstale":"2024-09-19T06:07:19.748635+0000","last_undegraded":"2024-09-19T06:07:19.748635+0000","last_fullsized":"2024-09-19T06:07:19.748635+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:33.484877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747788+0000","last_change":"2024-09-19T06:05:24.697232+0000","last_active":"2024-09-19T06:07:19.747788+0000","last_peered":"2024-09-19T06:07:19.747788+0000","last_clean":"2024-09-19T06:07:19.747788+0000","last_became_active":"2024-09-19T06:05:24.696727+0000","last_became_peered":"2024-09-19T06:05:24.696727+0000","last_unstale":"2024-09-19T06:07:19.747788+0000","last_undegraded":"2024-09-19T06:07:19.747788+0000","last_fullsized":"2024-09-19T06:07:19.747788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:36.168493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982918+0000","last_change":"2024-09-19T06:05:24.695489+0000","last_active":"2024-09-19T06:07:19.982918+0000","last_peered":"2024-09-19T06:07:19.982918+0000","last_clean":"2024-09-19T06:07:19.982918+0000","last_became_active":"2024-09-19T06:05:24.695012+0000","last_became_peered":"2024-09-19T06:05:24.695012+0000","last_unstale":"2024-09-19T06:07:19.982918+0000","last_undegraded":"2024-09-19T06:07:19.982918+0000","last_fullsized":"2024-09-19T06:07:19.982918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:41.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.981770+0000","last_change":"2024-09-19T06:05:24.697294+0000","last_active":"2024-09-19T06:07:19.981770+0000","last_peered":"2024-09-19T06:07:19.981770+0000","last_clean":"2024-09-19T06:07:19.981770+0000","last_became_active":"2024-09-19T06:05:24.696563+0000","last_became_peered":"2024-09-19T06:05:24.696563+0000","last_unstale":"2024-09-19T06:07:19.981770+0000","last_undegraded":"2024-09-19T06:07:19.981770+0000","last_fullsized":"2024-09-19T06:07:19.981770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:41.861120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.981838+0000","last_change":"2024-09-19T06:05:24.702710+0000","last_active":"2024-09-19T06:07:19.981838+0000","last_peered":"2024-09-19T06:07:19.981838+0000","last_clean":"2024-09-19T06:07:19.981838+0000","last_became_active":"2024-09-19T06:05:24.702039+0000","last_became_peered":"2024-09-19T06:05:24.702039+0000","last_unstale":"2024-09-19T06:07:19.981838+0000","last_undegraded":"2024-09-19T06:07:19.981838+0000","last_fullsized":"2024-09-19T06:07:19.981838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:23.831807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748351+0000","last_change":"2024-09-19T06:05:24.707671+0000","last_active":"2024-09-19T06:07:19.748351+0000","last_peered":"2024-09-19T06:07:19.748351+0000","last_clean":"2024-09-19T06:07:19.748351+0000","last_became_active":"2024-09-19T06:05:24.707325+0000","last_became_peered":"2024-09-19T06:05:24.707325+0000","last_unstale":"2024-09-19T06:07:19.748351+0000","last_undegraded":"2024-09-19T06:07:19.748351+0000","last_fullsized":"2024-09-19T06:07:19.748351+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:32.149103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831508+0000","last_change":"2024-09-19T06:05:24.704875+0000","last_active":"2024-09-19T06:07:19.831508+0000","last_peered":"2024-09-19T06:07:19.831508+0000","last_clean":"2024-09-19T06:07:19.831508+0000","last_became_active":"2024-09-19T06:05:24.704501+0000","last_became_peered":"2024-09-19T06:05:24.704501+0000","last_unstale":"2024-09-19T06:07:19.831508+0000","last_undegraded":"2024-09-19T06:07:19.831508+0000","last_fullsized":"2024-09-19T06:07:19.831508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'8","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:20.029873+0000","last_change":"2024-09-19T06:05:22.687857+0000","last_active":"2024-09-19T06:07:20.029873+0000","last_peered":"2024-09-19T06:07:20.029873+0000","last_clean":"2024-09-19T06:07:20.029873+0000","last_became_active":"2024-09-19T06:05:22.687573+0000","last_became_peered":"2024-09-19T06:05:22.687573+0000","last_unstale":"2024-09-19T06:07:20.029873+0000","last_undegraded":"2024-09-19T06:07:20.029873+0000","last_fullsized":"2024-09-19T06:07:20.029873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:31.972444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838777+0000","last_change":"2024-09-19T06:05:46.904521+0000","last_active":"2024-09-19T06:07:19.838777+0000","last_peered":"2024-09-19T06:07:19.838777+0000","last_clean":"2024-09-19T06:07:19.838777+0000","last_became_active":"2024-09-19T06:05:46.904146+0000","last_became_peered":"2024-09-19T06:05:46.904146+0000","last_unstale":"2024-09-19T06:07:19.838777+0000","last_undegraded":"2024-09-19T06:07:19.838777+0000","last_fullsized":"2024-09-19T06:07:19.838777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:48.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.750690+0000","last_change":"2024-09-19T06:05:22.680500+0000","last_active":"2024-09-19T06:07:19.750690+0000","last_peered":"2024-09-19T06:07:19.750690+0000","last_clean":"2024-09-19T06:07:19.750690+0000","last_became_active":"2024-09-19T06:05:22.679947+0000","last_became_peered":"2024-09-19T06:05:22.679947+0000","last_unstale":"2024-09-19T06:07:19.750690+0000","last_undegraded":"2024-09-19T06:07:19.750690+0000","last_fullsized":"2024-09-19T06:07:19.750690+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:34.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747505+0000","last_change":"2024-09-19T06:05:22.680962+0000","last_active":"2024-09-19T06:07:19.747505+0000","last_peered":"2024-09-19T06:07:19.747505+0000","last_clean":"2024-09-19T06:07:19.747505+0000","last_became_active":"2024-09-19T06:05:22.680662+0000","last_became_peered":"2024-09-19T06:05:22.680662+0000","last_unstale":"2024-09-19T06:07:19.747505+0000","last_undegraded":"2024-09-19T06:07:19.747505+0000","last_fullsized":"2024-09-19T06:07:19.747505+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.296422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831912+0000","last_change":"2024-09-19T06:05:24.695214+0000","last_active":"2024-09-19T06:07:19.831912+0000","last_peered":"2024-09-19T06:07:19.831912+0000","last_clean":"2024-09-19T06:07:19.831912+0000","last_became_active":"2024-09-19T06:05:24.694930+0000","last_became_peered":"2024-09-19T06:05:24.694930+0000","last_unstale":"2024-09-19T06:07:19.831912+0000","last_undegraded":"2024-09-19T06:07:19.831912+0000","last_fullsized":"2024-09-19T06:07:19.831912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:51.382934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838861+0000","last_change":"2024-09-19T06:05:22.684504+0000","last_active":"2024-09-19T06:07:19.838861+0000","last_peered":"2024-09-19T06:07:19.838861+0000","last_clean":"2024-09-19T06:07:19.838861+0000","last_became_active":"2024-09-19T06:05:22.684169+0000","last_became_peered":"2024-09-19T06:05:22.684169+0000","last_unstale":"2024-09-19T06:07:19.838861+0000","last_undegraded":"2024-09-19T06:07:19.838861+0000","last_fullsized":"2024-09-19T06:07:19.838861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:29.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.828826+0000","last_change":"2024-09-19T06:05:24.693056+0000","last_active":"2024-09-19T06:07:19.828826+0000","last_peered":"2024-09-19T06:07:19.828826+0000","last_clean":"2024-09-19T06:07:19.828826+0000","last_became_active":"2024-09-19T06:05:24.692544+0000","last_became_peered":"2024-09-19T06:05:24.692544+0000","last_unstale":"2024-09-19T06:07:19.828826+0000","last_undegraded":"2024-09-19T06:07:19.828826+0000","last_fullsized":"2024-09-19T06:07:19.828826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:45.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.751255+0000","last_change":"2024-09-19T06:05:22.682854+0000","last_active":"2024-09-19T06:07:19.751255+0000","last_peered":"2024-09-19T06:07:19.751255+0000","last_clean":"2024-09-19T06:07:19.751255+0000","last_became_active":"2024-09-19T06:05:22.682406+0000","last_became_peered":"2024-09-19T06:05:22.682406+0000","last_unstale":"2024-09-19T06:07:19.751255+0000","last_undegraded":"2024-09-19T06:07:19.751255+0000","last_fullsized":"2024-09-19T06:07:19.751255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.206144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983271+0000","last_change":"2024-09-19T06:05:24.699408+0000","last_active":"2024-09-19T06:07:19.983271+0000","last_peered":"2024-09-19T06:07:19.983271+0000","last_clean":"2024-09-19T06:07:19.983271+0000","last_became_active":"2024-09-19T06:05:24.699106+0000","last_became_peered":"2024-09-19T06:05:24.699106+0000","last_unstale":"2024-09-19T06:07:19.983271+0000","last_undegraded":"2024-09-19T06:07:19.983271+0000","last_fullsized":"2024-09-19T06:07:19.983271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:37.487458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983708+0000","last_change":"2024-09-19T06:05:22.686106+0000","last_active":"2024-09-19T06:07:19.983708+0000","last_peered":"2024-09-19T06:07:19.983708+0000","last_clean":"2024-09-19T06:07:19.983708+0000","last_became_active":"2024-09-19T06:05:22.685763+0000","last_became_peered":"2024-09-19T06:05:22.685763+0000","last_unstale":"2024-09-19T06:07:19.983708+0000","last_undegraded":"2024-09-19T06:07:19.983708+0000","last_fullsized":"2024-09-19T06:07:19.983708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:57.889128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983989+0000","last_change":"2024-09-19T06:05:46.524038+0000","last_active":"2024-09-19T06:07:19.983989+0000","last_peered":"2024-09-19T06:07:19.983989+0000","last_clean":"2024-09-19T06:07:19.983989+0000","last_became_active":"2024-09-19T06:05:46.523746+0000","last_became_peered":"2024-09-19T06:05:46.523746+0000","last_unstale":"2024-09-19T06:07:19.983989+0000","last_undegraded":"2024-09-19T06:07:19.983989+0000","last_fullsized":"2024-09-19T06:07:19.983989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:17.361840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.839043+0000","last_change":"2024-09-19T06:05:23.060545+0000","last_active":"2024-09-19T06:07:19.839043+0000","last_peered":"2024-09-19T06:07:19.839043+0000","last_clean":"2024-09-19T06:07:19.839043+0000","last_became_active":"2024-09-19T06:05:23.060187+0000","last_became_peered":"2024-09-19T06:05:23.060187+0000","last_unstale":"2024-09-19T06:07:19.839043+0000","last_undegraded":"2024-09-19T06:07:19.839043+0000","last_fullsized":"2024-09-19T06:07:19.839043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.604284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983213+0000","last_change":"2024-09-19T06:05:24.702535+0000","last_active":"2024-09-19T06:07:19.983213+0000","last_peered":"2024-09-19T06:07:19.983213+0000","last_clean":"2024-09-19T06:07:19.983213+0000","last_became_active":"2024-09-19T06:05:24.701616+0000","last_became_peered":"2024-09-19T06:05:24.701616+0000","last_unstale":"2024-09-19T06:07:19.983213+0000","last_undegraded":"2024-09-19T06:07:19.983213+0000","last_fullsized":"2024-09-19T06:07:19.983213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:43.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'35","reported_seq":281,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:20.031390+0000","last_change":"2024-09-19T06:05:22.685460+0000","last_active":"2024-09-19T06:07:20.031390+0000","last_peered":"2024-09-19T06:07:20.031390+0000","last_clean":"2024-09-19T06:07:20.031390+0000","last_became_active":"2024-09-19T06:05:22.685086+0000","last_became_peered":"2024-09-19T06:05:22.685086+0000","last_unstale":"2024-09-19T06:07:20.031390+0000","last_undegraded":"2024-09-19T06:07:20.031390+0000","last_fullsized":"2024-09-19T06:07:20.031390+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:10.373783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65608,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":170,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831730+0000","last_change":"2024-09-19T06:05:24.700431+0000","last_active":"2024-09-19T06:07:19.831730+0000","last_peered":"2024-09-19T06:07:19.831730+0000","last_clean":"2024-09-19T06:07:19.831730+0000","last_became_active":"2024-09-19T06:05:24.700092+0000","last_became_peered":"2024-09-19T06:05:24.700092+0000","last_unstale":"2024-09-19T06:07:19.831730+0000","last_undegraded":"2024-09-19T06:07:19.831730+0000","last_fullsized":"2024-09-19T06:07:19.831730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:17.208392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748475+0000","last_change":"2024-09-19T06:05:46.530433+0000","last_active":"2024-09-19T06:07:19.748475+0000","last_peered":"2024-09-19T06:07:19.748475+0000","last_clean":"2024-09-19T06:07:19.748475+0000","last_became_active":"2024-09-19T06:05:46.521700+0000","last_became_peered":"2024-09-19T06:05:46.521700+0000","last_unstale":"2024-09-19T06:07:19.748475+0000","last_undegraded":"2024-09-19T06:07:19.748475+0000","last_fullsized":"2024-09-19T06:07:19.748475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:40.489547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747529+0000","last_change":"2024-09-19T06:05:24.699149+0000","last_active":"2024-09-19T06:07:19.747529+0000","last_peered":"2024-09-19T06:07:19.747529+0000","last_clean":"2024-09-19T06:07:19.747529+0000","last_became_active":"2024-09-19T06:05:24.698846+0000","last_became_peered":"2024-09-19T06:05:24.698846+0000","last_unstale":"2024-09-19T06:07:19.747529+0000","last_undegraded":"2024-09-19T06:07:19.747529+0000","last_fullsized":"2024-09-19T06:07:19.747529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:19.416169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838769+0000","last_change":"2024-09-19T06:05:22.682157+0000","last_active":"2024-09-19T06:07:19.838769+0000","last_peered":"2024-09-19T06:07:19.838769+0000","last_clean":"2024-09-19T06:07:19.838769+0000","last_became_active":"2024-09-19T06:05:22.681816+0000","last_became_peered":"2024-09-19T06:05:22.681816+0000","last_unstale":"2024-09-19T06:07:19.838769+0000","last_undegraded":"2024-09-19T06:07:19.838769+0000","last_fullsized":"2024-09-19T06:07:19.838769+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:05.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983151+0000","last_change":"2024-09-19T06:05:24.699233+0000","last_active":"2024-09-19T06:07:19.983151+0000","last_peered":"2024-09-19T06:07:19.983151+0000","last_clean":"2024-09-19T06:07:19.983151+0000","last_became_active":"2024-09-19T06:05:24.698918+0000","last_became_peered":"2024-09-19T06:05:24.698918+0000","last_unstale":"2024-09-19T06:07:19.983151+0000","last_undegraded":"2024-09-19T06:07:19.983151+0000","last_fullsized":"2024-09-19T06:07:19.983151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:20.037927+0000","last_change":"2024-09-19T06:05:22.682161+0000","last_active":"2024-09-19T06:07:20.037927+0000","last_peered":"2024-09-19T06:07:20.037927+0000","last_clean":"2024-09-19T06:07:20.037927+0000","last_became_active":"2024-09-19T06:05:22.681805+0000","last_became_peered":"2024-09-19T06:05:22.681805+0000","last_unstale":"2024-09-19T06:07:20.037927+0000","last_undegraded":"2024-09-19T06:07:20.037927+0000","last_fullsized":"2024-09-19T06:07:20.037927+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:27.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1476,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983620+0000","last_change":"2024-09-19T06:05:24.703668+0000","last_active":"2024-09-19T06:07:19.983620+0000","last_peered":"2024-09-19T06:07:19.983620+0000","last_clean":"2024-09-19T06:07:19.983620+0000","last_became_active":"2024-09-19T06:05:24.703342+0000","last_became_peered":"2024-09-19T06:05:24.703342+0000","last_unstale":"2024-09-19T06:07:19.983620+0000","last_undegraded":"2024-09-19T06:07:19.983620+0000","last_fullsized":"2024-09-19T06:07:19.983620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:30.399187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831473+0000","last_change":"2024-09-19T06:05:23.060458+0000","last_active":"2024-09-19T06:07:19.831473+0000","last_peered":"2024-09-19T06:07:19.831473+0000","last_clean":"2024-09-19T06:07:19.831473+0000","last_became_active":"2024-09-19T06:05:23.060098+0000","last_became_peered":"2024-09-19T06:05:23.060098+0000","last_unstale":"2024-09-19T06:07:19.831473+0000","last_undegraded":"2024-09-19T06:07:19.831473+0000","last_fullsized":"2024-09-19T06:07:19.831473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:58.800162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838711+0000","last_change":"2024-09-19T06:05:24.699832+0000","last_active":"2024-09-19T06:07:19.838711+0000","last_peered":"2024-09-19T06:07:19.838711+0000","last_clean":"2024-09-19T06:07:19.838711+0000","last_became_active":"2024-09-19T06:05:24.697600+0000","last_became_peered":"2024-09-19T06:05:24.697600+0000","last_unstale":"2024-09-19T06:07:19.838711+0000","last_undegraded":"2024-09-19T06:07:19.838711+0000","last_fullsized":"2024-09-19T06:07:19.838711+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:15.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831904+0000","last_change":"2024-09-19T06:05:22.682962+0000","last_active":"2024-09-19T06:07:19.831904+0000","last_peered":"2024-09-19T06:07:19.831904+0000","last_clean":"2024-09-19T06:07:19.831904+0000","last_became_active":"2024-09-19T06:05:22.682573+0000","last_became_peered":"2024-09-19T06:05:22.682573+0000","last_unstale":"2024-09-19T06:07:19.831904+0000","last_undegraded":"2024-09-19T06:07:19.831904+0000","last_fullsized":"2024-09-19T06:07:19.831904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:31.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748646+0000","last_change":"2024-09-19T06:05:46.907103+0000","last_active":"2024-09-19T06:07:19.748646+0000","last_peered":"2024-09-19T06:07:19.748646+0000","last_clean":"2024-09-19T06:07:19.748646+0000","last_became_active":"2024-09-19T06:05:46.906741+0000","last_became_peered":"2024-09-19T06:05:46.906741+0000","last_unstale":"2024-09-19T06:07:19.748646+0000","last_undegraded":"2024-09-19T06:07:19.748646+0000","last_fullsized":"2024-09-19T06:07:19.748646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:42.275594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748126+0000","last_change":"2024-09-19T06:05:22.684007+0000","last_active":"2024-09-19T06:07:19.748126+0000","last_peered":"2024-09-19T06:07:19.748126+0000","last_clean":"2024-09-19T06:07:19.748126+0000","last_became_active":"2024-09-19T06:05:22.683606+0000","last_became_peered":"2024-09-19T06:05:22.683606+0000","last_unstale":"2024-09-19T06:07:19.748126+0000","last_undegraded":"2024-09-19T06:07:19.748126+0000","last_fullsized":"2024-09-19T06:07:19.748126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:29.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983666+0000","last_change":"2024-09-19T06:05:24.698057+0000","last_active":"2024-09-19T06:07:19.983666+0000","last_peered":"2024-09-19T06:07:19.983666+0000","last_clean":"2024-09-19T06:07:19.983666+0000","last_became_active":"2024-09-19T06:05:24.697604+0000","last_became_peered":"2024-09-19T06:05:24.697604+0000","last_unstale":"2024-09-19T06:07:19.983666+0000","last_undegraded":"2024-09-19T06:07:19.983666+0000","last_fullsized":"2024-09-19T06:07:19.983666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:33.246096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.959611+0000","last_change":"2024-09-19T06:05:22.680641+0000","last_active":"2024-09-19T06:07:19.959611+0000","last_peered":"2024-09-19T06:07:19.959611+0000","last_clean":"2024-09-19T06:07:19.959611+0000","last_became_active":"2024-09-19T06:05:22.680282+0000","last_became_peered":"2024-09-19T06:05:22.680282+0000","last_unstale":"2024-09-19T06:07:19.959611+0000","last_undegraded":"2024-09-19T06:07:19.959611+0000","last_fullsized":"2024-09-19T06:07:19.959611+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:07.171581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983468+0000","last_change":"2024-09-19T06:05:24.705525+0000","last_active":"2024-09-19T06:07:19.983468+0000","last_peered":"2024-09-19T06:07:19.983468+0000","last_clean":"2024-09-19T06:07:19.983468+0000","last_became_active":"2024-09-19T06:05:24.705226+0000","last_became_peered":"2024-09-19T06:05:24.705226+0000","last_unstale":"2024-09-19T06:07:19.983468+0000","last_undegraded":"2024-09-19T06:07:19.983468+0000","last_fullsized":"2024-09-19T06:07:19.983468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:51.020525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982028+0000","last_change":"2024-09-19T06:05:23.060628+0000","last_active":"2024-09-19T06:07:19.982028+0000","last_peered":"2024-09-19T06:07:19.982028+0000","last_clean":"2024-09-19T06:07:19.982028+0000","last_became_active":"2024-09-19T06:05:23.060066+0000","last_became_peered":"2024-09-19T06:05:23.060066+0000","last_unstale":"2024-09-19T06:07:19.982028+0000","last_undegraded":"2024-09-19T06:07:19.982028+0000","last_fullsized":"2024-09-19T06:07:19.982028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:55.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983885+0000","last_change":"2024-09-19T06:05:24.701994+0000","last_active":"2024-09-19T06:07:19.983885+0000","last_peered":"2024-09-19T06:07:19.983885+0000","last_clean":"2024-09-19T06:07:19.983885+0000","last_became_active":"2024-09-19T06:05:24.701648+0000","last_became_peered":"2024-09-19T06:05:24.701648+0000","last_unstale":"2024-09-19T06:07:19.983885+0000","last_undegraded":"2024-09-19T06:07:19.983885+0000","last_fullsized":"2024-09-19T06:07:19.983885+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:16.475339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983778+0000","last_change":"2024-09-19T06:04:14.186274+0000","last_active":"2024-09-19T06:07:19.983778+0000","last_peered":"2024-09-19T06:07:19.983778+0000","last_clean":"2024-09-19T06:07:19.983778+0000","last_became_active":"2024-09-19T06:04:14.185907+0000","last_became_peered":"2024-09-19T06:04:14.185907+0000","last_unstale":"2024-09-19T06:07:19.983778+0000","last_undegraded":"2024-09-19T06:07:19.983778+0000","last_fullsized":"2024-09-19T06:07:19.983778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_clean_scrub_stamp":"2024-09-19T06:00:59.680614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:01.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982897+0000","last_change":"2024-09-19T06:05:22.682242+0000","last_active":"2024-09-19T06:07:19.982897+0000","last_peered":"2024-09-19T06:07:19.982897+0000","last_clean":"2024-09-19T06:07:19.982897+0000","last_became_active":"2024-09-19T06:05:22.681896+0000","last_became_peered":"2024-09-19T06:05:22.681896+0000","last_unstale":"2024-09-19T06:07:19.982897+0000","last_undegraded":"2024-09-19T06:07:19.982897+0000","last_fullsized":"2024-09-19T06:07:19.982897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.119422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.828930+0000","last_change":"2024-09-19T06:05:46.962541+0000","last_active":"2024-09-19T06:07:19.828930+0000","last_peered":"2024-09-19T06:07:19.828930+0000","last_clean":"2024-09-19T06:07:19.828930+0000","last_became_active":"2024-09-19T06:05:46.962261+0000","last_became_peered":"2024-09-19T06:05:46.962261+0000","last_unstale":"2024-09-19T06:07:19.828930+0000","last_undegraded":"2024-09-19T06:07:19.828930+0000","last_fullsized":"2024-09-19T06:07:19.828930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:36.355129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983752+0000","last_change":"2024-09-19T06:05:22.685809+0000","last_active":"2024-09-19T06:07:19.983752+0000","last_peered":"2024-09-19T06:07:19.983752+0000","last_clean":"2024-09-19T06:07:19.983752+0000","last_became_active":"2024-09-19T06:05:22.685466+0000","last_became_peered":"2024-09-19T06:05:22.685466+0000","last_unstale":"2024-09-19T06:07:19.983752+0000","last_undegraded":"2024-09-19T06:07:19.983752+0000","last_fullsized":"2024-09-19T06:07:19.983752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:43.793845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747729+0000","last_change":"2024-09-19T06:05:24.701105+0000","last_active":"2024-09-19T06:07:19.747729+0000","last_peered":"2024-09-19T06:07:19.747729+0000","last_clean":"2024-09-19T06:07:19.747729+0000","last_became_active":"2024-09-19T06:05:24.700825+0000","last_became_peered":"2024-09-19T06:05:24.700825+0000","last_unstale":"2024-09-19T06:07:19.747729+0000","last_undegraded":"2024-09-19T06:07:19.747729+0000","last_fullsized":"2024-09-19T06:07:19.747729+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:35.707437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747671+0000","last_change":"2024-09-19T06:05:23.059587+0000","last_active":"2024-09-19T06:07:19.747671+0000","last_peered":"2024-09-19T06:07:19.747671+0000","last_clean":"2024-09-19T06:07:19.747671+0000","last_became_active":"2024-09-19T06:05:23.059248+0000","last_became_peered":"2024-09-19T06:05:23.059248+0000","last_unstale":"2024-09-19T06:07:19.747671+0000","last_undegraded":"2024-09-19T06:07:19.747671+0000","last_fullsized":"2024-09-19T06:07:19.747671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:25.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838746+0000","last_change":"2024-09-19T06:05:24.701610+0000","last_active":"2024-09-19T06:07:19.838746+0000","last_peered":"2024-09-19T06:07:19.838746+0000","last_clean":"2024-09-19T06:07:19.838746+0000","last_became_active":"2024-09-19T06:05:24.697296+0000","last_became_peered":"2024-09-19T06:05:24.697296+0000","last_unstale":"2024-09-19T06:07:19.838746+0000","last_undegraded":"2024-09-19T06:07:19.838746+0000","last_fullsized":"2024-09-19T06:07:19.838746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:52.256284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983775+0000","last_change":"2024-09-19T06:05:22.684818+0000","last_active":"2024-09-19T06:07:19.983775+0000","last_peered":"2024-09-19T06:07:19.983775+0000","last_clean":"2024-09-19T06:07:19.983775+0000","last_became_active":"2024-09-19T06:05:22.684211+0000","last_became_peered":"2024-09-19T06:05:22.684211+0000","last_unstale":"2024-09-19T06:07:19.983775+0000","last_undegraded":"2024-09-19T06:07:19.983775+0000","last_fullsized":"2024-09-19T06:07:19.983775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:50.711805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.750888+0000","last_change":"2024-09-19T06:05:24.702992+0000","last_active":"2024-09-19T06:07:19.750888+0000","last_peered":"2024-09-19T06:07:19.750888+0000","last_clean":"2024-09-19T06:07:19.750888+0000","last_became_active":"2024-09-19T06:05:24.702643+0000","last_became_peered":"2024-09-19T06:05:24.702643+0000","last_unstale":"2024-09-19T06:07:19.750888+0000","last_undegraded":"2024-09-19T06:07:19.750888+0000","last_fullsized":"2024-09-19T06:07:19.750888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:40.651861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.829239+0000","last_change":"2024-09-19T06:05:23.060444+0000","last_active":"2024-09-19T06:07:19.829239+0000","last_peered":"2024-09-19T06:07:19.829239+0000","last_clean":"2024-09-19T06:07:19.829239+0000","last_became_active":"2024-09-19T06:05:23.059879+0000","last_became_peered":"2024-09-19T06:05:23.059879+0000","last_unstale":"2024-09-19T06:07:19.829239+0000","last_undegraded":"2024-09-19T06:07:19.829239+0000","last_fullsized":"2024-09-19T06:07:19.829239+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:39.013096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.751068+0000","last_change":"2024-09-19T06:05:24.694892+0000","last_active":"2024-09-19T06:07:19.751068+0000","last_peered":"2024-09-19T06:07:19.751068+0000","last_clean":"2024-09-19T06:07:19.751068+0000","last_became_active":"2024-09-19T06:05:24.694534+0000","last_became_peered":"2024-09-19T06:05:24.694534+0000","last_unstale":"2024-09-19T06:07:19.751068+0000","last_undegraded":"2024-09-19T06:07:19.751068+0000","last_fullsized":"2024-09-19T06:07:19.751068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:50.633035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831903+0000","last_change":"2024-09-19T06:05:23.060597+0000","last_active":"2024-09-19T06:07:19.831903+0000","last_peered":"2024-09-19T06:07:19.831903+0000","last_clean":"2024-09-19T06:07:19.831903+0000","last_became_active":"2024-09-19T06:05:23.060235+0000","last_became_peered":"2024-09-19T06:05:23.060235+0000","last_unstale":"2024-09-19T06:07:19.831903+0000","last_undegraded":"2024-09-19T06:07:19.831903+0000","last_fullsized":"2024-09-19T06:07:19.831903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:54.517780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747923+0000","last_change":"2024-09-19T06:05:24.698131+0000","last_active":"2024-09-19T06:07:19.747923+0000","last_peered":"2024-09-19T06:07:19.747923+0000","last_clean":"2024-09-19T06:07:19.747923+0000","last_became_active":"2024-09-19T06:05:24.697784+0000","last_became_peered":"2024-09-19T06:05:24.697784+0000","last_unstale":"2024-09-19T06:07:19.747923+0000","last_undegraded":"2024-09-19T06:07:19.747923+0000","last_fullsized":"2024-09-19T06:07:19.747923+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:49.563908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'46","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.963022+0000","last_change":"2024-09-19T06:05:22.679532+0000","last_active":"2024-09-19T06:07:19.963022+0000","last_peered":"2024-09-19T06:07:19.963022+0000","last_clean":"2024-09-19T06:07:19.963022+0000","last_became_active":"2024-09-19T06:05:22.679156+0000","last_became_peered":"2024-09-19T06:05:22.679156+0000","last_unstale":"2024-09-19T06:07:19.963022+0000","last_undegraded":"2024-09-19T06:07:19.963022+0000","last_fullsized":"2024-09-19T06:07:19.963022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:31.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":83,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833475+0000","last_change":"2024-09-19T06:05:24.698383+0000","last_active":"2024-09-19T06:07:19.833475+0000","last_peered":"2024-09-19T06:07:19.833475+0000","last_clean":"2024-09-19T06:07:19.833475+0000","last_became_active":"2024-09-19T06:05:24.698044+0000","last_became_peered":"2024-09-19T06:05:24.698044+0000","last_unstale":"2024-09-19T06:07:19.833475+0000","last_undegraded":"2024-09-19T06:07:19.833475+0000","last_fullsized":"2024-09-19T06:07:19.833475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:53.388847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983321+0000","last_change":"2024-09-19T06:05:22.684799+0000","last_active":"2024-09-19T06:07:19.983321+0000","last_peered":"2024-09-19T06:07:19.983321+0000","last_clean":"2024-09-19T06:07:19.983321+0000","last_became_active":"2024-09-19T06:05:22.684376+0000","last_became_peered":"2024-09-19T06:05:22.684376+0000","last_unstale":"2024-09-19T06:07:19.983321+0000","last_undegraded":"2024-09-19T06:07:19.983321+0000","last_fullsized":"2024-09-19T06:07:19.983321+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.124960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983541+0000","last_change":"2024-09-19T06:05:24.693751+0000","last_active":"2024-09-19T06:07:19.983541+0000","last_peered":"2024-09-19T06:07:19.983541+0000","last_clean":"2024-09-19T06:07:19.983541+0000","last_became_active":"2024-09-19T06:05:24.693442+0000","last_became_peered":"2024-09-19T06:05:24.693442+0000","last_unstale":"2024-09-19T06:07:19.983541+0000","last_undegraded":"2024-09-19T06:07:19.983541+0000","last_fullsized":"2024-09-19T06:07:19.983541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:46.491860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982675+0000","last_change":"2024-09-19T06:05:23.060522+0000","last_active":"2024-09-19T06:07:19.982675+0000","last_peered":"2024-09-19T06:07:19.982675+0000","last_clean":"2024-09-19T06:07:19.982675+0000","last_became_active":"2024-09-19T06:05:23.060170+0000","last_became_peered":"2024-09-19T06:05:23.060170+0000","last_unstale":"2024-09-19T06:07:19.982675+0000","last_undegraded":"2024-09-19T06:07:19.982675+0000","last_fullsized":"2024-09-19T06:07:19.982675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:54.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831493+0000","last_change":"2024-09-19T06:05:24.701242+0000","last_active":"2024-09-19T06:07:19.831493+0000","last_peered":"2024-09-19T06:07:19.831493+0000","last_clean":"2024-09-19T06:07:19.831493+0000","last_became_active":"2024-09-19T06:05:24.700813+0000","last_became_peered":"2024-09-19T06:05:24.700813+0000","last_unstale":"2024-09-19T06:07:19.831493+0000","last_undegraded":"2024-09-19T06:07:19.831493+0000","last_fullsized":"2024-09-19T06:07:19.831493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:42.706448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831877+0000","last_change":"2024-09-19T06:05:22.677502+0000","last_active":"2024-09-19T06:07:19.831877+0000","last_peered":"2024-09-19T06:07:19.831877+0000","last_clean":"2024-09-19T06:07:19.831877+0000","last_became_active":"2024-09-19T06:05:22.677082+0000","last_became_peered":"2024-09-19T06:05:22.677082+0000","last_unstale":"2024-09-19T06:07:19.831877+0000","last_undegraded":"2024-09-19T06:07:19.831877+0000","last_fullsized":"2024-09-19T06:07:19.831877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:30.991778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748429+0000","last_change":"2024-09-19T06:05:24.703155+0000","last_active":"2024-09-19T06:07:19.748429+0000","last_peered":"2024-09-19T06:07:19.748429+0000","last_clean":"2024-09-19T06:07:19.748429+0000","last_became_active":"2024-09-19T06:05:24.702570+0000","last_became_peered":"2024-09-19T06:05:24.702570+0000","last_unstale":"2024-09-19T06:07:19.748429+0000","last_undegraded":"2024-09-19T06:07:19.748429+0000","last_fullsized":"2024-09-19T06:07:19.748429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:36.016886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'2","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748368+0000","last_change":"2024-09-19T06:05:46.532666+0000","last_active":"2024-09-19T06:07:19.748368+0000","last_peered":"2024-09-19T06:07:19.748368+0000","last_clean":"2024-09-19T06:07:19.748368+0000","last_became_active":"2024-09-19T06:05:46.523271+0000","last_became_peered":"2024-09-19T06:05:46.523271+0000","last_unstale":"2024-09-19T06:07:19.748368+0000","last_undegraded":"2024-09-19T06:07:19.748368+0000","last_fullsized":"2024-09-19T06:07:19.748368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:04.627727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.832300+0000","last_change":"2024-09-19T06:05:24.694476+0000","last_active":"2024-09-19T06:07:19.832300+0000","last_peered":"2024-09-19T06:07:19.832300+0000","last_clean":"2024-09-19T06:07:19.832300+0000","last_became_active":"2024-09-19T06:05:24.694147+0000","last_became_peered":"2024-09-19T06:05:24.694147+0000","last_unstale":"2024-09-19T06:07:19.832300+0000","last_undegraded":"2024-09-19T06:07:19.832300+0000","last_fullsized":"2024-09-19T06:07:19.832300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:48.830522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831587+0000","last_change":"2024-09-19T06:05:22.687422+0000","last_active":"2024-09-19T06:07:19.831587+0000","last_peered":"2024-09-19T06:07:19.831587+0000","last_clean":"2024-09-19T06:07:19.831587+0000","last_became_active":"2024-09-19T06:05:22.686950+0000","last_became_peered":"2024-09-19T06:05:22.686950+0000","last_unstale":"2024-09-19T06:07:19.831587+0000","last_undegraded":"2024-09-19T06:07:19.831587+0000","last_fullsized":"2024-09-19T06:07:19.831587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:49.279769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983692+0000","last_change":"2024-09-19T06:05:24.695701+0000","last_active":"2024-09-19T06:07:19.983692+0000","last_peered":"2024-09-19T06:07:19.983692+0000","last_clean":"2024-09-19T06:07:19.983692+0000","last_became_active":"2024-09-19T06:05:24.695341+0000","last_became_peered":"2024-09-19T06:05:24.695341+0000","last_unstale":"2024-09-19T06:07:19.983692+0000","last_undegraded":"2024-09-19T06:07:19.983692+0000","last_fullsized":"2024-09-19T06:07:19.983692+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:52.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838983+0000","last_change":"2024-09-19T06:05:24.703456+0000","last_active":"2024-09-19T06:07:19.838983+0000","last_peered":"2024-09-19T06:07:19.838983+0000","last_clean":"2024-09-19T06:07:19.838983+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:07:19.838983+0000","last_undegraded":"2024-09-19T06:07:19.838983+0000","last_fullsized":"2024-09-19T06:07:19.838983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:15.159843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831759+0000","last_change":"2024-09-19T06:05:22.683833+0000","last_active":"2024-09-19T06:07:19.831759+0000","last_peered":"2024-09-19T06:07:19.831759+0000","last_clean":"2024-09-19T06:07:19.831759+0000","last_became_active":"2024-09-19T06:05:22.683439+0000","last_became_peered":"2024-09-19T06:05:22.683439+0000","last_unstale":"2024-09-19T06:07:19.831759+0000","last_undegraded":"2024-09-19T06:07:19.831759+0000","last_fullsized":"2024-09-19T06:07:19.831759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:52.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983107+0000","last_change":"2024-09-19T06:05:24.695905+0000","last_active":"2024-09-19T06:07:19.983107+0000","last_peered":"2024-09-19T06:07:19.983107+0000","last_clean":"2024-09-19T06:07:19.983107+0000","last_became_active":"2024-09-19T06:05:24.695570+0000","last_became_peered":"2024-09-19T06:05:24.695570+0000","last_unstale":"2024-09-19T06:07:19.983107+0000","last_undegraded":"2024-09-19T06:07:19.983107+0000","last_fullsized":"2024-09-19T06:07:19.983107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:00.167126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831795+0000","last_change":"2024-09-19T06:05:22.686853+0000","last_active":"2024-09-19T06:07:19.831795+0000","last_peered":"2024-09-19T06:07:19.831795+0000","last_clean":"2024-09-19T06:07:19.831795+0000","last_became_active":"2024-09-19T06:05:22.686143+0000","last_became_peered":"2024-09-19T06:05:22.686143+0000","last_unstale":"2024-09-19T06:07:19.831795+0000","last_undegraded":"2024-09-19T06:07:19.831795+0000","last_fullsized":"2024-09-19T06:07:19.831795+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:30.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983866+0000","last_change":"2024-09-19T06:05:24.702420+0000","last_active":"2024-09-19T06:07:19.983866+0000","last_peered":"2024-09-19T06:07:19.983866+0000","last_clean":"2024-09-19T06:07:19.983866+0000","last_became_active":"2024-09-19T06:05:24.702140+0000","last_became_peered":"2024-09-19T06:05:24.702140+0000","last_unstale":"2024-09-19T06:07:19.983866+0000","last_undegraded":"2024-09-19T06:07:19.983866+0000","last_fullsized":"2024-09-19T06:07:19.983866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:27.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833352+0000","last_change":"2024-09-19T06:05:23.059638+0000","last_active":"2024-09-19T06:07:19.833352+0000","last_peered":"2024-09-19T06:07:19.833352+0000","last_clean":"2024-09-19T06:07:19.833352+0000","last_became_active":"2024-09-19T06:05:23.059273+0000","last_became_peered":"2024-09-19T06:05:23.059273+0000","last_unstale":"2024-09-19T06:07:19.833352+0000","last_undegraded":"2024-09-19T06:07:19.833352+0000","last_fullsized":"2024-09-19T06:07:19.833352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:56.981598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833048+0000","last_change":"2024-09-19T06:05:24.703608+0000","last_active":"2024-09-19T06:07:19.833048+0000","last_peered":"2024-09-19T06:07:19.833048+0000","last_clean":"2024-09-19T06:07:19.833048+0000","last_became_active":"2024-09-19T06:05:24.703300+0000","last_became_peered":"2024-09-19T06:05:24.703300+0000","last_unstale":"2024-09-19T06:07:19.833048+0000","last_undegraded":"2024-09-19T06:07:19.833048+0000","last_fullsized":"2024-09-19T06:07:19.833048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.063545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.829583+0000","last_change":"2024-09-19T06:05:22.679379+0000","last_active":"2024-09-19T06:07:19.829583+0000","last_peered":"2024-09-19T06:07:19.829583+0000","last_clean":"2024-09-19T06:07:19.829583+0000","last_became_active":"2024-09-19T06:05:22.679091+0000","last_became_peered":"2024-09-19T06:05:22.679091+0000","last_unstale":"2024-09-19T06:07:19.829583+0000","last_undegraded":"2024-09-19T06:07:19.829583+0000","last_fullsized":"2024-09-19T06:07:19.829583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596203,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":760,"num_read_kb":483,"num_write":288,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2015232,"data_stored":1788609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":436832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28768,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716384,"statfs":{"total":95995035648,"available":95965577216,"internally_reserved":0,"allocated":1724416,"data_stored":1226375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037806,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1298432,"data_stored":830250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32456,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712696,"statfs":{"total":95995035648,"available":95961800704,"internally_reserved":0,"allocated":1298432,"data_stored":830170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32652,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712500,"statfs":{"total":95995035648,"available":95961600000,"internally_reserved":0,"allocated":1499136,"data_stored":1030662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":436423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32792,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712360,"statfs":{"total":95995035648,"available":95961456640,"internally_reserved":0,"allocated":1646592,"data_stored":1160272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":437748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1437696,"data_stored":961550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":489637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":501824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":428796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":199674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:07:23.179 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T06:07:23.179 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:07:23.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:07:23.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: Unable to set osd_memory_target on smithi169 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-19T06:07:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: Unable to set osd_memory_target on smithi174 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T06:07:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-19T06:07:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:22 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:07:23.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: Unable to set osd_memory_target on smithi169 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: Unable to set osd_memory_target on smithi174 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:22 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:23.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.314+0000 7fd56420a640 1 -- 172.21.15.103:0/3642633848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55c1025c0 msgr2=0x7fd55c108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.314+0000 7fd56420a640 1 --2- 172.21.15.103:0/3642633848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55c1025c0 0x7fd55c108e50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd554009ca0 tx=0x7fd55402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.314+0000 7fd56420a640 1 -- 172.21.15.103:0/3642633848 shutdown_connections 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.314+0000 7fd56420a640 1 --2- 172.21.15.103:0/3642633848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55c1025c0 0x7fd55c108e50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.314+0000 7fd56420a640 1 --2- 172.21.15.103:0/3642633848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd55c101c00 0x7fd55c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.314+0000 7fd56420a640 1 --2- 172.21.15.103:0/3642633848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd55c100a10 0x7fd55c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.314+0000 7fd56420a640 1 -- 172.21.15.103:0/3642633848 >> 172.21.15.103:0/3642633848 conn(0x7fd55c0fc170 msgr2=0x7fd55c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.314+0000 7fd56420a640 1 -- 172.21.15.103:0/3642633848 shutdown_connections 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.314+0000 7fd56420a640 1 -- 172.21.15.103:0/3642633848 wait complete. 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd56420a640 1 Processor -- start 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd56420a640 1 -- start start 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd56420a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd55c100a10 0x7fd55c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd56420a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55c101c00 0x7fd55c19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:23.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd56420a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd55c1025c0 0x7fd55c19f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd56420a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c10c520 con 0x7fd55c101c00 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd56420a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c10c3a0 con 0x7fd55c100a10 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd56420a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c10c6a0 con 0x7fd55c1025c0 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd5617a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55c101c00 0x7fd55c19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd5617a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55c101c00 0x7fd55c19ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40270/0 (socket says 172.21.15.103:40270) 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd561fa6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd55c100a10 0x7fd55c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd5617a5640 1 -- 172.21.15.103:0/144603904 learned_addr learned my addr 172.21.15.103:0/144603904 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd5627a7640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd55c1025c0 0x7fd55c19f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd561fa6640 1 -- 172.21.15.103:0/144603904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd55c1025c0 msgr2=0x7fd55c19f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd561fa6640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd55c1025c0 0x7fd55c19f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd561fa6640 1 -- 172.21.15.103:0/144603904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55c101c00 msgr2=0x7fd55c19ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:23.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd561fa6640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55c101c00 0x7fd55c19ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd561fa6640 1 -- 172.21.15.103:0/144603904 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55c19f980 con 0x7fd55c100a10 2024-09-19T06:07:23.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd5617a5640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55c101c00 0x7fd55c19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:07:23.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.315+0000 7fd561fa6640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd55c100a10 0x7fd55c069ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd55800d6a0 tx=0x7fd55800db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:23.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.316+0000 7fd552ffd640 1 -- 172.21.15.103:0/144603904 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558017070 con 0x7fd55c100a10 2024-09-19T06:07:23.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.316+0000 7fd552ffd640 1 -- 172.21.15.103:0/144603904 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd558009cd0 con 0x7fd55c100a10 2024-09-19T06:07:23.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.316+0000 7fd552ffd640 1 -- 172.21.15.103:0/144603904 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558003bf0 con 0x7fd55c100a10 2024-09-19T06:07:23.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.316+0000 7fd56420a640 1 -- 172.21.15.103:0/144603904 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55c19fc10 con 0x7fd55c100a10 2024-09-19T06:07:23.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.316+0000 7fd56420a640 1 -- 172.21.15.103:0/144603904 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55c1a0160 con 0x7fd55c100a10 2024-09-19T06:07:23.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.317+0000 7fd56420a640 1 -- 172.21.15.103:0/144603904 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd55c107e50 con 0x7fd55c100a10 2024-09-19T06:07:23.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.318+0000 7fd552ffd640 1 -- 172.21.15.103:0/144603904 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 23) ==== 138476+0+0 (secure 0 0 0) 0x7fd558009820 con 0x7fd55c100a10 2024-09-19T06:07:23.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.319+0000 7fd552ffd640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd5480a33c0 0x7fd5480a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:23.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.319+0000 7fd552ffd640 1 -- 172.21.15.103:0/144603904 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fd5580cf9b0 con 0x7fd55c100a10 2024-09-19T06:07:23.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.319+0000 7fd5617a5640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd5480a33c0 0x7fd5480a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:23.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.319+0000 7fd5617a5640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd5480a33c0 0x7fd5480a5880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd55c069c60 tx=0x7fd54c00b480 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:23.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.323+0000 7fd552ffd640 1 -- 172.21.15.103:0/144603904 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd55809c3e0 con 0x7fd55c100a10 2024-09-19T06:07:23.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.528+0000 7fd56420a640 1 -- 172.21.15.103:0/144603904 --> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd55c062630 con 0x7fd5480a33c0 2024-09-19T06:07:23.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.534+0000 7fd552ffd640 1 -- 172.21.15.103:0/144603904 <== mgr.15189 v2:172.21.15.103:6800/266758959 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257729 (secure 0 0 0) 0x7fd55c062630 con 0x7fd5480a33c0 2024-09-19T06:07:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T06:07:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 -- 172.21.15.103:0/144603904 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd5480a33c0 msgr2=0x7fd5480a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd5480a33c0 0x7fd5480a5880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd55c069c60 tx=0x7fd54c00b480 comp rx=0 tx=0).stop 2024-09-19T06:07:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 -- 172.21.15.103:0/144603904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd55c100a10 msgr2=0x7fd55c069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd55c100a10 0x7fd55c069ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd55800d6a0 tx=0x7fd55800db60 comp rx=0 tx=0).stop 2024-09-19T06:07:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 -- 172.21.15.103:0/144603904 shutdown_connections 2024-09-19T06:07:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd5480a33c0 0x7fd5480a5880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd55c1025c0 0x7fd55c19f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55c101c00 0x7fd55c19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 --2- 172.21.15.103:0/144603904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd55c100a10 0x7fd55c069ef0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:23.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 -- 172.21.15.103:0/144603904 >> 172.21.15.103:0/144603904 conn(0x7fd55c0fc170 msgr2=0x7fd55c105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:23.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 -- 172.21.15.103:0/144603904 shutdown_connections 2024-09-19T06:07:23.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:23.537+0000 7fd56420a640 1 -- 172.21.15.103:0/144603904 wait complete. 2024-09-19T06:07:23.552 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T06:07:21.760511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186805,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":896,"num_read_kb":602,"num_write":471,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363400,"kb_used_data":14064,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578424,"statfs":{"total":1151940427776,"available":1151568306176,"internally_reserved":0,"allocated":14401536,"data_stored":8770539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.994240"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748742+0000","last_change":"2024-09-19T06:05:24.703290+0000","last_active":"2024-09-19T06:07:19.748742+0000","last_peered":"2024-09-19T06:07:19.748742+0000","last_clean":"2024-09-19T06:07:19.748742+0000","last_became_active":"2024-09-19T06:05:24.702343+0000","last_became_peered":"2024-09-19T06:05:24.702343+0000","last_unstale":"2024-09-19T06:07:19.748742+0000","last_undegraded":"2024-09-19T06:07:19.748742+0000","last_fullsized":"2024-09-19T06:07:19.748742+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:50.594004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983423+0000","last_change":"2024-09-19T06:05:24.700363+0000","last_active":"2024-09-19T06:07:19.983423+0000","last_peered":"2024-09-19T06:07:19.983423+0000","last_clean":"2024-09-19T06:07:19.983423+0000","last_became_active":"2024-09-19T06:05:24.700066+0000","last_became_peered":"2024-09-19T06:05:24.700066+0000","last_unstale":"2024-09-19T06:07:19.983423+0000","last_undegraded":"2024-09-19T06:07:19.983423+0000","last_fullsized":"2024-09-19T06:07:19.983423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:26.094195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983216+0000","last_change":"2024-09-19T06:05:24.702458+0000","last_active":"2024-09-19T06:07:19.983216+0000","last_peered":"2024-09-19T06:07:19.983216+0000","last_clean":"2024-09-19T06:07:19.983216+0000","last_became_active":"2024-09-19T06:05:24.702029+0000","last_became_peered":"2024-09-19T06:05:24.702029+0000","last_unstale":"2024-09-19T06:07:19.983216+0000","last_undegraded":"2024-09-19T06:07:19.983216+0000","last_fullsized":"2024-09-19T06:07:19.983216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.456231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983262+0000","last_change":"2024-09-19T06:05:24.699402+0000","last_active":"2024-09-19T06:07:19.983262+0000","last_peered":"2024-09-19T06:07:19.983262+0000","last_clean":"2024-09-19T06:07:19.983262+0000","last_became_active":"2024-09-19T06:05:24.698191+0000","last_became_peered":"2024-09-19T06:05:24.698191+0000","last_unstale":"2024-09-19T06:07:19.983262+0000","last_undegraded":"2024-09-19T06:07:19.983262+0000","last_fullsized":"2024-09-19T06:07:19.983262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.056347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831523+0000","last_change":"2024-09-19T06:05:24.699821+0000","last_active":"2024-09-19T06:07:19.831523+0000","last_peered":"2024-09-19T06:07:19.831523+0000","last_clean":"2024-09-19T06:07:19.831523+0000","last_became_active":"2024-09-19T06:05:24.699493+0000","last_became_peered":"2024-09-19T06:05:24.699493+0000","last_unstale":"2024-09-19T06:07:19.831523+0000","last_undegraded":"2024-09-19T06:07:19.831523+0000","last_fullsized":"2024-09-19T06:07:19.831523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:34.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.750647+0000","last_change":"2024-09-19T06:05:24.697821+0000","last_active":"2024-09-19T06:07:19.750647+0000","last_peered":"2024-09-19T06:07:19.750647+0000","last_clean":"2024-09-19T06:07:19.750647+0000","last_became_active":"2024-09-19T06:05:24.697495+0000","last_became_peered":"2024-09-19T06:05:24.697495+0000","last_unstale":"2024-09-19T06:07:19.750647+0000","last_undegraded":"2024-09-19T06:07:19.750647+0000","last_fullsized":"2024-09-19T06:07:19.750647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:03.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982865+0000","last_change":"2024-09-19T06:05:24.704610+0000","last_active":"2024-09-19T06:07:19.982865+0000","last_peered":"2024-09-19T06:07:19.982865+0000","last_clean":"2024-09-19T06:07:19.982865+0000","last_became_active":"2024-09-19T06:05:24.704288+0000","last_became_peered":"2024-09-19T06:05:24.704288+0000","last_unstale":"2024-09-19T06:07:19.982865+0000","last_undegraded":"2024-09-19T06:07:19.982865+0000","last_fullsized":"2024-09-19T06:07:19.982865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.530553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831687+0000","last_change":"2024-09-19T06:05:24.693662+0000","last_active":"2024-09-19T06:07:19.831687+0000","last_peered":"2024-09-19T06:07:19.831687+0000","last_clean":"2024-09-19T06:07:19.831687+0000","last_became_active":"2024-09-19T06:05:24.693327+0000","last_became_peered":"2024-09-19T06:05:24.693327+0000","last_unstale":"2024-09-19T06:07:19.831687+0000","last_undegraded":"2024-09-19T06:07:19.831687+0000","last_fullsized":"2024-09-19T06:07:19.831687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:39.646907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983592+0000","last_change":"2024-09-19T06:05:24.702552+0000","last_active":"2024-09-19T06:07:19.983592+0000","last_peered":"2024-09-19T06:07:19.983592+0000","last_clean":"2024-09-19T06:07:19.983592+0000","last_became_active":"2024-09-19T06:05:24.701090+0000","last_became_peered":"2024-09-19T06:05:24.701090+0000","last_unstale":"2024-09-19T06:07:19.983592+0000","last_undegraded":"2024-09-19T06:07:19.983592+0000","last_fullsized":"2024-09-19T06:07:19.983592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:44.361368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.751254+0000","last_change":"2024-09-19T06:05:46.524330+0000","last_active":"2024-09-19T06:07:19.751254+0000","last_peered":"2024-09-19T06:07:19.751254+0000","last_clean":"2024-09-19T06:07:19.751254+0000","last_became_active":"2024-09-19T06:05:46.523934+0000","last_became_peered":"2024-09-19T06:05:46.523934+0000","last_unstale":"2024-09-19T06:07:19.751254+0000","last_undegraded":"2024-09-19T06:07:19.751254+0000","last_fullsized":"2024-09-19T06:07:19.751254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:11:12.301698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983702+0000","last_change":"2024-09-19T06:05:24.703118+0000","last_active":"2024-09-19T06:07:19.983702+0000","last_peered":"2024-09-19T06:07:19.983702+0000","last_clean":"2024-09-19T06:07:19.983702+0000","last_became_active":"2024-09-19T06:05:24.702561+0000","last_became_peered":"2024-09-19T06:05:24.702561+0000","last_unstale":"2024-09-19T06:07:19.983702+0000","last_undegraded":"2024-09-19T06:07:19.983702+0000","last_fullsized":"2024-09-19T06:07:19.983702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:51.063256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983406+0000","last_change":"2024-09-19T06:05:24.698704+0000","last_active":"2024-09-19T06:07:19.983406+0000","last_peered":"2024-09-19T06:07:19.983406+0000","last_clean":"2024-09-19T06:07:19.983406+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:07:19.983406+0000","last_undegraded":"2024-09-19T06:07:19.983406+0000","last_fullsized":"2024-09-19T06:07:19.983406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:35.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747930+0000","last_change":"2024-09-19T06:05:24.696236+0000","last_active":"2024-09-19T06:07:19.747930+0000","last_peered":"2024-09-19T06:07:19.747930+0000","last_clean":"2024-09-19T06:07:19.747930+0000","last_became_active":"2024-09-19T06:05:24.695952+0000","last_became_peered":"2024-09-19T06:05:24.695952+0000","last_unstale":"2024-09-19T06:07:19.747930+0000","last_undegraded":"2024-09-19T06:07:19.747930+0000","last_fullsized":"2024-09-19T06:07:19.747930+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:17.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982598+0000","last_change":"2024-09-19T06:05:24.699962+0000","last_active":"2024-09-19T06:07:19.982598+0000","last_peered":"2024-09-19T06:07:19.982598+0000","last_clean":"2024-09-19T06:07:19.982598+0000","last_became_active":"2024-09-19T06:05:24.699625+0000","last_became_peered":"2024-09-19T06:05:24.699625+0000","last_unstale":"2024-09-19T06:07:19.982598+0000","last_undegraded":"2024-09-19T06:07:19.982598+0000","last_fullsized":"2024-09-19T06:07:19.982598+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:34.110712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982302+0000","last_change":"2024-09-19T06:05:24.701310+0000","last_active":"2024-09-19T06:07:19.982302+0000","last_peered":"2024-09-19T06:07:19.982302+0000","last_clean":"2024-09-19T06:07:19.982302+0000","last_became_active":"2024-09-19T06:05:24.701032+0000","last_became_peered":"2024-09-19T06:05:24.701032+0000","last_unstale":"2024-09-19T06:07:19.982302+0000","last_undegraded":"2024-09-19T06:07:19.982302+0000","last_fullsized":"2024-09-19T06:07:19.982302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:29.557533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982549+0000","last_change":"2024-09-19T06:05:24.699803+0000","last_active":"2024-09-19T06:07:19.982549+0000","last_peered":"2024-09-19T06:07:19.982549+0000","last_clean":"2024-09-19T06:07:19.982549+0000","last_became_active":"2024-09-19T06:05:24.699506+0000","last_became_peered":"2024-09-19T06:05:24.699506+0000","last_unstale":"2024-09-19T06:07:19.982549+0000","last_undegraded":"2024-09-19T06:07:19.982549+0000","last_fullsized":"2024-09-19T06:07:19.982549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:32.669231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748756+0000","last_change":"2024-09-19T06:05:24.703805+0000","last_active":"2024-09-19T06:07:19.748756+0000","last_peered":"2024-09-19T06:07:19.748756+0000","last_clean":"2024-09-19T06:07:19.748756+0000","last_became_active":"2024-09-19T06:05:24.702728+0000","last_became_peered":"2024-09-19T06:05:24.702728+0000","last_unstale":"2024-09-19T06:07:19.748756+0000","last_undegraded":"2024-09-19T06:07:19.748756+0000","last_fullsized":"2024-09-19T06:07:19.748756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:20.807530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.829583+0000","last_change":"2024-09-19T06:05:24.691055+0000","last_active":"2024-09-19T06:07:19.829583+0000","last_peered":"2024-09-19T06:07:19.829583+0000","last_clean":"2024-09-19T06:07:19.829583+0000","last_became_active":"2024-09-19T06:05:24.690165+0000","last_became_peered":"2024-09-19T06:05:24.690165+0000","last_unstale":"2024-09-19T06:07:19.829583+0000","last_undegraded":"2024-09-19T06:07:19.829583+0000","last_fullsized":"2024-09-19T06:07:19.829583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:48.656335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.981942+0000","last_change":"2024-09-19T06:05:24.697955+0000","last_active":"2024-09-19T06:07:19.981942+0000","last_peered":"2024-09-19T06:07:19.981942+0000","last_clean":"2024-09-19T06:07:19.981942+0000","last_became_active":"2024-09-19T06:05:24.697598+0000","last_became_peered":"2024-09-19T06:05:24.697598+0000","last_unstale":"2024-09-19T06:07:19.981942+0000","last_undegraded":"2024-09-19T06:07:19.981942+0000","last_fullsized":"2024-09-19T06:07:19.981942+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.458647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748385+0000","last_change":"2024-09-19T06:05:24.705110+0000","last_active":"2024-09-19T06:07:19.748385+0000","last_peered":"2024-09-19T06:07:19.748385+0000","last_clean":"2024-09-19T06:07:19.748385+0000","last_became_active":"2024-09-19T06:05:24.704783+0000","last_became_peered":"2024-09-19T06:05:24.704783+0000","last_unstale":"2024-09-19T06:07:19.748385+0000","last_undegraded":"2024-09-19T06:07:19.748385+0000","last_fullsized":"2024-09-19T06:07:19.748385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:43.092969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747958+0000","last_change":"2024-09-19T06:05:24.693845+0000","last_active":"2024-09-19T06:07:19.747958+0000","last_peered":"2024-09-19T06:07:19.747958+0000","last_clean":"2024-09-19T06:07:19.747958+0000","last_became_active":"2024-09-19T06:05:24.693385+0000","last_became_peered":"2024-09-19T06:05:24.693385+0000","last_unstale":"2024-09-19T06:07:19.747958+0000","last_undegraded":"2024-09-19T06:07:19.747958+0000","last_fullsized":"2024-09-19T06:07:19.747958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:05.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982905+0000","last_change":"2024-09-19T06:05:24.697903+0000","last_active":"2024-09-19T06:07:19.982905+0000","last_peered":"2024-09-19T06:07:19.982905+0000","last_clean":"2024-09-19T06:07:19.982905+0000","last_became_active":"2024-09-19T06:05:24.697566+0000","last_became_peered":"2024-09-19T06:05:24.697566+0000","last_unstale":"2024-09-19T06:07:19.982905+0000","last_undegraded":"2024-09-19T06:07:19.982905+0000","last_fullsized":"2024-09-19T06:07:19.982905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:10.340401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831767+0000","last_change":"2024-09-19T06:05:24.696888+0000","last_active":"2024-09-19T06:07:19.831767+0000","last_peered":"2024-09-19T06:07:19.831767+0000","last_clean":"2024-09-19T06:07:19.831767+0000","last_became_active":"2024-09-19T06:05:24.696554+0000","last_became_peered":"2024-09-19T06:05:24.696554+0000","last_unstale":"2024-09-19T06:07:19.831767+0000","last_undegraded":"2024-09-19T06:07:19.831767+0000","last_fullsized":"2024-09-19T06:07:19.831767+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838648+0000","last_change":"2024-09-19T06:05:24.692443+0000","last_active":"2024-09-19T06:07:19.838648+0000","last_peered":"2024-09-19T06:07:19.838648+0000","last_clean":"2024-09-19T06:07:19.838648+0000","last_became_active":"2024-09-19T06:05:24.690555+0000","last_became_peered":"2024-09-19T06:05:24.690555+0000","last_unstale":"2024-09-19T06:07:19.838648+0000","last_undegraded":"2024-09-19T06:07:19.838648+0000","last_fullsized":"2024-09-19T06:07:19.838648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:29.340744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833473+0000","last_change":"2024-09-19T06:05:24.699379+0000","last_active":"2024-09-19T06:07:19.833473+0000","last_peered":"2024-09-19T06:07:19.833473+0000","last_clean":"2024-09-19T06:07:19.833473+0000","last_became_active":"2024-09-19T06:05:24.699056+0000","last_became_peered":"2024-09-19T06:05:24.699056+0000","last_unstale":"2024-09-19T06:07:19.833473+0000","last_undegraded":"2024-09-19T06:07:19.833473+0000","last_fullsized":"2024-09-19T06:07:19.833473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:30.337080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982063+0000","last_change":"2024-09-19T06:05:24.698672+0000","last_active":"2024-09-19T06:07:19.982063+0000","last_peered":"2024-09-19T06:07:19.982063+0000","last_clean":"2024-09-19T06:07:19.982063+0000","last_became_active":"2024-09-19T06:05:24.698229+0000","last_became_peered":"2024-09-19T06:05:24.698229+0000","last_unstale":"2024-09-19T06:07:19.982063+0000","last_undegraded":"2024-09-19T06:07:19.982063+0000","last_fullsized":"2024-09-19T06:07:19.982063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.082538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748635+0000","last_change":"2024-09-19T06:05:24.707830+0000","last_active":"2024-09-19T06:07:19.748635+0000","last_peered":"2024-09-19T06:07:19.748635+0000","last_clean":"2024-09-19T06:07:19.748635+0000","last_became_active":"2024-09-19T06:05:24.707478+0000","last_became_peered":"2024-09-19T06:05:24.707478+0000","last_unstale":"2024-09-19T06:07:19.748635+0000","last_undegraded":"2024-09-19T06:07:19.748635+0000","last_fullsized":"2024-09-19T06:07:19.748635+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:33.484877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747788+0000","last_change":"2024-09-19T06:05:24.697232+0000","last_active":"2024-09-19T06:07:19.747788+0000","last_peered":"2024-09-19T06:07:19.747788+0000","last_clean":"2024-09-19T06:07:19.747788+0000","last_became_active":"2024-09-19T06:05:24.696727+0000","last_became_peered":"2024-09-19T06:05:24.696727+0000","last_unstale":"2024-09-19T06:07:19.747788+0000","last_undegraded":"2024-09-19T06:07:19.747788+0000","last_fullsized":"2024-09-19T06:07:19.747788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:36.168493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982918+0000","last_change":"2024-09-19T06:05:24.695489+0000","last_active":"2024-09-19T06:07:19.982918+0000","last_peered":"2024-09-19T06:07:19.982918+0000","last_clean":"2024-09-19T06:07:19.982918+0000","last_became_active":"2024-09-19T06:05:24.695012+0000","last_became_peered":"2024-09-19T06:05:24.695012+0000","last_unstale":"2024-09-19T06:07:19.982918+0000","last_undegraded":"2024-09-19T06:07:19.982918+0000","last_fullsized":"2024-09-19T06:07:19.982918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:41.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.981770+0000","last_change":"2024-09-19T06:05:24.697294+0000","last_active":"2024-09-19T06:07:19.981770+0000","last_peered":"2024-09-19T06:07:19.981770+0000","last_clean":"2024-09-19T06:07:19.981770+0000","last_became_active":"2024-09-19T06:05:24.696563+0000","last_became_peered":"2024-09-19T06:05:24.696563+0000","last_unstale":"2024-09-19T06:07:19.981770+0000","last_undegraded":"2024-09-19T06:07:19.981770+0000","last_fullsized":"2024-09-19T06:07:19.981770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:41.861120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.981838+0000","last_change":"2024-09-19T06:05:24.702710+0000","last_active":"2024-09-19T06:07:19.981838+0000","last_peered":"2024-09-19T06:07:19.981838+0000","last_clean":"2024-09-19T06:07:19.981838+0000","last_became_active":"2024-09-19T06:05:24.702039+0000","last_became_peered":"2024-09-19T06:05:24.702039+0000","last_unstale":"2024-09-19T06:07:19.981838+0000","last_undegraded":"2024-09-19T06:07:19.981838+0000","last_fullsized":"2024-09-19T06:07:19.981838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:23.831807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748351+0000","last_change":"2024-09-19T06:05:24.707671+0000","last_active":"2024-09-19T06:07:19.748351+0000","last_peered":"2024-09-19T06:07:19.748351+0000","last_clean":"2024-09-19T06:07:19.748351+0000","last_became_active":"2024-09-19T06:05:24.707325+0000","last_became_peered":"2024-09-19T06:05:24.707325+0000","last_unstale":"2024-09-19T06:07:19.748351+0000","last_undegraded":"2024-09-19T06:07:19.748351+0000","last_fullsized":"2024-09-19T06:07:19.748351+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:32.149103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831508+0000","last_change":"2024-09-19T06:05:24.704875+0000","last_active":"2024-09-19T06:07:19.831508+0000","last_peered":"2024-09-19T06:07:19.831508+0000","last_clean":"2024-09-19T06:07:19.831508+0000","last_became_active":"2024-09-19T06:05:24.704501+0000","last_became_peered":"2024-09-19T06:05:24.704501+0000","last_unstale":"2024-09-19T06:07:19.831508+0000","last_undegraded":"2024-09-19T06:07:19.831508+0000","last_fullsized":"2024-09-19T06:07:19.831508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'8","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:20.029873+0000","last_change":"2024-09-19T06:05:22.687857+0000","last_active":"2024-09-19T06:07:20.029873+0000","last_peered":"2024-09-19T06:07:20.029873+0000","last_clean":"2024-09-19T06:07:20.029873+0000","last_became_active":"2024-09-19T06:05:22.687573+0000","last_became_peered":"2024-09-19T06:05:22.687573+0000","last_unstale":"2024-09-19T06:07:20.029873+0000","last_undegraded":"2024-09-19T06:07:20.029873+0000","last_fullsized":"2024-09-19T06:07:20.029873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:31.972444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838777+0000","last_change":"2024-09-19T06:05:46.904521+0000","last_active":"2024-09-19T06:07:19.838777+0000","last_peered":"2024-09-19T06:07:19.838777+0000","last_clean":"2024-09-19T06:07:19.838777+0000","last_became_active":"2024-09-19T06:05:46.904146+0000","last_became_peered":"2024-09-19T06:05:46.904146+0000","last_unstale":"2024-09-19T06:07:19.838777+0000","last_undegraded":"2024-09-19T06:07:19.838777+0000","last_fullsized":"2024-09-19T06:07:19.838777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:48.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.750690+0000","last_change":"2024-09-19T06:05:22.680500+0000","last_active":"2024-09-19T06:07:19.750690+0000","last_peered":"2024-09-19T06:07:19.750690+0000","last_clean":"2024-09-19T06:07:19.750690+0000","last_became_active":"2024-09-19T06:05:22.679947+0000","last_became_peered":"2024-09-19T06:05:22.679947+0000","last_unstale":"2024-09-19T06:07:19.750690+0000","last_undegraded":"2024-09-19T06:07:19.750690+0000","last_fullsized":"2024-09-19T06:07:19.750690+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:34.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747505+0000","last_change":"2024-09-19T06:05:22.680962+0000","last_active":"2024-09-19T06:07:19.747505+0000","last_peered":"2024-09-19T06:07:19.747505+0000","last_clean":"2024-09-19T06:07:19.747505+0000","last_became_active":"2024-09-19T06:05:22.680662+0000","last_became_peered":"2024-09-19T06:05:22.680662+0000","last_unstale":"2024-09-19T06:07:19.747505+0000","last_undegraded":"2024-09-19T06:07:19.747505+0000","last_fullsized":"2024-09-19T06:07:19.747505+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.296422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831912+0000","last_change":"2024-09-19T06:05:24.695214+0000","last_active":"2024-09-19T06:07:19.831912+0000","last_peered":"2024-09-19T06:07:19.831912+0000","last_clean":"2024-09-19T06:07:19.831912+0000","last_became_active":"2024-09-19T06:05:24.694930+0000","last_became_peered":"2024-09-19T06:05:24.694930+0000","last_unstale":"2024-09-19T06:07:19.831912+0000","last_undegraded":"2024-09-19T06:07:19.831912+0000","last_fullsized":"2024-09-19T06:07:19.831912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:51.382934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838861+0000","last_change":"2024-09-19T06:05:22.684504+0000","last_active":"2024-09-19T06:07:19.838861+0000","last_peered":"2024-09-19T06:07:19.838861+0000","last_clean":"2024-09-19T06:07:19.838861+0000","last_became_active":"2024-09-19T06:05:22.684169+0000","last_became_peered":"2024-09-19T06:05:22.684169+0000","last_unstale":"2024-09-19T06:07:19.838861+0000","last_undegraded":"2024-09-19T06:07:19.838861+0000","last_fullsized":"2024-09-19T06:07:19.838861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:29.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.828826+0000","last_change":"2024-09-19T06:05:24.693056+0000","last_active":"2024-09-19T06:07:19.828826+0000","last_peered":"2024-09-19T06:07:19.828826+0000","last_clean":"2024-09-19T06:07:19.828826+0000","last_became_active":"2024-09-19T06:05:24.692544+0000","last_became_peered":"2024-09-19T06:05:24.692544+0000","last_unstale":"2024-09-19T06:07:19.828826+0000","last_undegraded":"2024-09-19T06:07:19.828826+0000","last_fullsized":"2024-09-19T06:07:19.828826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:45.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.751255+0000","last_change":"2024-09-19T06:05:22.682854+0000","last_active":"2024-09-19T06:07:19.751255+0000","last_peered":"2024-09-19T06:07:19.751255+0000","last_clean":"2024-09-19T06:07:19.751255+0000","last_became_active":"2024-09-19T06:05:22.682406+0000","last_became_peered":"2024-09-19T06:05:22.682406+0000","last_unstale":"2024-09-19T06:07:19.751255+0000","last_undegraded":"2024-09-19T06:07:19.751255+0000","last_fullsized":"2024-09-19T06:07:19.751255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.206144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983271+0000","last_change":"2024-09-19T06:05:24.699408+0000","last_active":"2024-09-19T06:07:19.983271+0000","last_peered":"2024-09-19T06:07:19.983271+0000","last_clean":"2024-09-19T06:07:19.983271+0000","last_became_active":"2024-09-19T06:05:24.699106+0000","last_became_peered":"2024-09-19T06:05:24.699106+0000","last_unstale":"2024-09-19T06:07:19.983271+0000","last_undegraded":"2024-09-19T06:07:19.983271+0000","last_fullsized":"2024-09-19T06:07:19.983271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:37.487458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983708+0000","last_change":"2024-09-19T06:05:22.686106+0000","last_active":"2024-09-19T06:07:19.983708+0000","last_peered":"2024-09-19T06:07:19.983708+0000","last_clean":"2024-09-19T06:07:19.983708+0000","last_became_active":"2024-09-19T06:05:22.685763+0000","last_became_peered":"2024-09-19T06:05:22.685763+0000","last_unstale":"2024-09-19T06:07:19.983708+0000","last_undegraded":"2024-09-19T06:07:19.983708+0000","last_fullsized":"2024-09-19T06:07:19.983708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:57.889128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983989+0000","last_change":"2024-09-19T06:05:46.524038+0000","last_active":"2024-09-19T06:07:19.983989+0000","last_peered":"2024-09-19T06:07:19.983989+0000","last_clean":"2024-09-19T06:07:19.983989+0000","last_became_active":"2024-09-19T06:05:46.523746+0000","last_became_peered":"2024-09-19T06:05:46.523746+0000","last_unstale":"2024-09-19T06:07:19.983989+0000","last_undegraded":"2024-09-19T06:07:19.983989+0000","last_fullsized":"2024-09-19T06:07:19.983989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:17.361840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.839043+0000","last_change":"2024-09-19T06:05:23.060545+0000","last_active":"2024-09-19T06:07:19.839043+0000","last_peered":"2024-09-19T06:07:19.839043+0000","last_clean":"2024-09-19T06:07:19.839043+0000","last_became_active":"2024-09-19T06:05:23.060187+0000","last_became_peered":"2024-09-19T06:05:23.060187+0000","last_unstale":"2024-09-19T06:07:19.839043+0000","last_undegraded":"2024-09-19T06:07:19.839043+0000","last_fullsized":"2024-09-19T06:07:19.839043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.604284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983213+0000","last_change":"2024-09-19T06:05:24.702535+0000","last_active":"2024-09-19T06:07:19.983213+0000","last_peered":"2024-09-19T06:07:19.983213+0000","last_clean":"2024-09-19T06:07:19.983213+0000","last_became_active":"2024-09-19T06:05:24.701616+0000","last_became_peered":"2024-09-19T06:05:24.701616+0000","last_unstale":"2024-09-19T06:07:19.983213+0000","last_undegraded":"2024-09-19T06:07:19.983213+0000","last_fullsized":"2024-09-19T06:07:19.983213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:43.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'35","reported_seq":281,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:20.031390+0000","last_change":"2024-09-19T06:05:22.685460+0000","last_active":"2024-09-19T06:07:20.031390+0000","last_peered":"2024-09-19T06:07:20.031390+0000","last_clean":"2024-09-19T06:07:20.031390+0000","last_became_active":"2024-09-19T06:05:22.685086+0000","last_became_peered":"2024-09-19T06:05:22.685086+0000","last_unstale":"2024-09-19T06:07:20.031390+0000","last_undegraded":"2024-09-19T06:07:20.031390+0000","last_fullsized":"2024-09-19T06:07:20.031390+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:10.373783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65608,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":170,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831730+0000","last_change":"2024-09-19T06:05:24.700431+0000","last_active":"2024-09-19T06:07:19.831730+0000","last_peered":"2024-09-19T06:07:19.831730+0000","last_clean":"2024-09-19T06:07:19.831730+0000","last_became_active":"2024-09-19T06:05:24.700092+0000","last_became_peered":"2024-09-19T06:05:24.700092+0000","last_unstale":"2024-09-19T06:07:19.831730+0000","last_undegraded":"2024-09-19T06:07:19.831730+0000","last_fullsized":"2024-09-19T06:07:19.831730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:17.208392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748475+0000","last_change":"2024-09-19T06:05:46.530433+0000","last_active":"2024-09-19T06:07:19.748475+0000","last_peered":"2024-09-19T06:07:19.748475+0000","last_clean":"2024-09-19T06:07:19.748475+0000","last_became_active":"2024-09-19T06:05:46.521700+0000","last_became_peered":"2024-09-19T06:05:46.521700+0000","last_unstale":"2024-09-19T06:07:19.748475+0000","last_undegraded":"2024-09-19T06:07:19.748475+0000","last_fullsized":"2024-09-19T06:07:19.748475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:40.489547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747529+0000","last_change":"2024-09-19T06:05:24.699149+0000","last_active":"2024-09-19T06:07:19.747529+0000","last_peered":"2024-09-19T06:07:19.747529+0000","last_clean":"2024-09-19T06:07:19.747529+0000","last_became_active":"2024-09-19T06:05:24.698846+0000","last_became_peered":"2024-09-19T06:05:24.698846+0000","last_unstale":"2024-09-19T06:07:19.747529+0000","last_undegraded":"2024-09-19T06:07:19.747529+0000","last_fullsized":"2024-09-19T06:07:19.747529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:19.416169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838769+0000","last_change":"2024-09-19T06:05:22.682157+0000","last_active":"2024-09-19T06:07:19.838769+0000","last_peered":"2024-09-19T06:07:19.838769+0000","last_clean":"2024-09-19T06:07:19.838769+0000","last_became_active":"2024-09-19T06:05:22.681816+0000","last_became_peered":"2024-09-19T06:05:22.681816+0000","last_unstale":"2024-09-19T06:07:19.838769+0000","last_undegraded":"2024-09-19T06:07:19.838769+0000","last_fullsized":"2024-09-19T06:07:19.838769+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:05.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983151+0000","last_change":"2024-09-19T06:05:24.699233+0000","last_active":"2024-09-19T06:07:19.983151+0000","last_peered":"2024-09-19T06:07:19.983151+0000","last_clean":"2024-09-19T06:07:19.983151+0000","last_became_active":"2024-09-19T06:05:24.698918+0000","last_became_peered":"2024-09-19T06:05:24.698918+0000","last_unstale":"2024-09-19T06:07:19.983151+0000","last_undegraded":"2024-09-19T06:07:19.983151+0000","last_fullsized":"2024-09-19T06:07:19.983151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:20.037927+0000","last_change":"2024-09-19T06:05:22.682161+0000","last_active":"2024-09-19T06:07:20.037927+0000","last_peered":"2024-09-19T06:07:20.037927+0000","last_clean":"2024-09-19T06:07:20.037927+0000","last_became_active":"2024-09-19T06:05:22.681805+0000","last_became_peered":"2024-09-19T06:05:22.681805+0000","last_unstale":"2024-09-19T06:07:20.037927+0000","last_undegraded":"2024-09-19T06:07:20.037927+0000","last_fullsized":"2024-09-19T06:07:20.037927+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:27.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1476,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983620+0000","last_change":"2024-09-19T06:05:24.703668+0000","last_active":"2024-09-19T06:07:19.983620+0000","last_peered":"2024-09-19T06:07:19.983620+0000","last_clean":"2024-09-19T06:07:19.983620+0000","last_became_active":"2024-09-19T06:05:24.703342+0000","last_became_peered":"2024-09-19T06:05:24.703342+0000","last_unstale":"2024-09-19T06:07:19.983620+0000","last_undegraded":"2024-09-19T06:07:19.983620+0000","last_fullsized":"2024-09-19T06:07:19.983620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:30.399187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831473+0000","last_change":"2024-09-19T06:05:23.060458+0000","last_active":"2024-09-19T06:07:19.831473+0000","last_peered":"2024-09-19T06:07:19.831473+0000","last_clean":"2024-09-19T06:07:19.831473+0000","last_became_active":"2024-09-19T06:05:23.060098+0000","last_became_peered":"2024-09-19T06:05:23.060098+0000","last_unstale":"2024-09-19T06:07:19.831473+0000","last_undegraded":"2024-09-19T06:07:19.831473+0000","last_fullsized":"2024-09-19T06:07:19.831473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:58.800162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838711+0000","last_change":"2024-09-19T06:05:24.699832+0000","last_active":"2024-09-19T06:07:19.838711+0000","last_peered":"2024-09-19T06:07:19.838711+0000","last_clean":"2024-09-19T06:07:19.838711+0000","last_became_active":"2024-09-19T06:05:24.697600+0000","last_became_peered":"2024-09-19T06:05:24.697600+0000","last_unstale":"2024-09-19T06:07:19.838711+0000","last_undegraded":"2024-09-19T06:07:19.838711+0000","last_fullsized":"2024-09-19T06:07:19.838711+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:15.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831904+0000","last_change":"2024-09-19T06:05:22.682962+0000","last_active":"2024-09-19T06:07:19.831904+0000","last_peered":"2024-09-19T06:07:19.831904+0000","last_clean":"2024-09-19T06:07:19.831904+0000","last_became_active":"2024-09-19T06:05:22.682573+0000","last_became_peered":"2024-09-19T06:05:22.682573+0000","last_unstale":"2024-09-19T06:07:19.831904+0000","last_undegraded":"2024-09-19T06:07:19.831904+0000","last_fullsized":"2024-09-19T06:07:19.831904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:31.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748646+0000","last_change":"2024-09-19T06:05:46.907103+0000","last_active":"2024-09-19T06:07:19.748646+0000","last_peered":"2024-09-19T06:07:19.748646+0000","last_clean":"2024-09-19T06:07:19.748646+0000","last_became_active":"2024-09-19T06:05:46.906741+0000","last_became_peered":"2024-09-19T06:05:46.906741+0000","last_unstale":"2024-09-19T06:07:19.748646+0000","last_undegraded":"2024-09-19T06:07:19.748646+0000","last_fullsized":"2024-09-19T06:07:19.748646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:42.275594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748126+0000","last_change":"2024-09-19T06:05:22.684007+0000","last_active":"2024-09-19T06:07:19.748126+0000","last_peered":"2024-09-19T06:07:19.748126+0000","last_clean":"2024-09-19T06:07:19.748126+0000","last_became_active":"2024-09-19T06:05:22.683606+0000","last_became_peered":"2024-09-19T06:05:22.683606+0000","last_unstale":"2024-09-19T06:07:19.748126+0000","last_undegraded":"2024-09-19T06:07:19.748126+0000","last_fullsized":"2024-09-19T06:07:19.748126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:29.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983666+0000","last_change":"2024-09-19T06:05:24.698057+0000","last_active":"2024-09-19T06:07:19.983666+0000","last_peered":"2024-09-19T06:07:19.983666+0000","last_clean":"2024-09-19T06:07:19.983666+0000","last_became_active":"2024-09-19T06:05:24.697604+0000","last_became_peered":"2024-09-19T06:05:24.697604+0000","last_unstale":"2024-09-19T06:07:19.983666+0000","last_undegraded":"2024-09-19T06:07:19.983666+0000","last_fullsized":"2024-09-19T06:07:19.983666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:33.246096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.959611+0000","last_change":"2024-09-19T06:05:22.680641+0000","last_active":"2024-09-19T06:07:19.959611+0000","last_peered":"2024-09-19T06:07:19.959611+0000","last_clean":"2024-09-19T06:07:19.959611+0000","last_became_active":"2024-09-19T06:05:22.680282+0000","last_became_peered":"2024-09-19T06:05:22.680282+0000","last_unstale":"2024-09-19T06:07:19.959611+0000","last_undegraded":"2024-09-19T06:07:19.959611+0000","last_fullsized":"2024-09-19T06:07:19.959611+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:07.171581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983468+0000","last_change":"2024-09-19T06:05:24.705525+0000","last_active":"2024-09-19T06:07:19.983468+0000","last_peered":"2024-09-19T06:07:19.983468+0000","last_clean":"2024-09-19T06:07:19.983468+0000","last_became_active":"2024-09-19T06:05:24.705226+0000","last_became_peered":"2024-09-19T06:05:24.705226+0000","last_unstale":"2024-09-19T06:07:19.983468+0000","last_undegraded":"2024-09-19T06:07:19.983468+0000","last_fullsized":"2024-09-19T06:07:19.983468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:51.020525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982028+0000","last_change":"2024-09-19T06:05:23.060628+0000","last_active":"2024-09-19T06:07:19.982028+0000","last_peered":"2024-09-19T06:07:19.982028+0000","last_clean":"2024-09-19T06:07:19.982028+0000","last_became_active":"2024-09-19T06:05:23.060066+0000","last_became_peered":"2024-09-19T06:05:23.060066+0000","last_unstale":"2024-09-19T06:07:19.982028+0000","last_undegraded":"2024-09-19T06:07:19.982028+0000","last_fullsized":"2024-09-19T06:07:19.982028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:55.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983885+0000","last_change":"2024-09-19T06:05:24.701994+0000","last_active":"2024-09-19T06:07:19.983885+0000","last_peered":"2024-09-19T06:07:19.983885+0000","last_clean":"2024-09-19T06:07:19.983885+0000","last_became_active":"2024-09-19T06:05:24.701648+0000","last_became_peered":"2024-09-19T06:05:24.701648+0000","last_unstale":"2024-09-19T06:07:19.983885+0000","last_undegraded":"2024-09-19T06:07:19.983885+0000","last_fullsized":"2024-09-19T06:07:19.983885+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:16.475339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983778+0000","last_change":"2024-09-19T06:04:14.186274+0000","last_active":"2024-09-19T06:07:19.983778+0000","last_peered":"2024-09-19T06:07:19.983778+0000","last_clean":"2024-09-19T06:07:19.983778+0000","last_became_active":"2024-09-19T06:04:14.185907+0000","last_became_peered":"2024-09-19T06:04:14.185907+0000","last_unstale":"2024-09-19T06:07:19.983778+0000","last_undegraded":"2024-09-19T06:07:19.983778+0000","last_fullsized":"2024-09-19T06:07:19.983778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:00:59.680614+0000","last_clean_scrub_stamp":"2024-09-19T06:00:59.680614+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:01.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982897+0000","last_change":"2024-09-19T06:05:22.682242+0000","last_active":"2024-09-19T06:07:19.982897+0000","last_peered":"2024-09-19T06:07:19.982897+0000","last_clean":"2024-09-19T06:07:19.982897+0000","last_became_active":"2024-09-19T06:05:22.681896+0000","last_became_peered":"2024-09-19T06:05:22.681896+0000","last_unstale":"2024-09-19T06:07:19.982897+0000","last_undegraded":"2024-09-19T06:07:19.982897+0000","last_fullsized":"2024-09-19T06:07:19.982897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.119422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.828930+0000","last_change":"2024-09-19T06:05:46.962541+0000","last_active":"2024-09-19T06:07:19.828930+0000","last_peered":"2024-09-19T06:07:19.828930+0000","last_clean":"2024-09-19T06:07:19.828930+0000","last_became_active":"2024-09-19T06:05:46.962261+0000","last_became_peered":"2024-09-19T06:05:46.962261+0000","last_unstale":"2024-09-19T06:07:19.828930+0000","last_undegraded":"2024-09-19T06:07:19.828930+0000","last_fullsized":"2024-09-19T06:07:19.828930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:36.355129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983752+0000","last_change":"2024-09-19T06:05:22.685809+0000","last_active":"2024-09-19T06:07:19.983752+0000","last_peered":"2024-09-19T06:07:19.983752+0000","last_clean":"2024-09-19T06:07:19.983752+0000","last_became_active":"2024-09-19T06:05:22.685466+0000","last_became_peered":"2024-09-19T06:05:22.685466+0000","last_unstale":"2024-09-19T06:07:19.983752+0000","last_undegraded":"2024-09-19T06:07:19.983752+0000","last_fullsized":"2024-09-19T06:07:19.983752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:43.793845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747729+0000","last_change":"2024-09-19T06:05:24.701105+0000","last_active":"2024-09-19T06:07:19.747729+0000","last_peered":"2024-09-19T06:07:19.747729+0000","last_clean":"2024-09-19T06:07:19.747729+0000","last_became_active":"2024-09-19T06:05:24.700825+0000","last_became_peered":"2024-09-19T06:05:24.700825+0000","last_unstale":"2024-09-19T06:07:19.747729+0000","last_undegraded":"2024-09-19T06:07:19.747729+0000","last_fullsized":"2024-09-19T06:07:19.747729+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:35.707437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747671+0000","last_change":"2024-09-19T06:05:23.059587+0000","last_active":"2024-09-19T06:07:19.747671+0000","last_peered":"2024-09-19T06:07:19.747671+0000","last_clean":"2024-09-19T06:07:19.747671+0000","last_became_active":"2024-09-19T06:05:23.059248+0000","last_became_peered":"2024-09-19T06:05:23.059248+0000","last_unstale":"2024-09-19T06:07:19.747671+0000","last_undegraded":"2024-09-19T06:07:19.747671+0000","last_fullsized":"2024-09-19T06:07:19.747671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:25.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838746+0000","last_change":"2024-09-19T06:05:24.701610+0000","last_active":"2024-09-19T06:07:19.838746+0000","last_peered":"2024-09-19T06:07:19.838746+0000","last_clean":"2024-09-19T06:07:19.838746+0000","last_became_active":"2024-09-19T06:05:24.697296+0000","last_became_peered":"2024-09-19T06:05:24.697296+0000","last_unstale":"2024-09-19T06:07:19.838746+0000","last_undegraded":"2024-09-19T06:07:19.838746+0000","last_fullsized":"2024-09-19T06:07:19.838746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:52.256284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983775+0000","last_change":"2024-09-19T06:05:22.684818+0000","last_active":"2024-09-19T06:07:19.983775+0000","last_peered":"2024-09-19T06:07:19.983775+0000","last_clean":"2024-09-19T06:07:19.983775+0000","last_became_active":"2024-09-19T06:05:22.684211+0000","last_became_peered":"2024-09-19T06:05:22.684211+0000","last_unstale":"2024-09-19T06:07:19.983775+0000","last_undegraded":"2024-09-19T06:07:19.983775+0000","last_fullsized":"2024-09-19T06:07:19.983775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:50.711805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.750888+0000","last_change":"2024-09-19T06:05:24.702992+0000","last_active":"2024-09-19T06:07:19.750888+0000","last_peered":"2024-09-19T06:07:19.750888+0000","last_clean":"2024-09-19T06:07:19.750888+0000","last_became_active":"2024-09-19T06:05:24.702643+0000","last_became_peered":"2024-09-19T06:05:24.702643+0000","last_unstale":"2024-09-19T06:07:19.750888+0000","last_undegraded":"2024-09-19T06:07:19.750888+0000","last_fullsized":"2024-09-19T06:07:19.750888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:40.651861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.829239+0000","last_change":"2024-09-19T06:05:23.060444+0000","last_active":"2024-09-19T06:07:19.829239+0000","last_peered":"2024-09-19T06:07:19.829239+0000","last_clean":"2024-09-19T06:07:19.829239+0000","last_became_active":"2024-09-19T06:05:23.059879+0000","last_became_peered":"2024-09-19T06:05:23.059879+0000","last_unstale":"2024-09-19T06:07:19.829239+0000","last_undegraded":"2024-09-19T06:07:19.829239+0000","last_fullsized":"2024-09-19T06:07:19.829239+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:39.013096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.751068+0000","last_change":"2024-09-19T06:05:24.694892+0000","last_active":"2024-09-19T06:07:19.751068+0000","last_peered":"2024-09-19T06:07:19.751068+0000","last_clean":"2024-09-19T06:07:19.751068+0000","last_became_active":"2024-09-19T06:05:24.694534+0000","last_became_peered":"2024-09-19T06:05:24.694534+0000","last_unstale":"2024-09-19T06:07:19.751068+0000","last_undegraded":"2024-09-19T06:07:19.751068+0000","last_fullsized":"2024-09-19T06:07:19.751068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:50.633035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831903+0000","last_change":"2024-09-19T06:05:23.060597+0000","last_active":"2024-09-19T06:07:19.831903+0000","last_peered":"2024-09-19T06:07:19.831903+0000","last_clean":"2024-09-19T06:07:19.831903+0000","last_became_active":"2024-09-19T06:05:23.060235+0000","last_became_peered":"2024-09-19T06:05:23.060235+0000","last_unstale":"2024-09-19T06:07:19.831903+0000","last_undegraded":"2024-09-19T06:07:19.831903+0000","last_fullsized":"2024-09-19T06:07:19.831903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:54.517780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.747923+0000","last_change":"2024-09-19T06:05:24.698131+0000","last_active":"2024-09-19T06:07:19.747923+0000","last_peered":"2024-09-19T06:07:19.747923+0000","last_clean":"2024-09-19T06:07:19.747923+0000","last_became_active":"2024-09-19T06:05:24.697784+0000","last_became_peered":"2024-09-19T06:05:24.697784+0000","last_unstale":"2024-09-19T06:07:19.747923+0000","last_undegraded":"2024-09-19T06:07:19.747923+0000","last_fullsized":"2024-09-19T06:07:19.747923+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:49.563908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'46","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.963022+0000","last_change":"2024-09-19T06:05:22.679532+0000","last_active":"2024-09-19T06:07:19.963022+0000","last_peered":"2024-09-19T06:07:19.963022+0000","last_clean":"2024-09-19T06:07:19.963022+0000","last_became_active":"2024-09-19T06:05:22.679156+0000","last_became_peered":"2024-09-19T06:05:22.679156+0000","last_unstale":"2024-09-19T06:07:19.963022+0000","last_undegraded":"2024-09-19T06:07:19.963022+0000","last_fullsized":"2024-09-19T06:07:19.963022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:31.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":83,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833475+0000","last_change":"2024-09-19T06:05:24.698383+0000","last_active":"2024-09-19T06:07:19.833475+0000","last_peered":"2024-09-19T06:07:19.833475+0000","last_clean":"2024-09-19T06:07:19.833475+0000","last_became_active":"2024-09-19T06:05:24.698044+0000","last_became_peered":"2024-09-19T06:05:24.698044+0000","last_unstale":"2024-09-19T06:07:19.833475+0000","last_undegraded":"2024-09-19T06:07:19.833475+0000","last_fullsized":"2024-09-19T06:07:19.833475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:53.388847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983321+0000","last_change":"2024-09-19T06:05:22.684799+0000","last_active":"2024-09-19T06:07:19.983321+0000","last_peered":"2024-09-19T06:07:19.983321+0000","last_clean":"2024-09-19T06:07:19.983321+0000","last_became_active":"2024-09-19T06:05:22.684376+0000","last_became_peered":"2024-09-19T06:05:22.684376+0000","last_unstale":"2024-09-19T06:07:19.983321+0000","last_undegraded":"2024-09-19T06:07:19.983321+0000","last_fullsized":"2024-09-19T06:07:19.983321+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.124960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983541+0000","last_change":"2024-09-19T06:05:24.693751+0000","last_active":"2024-09-19T06:07:19.983541+0000","last_peered":"2024-09-19T06:07:19.983541+0000","last_clean":"2024-09-19T06:07:19.983541+0000","last_became_active":"2024-09-19T06:05:24.693442+0000","last_became_peered":"2024-09-19T06:05:24.693442+0000","last_unstale":"2024-09-19T06:07:19.983541+0000","last_undegraded":"2024-09-19T06:07:19.983541+0000","last_fullsized":"2024-09-19T06:07:19.983541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:46.491860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.982675+0000","last_change":"2024-09-19T06:05:23.060522+0000","last_active":"2024-09-19T06:07:19.982675+0000","last_peered":"2024-09-19T06:07:19.982675+0000","last_clean":"2024-09-19T06:07:19.982675+0000","last_became_active":"2024-09-19T06:05:23.060170+0000","last_became_peered":"2024-09-19T06:05:23.060170+0000","last_unstale":"2024-09-19T06:07:19.982675+0000","last_undegraded":"2024-09-19T06:07:19.982675+0000","last_fullsized":"2024-09-19T06:07:19.982675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:54.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831493+0000","last_change":"2024-09-19T06:05:24.701242+0000","last_active":"2024-09-19T06:07:19.831493+0000","last_peered":"2024-09-19T06:07:19.831493+0000","last_clean":"2024-09-19T06:07:19.831493+0000","last_became_active":"2024-09-19T06:05:24.700813+0000","last_became_peered":"2024-09-19T06:05:24.700813+0000","last_unstale":"2024-09-19T06:07:19.831493+0000","last_undegraded":"2024-09-19T06:07:19.831493+0000","last_fullsized":"2024-09-19T06:07:19.831493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:42.706448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831877+0000","last_change":"2024-09-19T06:05:22.677502+0000","last_active":"2024-09-19T06:07:19.831877+0000","last_peered":"2024-09-19T06:07:19.831877+0000","last_clean":"2024-09-19T06:07:19.831877+0000","last_became_active":"2024-09-19T06:05:22.677082+0000","last_became_peered":"2024-09-19T06:05:22.677082+0000","last_unstale":"2024-09-19T06:07:19.831877+0000","last_undegraded":"2024-09-19T06:07:19.831877+0000","last_fullsized":"2024-09-19T06:07:19.831877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:30.991778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748429+0000","last_change":"2024-09-19T06:05:24.703155+0000","last_active":"2024-09-19T06:07:19.748429+0000","last_peered":"2024-09-19T06:07:19.748429+0000","last_clean":"2024-09-19T06:07:19.748429+0000","last_became_active":"2024-09-19T06:05:24.702570+0000","last_became_peered":"2024-09-19T06:05:24.702570+0000","last_unstale":"2024-09-19T06:07:19.748429+0000","last_undegraded":"2024-09-19T06:07:19.748429+0000","last_fullsized":"2024-09-19T06:07:19.748429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:36.016886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'2","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.748368+0000","last_change":"2024-09-19T06:05:46.532666+0000","last_active":"2024-09-19T06:07:19.748368+0000","last_peered":"2024-09-19T06:07:19.748368+0000","last_clean":"2024-09-19T06:07:19.748368+0000","last_became_active":"2024-09-19T06:05:46.523271+0000","last_became_peered":"2024-09-19T06:05:46.523271+0000","last_unstale":"2024-09-19T06:07:19.748368+0000","last_undegraded":"2024-09-19T06:07:19.748368+0000","last_fullsized":"2024-09-19T06:07:19.748368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:04.627727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.832300+0000","last_change":"2024-09-19T06:05:24.694476+0000","last_active":"2024-09-19T06:07:19.832300+0000","last_peered":"2024-09-19T06:07:19.832300+0000","last_clean":"2024-09-19T06:07:19.832300+0000","last_became_active":"2024-09-19T06:05:24.694147+0000","last_became_peered":"2024-09-19T06:05:24.694147+0000","last_unstale":"2024-09-19T06:07:19.832300+0000","last_undegraded":"2024-09-19T06:07:19.832300+0000","last_fullsized":"2024-09-19T06:07:19.832300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:48.830522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831587+0000","last_change":"2024-09-19T06:05:22.687422+0000","last_active":"2024-09-19T06:07:19.831587+0000","last_peered":"2024-09-19T06:07:19.831587+0000","last_clean":"2024-09-19T06:07:19.831587+0000","last_became_active":"2024-09-19T06:05:22.686950+0000","last_became_peered":"2024-09-19T06:05:22.686950+0000","last_unstale":"2024-09-19T06:07:19.831587+0000","last_undegraded":"2024-09-19T06:07:19.831587+0000","last_fullsized":"2024-09-19T06:07:19.831587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:49.279769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983692+0000","last_change":"2024-09-19T06:05:24.695701+0000","last_active":"2024-09-19T06:07:19.983692+0000","last_peered":"2024-09-19T06:07:19.983692+0000","last_clean":"2024-09-19T06:07:19.983692+0000","last_became_active":"2024-09-19T06:05:24.695341+0000","last_became_peered":"2024-09-19T06:05:24.695341+0000","last_unstale":"2024-09-19T06:07:19.983692+0000","last_undegraded":"2024-09-19T06:07:19.983692+0000","last_fullsized":"2024-09-19T06:07:19.983692+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:52.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.838983+0000","last_change":"2024-09-19T06:05:24.703456+0000","last_active":"2024-09-19T06:07:19.838983+0000","last_peered":"2024-09-19T06:07:19.838983+0000","last_clean":"2024-09-19T06:07:19.838983+0000","last_became_active":"2024-09-19T06:05:24.698016+0000","last_became_peered":"2024-09-19T06:05:24.698016+0000","last_unstale":"2024-09-19T06:07:19.838983+0000","last_undegraded":"2024-09-19T06:07:19.838983+0000","last_fullsized":"2024-09-19T06:07:19.838983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:15.159843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831759+0000","last_change":"2024-09-19T06:05:22.683833+0000","last_active":"2024-09-19T06:07:19.831759+0000","last_peered":"2024-09-19T06:07:19.831759+0000","last_clean":"2024-09-19T06:07:19.831759+0000","last_became_active":"2024-09-19T06:05:22.683439+0000","last_became_peered":"2024-09-19T06:05:22.683439+0000","last_unstale":"2024-09-19T06:07:19.831759+0000","last_undegraded":"2024-09-19T06:07:19.831759+0000","last_fullsized":"2024-09-19T06:07:19.831759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:52.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983107+0000","last_change":"2024-09-19T06:05:24.695905+0000","last_active":"2024-09-19T06:07:19.983107+0000","last_peered":"2024-09-19T06:07:19.983107+0000","last_clean":"2024-09-19T06:07:19.983107+0000","last_became_active":"2024-09-19T06:05:24.695570+0000","last_became_peered":"2024-09-19T06:05:24.695570+0000","last_unstale":"2024-09-19T06:07:19.983107+0000","last_undegraded":"2024-09-19T06:07:19.983107+0000","last_fullsized":"2024-09-19T06:07:19.983107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:00.167126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.831795+0000","last_change":"2024-09-19T06:05:22.686853+0000","last_active":"2024-09-19T06:07:19.831795+0000","last_peered":"2024-09-19T06:07:19.831795+0000","last_clean":"2024-09-19T06:07:19.831795+0000","last_became_active":"2024-09-19T06:05:22.686143+0000","last_became_peered":"2024-09-19T06:05:22.686143+0000","last_unstale":"2024-09-19T06:07:19.831795+0000","last_undegraded":"2024-09-19T06:07:19.831795+0000","last_fullsized":"2024-09-19T06:07:19.831795+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:30.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.983866+0000","last_change":"2024-09-19T06:05:24.702420+0000","last_active":"2024-09-19T06:07:19.983866+0000","last_peered":"2024-09-19T06:07:19.983866+0000","last_clean":"2024-09-19T06:07:19.983866+0000","last_became_active":"2024-09-19T06:05:24.702140+0000","last_became_peered":"2024-09-19T06:05:24.702140+0000","last_unstale":"2024-09-19T06:07:19.983866+0000","last_undegraded":"2024-09-19T06:07:19.983866+0000","last_fullsized":"2024-09-19T06:07:19.983866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:27.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833352+0000","last_change":"2024-09-19T06:05:23.059638+0000","last_active":"2024-09-19T06:07:19.833352+0000","last_peered":"2024-09-19T06:07:19.833352+0000","last_clean":"2024-09-19T06:07:19.833352+0000","last_became_active":"2024-09-19T06:05:23.059273+0000","last_became_peered":"2024-09-19T06:05:23.059273+0000","last_unstale":"2024-09-19T06:07:19.833352+0000","last_undegraded":"2024-09-19T06:07:19.833352+0000","last_fullsized":"2024-09-19T06:07:19.833352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:56.981598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.833048+0000","last_change":"2024-09-19T06:05:24.703608+0000","last_active":"2024-09-19T06:07:19.833048+0000","last_peered":"2024-09-19T06:07:19.833048+0000","last_clean":"2024-09-19T06:07:19.833048+0000","last_became_active":"2024-09-19T06:05:24.703300+0000","last_became_peered":"2024-09-19T06:05:24.703300+0000","last_unstale":"2024-09-19T06:07:19.833048+0000","last_undegraded":"2024-09-19T06:07:19.833048+0000","last_fullsized":"2024-09-19T06:07:19.833048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:23.670658+0000","last_clean_scrub_stamp":"2024-09-19T06:05:23.670658+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.063545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:07:19.829583+0000","last_change":"2024-09-19T06:05:22.679379+0000","last_active":"2024-09-19T06:07:19.829583+0000","last_peered":"2024-09-19T06:07:19.829583+0000","last_clean":"2024-09-19T06:07:19.829583+0000","last_became_active":"2024-09-19T06:05:22.679091+0000","last_became_peered":"2024-09-19T06:05:22.679091+0000","last_unstale":"2024-09-19T06:07:19.829583+0000","last_undegraded":"2024-09-19T06:07:19.829583+0000","last_fullsized":"2024-09-19T06:07:19.829583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:05:21.667156+0000","last_clean_scrub_stamp":"2024-09-19T06:05:21.667156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.396392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596203,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":760,"num_read_kb":483,"num_write":288,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2015232,"data_stored":1788609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":436832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28768,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716384,"statfs":{"total":95995035648,"available":95965577216,"internally_reserved":0,"allocated":1724416,"data_stored":1226375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037806,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1298432,"data_stored":830250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32456,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712696,"statfs":{"total":95995035648,"available":95961800704,"internally_reserved":0,"allocated":1298432,"data_stored":830170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32652,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712500,"statfs":{"total":95995035648,"available":95961600000,"internally_reserved":0,"allocated":1499136,"data_stored":1030662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":436423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32792,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712360,"statfs":{"total":95995035648,"available":95961456640,"internally_reserved":0,"allocated":1646592,"data_stored":1160272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":437748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1437696,"data_stored":961550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":489637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":501824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":428796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":199674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:07:23.556 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:07:23.856 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:24.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.373+0000 7ff99ea80640 1 -- 172.21.15.103:0/2874926225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff998108300 msgr2=0x7ff99810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:24.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.373+0000 7ff99ea80640 1 --2- 172.21.15.103:0/2874926225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff998108300 0x7ff99810ec70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff990009be0 tx=0x7ff99002a6b0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 -- 172.21.15.103:0/2874926225 shutdown_connections 2024-09-19T06:07:24.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 --2- 172.21.15.103:0/2874926225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff998108300 0x7ff99810ec70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 --2- 172.21.15.103:0/2874926225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff998103780 0x7ff998107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 --2- 172.21.15.103:0/2874926225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff998102dd0 0x7ff9981031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 -- 172.21.15.103:0/2874926225 >> 172.21.15.103:0/2874926225 conn(0x7ff9980fc7d0 msgr2=0x7ff9980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:24.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 -- 172.21.15.103:0/2874926225 shutdown_connections 2024-09-19T06:07:24.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 -- 172.21.15.103:0/2874926225 wait complete. 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 Processor -- start 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 -- start start 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff998102dd0 0x7ff9981984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff998103780 0x7ff998198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff998108300 0x7ff99819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.374+0000 7ff99ea80640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff998111f80 con 0x7ff998102dd0 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff99ea80640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff998111e00 con 0x7ff998108300 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff99ea80640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff998112100 con 0x7ff998103780 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff997fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff998103780 0x7ff998198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff99c81c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff998102dd0 0x7ff9981984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff997fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff998103780 0x7ff998198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34186/0 (socket says 172.21.15.103:34186) 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff997fff640 1 -- 172.21.15.103:0/4283035144 learned_addr learned my addr 172.21.15.103:0/4283035144 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:24.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff99c81c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff998102dd0 0x7ff9981984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40282/0 (socket says 172.21.15.103:40282) 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff99d01d640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff998108300 0x7ff99819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff997fff640 1 -- 172.21.15.103:0/4283035144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff998108300 msgr2=0x7ff99819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff997fff640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff998108300 0x7ff99819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff997fff640 1 -- 172.21.15.103:0/4283035144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff998102dd0 msgr2=0x7ff9981984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff997fff640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff998102dd0 0x7ff9981984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff997fff640 1 -- 172.21.15.103:0/4283035144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99819d490 con 0x7ff998103780 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff99c81c640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff998102dd0 0x7ff9981984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff99d01d640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff998108300 0x7ff99819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff997fff640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff998103780 0x7ff998198a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff98400e7e0 tx=0x7ff98400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff995ffb640 1 -- 172.21.15.103:0/4283035144 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98400ccc0 con 0x7ff998103780 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff995ffb640 1 -- 172.21.15.103:0/4283035144 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9840054d0 con 0x7ff998103780 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff99ea80640 1 -- 172.21.15.103:0/4283035144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99819d780 con 0x7ff998103780 2024-09-19T06:07:24.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.375+0000 7ff995ffb640 1 -- 172.21.15.103:0/4283035144 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984010430 con 0x7ff998103780 2024-09-19T06:07:24.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.376+0000 7ff99ea80640 1 -- 172.21.15.103:0/4283035144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9981a5060 con 0x7ff998103780 2024-09-19T06:07:24.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.377+0000 7ff99ea80640 1 -- 172.21.15.103:0/4283035144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9981031b0 con 0x7ff998103780 2024-09-19T06:07:24.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.378+0000 7ff995ffb640 1 -- 172.21.15.103:0/4283035144 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 23) ==== 138476+0+0 (secure 0 0 0) 0x7ff984004f20 con 0x7ff998103780 2024-09-19T06:07:24.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.378+0000 7ff995ffb640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff9880a33b0 0x7ff9880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:24.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.378+0000 7ff99c81c640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff9880a33b0 0x7ff9880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:24.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.379+0000 7ff995ffb640 1 -- 172.21.15.103:0/4283035144 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7ff9840cfef0 con 0x7ff998103780 2024-09-19T06:07:24.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.379+0000 7ff99c81c640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff9880a33b0 0x7ff9880a5870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0095f0 tx=0x7ff98c005f90 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:24.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.383+0000 7ff995ffb640 1 -- 172.21.15.103:0/4283035144 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff98409c8c0 con 0x7ff998103780 2024-09-19T06:07:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.488+0000 7ff995ffb640 1 -- 172.21.15.103:0/4283035144 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7ff984098830 con 0x7ff998103780 2024-09-19T06:07:24.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.632+0000 7ff99ea80640 1 -- 172.21.15.103:0/4283035144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff998199840 con 0x7ff998103780 2024-09-19T06:07:24.635 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:07:24.635 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:07:24.635 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: Unable to set osd_memory_target on smithi103 to 184582451: error parsing value: Value '184582451' is below minimum 939524096 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-19T06:07:24.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-19T06:07:24.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='client.24881 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:07:24.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:24 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.633+0000 7ff995ffb640 1 -- 172.21.15.103:0/4283035144 <== mon.1 v2:172.21.15.174:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11933 (secure 0 0 0) 0x7ff984056ca0 con 0x7ff998103780 2024-09-19T06:07:24.638 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:24.638 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-09-19T06:07:18:721714+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:07:18.671540+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24488,24475,24463]},"id":1}]} 2024-09-19T06:07:24.638 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-19T06:07:24.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.636+0000 7ff99ea80640 1 -- 172.21.15.103:0/4283035144 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff9880a33b0 msgr2=0x7ff9880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:24.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.636+0000 7ff99ea80640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff9880a33b0 0x7ff9880a5870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0095f0 tx=0x7ff98c005f90 comp rx=0 tx=0).stop 2024-09-19T06:07:24.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.636+0000 7ff99ea80640 1 -- 172.21.15.103:0/4283035144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff998103780 msgr2=0x7ff998198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:24.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.636+0000 7ff99ea80640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff998103780 0x7ff998198a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff98400e7e0 tx=0x7ff98400eca0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.636+0000 7ff99ea80640 1 -- 172.21.15.103:0/4283035144 shutdown_connections 2024-09-19T06:07:24.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.636+0000 7ff99ea80640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff9880a33b0 0x7ff9880a5870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.636+0000 7ff99ea80640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff998108300 0x7ff99819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.636+0000 7ff99ea80640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff998103780 0x7ff998198a20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.636+0000 7ff99ea80640 1 --2- 172.21.15.103:0/4283035144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff998102dd0 0x7ff9981984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:24.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.636+0000 7ff99ea80640 1 -- 172.21.15.103:0/4283035144 >> 172.21.15.103:0/4283035144 conn(0x7ff9980fc7d0 msgr2=0x7ff998105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:24.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.637+0000 7ff99ea80640 1 -- 172.21.15.103:0/4283035144 shutdown_connections 2024-09-19T06:07:24.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:24.637+0000 7ff99ea80640 1 -- 172.21.15.103:0/4283035144 wait complete. 2024-09-19T06:07:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:07:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:07:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: Unable to set osd_memory_target on smithi103 to 184582451: error parsing value: Value '184582451' is below minimum 939524096 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='client.24881 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:24 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:07:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:07:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: Unable to set osd_memory_target on smithi103 to 184582451: error parsing value: Value '184582451' is below minimum 939524096 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='client.24881 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:24.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:24 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:25.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:07:25.595 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:07:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:07:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:07:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:07:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:07:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:07:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:07:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-19T06:07:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:25 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/4283035144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:07:25.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-19T06:07:25.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:25.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:25.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:25.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:25.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:25 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/4283035144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: Updating smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: Updating smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: Updating smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:25.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:25.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:25 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/4283035144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.070+0000 7f15c4672640 1 -- 172.21.15.103:0/3586082615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15bc101de0 msgr2=0x7f15bc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.070+0000 7f15c4672640 1 --2- 172.21.15.103:0/3586082615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15bc101de0 0x7f15bc1021c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009900 tx=0x7f15b802a410 comp rx=0 tx=0).stop 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.070+0000 7f15c4672640 1 -- 172.21.15.103:0/3586082615 shutdown_connections 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.070+0000 7f15c4672640 1 --2- 172.21.15.103:0/3586082615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc106f10 0x7f15bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.070+0000 7f15c4672640 1 --2- 172.21.15.103:0/3586082615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15bc102790 0x7f15bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.070+0000 7f15c4672640 1 --2- 172.21.15.103:0/3586082615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15bc101de0 0x7f15bc1021c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.070+0000 7f15c4672640 1 -- 172.21.15.103:0/3586082615 >> 172.21.15.103:0/3586082615 conn(0x7f15bc0fd8c0 msgr2=0x7f15bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.070+0000 7f15c4672640 1 -- 172.21.15.103:0/3586082615 shutdown_connections 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.070+0000 7f15c4672640 1 -- 172.21.15.103:0/3586082615 wait complete. 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c4672640 1 Processor -- start 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c4672640 1 -- start start 2024-09-19T06:07:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c4672640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15bc101de0 0x7f15bc198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c4672640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15bc102790 0x7f15bc1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c4672640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc106f10 0x7f15bc19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c4672640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc111e20 con 0x7f15bc102790 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c4672640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc111ca0 con 0x7f15bc101de0 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c4672640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc111fa0 con 0x7f15bc106f10 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c1c0d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15bc102790 0x7f15bc1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c1c0d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15bc102790 0x7f15bc1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40300/0 (socket says 172.21.15.103:40300) 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c1c0d640 1 -- 172.21.15.103:0/3511988626 learned_addr learned my addr 172.21.15.103:0/3511988626 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c2c0f640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc106f10 0x7f15bc19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.071+0000 7f15c240e640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15bc101de0 0x7f15bc198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15c1c0d640 1 -- 172.21.15.103:0/3511988626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc106f10 msgr2=0x7f15bc19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15c1c0d640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc106f10 0x7f15bc19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15c1c0d640 1 -- 172.21.15.103:0/3511988626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15bc101de0 msgr2=0x7f15bc198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15c1c0d640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15bc101de0 0x7f15bc198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15c1c0d640 1 -- 172.21.15.103:0/3511988626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc19d330 con 0x7f15bc102790 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15c1c0d640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15bc102790 0x7f15bc1988c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00d950 tx=0x7f15ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15b37fe640 1 -- 172.21.15.103:0/3511988626 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac017070 con 0x7f15bc102790 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15c4672640 1 -- 172.21.15.103:0/3511988626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15bc19d620 con 0x7f15bc102790 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15b37fe640 1 -- 172.21.15.103:0/3511988626 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f15ac009c30 con 0x7f15bc102790 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15b37fe640 1 -- 172.21.15.103:0/3511988626 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00f620 con 0x7f15bc102790 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.072+0000 7f15c4672640 1 -- 172.21.15.103:0/3511988626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15bc1a4f00 con 0x7f15bc102790 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.073+0000 7f15c4672640 1 -- 172.21.15.103:0/3511988626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15bc1021c0 con 0x7f15bc102790 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.074+0000 7f15b37fe640 1 -- 172.21.15.103:0/3511988626 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7f15ac0109a0 con 0x7f15bc102790 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.075+0000 7f15b37fe640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f15a80a3440 0x7f15a80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.075+0000 7f15c240e640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f15a80a3440 0x7f15a80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.075+0000 7f15b37fe640 1 -- 172.21.15.103:0/3511988626 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f15ac0cfa70 con 0x7f15bc102790 2024-09-19T06:07:26.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.076+0000 7f15c240e640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f15a80a3440 0x7f15a80a5900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f15b8031440 tx=0x7f15b8005b50 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:26.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.080+0000 7f15b37fe640 1 -- 172.21.15.103:0/3511988626 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15ac009de0 con 0x7f15bc102790 2024-09-19T06:07:26.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.248+0000 7f15c4672640 1 -- 172.21.15.103:0/3511988626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15bc10a150 con 0x7f15bc102790 2024-09-19T06:07:26.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.249+0000 7f15b37fe640 1 -- 172.21.15.103:0/3511988626 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23062 (secure 0 0 0) 0x7f15ac09bc80 con 0x7f15bc102790 2024-09-19T06:07:26.252 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:07:26.252 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":81,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:07:19.742969+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:05:21.617020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:05:23.597579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1612408044":"2024-09-20T06:07:19.742943+0000","172.21.15.103:0/2210851046":"2024-09-20T06:07:19.742943+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/2607266510":"2024-09-20T06:07:19.742943+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/550453146":"2024-09-20T06:07:19.742943+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/253046125":"2024-09-20T06:07:19.742943+0000","172.21.15.103:6801/253046125":"2024-09-20T06:07:19.742943+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:07:26.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.251+0000 7f15c4672640 1 -- 172.21.15.103:0/3511988626 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f15a80a3440 msgr2=0x7f15a80a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:26.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.251+0000 7f15c4672640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f15a80a3440 0x7f15a80a5900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f15b8031440 tx=0x7f15b8005b50 comp rx=0 tx=0).stop 2024-09-19T06:07:26.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.252+0000 7f15c4672640 1 -- 172.21.15.103:0/3511988626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15bc102790 msgr2=0x7f15bc1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:26.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.252+0000 7f15c4672640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15bc102790 0x7f15bc1988c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00d950 tx=0x7f15ac00de10 comp rx=0 tx=0).stop 2024-09-19T06:07:26.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.252+0000 7f15c4672640 1 -- 172.21.15.103:0/3511988626 shutdown_connections 2024-09-19T06:07:26.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.252+0000 7f15c4672640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f15a80a3440 0x7f15a80a5900 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:26.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.252+0000 7f15c4672640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc106f10 0x7f15bc19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:26.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.252+0000 7f15c4672640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15bc102790 0x7f15bc1988c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:26.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.252+0000 7f15c4672640 1 --2- 172.21.15.103:0/3511988626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15bc101de0 0x7f15bc198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:26.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.252+0000 7f15c4672640 1 -- 172.21.15.103:0/3511988626 >> 172.21.15.103:0/3511988626 conn(0x7f15bc0fd8c0 msgr2=0x7f15bc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:26.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.252+0000 7f15c4672640 1 -- 172.21.15.103:0/3511988626 shutdown_connections 2024-09-19T06:07:26.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:26.252+0000 7f15c4672640 1 -- 172.21.15.103:0/3511988626 wait complete. 2024-09-19T06:07:26.623 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:26 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3511988626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:07:26.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:26 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3511988626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:07:26.951 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T06:07:26.951 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T06:07:26.962 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:07:26.962 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T06:07:26.962 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T06:07:26.962 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T06:07:26.962 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:07:26.963 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:07:26.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:26 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3511988626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:07:27.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.064+0000 7f75dffd6640 1 -- 172.21.15.103:0/1546149891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75d81009b0 msgr2=0x7f75d8100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.064+0000 7f75dffd6640 1 --2- 172.21.15.103:0/1546149891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75d81009b0 0x7f75d8100e10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009930 tx=0x7f75c802a420 comp rx=0 tx=0).stop 2024-09-19T06:07:27.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.064+0000 7f75dffd6640 1 -- 172.21.15.103:0/1546149891 shutdown_connections 2024-09-19T06:07:27.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.064+0000 7f75dffd6640 1 --2- 172.21.15.103:0/1546149891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d8101350 0x7f75d810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.064+0000 7f75dffd6640 1 --2- 172.21.15.103:0/1546149891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75d81009b0 0x7f75d8100e10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.064+0000 7f75dffd6640 1 --2- 172.21.15.103:0/1546149891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75d81069c0 0x7f75d8106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.064+0000 7f75dffd6640 1 -- 172.21.15.103:0/1546149891 >> 172.21.15.103:0/1546149891 conn(0x7f75d8077990 msgr2=0x7f75d80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.064+0000 7f75dffd6640 1 -- 172.21.15.103:0/1546149891 shutdown_connections 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.064+0000 7f75dffd6640 1 -- 172.21.15.103:0/1546149891 wait complete. 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75dffd6640 1 Processor -- start 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75dffd6640 1 -- start start 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75dffd6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75d81009b0 0x7f75d81970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75dffd6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75d8101350 0x7f75d8197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75dffd6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d81069c0 0x7f75d819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75dffd6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8110d00 con 0x7f75d81009b0 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75dffd6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8110b80 con 0x7f75d8101350 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75dffd6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8110e80 con 0x7f75d81069c0 2024-09-19T06:07:27.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75ddd72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75d81009b0 0x7f75d81970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75ddd72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75d81009b0 0x7f75d81970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40310/0 (socket says 172.21.15.103:40310) 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75ddd72640 1 -- 172.21.15.103:0/37019552 learned_addr learned my addr 172.21.15.103:0/37019552 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.065+0000 7f75de573640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d81069c0 0x7f75d819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75dd571640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75d8101350 0x7f75d8197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75ddd72640 1 -- 172.21.15.103:0/37019552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d81069c0 msgr2=0x7f75d819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75ddd72640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d81069c0 0x7f75d819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75ddd72640 1 -- 172.21.15.103:0/37019552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75d8101350 msgr2=0x7f75d8197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75ddd72640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75d8101350 0x7f75d8197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75ddd72640 1 -- 172.21.15.103:0/37019552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d819c0d0 con 0x7f75d81009b0 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75ddd72640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75d81009b0 0x7f75d81970e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f75d4007b50 tx=0x7f75d400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75ceffd640 1 -- 172.21.15.103:0/37019552 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d4007c40 con 0x7f75d81009b0 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75ceffd640 1 -- 172.21.15.103:0/37019552 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75d4007de0 con 0x7f75d81009b0 2024-09-19T06:07:27.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75dffd6640 1 -- 172.21.15.103:0/37019552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d819c3c0 con 0x7f75d81009b0 2024-09-19T06:07:27.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75ceffd640 1 -- 172.21.15.103:0/37019552 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d400ad40 con 0x7f75d81009b0 2024-09-19T06:07:27.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.066+0000 7f75dffd6640 1 -- 172.21.15.103:0/37019552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d80698a0 con 0x7f75d81009b0 2024-09-19T06:07:27.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.067+0000 7f75dffd6640 1 -- 172.21.15.103:0/37019552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d8100e10 con 0x7f75d81009b0 2024-09-19T06:07:27.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.068+0000 7f75ceffd640 1 -- 172.21.15.103:0/37019552 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7f75d400eb30 con 0x7f75d81009b0 2024-09-19T06:07:27.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.069+0000 7f75ceffd640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75c40a3580 0x7f75c40a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.069+0000 7f75ceffd640 1 -- 172.21.15.103:0/37019552 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f75d40d1340 con 0x7f75d81009b0 2024-09-19T06:07:27.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.069+0000 7f75dd571640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75c40a3580 0x7f75c40a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.069+0000 7f75dd571640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75c40a3580 0x7f75c40a5a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75c8006010 tx=0x7f75c8000bc0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.073+0000 7f75ceffd640 1 -- 172.21.15.103:0/37019552 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f75d4023060 con 0x7f75d81009b0 2024-09-19T06:07:27.230 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:27.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.272+0000 7f75dffd6640 1 -- 172.21.15.103:0/37019552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f75d8069b70 con 0x7f75d81009b0 2024-09-19T06:07:27.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.276+0000 7f75ceffd640 1 -- 172.21.15.103:0/37019552 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7f75d400ee20 con 0x7f75d81009b0 2024-09-19T06:07:27.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 -- 172.21.15.103:0/37019552 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75c40a3580 msgr2=0x7f75c40a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75c40a3580 0x7f75c40a5a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75c8006010 tx=0x7f75c8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 -- 172.21.15.103:0/37019552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75d81009b0 msgr2=0x7f75d81970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75d81009b0 0x7f75d81970e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f75d4007b50 tx=0x7f75d400e420 comp rx=0 tx=0).stop 2024-09-19T06:07:27.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 -- 172.21.15.103:0/37019552 shutdown_connections 2024-09-19T06:07:27.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75c40a3580 0x7f75c40a5a40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d81069c0 0x7f75d819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75d8101350 0x7f75d8197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 --2- 172.21.15.103:0/37019552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75d81009b0 0x7f75d81970e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 -- 172.21.15.103:0/37019552 >> 172.21.15.103:0/37019552 conn(0x7f75d8077990 msgr2=0x7f75d8103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 -- 172.21.15.103:0/37019552 shutdown_connections 2024-09-19T06:07:27.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.279+0000 7f75dffd6640 1 -- 172.21.15.103:0/37019552 wait complete. 2024-09-19T06:07:27.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T06:07:27.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.394+0000 7f02f4f52640 1 -- 172.21.15.103:0/4010091301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f01009e0 msgr2=0x7f02f0100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.394+0000 7f02f4f52640 1 --2- 172.21.15.103:0/4010091301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f01009e0 0x7f02f0100e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009930 tx=0x7f02e402a420 comp rx=0 tx=0).stop 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.394+0000 7f02f4f52640 1 -- 172.21.15.103:0/4010091301 shutdown_connections 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.394+0000 7f02f4f52640 1 --2- 172.21.15.103:0/4010091301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f0101380 0x7f02f010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.394+0000 7f02f4f52640 1 --2- 172.21.15.103:0/4010091301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f01009e0 0x7f02f0100e40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.394+0000 7f02f4f52640 1 --2- 172.21.15.103:0/4010091301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f01069f0 0x7f02f0106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.394+0000 7f02f4f52640 1 -- 172.21.15.103:0/4010091301 >> 172.21.15.103:0/4010091301 conn(0x7f02f00fc6c0 msgr2=0x7f02f00feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.394+0000 7f02f4f52640 1 -- 172.21.15.103:0/4010091301 shutdown_connections 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.394+0000 7f02f4f52640 1 -- 172.21.15.103:0/4010091301 wait complete. 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02f4f52640 1 Processor -- start 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02f4f52640 1 -- start start 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02f4f52640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f01009e0 0x7f02f01982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02f4f52640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f0101380 0x7f02f01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02f4f52640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f01069f0 0x7f02f019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02f4f52640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f02f0110ce0 con 0x7f02f01069f0 2024-09-19T06:07:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02f4f52640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02f0110b60 con 0x7f02f0101380 2024-09-19T06:07:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02f4f52640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f02f0110e60 con 0x7f02f01009e0 2024-09-19T06:07:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02eed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f01069f0 0x7f02f019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02eed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f01069f0 0x7f02f019cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40328/0 (socket says 172.21.15.103:40328) 2024-09-19T06:07:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02eed9d640 1 -- 172.21.15.103:0/2554485794 learned_addr learned my addr 172.21.15.103:0/2554485794 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02ee59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f01009e0 0x7f02f01982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02edd9b640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f0101380 0x7f02f01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02eed9d640 1 -- 172.21.15.103:0/2554485794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f01009e0 msgr2=0x7f02f01982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02eed9d640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f01009e0 0x7f02f01982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02eed9d640 1 -- 172.21.15.103:0/2554485794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f0101380 msgr2=0x7f02f01987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02eed9d640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f0101380 0x7f02f01987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.395+0000 7f02eed9d640 1 -- 172.21.15.103:0/2554485794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f019d290 con 0x7f02f01069f0 2024-09-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.396+0000 7f02eed9d640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f01069f0 0x7f02f019cb60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f02e800eaa0 tx=0x7f02e800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.396+0000 7f02df7fe640 1 -- 172.21.15.103:0/2554485794 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e800cdb0 con 0x7f02f01069f0 2024-09-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.396+0000 7f02f4f52640 1 -- 172.21.15.103:0/2554485794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f019d580 con 0x7f02f01069f0 2024-09-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.396+0000 7f02df7fe640 1 -- 172.21.15.103:0/2554485794 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02e8005020 con 0x7f02f01069f0 2024-09-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.396+0000 7f02f4f52640 1 -- 172.21.15.103:0/2554485794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f01a4e10 con 0x7f02f01069f0 2024-09-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.396+0000 7f02df7fe640 1 -- 172.21.15.103:0/2554485794 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e801f060 con 0x7f02f01069f0 2024-09-19T06:07:27.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.397+0000 7f02f4f52640 1 -- 172.21.15.103:0/2554485794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f0100e40 con 0x7f02f01069f0 2024-09-19T06:07:27.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.398+0000 7f02df7fe640 1 -- 172.21.15.103:0/2554485794 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7f02e80051d0 con 0x7f02f01069f0 2024-09-19T06:07:27.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.399+0000 7f02df7fe640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f02d80a3500 0x7f02d80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.399+0000 7f02ee59c640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f02d80a3500 0x7f02d80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.399+0000 7f02df7fe640 1 -- 172.21.15.103:0/2554485794 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f02e80d02d0 con 0x7f02f01069f0 2024-09-19T06:07:27.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.399+0000 7f02ee59c640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f02d80a3500 0x7f02d80a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f02e0005d00 tx=0x7f02e000b410 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.403+0000 7f02df7fe640 1 -- 172.21.15.103:0/2554485794 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02e8016030 con 0x7f02f01069f0 2024-09-19T06:07:27.543 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:27 smithi103 ceph-mon[30925]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 2 op/s 2024-09-19T06:07:27.543 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:27 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/37019552' entity='client.admin' 2024-09-19T06:07:27.543 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:27 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:27.543 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:27 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:27.543 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:27 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:27.543 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:27 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:27.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.582+0000 7f02f4f52640 1 -- 172.21.15.103:0/2554485794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f02f002d7c0 con 0x7f02f01069f0 2024-09-19T06:07:27.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.586+0000 7f02df7fe640 1 -- 172.21.15.103:0/2554485794 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7f02e809c540 con 0x7f02f01069f0 2024-09-19T06:07:27.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 -- 172.21.15.103:0/2554485794 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f02d80a3500 msgr2=0x7f02d80a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f02d80a3500 0x7f02d80a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f02e0005d00 tx=0x7f02e000b410 comp rx=0 tx=0).stop 2024-09-19T06:07:27.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 -- 172.21.15.103:0/2554485794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f01069f0 msgr2=0x7f02f019cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f01069f0 0x7f02f019cb60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f02e800eaa0 tx=0x7f02e800ef60 comp rx=0 tx=0).stop 2024-09-19T06:07:27.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 -- 172.21.15.103:0/2554485794 shutdown_connections 2024-09-19T06:07:27.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f02d80a3500 0x7f02d80a59c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f01069f0 0x7f02f019cb60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f0101380 0x7f02f01987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 --2- 172.21.15.103:0/2554485794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f01009e0 0x7f02f01982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 -- 172.21.15.103:0/2554485794 >> 172.21.15.103:0/2554485794 conn(0x7f02f00fc6c0 msgr2=0x7f02f006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 -- 172.21.15.103:0/2554485794 shutdown_connections 2024-09-19T06:07:27.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.589+0000 7f02f4f52640 1 -- 172.21.15.103:0/2554485794 wait complete. 2024-09-19T06:07:27.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T06:07:27.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.705+0000 7f2bef59e640 1 -- 172.21.15.103:0/2326939440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf010bf30 msgr2=0x7f2bf010e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.705+0000 7f2bef59e640 1 --2- 172.21.15.103:0/2326939440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf010bf30 0x7f2bf010e3b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009ca0 tx=0x7f2be802a950 comp rx=0 tx=0).stop 2024-09-19T06:07:27.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.705+0000 7f2bef59e640 1 -- 172.21.15.103:0/2326939440 shutdown_connections 2024-09-19T06:07:27.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.705+0000 7f2bef59e640 1 --2- 172.21.15.103:0/2326939440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf010bf30 0x7f2bf010e3b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.705+0000 7f2bef59e640 1 --2- 172.21.15.103:0/2326939440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf0103400 0x7f2bf010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.705+0000 7f2bef59e640 1 --2- 172.21.15.103:0/2326939440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bf0102ae0 0x7f2bf0102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.705+0000 7f2bef59e640 1 -- 172.21.15.103:0/2326939440 >> 172.21.15.103:0/2326939440 conn(0x7f2bf00fc510 msgr2=0x7f2bf00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.705+0000 7f2bef59e640 1 -- 172.21.15.103:0/2326939440 shutdown_connections 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.705+0000 7f2bef59e640 1 -- 172.21.15.103:0/2326939440 wait complete. 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2bef59e640 1 Processor -- start 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2bef59e640 1 -- start start 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2bef59e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bf0102ae0 0x7f2bf0100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2bef59e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf0103400 0x7f2bf0100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2bef59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf010bf30 0x7f2bf01011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2bef59e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf0111b80 con 0x7f2bf010bf30 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2bef59e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf0111a00 con 0x7f2bf0102ae0 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2bef59e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf0111d00 con 0x7f2bf0103400 2024-09-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2beed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf010bf30 0x7f2bf01011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2beed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf010bf30 0x7f2bf01011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40348/0 (socket says 172.21.15.103:40348) 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.706+0000 7f2beed9d640 1 -- 172.21.15.103:0/3818912143 learned_addr learned my addr 172.21.15.103:0/3818912143 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2bee59c640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bf0102ae0 0x7f2bf0100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2bedd9b640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf0103400 0x7f2bf0100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2beed9d640 1 -- 172.21.15.103:0/3818912143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf0103400 msgr2=0x7f2bf0100c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2beed9d640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf0103400 0x7f2bf0100c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2beed9d640 1 -- 172.21.15.103:0/3818912143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bf0102ae0 msgr2=0x7f2bf0100730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2beed9d640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bf0102ae0 0x7f2bf0100730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2beed9d640 1 -- 172.21.15.103:0/3818912143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf01a6630 con 0x7f2bf010bf30 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2bedd9b640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf0103400 0x7f2bf0100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2beed9d640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf010bf30 0x7f2bf01011b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2be8004af0 tx=0x7f2be802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2bdf7fe640 1 -- 172.21.15.103:0/3818912143 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8034040 con 0x7f2bf010bf30 2024-09-19T06:07:27.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2bef59e640 1 -- 172.21.15.103:0/3818912143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf01a68c0 con 0x7f2bf010bf30 2024-09-19T06:07:27.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2bdf7fe640 1 -- 172.21.15.103:0/3818912143 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2be802fe80 con 0x7f2bf010bf30 2024-09-19T06:07:27.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2bdf7fe640 1 -- 172.21.15.103:0/3818912143 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be80046a0 con 0x7f2bf010bf30 2024-09-19T06:07:27.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.707+0000 7f2bef59e640 1 -- 172.21.15.103:0/3818912143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf01a6e00 con 0x7f2bf010bf30 2024-09-19T06:07:27.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.708+0000 7f2bef59e640 1 -- 172.21.15.103:0/3818912143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf0102ec0 con 0x7f2bf010bf30 2024-09-19T06:07:27.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.710+0000 7f2bdf7fe640 1 -- 172.21.15.103:0/3818912143 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7f2be8037020 con 0x7f2bf010bf30 2024-09-19T06:07:27.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.711+0000 7f2bdf7fe640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2bd80a3440 0x7f2bd80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.711+0000 7f2bee59c640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2bd80a3440 0x7f2bd80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.711+0000 7f2bdf7fe640 1 -- 172.21.15.103:0/3818912143 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f2be80f0e90 con 0x7f2bf010bf30 2024-09-19T06:07:27.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.712+0000 7f2bee59c640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2bd80a3440 0x7f2bd80a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2be000bbe0 tx=0x7f2be000b390 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.714+0000 7f2bdf7fe640 1 -- 172.21.15.103:0/3818912143 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2be8081210 con 0x7f2bf010bf30 2024-09-19T06:07:27.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:27 smithi169 ceph-mon[34350]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 2 op/s 2024-09-19T06:07:27.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:27 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/37019552' entity='client.admin' 2024-09-19T06:07:27.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:27 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:27.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:27 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:27.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:27 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:27.779 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:27 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:27.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.770+0000 7ff24b7d4640 1 -- 172.21.15.103:0/1495672810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244108300 msgr2=0x7ff24410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.770+0000 7ff24b7d4640 1 --2- 172.21.15.103:0/1495672810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244108300 0x7ff24410ec70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009cd0 tx=0x7ff23c02a8d0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.770+0000 7ff24b7d4640 1 -- 172.21.15.103:0/1495672810 shutdown_connections 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.770+0000 7ff24b7d4640 1 --2- 172.21.15.103:0/1495672810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244108300 0x7ff24410ec70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.770+0000 7ff24b7d4640 1 --2- 172.21.15.103:0/1495672810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff244103780 0x7ff244107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.770+0000 7ff24b7d4640 1 --2- 172.21.15.103:0/1495672810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff244102dd0 0x7ff2441031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.770+0000 7ff24b7d4640 1 -- 172.21.15.103:0/1495672810 >> 172.21.15.103:0/1495672810 conn(0x7ff2440fc7d0 msgr2=0x7ff2440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff24b7d4640 1 -- 172.21.15.103:0/1495672810 shutdown_connections 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff24b7d4640 1 -- 172.21.15.103:0/1495672810 wait complete. 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff24b7d4640 1 Processor -- start 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff24b7d4640 1 -- start start 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff24b7d4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff244102dd0 0x7ff24419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff24b7d4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244103780 0x7ff24419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff24b7d4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff244108300 0x7ff24419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff24b7d4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff244111f80 con 0x7ff244103780 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff24b7d4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff244111e00 con 0x7ff244102dd0 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff24b7d4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff244112100 con 0x7ff244108300 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.771+0000 7ff248d6f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244103780 0x7ff24419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff248d6f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244103780 0x7ff24419ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40366/0 (socket says 172.21.15.103:40366) 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff248d6f640 1 -- 172.21.15.103:0/2500360056 learned_addr learned my addr 172.21.15.103:0/2500360056 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff249d71640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff244108300 0x7ff24419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff249570640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff244102dd0 0x7ff24419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff248d6f640 1 -- 172.21.15.103:0/2500360056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff244108300 msgr2=0x7ff24419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff248d6f640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff244108300 0x7ff24419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff248d6f640 1 -- 172.21.15.103:0/2500360056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff244102dd0 msgr2=0x7ff24419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff248d6f640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff244102dd0 0x7ff24419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff248d6f640 1 -- 172.21.15.103:0/2500360056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24419f680 con 0x7ff244103780 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff249d71640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff244108300 0x7ff24419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff248d6f640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244103780 0x7ff24419ac10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff24000c970 tx=0x7ff24000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff23a7fc640 1 -- 172.21.15.103:0/2500360056 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240007bb0 con 0x7ff244103780 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff23a7fc640 1 -- 172.21.15.103:0/2500360056 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff240007d50 con 0x7ff244103780 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff24b7d4640 1 -- 172.21.15.103:0/2500360056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24419f970 con 0x7ff244103780 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff23a7fc640 1 -- 172.21.15.103:0/2500360056 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24000f450 con 0x7ff244103780 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.772+0000 7ff24b7d4640 1 -- 172.21.15.103:0/2500360056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2441a7250 con 0x7ff244103780 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff23a7fc640 1 -- 172.21.15.103:0/2500360056 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7ff240004eb0 con 0x7ff244103780 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff24dbad740 1 Processor -- start 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff24dbad740 1 -- start start 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 0x563adef6ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef79800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef7c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff24dbad740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563adeed4280 con 0x563adef6f480 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff24dbad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563adee7bb10 con 0x563adef79d40 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff24dbad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563adeed0240 con 0x563adef6eb60 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff249570640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef79800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff249570640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef79800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40370/0 (socket says 172.21.15.103:40370) 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff249570640 1 -- 172.21.15.103:0/3295470753 learned_addr learned my addr 172.21.15.103:0/3295470753 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff248d6f640 1 --2- 172.21.15.103:0/3295470753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef7c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff23a7fc640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff2300a3440 0x7ff2300a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.775+0000 7ff249d71640 1 --2- 172.21.15.103:0/3295470753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 0x563adef6ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff23a7fc640 1 -- 172.21.15.103:0/2500360056 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7ff2400cfc10 con 0x7ff244103780 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff249d71640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff2300a3440 0x7ff2300a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff249570640 1 -- 172.21.15.103:0/3295470753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 msgr2=0x563adef6ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff249570640 1 --2- 172.21.15.103:0/3295470753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 0x563adef6ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff249570640 1 -- 172.21.15.103:0/3295470753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 msgr2=0x563adef7c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:27.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff249570640 1 --2- 172.21.15.103:0/3295470753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef7c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff249570640 1 -- 172.21.15.103:0/3295470753 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563adee881f0 con 0x563adef6f480 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff249570640 1 --2- 172.21.15.103:0/3295470753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef79800 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff23400bcf0 tx=0x7ff23400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9980985b2d2545f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff249d71640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff2300a3440 0x7ff2300a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff23c005e30 tx=0x7ff23c02a8d0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff22f7fe640 1 -- 172.21.15.103:0/3295470753 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234015070 con 0x563adef6f480 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff22f7fe640 1 -- 172.21.15.103:0/3295470753 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff23401a910 con 0x563adef6f480 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.776+0000 7ff22f7fe640 1 -- 172.21.15.103:0/3295470753 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234011930 con 0x563adef6f480 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.777+0000 7ff24dbad740 1 -- 172.21.15.103:0/3295470753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 msgr2=0x563adef79800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.777+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3295470753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef79800 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff23400bcf0 tx=0x7ff23400f730 comp rx=0 tx=0).stop 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.777+0000 7ff24dbad740 1 -- 172.21.15.103:0/3295470753 shutdown_connections 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.777+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3295470753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef7c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.777+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3295470753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef79800 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.777+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3295470753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 0x563adef6ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.777+0000 7ff24dbad740 1 -- 172.21.15.103:0/3295470753 >> 172.21.15.103:0/3295470753 conn(0x563adef6b0f0 msgr2=0x563adef6b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.777+0000 7ff24dbad740 1 -- 172.21.15.103:0/3295470753 shutdown_connections 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.777+0000 7ff24dbad740 1 -- 172.21.15.103:0/3295470753 wait complete. 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.777+0000 7ff24dbad740 1 -- start start 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff24dbad740 1 Processor -- start 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 0x563adef76bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef77130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef77670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff24dbad740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563adef7c910 con 0x563adef6f480 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff24dbad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563adee8ef10 con 0x563adef79d40 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff24dbad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563adef7ca90 con 0x563adef6eb60 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff24dbad740 10 client.0 _ll_register_callbacks cb 0x563adee57a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff248d6f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef77130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff248d6f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef77130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40386/0 (socket says 172.21.15.103:40386) 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff248d6f640 1 -- 172.21.15.103:0/3899049710 learned_addr learned my addr 172.21.15.103:0/3899049710 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff249570640 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 0x563adef76bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff248d6f640 1 -- 172.21.15.103:0/3899049710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 msgr2=0x563adef76bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff248d6f640 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 0x563adef76bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff249d71640 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef77670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff248d6f640 1 -- 172.21.15.103:0/3899049710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 msgr2=0x563adef77670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff248d6f640 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef77670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff248d6f640 1 -- 172.21.15.103:0/3899049710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563adec456a0 con 0x563adef6f480 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.778+0000 7ff249570640 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 0x563adef76bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff248d6f640 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef77130 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff240098230 tx=0x7ff2400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bda5d40cad79603 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff22cff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff22cff9640 1 -- 172.21.15.103:0/3899049710 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24001d070 con 0x563adef6f480 2024-09-19T06:07:27.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff22cff9640 1 -- 172.21.15.103:0/3899049710 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7ff24009c030 con 0x563adef6f480 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff24dbad740 1 -- 172.21.15.103:0/3899049710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff23401a910 con 0x563adef6f480 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff22cff9640 1 -- 172.21.15.103:0/3899049710 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff2400cd7a0 con 0x563adef6f480 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff24dbad740 10 client.15333 fetch_fsmap learned FSMap version 25 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff24dbad740 1 -- 172.21.15.103:0/3899049710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563adef884e0 con 0x563adef6f480 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff22cff9640 1 -- 172.21.15.103:0/3899049710 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff23401a910 con 0x563adef6f480 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff22cff9640 1 -- 172.21.15.103:0/3899049710 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff2400b1030 con 0x563adef6f480 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff24dbad740 10 client.15333 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff24dbad740 10 client.15333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff24dbad740 20 client.15333 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563adef898f0 0x563adef8bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff24dbad740 4 client.15333 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.779+0000 7ff24dbad740 1 -- 172.21.15.103:0/3899049710 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563adeee17f0 con 0x563adef898f0 2024-09-19T06:07:27.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.780+0000 7ff249570640 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563adef898f0 0x563adef8bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.780+0000 7ff22cff9640 10 client.15333 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.780+0000 7ff249570640 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563adef898f0 0x563adef8bce0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=446b3f1ea84de58 server_cookie=8dd1d85ee063857a in_seq=0 out_seq=0 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff22cff9640 1 -- 172.21.15.103:0/3899049710 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563adeee17f0 con 0x563adef898f0 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff22cff9640 10 client.15333 handle_command_reply: tid=0 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 client.15333 shutdown 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 -- 172.21.15.103:0/3899049710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 msgr2=0x563adef77130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef77130 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff240098230 tx=0x7ff2400046c0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 -- 172.21.15.103:0/3899049710 shutdown_connections 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563adef898f0 0x563adef8bce0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef77670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff22cff9640 0 client.15333 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6f480 0x563adef77130 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3899049710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6eb60 0x563adef76bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 -- 172.21.15.103:0/3899049710 >> 172.21.15.103:0/3899049710 conn(0x563adef6b0f0 msgr2=0x563adef70dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 -- 172.21.15.103:0/3899049710 shutdown_connections 2024-09-19T06:07:27.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 1 -- 172.21.15.103:0/3899049710 wait complete. 2024-09-19T06:07:27.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.781+0000 7ff24dbad740 20 client.15333 trim_cache size 0 max 16384 2024-09-19T06:07:27.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.817+0000 7ff24dbad740 1 Processor -- start 2024-09-19T06:07:27.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.817+0000 7ff24dbad740 1 -- start start 2024-09-19T06:07:27.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.817+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef91590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.817+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6f480 0x563adef91ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.817+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef78340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.817+0000 7ff24dbad740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2441b2240 con 0x563adef6eb60 2024-09-19T06:07:27.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.817+0000 7ff24dbad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2441afb10 con 0x563adef79d40 2024-09-19T06:07:27.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.817+0000 7ff24dbad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff2441ad960 con 0x563adef6f480 2024-09-19T06:07:27.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff249570640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef91590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff249570640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef91590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40398/0 (socket says 172.21.15.103:40398) 2024-09-19T06:07:27.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff249570640 1 -- 172.21.15.103:0/4147043981 learned_addr learned my addr 172.21.15.103:0/4147043981 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:27.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff249d71640 1 --2- 172.21.15.103:0/4147043981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef78340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff248d6f640 1 --2- 172.21.15.103:0/4147043981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6f480 0x563adef91ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff249570640 1 -- 172.21.15.103:0/4147043981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6f480 msgr2=0x563adef91ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:27.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff249570640 1 --2- 172.21.15.103:0/4147043981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6f480 0x563adef91ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff249570640 1 -- 172.21.15.103:0/4147043981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 msgr2=0x563adef78340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:27.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff249570640 1 --2- 172.21.15.103:0/4147043981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef78340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff249570640 1 -- 172.21.15.103:0/4147043981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563adef6bd80 con 0x563adef6eb60 2024-09-19T06:07:27.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff249570640 1 --2- 172.21.15.103:0/4147043981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef91590 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff23400bcf0 tx=0x7ff23400b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd145b049279b42e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff22effd640 1 -- 172.21.15.103:0/4147043981 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234015050 con 0x563adef6eb60 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff22effd640 1 -- 172.21.15.103:0/4147043981 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff234011440 con 0x563adef6eb60 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.818+0000 7ff22effd640 1 -- 172.21.15.103:0/4147043981 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234004680 con 0x563adef6eb60 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.819+0000 7ff24dbad740 1 -- 172.21.15.103:0/4147043981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 msgr2=0x563adef91590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.819+0000 7ff24dbad740 1 --2- 172.21.15.103:0/4147043981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef91590 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff23400bcf0 tx=0x7ff23400b5e0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.819+0000 7ff24dbad740 1 -- 172.21.15.103:0/4147043981 shutdown_connections 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.819+0000 7ff24dbad740 1 --2- 172.21.15.103:0/4147043981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef78340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.819+0000 7ff24dbad740 1 --2- 172.21.15.103:0/4147043981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6f480 0x563adef91ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.819+0000 7ff24dbad740 1 --2- 172.21.15.103:0/4147043981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef91590 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.819+0000 7ff24dbad740 1 -- 172.21.15.103:0/4147043981 >> 172.21.15.103:0/4147043981 conn(0x563adef6b0f0 msgr2=0x563adef75ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.819+0000 7ff24dbad740 1 -- 172.21.15.103:0/4147043981 shutdown_connections 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.819+0000 7ff24dbad740 1 -- 172.21.15.103:0/4147043981 wait complete. 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.820+0000 7ff24dbad740 1 -- start start 2024-09-19T06:07:27.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.820+0000 7ff24dbad740 1 Processor -- start 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.820+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef82550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.820+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6f480 0x563adef7d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff24dbad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef7de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff24dbad740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2441adfd0 con 0x563adef6eb60 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff24dbad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2441af440 con 0x563adef79d40 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff24dbad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff2441ae6a0 con 0x563adef6f480 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff24dbad740 10 client.0 _ll_register_callbacks cb 0x7ff240007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff249570640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef82550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff249570640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef82550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40412/0 (socket says 172.21.15.103:40412) 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff249570640 1 -- 172.21.15.103:0/3002304478 learned_addr learned my addr 172.21.15.103:0/3002304478 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff249d71640 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef7de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff248d6f640 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6f480 0x563adef7d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff249570640 1 -- 172.21.15.103:0/3002304478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6f480 msgr2=0x563adef7d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff249570640 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6f480 0x563adef7d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff249570640 1 -- 172.21.15.103:0/3002304478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 msgr2=0x563adef7de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff249570640 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef7de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff249570640 1 -- 172.21.15.103:0/3002304478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563adef7e6a0 con 0x563adef6eb60 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff249570640 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef82550 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff23400ba80 tx=0x7ff23400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1712a29735e025 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.821+0000 7ff22cff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff22cff9640 1 -- 172.21.15.103:0/3002304478 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234005240 con 0x563adef6eb60 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff22cff9640 1 -- 172.21.15.103:0/3002304478 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7ff2340053e0 con 0x563adef6eb60 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff24dbad740 1 -- 172.21.15.103:0/3002304478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff234011440 con 0x563adef6eb60 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff22cff9640 1 -- 172.21.15.103:0/3002304478 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff234040050 con 0x563adef6eb60 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff24dbad740 10 client.15339 fetch_fsmap learned FSMap version 25 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff24dbad740 1 -- 172.21.15.103:0/3002304478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563adeff46b0 con 0x563adef6eb60 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff22cff9640 1 -- 172.21.15.103:0/3002304478 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff234011440 con 0x563adef6eb60 2024-09-19T06:07:27.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff22cff9640 1 -- 172.21.15.103:0/3002304478 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff234025460 con 0x563adef6eb60 2024-09-19T06:07:27.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff24dbad740 10 client.15339 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:07:27.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff24dbad740 10 client.15339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:07:27.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff24dbad740 20 client.15339 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:27.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563adeff4b70 0x563adeff6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:27.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff24dbad740 4 client.15339 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:07:27.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.822+0000 7ff24dbad740 1 -- 172.21.15.103:0/3002304478 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563adeedbd00 con 0x563adeff4b70 2024-09-19T06:07:27.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.823+0000 7ff248d6f640 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563adeff4b70 0x563adeff6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:27.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.823+0000 7ff248d6f640 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563adeff4b70 0x563adeff6f60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15a4e469a28c5ad9 server_cookie=fdd4fd475d30a3ac in_seq=0 out_seq=0 2024-09-19T06:07:27.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.823+0000 7ff22cff9640 10 client.15339 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:27.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.824+0000 7ff22cff9640 1 -- 172.21.15.103:0/3002304478 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563adeedbd00 con 0x563adeff4b70 2024-09-19T06:07:27.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.824+0000 7ff22cff9640 10 client.15339 handle_command_reply: tid=0 2024-09-19T06:07:27.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.824+0000 7ff24dbad740 1 client.15339 shutdown 2024-09-19T06:07:27.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.824+0000 7ff24dbad740 1 -- 172.21.15.103:0/3002304478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 msgr2=0x563adef82550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.824+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef82550 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff23400ba80 tx=0x7ff23400fc30 comp rx=0 tx=0).stop 2024-09-19T06:07:27.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.825+0000 7ff24dbad740 1 -- 172.21.15.103:0/3002304478 shutdown_connections 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.825+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563adeff4b70 0x563adeff6f60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.825+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563adef79d40 0x563adef7de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.825+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563adef6f480 0x563adef7d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.825+0000 7ff24dbad740 1 --2- 172.21.15.103:0/3002304478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563adef6eb60 0x563adef82550 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.825+0000 7ff24dbad740 1 -- 172.21.15.103:0/3002304478 >> 172.21.15.103:0/3002304478 conn(0x563adef6b0f0 msgr2=0x563adef69a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.825+0000 7ff22cff9640 0 client.15339 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.825+0000 7ff24dbad740 1 -- 172.21.15.103:0/3002304478 shutdown_connections 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.825+0000 7ff24dbad740 1 -- 172.21.15.103:0/3002304478 wait complete. 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.825+0000 7ff24dbad740 20 client.15339 trim_cache size 0 max 16384 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:07:27.830 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-09-19T06:07:27.831 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "882ea971-db04-4cdb-ba5c-51a698e76c8c", 2024-09-19T06:07:27.831 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-09-19T06:07:27.831 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:07:27.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 -- 172.21.15.103:0/2500360056 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff2300a3440 msgr2=0x7ff2300a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff2300a3440 0x7ff2300a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff23c005e30 tx=0x7ff23c02a8d0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 -- 172.21.15.103:0/2500360056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244103780 msgr2=0x7ff24419ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244103780 0x7ff24419ac10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff24000c970 tx=0x7ff24000ce30 comp rx=0 tx=0).stop 2024-09-19T06:07:27.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 -- 172.21.15.103:0/2500360056 shutdown_connections 2024-09-19T06:07:27.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ff2300a3440 0x7ff2300a5900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff244108300 0x7ff24419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244103780 0x7ff24419ac10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 --2- 172.21.15.103:0/2500360056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff244102dd0 0x7ff24419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 -- 172.21.15.103:0/2500360056 >> 172.21.15.103:0/2500360056 conn(0x7ff2440fc7d0 msgr2=0x7ff244100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 -- 172.21.15.103:0/2500360056 shutdown_connections 2024-09-19T06:07:27.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.826+0000 7ff24b7d4640 1 -- 172.21.15.103:0/2500360056 wait complete. 2024-09-19T06:07:27.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.917+0000 7f2bef59e640 1 -- 172.21.15.103:0/3818912143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f2bf0106f80 con 0x7f2bf010bf30 2024-09-19T06:07:27.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.921+0000 7f2bdf7fe640 1 -- 172.21.15.103:0/3818912143 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7f2be80bd860 con 0x7f2bf010bf30 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 -- 172.21.15.103:0/3818912143 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2bd80a3440 msgr2=0x7f2bd80a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2bd80a3440 0x7f2bd80a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2be000bbe0 tx=0x7f2be000b390 comp rx=0 tx=0).stop 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 -- 172.21.15.103:0/3818912143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf010bf30 msgr2=0x7f2bf01011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf010bf30 0x7f2bf01011b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2be8004af0 tx=0x7f2be802f5d0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 -- 172.21.15.103:0/3818912143 shutdown_connections 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2bd80a3440 0x7f2bd80a5900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf010bf30 0x7f2bf01011b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf0103400 0x7f2bf0100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 --2- 172.21.15.103:0/3818912143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bf0102ae0 0x7f2bf0100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 -- 172.21.15.103:0/3818912143 >> 172.21.15.103:0/3818912143 conn(0x7f2bf00fc510 msgr2=0x7f2bf00fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 -- 172.21.15.103:0/3818912143 shutdown_connections 2024-09-19T06:07:27.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:27.923+0000 7f2bef59e640 1 -- 172.21.15.103:0/3818912143 wait complete. 2024-09-19T06:07:27.937 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T06:07:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:27 smithi174 ceph-mon[34488]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 2 op/s 2024-09-19T06:07:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:27 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/37019552' entity='client.admin' 2024-09-19T06:07:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:27 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:27 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:27 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:27 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:28.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.040+0000 7f61c65ef640 1 -- 172.21.15.103:0/2748951996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61c01009b0 msgr2=0x7f61c0100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.040+0000 7f61c65ef640 1 --2- 172.21.15.103:0/2748951996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61c01009b0 0x7f61c0100e10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009930 tx=0x7f61a802a420 comp rx=0 tx=0).stop 2024-09-19T06:07:28.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.040+0000 7f61c65ef640 1 -- 172.21.15.103:0/2748951996 shutdown_connections 2024-09-19T06:07:28.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.040+0000 7f61c65ef640 1 --2- 172.21.15.103:0/2748951996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c0101350 0x7f61c010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.040+0000 7f61c65ef640 1 --2- 172.21.15.103:0/2748951996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61c01009b0 0x7f61c0100e10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.040+0000 7f61c65ef640 1 --2- 172.21.15.103:0/2748951996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61c01069c0 0x7f61c0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.040+0000 7f61c65ef640 1 -- 172.21.15.103:0/2748951996 >> 172.21.15.103:0/2748951996 conn(0x7f61c0077990 msgr2=0x7f61c00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:28.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c65ef640 1 -- 172.21.15.103:0/2748951996 shutdown_connections 2024-09-19T06:07:28.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c65ef640 1 -- 172.21.15.103:0/2748951996 wait complete. 2024-09-19T06:07:28.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c65ef640 1 Processor -- start 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c65ef640 1 -- start start 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c65ef640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c01009b0 0x7f61c0199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c65ef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61c0101350 0x7f61c0199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c65ef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61c01069c0 0x7f61c01a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c65ef640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0110cb0 con 0x7f61c01069c0 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c65ef640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0110b30 con 0x7f61c0101350 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c65ef640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0110e30 con 0x7f61c01009b0 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c4b8c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61c01069c0 0x7f61c01a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c4b8c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61c01069c0 0x7f61c01a41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40436/0 (socket says 172.21.15.103:40436) 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61c4b8c640 1 -- 172.21.15.103:0/648926306 learned_addr learned my addr 172.21.15.103:0/648926306 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.041+0000 7f61bffff640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c01009b0 0x7f61c0199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61b7fff640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61c0101350 0x7f61c0199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61c4b8c640 1 -- 172.21.15.103:0/648926306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c01009b0 msgr2=0x7f61c0199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61c4b8c640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c01009b0 0x7f61c0199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61c4b8c640 1 -- 172.21.15.103:0/648926306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61c0101350 msgr2=0x7f61c0199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61c4b8c640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61c0101350 0x7f61c0199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61c4b8c640 1 -- 172.21.15.103:0/648926306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c01a4700 con 0x7f61c01069c0 2024-09-19T06:07:28.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61c4b8c640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61c01069c0 0x7f61c01a41c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f61b800eb10 tx=0x7f61b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:28.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61bdffb640 1 -- 172.21.15.103:0/648926306 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8004b20 con 0x7f61c01069c0 2024-09-19T06:07:28.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61bdffb640 1 -- 172.21.15.103:0/648926306 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61b8004cc0 con 0x7f61c01069c0 2024-09-19T06:07:28.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61bdffb640 1 -- 172.21.15.103:0/648926306 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8010690 con 0x7f61c01069c0 2024-09-19T06:07:28.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61c65ef640 1 -- 172.21.15.103:0/648926306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c01a48d0 con 0x7f61c01069c0 2024-09-19T06:07:28.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.042+0000 7f61c65ef640 1 -- 172.21.15.103:0/648926306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c01a4df0 con 0x7f61c01069c0 2024-09-19T06:07:28.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.043+0000 7f61c65ef640 1 -- 172.21.15.103:0/648926306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c0100e10 con 0x7f61c01069c0 2024-09-19T06:07:28.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.044+0000 7f61bdffb640 1 -- 172.21.15.103:0/648926306 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7f61b8005000 con 0x7f61c01069c0 2024-09-19T06:07:28.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.045+0000 7f61bdffb640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61ac0a3500 0x7f61ac0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.045+0000 7f61bffff640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61ac0a3500 0x7f61ac0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.045+0000 7f61bdffb640 1 -- 172.21.15.103:0/648926306 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f61b80d0880 con 0x7f61c01069c0 2024-09-19T06:07:28.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.045+0000 7f61bffff640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61ac0a3500 0x7f61ac0a59c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f61b0005d00 tx=0x7f61b000b410 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:28.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.048+0000 7f61bdffb640 1 -- 172.21.15.103:0/648926306 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f61b809d140 con 0x7f61c01069c0 2024-09-19T06:07:28.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.240+0000 7f61c65ef640 1 -- 172.21.15.103:0/648926306 --> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f61c0062630 con 0x7f61ac0a3500 2024-09-19T06:07:28.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.305+0000 7f61bdffb640 1 -- 172.21.15.103:0/648926306 <== mgr.15189 v2:172.21.15.103:6800/266758959 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f61c0062630 con 0x7f61ac0a3500 2024-09-19T06:07:28.308 INFO:teuthology.orchestra.run.smithi103.stdout:Schedule set for path / 2024-09-19T06:07:28.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 -- 172.21.15.103:0/648926306 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61ac0a3500 msgr2=0x7f61ac0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61ac0a3500 0x7f61ac0a59c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f61b0005d00 tx=0x7f61b000b410 comp rx=0 tx=0).stop 2024-09-19T06:07:28.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 -- 172.21.15.103:0/648926306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61c01069c0 msgr2=0x7f61c01a41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61c01069c0 0x7f61c01a41c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f61b800eb10 tx=0x7f61b800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 -- 172.21.15.103:0/648926306 shutdown_connections 2024-09-19T06:07:28.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61ac0a3500 0x7f61ac0a59c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61c01069c0 0x7f61c01a41c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61c0101350 0x7f61c0199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 --2- 172.21.15.103:0/648926306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c01009b0 0x7f61c0199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 -- 172.21.15.103:0/648926306 >> 172.21.15.103:0/648926306 conn(0x7f61c0077990 msgr2=0x7f61c0103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:28.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 -- 172.21.15.103:0/648926306 shutdown_connections 2024-09-19T06:07:28.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.307+0000 7f61c65ef640 1 -- 172.21.15.103:0/648926306 wait complete. 2024-09-19T06:07:28.320 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T06:07:28.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.421+0000 7fec71a9b640 1 -- 172.21.15.103:0/2398717035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec6c101390 msgr2=0x7fec6c10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.421+0000 7fec71a9b640 1 --2- 172.21.15.103:0/2398717035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec6c101390 0x7fec6c10d8c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fec64009930 tx=0x7fec6402a420 comp rx=0 tx=0).stop 2024-09-19T06:07:28.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.421+0000 7fec71a9b640 1 -- 172.21.15.103:0/2398717035 shutdown_connections 2024-09-19T06:07:28.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.421+0000 7fec71a9b640 1 --2- 172.21.15.103:0/2398717035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec6c101390 0x7fec6c10d8c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.421+0000 7fec71a9b640 1 --2- 172.21.15.103:0/2398717035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec6c1009f0 0x7fec6c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.421+0000 7fec71a9b640 1 --2- 172.21.15.103:0/2398717035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec6c106a00 0x7fec6c106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.421+0000 7fec71a9b640 1 -- 172.21.15.103:0/2398717035 >> 172.21.15.103:0/2398717035 conn(0x7fec6c0fc6b0 msgr2=0x7fec6c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:28.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.421+0000 7fec71a9b640 1 -- 172.21.15.103:0/2398717035 shutdown_connections 2024-09-19T06:07:28.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.421+0000 7fec71a9b640 1 -- 172.21.15.103:0/2398717035 wait complete. 2024-09-19T06:07:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec71a9b640 1 Processor -- start 2024-09-19T06:07:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec71a9b640 1 -- start start 2024-09-19T06:07:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec71a9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec6c1009f0 0x7fec6c0fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec71a9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec6c101390 0x7fec6c0fd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec71a9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec6c106a00 0x7fec6c0fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec71a9b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c110d40 con 0x7fec6c101390 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec71a9b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c110bc0 con 0x7fec6c1009f0 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec71a9b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c110ec0 con 0x7fec6c106a00 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec6affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec6c101390 0x7fec6c0fd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec6affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec6c101390 0x7fec6c0fd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40448/0 (socket says 172.21.15.103:40448) 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.422+0000 7fec6affd640 1 -- 172.21.15.103:0/1417554948 learned_addr learned my addr 172.21.15.103:0/1417554948 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec6b7fe640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec6c1009f0 0x7fec6c0fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec6bfff640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec6c106a00 0x7fec6c0fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec6affd640 1 -- 172.21.15.103:0/1417554948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec6c106a00 msgr2=0x7fec6c0fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec6affd640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec6c106a00 0x7fec6c0fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec6affd640 1 -- 172.21.15.103:0/1417554948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec6c1009f0 msgr2=0x7fec6c0fcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec6affd640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec6c1009f0 0x7fec6c0fcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec6affd640 1 -- 172.21.15.103:0/1417554948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6c1a6860 con 0x7fec6c101390 2024-09-19T06:07:28.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec6bfff640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec6c106a00 0x7fec6c0fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:28.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec6b7fe640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec6c1009f0 0x7fec6c0fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:28.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec6affd640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec6c101390 0x7fec6c0fd1e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec6000e9f0 tx=0x7fec6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:28.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec68ff9640 1 -- 172.21.15.103:0/1417554948 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6000cd80 con 0x7fec6c101390 2024-09-19T06:07:28.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec68ff9640 1 -- 172.21.15.103:0/1417554948 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec600108e0 con 0x7fec6c101390 2024-09-19T06:07:28.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec71a9b640 1 -- 172.21.15.103:0/1417554948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6c1a6b50 con 0x7fec6c101390 2024-09-19T06:07:28.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec68ff9640 1 -- 172.21.15.103:0/1417554948 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60018920 con 0x7fec6c101390 2024-09-19T06:07:28.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.423+0000 7fec71a9b640 1 -- 172.21.15.103:0/1417554948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6c1a70a0 con 0x7fec6c101390 2024-09-19T06:07:28.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.424+0000 7fec71a9b640 1 -- 172.21.15.103:0/1417554948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6c100e50 con 0x7fec6c101390 2024-09-19T06:07:28.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.426+0000 7fec68ff9640 1 -- 172.21.15.103:0/1417554948 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7fec60010a90 con 0x7fec6c101390 2024-09-19T06:07:28.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.426+0000 7fec68ff9640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fec540a3500 0x7fec540a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.426+0000 7fec6b7fe640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fec540a3500 0x7fec540a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.427+0000 7fec68ff9640 1 -- 172.21.15.103:0/1417554948 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fec600d07d0 con 0x7fec6c101390 2024-09-19T06:07:28.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.427+0000 7fec6b7fe640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fec540a3500 0x7fec540a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005fd0 tx=0x7fec5c009500 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:28.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.430+0000 7fec68ff9640 1 -- 172.21.15.103:0/1417554948 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fec6009d090 con 0x7fec6c101390 2024-09-19T06:07:28.612 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:07:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.625+0000 7fec71a9b640 1 -- 172.21.15.103:0/1417554948 --> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fec6c062630 con 0x7fec540a3500 2024-09-19T06:07:28.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.687+0000 7fec68ff9640 1 -- 172.21.15.103:0/1417554948 <== mgr.15189 v2:172.21.15.103:6800/266758959 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fec6c062630 con 0x7fec540a3500 2024-09-19T06:07:28.690 INFO:teuthology.orchestra.run.smithi103.stdout:Retention added to path / 2024-09-19T06:07:28.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.690+0000 7fec71a9b640 1 -- 172.21.15.103:0/1417554948 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fec540a3500 msgr2=0x7fec540a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.690+0000 7fec71a9b640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fec540a3500 0x7fec540a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005fd0 tx=0x7fec5c009500 comp rx=0 tx=0).stop 2024-09-19T06:07:28.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.690+0000 7fec71a9b640 1 -- 172.21.15.103:0/1417554948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec6c101390 msgr2=0x7fec6c0fd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.690+0000 7fec71a9b640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec6c101390 0x7fec6c0fd1e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec6000e9f0 tx=0x7fec6000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.690+0000 7fec71a9b640 1 -- 172.21.15.103:0/1417554948 shutdown_connections 2024-09-19T06:07:28.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.690+0000 7fec71a9b640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fec540a3500 0x7fec540a59c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.690+0000 7fec71a9b640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec6c106a00 0x7fec6c0fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.690+0000 7fec71a9b640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec6c101390 0x7fec6c0fd1e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.690+0000 7fec71a9b640 1 --2- 172.21.15.103:0/1417554948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec6c1009f0 0x7fec6c0fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.691+0000 7fec71a9b640 1 -- 172.21.15.103:0/1417554948 >> 172.21.15.103:0/1417554948 conn(0x7fec6c0fc6b0 msgr2=0x7fec6c06a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:28.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.691+0000 7fec71a9b640 1 -- 172.21.15.103:0/1417554948 shutdown_connections 2024-09-19T06:07:28.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.691+0000 7fec71a9b640 1 -- 172.21.15.103:0/1417554948 wait complete. 2024-09-19T06:07:28.707 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T06:07:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.852+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2598462605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6a8101370 msgr2=0x7fb6a810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.852+0000 7fb6aefb7640 1 --2- 172.21.15.103:0/2598462605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6a8101370 0x7fb6a810d8a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009cd0 tx=0x7fb6a002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.852+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2598462605 shutdown_connections 2024-09-19T06:07:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.852+0000 7fb6aefb7640 1 --2- 172.21.15.103:0/2598462605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6a8101370 0x7fb6a810d8a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.852+0000 7fb6aefb7640 1 --2- 172.21.15.103:0/2598462605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6a81009d0 0x7fb6a8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.852+0000 7fb6aefb7640 1 --2- 172.21.15.103:0/2598462605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6a81069e0 0x7fb6a8106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.852+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2598462605 >> 172.21.15.103:0/2598462605 conn(0x7fb6a80fc6b0 msgr2=0x7fb6a80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.852+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2598462605 shutdown_connections 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.852+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2598462605 wait complete. 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6aefb7640 1 Processor -- start 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6aefb7640 1 -- start start 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6aefb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6a81009d0 0x7fb6a8199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6aefb7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6a8101370 0x7fb6a8199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6aefb7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6a81069e0 0x7fb6a81a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6aefb7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a8110d20 con 0x7fb6a81009d0 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6aefb7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a8110ba0 con 0x7fb6a8101370 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6aefb7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a8110ea0 con 0x7fb6a81069e0 2024-09-19T06:07:28.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6acd53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6a81009d0 0x7fb6a8199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6acd53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6a81009d0 0x7fb6a8199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40454/0 (socket says 172.21.15.103:40454) 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6acd53640 1 -- 172.21.15.103:0/2806153683 learned_addr learned my addr 172.21.15.103:0/2806153683 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6ad554640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6a81069e0 0x7fb6a81a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6a7fff640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6a8101370 0x7fb6a8199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6acd53640 1 -- 172.21.15.103:0/2806153683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6a81069e0 msgr2=0x7fb6a81a40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6acd53640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6a81069e0 0x7fb6a81a40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6acd53640 1 -- 172.21.15.103:0/2806153683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6a8101370 msgr2=0x7fb6a8199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6acd53640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6a8101370 0x7fb6a8199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.853+0000 7fb6acd53640 1 -- 172.21.15.103:0/2806153683 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a81a45f0 con 0x7fb6a81009d0 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.854+0000 7fb6acd53640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6a81009d0 0x7fb6a8199030 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00d950 tx=0x7fb69c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.854+0000 7fb6a5ffb640 1 -- 172.21.15.103:0/2806153683 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c017070 con 0x7fb6a81009d0 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.854+0000 7fb6a5ffb640 1 -- 172.21.15.103:0/2806153683 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb69c009c30 con 0x7fb6a81009d0 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.854+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2806153683 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a81a47c0 con 0x7fb6a81009d0 2024-09-19T06:07:28.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.854+0000 7fb6a5ffb640 1 -- 172.21.15.103:0/2806153683 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00f620 con 0x7fb6a81009d0 2024-09-19T06:07:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.854+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2806153683 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a81a4d60 con 0x7fb6a81009d0 2024-09-19T06:07:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.855+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2806153683 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a8100e30 con 0x7fb6a81009d0 2024-09-19T06:07:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.857+0000 7fb6a5ffb640 1 -- 172.21.15.103:0/2806153683 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7fb69c0109a0 con 0x7fb6a81009d0 2024-09-19T06:07:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.858+0000 7fb6a5ffb640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fb6980a3580 0x7fb6980a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.858+0000 7fb6a7fff640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fb6980a3580 0x7fb6980a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.858+0000 7fb6a5ffb640 1 -- 172.21.15.103:0/2806153683 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fb69c0cf950 con 0x7fb6a81009d0 2024-09-19T06:07:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.859+0000 7fb6a7fff640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fb6980a3580 0x7fb6980a5a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb6a806ac50 tx=0x7fb694005f90 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:28.862+0000 7fb6a5ffb640 1 -- 172.21.15.103:0/2806153683 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb69c009de0 con 0x7fb6a81009d0 2024-09-19T06:07:28.884 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2554485794' entity='client.admin' 2024-09-19T06:07:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:28.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:28.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: scrub queued for path: / 2024-09-19T06:07:28.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: scrub summary: idle+waiting paths [/] 2024-09-19T06:07:28.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: scrub summary: active paths [/] 2024-09-19T06:07:28.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: scrub summary: idle+waiting paths [/] 2024-09-19T06:07:28.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3818912143' entity='client.admin' 2024-09-19T06:07:28.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:28.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:28.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:28.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:28.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2554485794' entity='client.admin' 2024-09-19T06:07:28.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:28.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:28.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: scrub queued for path: / 2024-09-19T06:07:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: scrub summary: idle+waiting paths [/] 2024-09-19T06:07:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: scrub summary: active paths [/] 2024-09-19T06:07:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: scrub summary: idle+waiting paths [/] 2024-09-19T06:07:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3818912143' entity='client.admin' 2024-09-19T06:07:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:28.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2554485794' entity='client.admin' 2024-09-19T06:07:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: scrub queued for path: / 2024-09-19T06:07:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: scrub summary: idle+waiting paths [/] 2024-09-19T06:07:29.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: scrub summary: active paths [/] 2024-09-19T06:07:29.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: scrub summary: idle+waiting paths [/] 2024-09-19T06:07:29.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3818912143' entity='client.admin' 2024-09-19T06:07:29.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:29.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:29.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:29.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:07:29.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.061+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2806153683 --> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fb6a80fe480 con 0x7fb6980a3580 2024-09-19T06:07:29.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.068+0000 7fb6a5ffb640 1 -- 172.21.15.103:0/2806153683 <== mgr.15189 v2:172.21.15.103:6800/266758959 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fb6a80fe480 con 0x7fb6980a3580 2024-09-19T06:07:29.070 INFO:teuthology.orchestra.run.smithi103.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T06:07:28", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2806153683 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fb6980a3580 msgr2=0x7fb6980a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fb6980a3580 0x7fb6980a5a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb6a806ac50 tx=0x7fb694005f90 comp rx=0 tx=0).stop 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2806153683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6a81009d0 msgr2=0x7fb6a8199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6a81009d0 0x7fb6a8199030 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00d950 tx=0x7fb69c00de10 comp rx=0 tx=0).stop 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2806153683 shutdown_connections 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fb6980a3580 0x7fb6980a5a40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6a81069e0 0x7fb6a81a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6a8101370 0x7fb6a8199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 --2- 172.21.15.103:0/2806153683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6a81009d0 0x7fb6a8199030 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2806153683 >> 172.21.15.103:0/2806153683 conn(0x7fb6a80fc6b0 msgr2=0x7fb6a80fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:29.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2806153683 shutdown_connections 2024-09-19T06:07:29.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.070+0000 7fb6aefb7640 1 -- 172.21.15.103:0/2806153683 wait complete. 2024-09-19T06:07:29.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T06:07:29.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.196+0000 7fac09627640 1 -- 172.21.15.103:0/3772530170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac041069c0 msgr2=0x7fac04106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.196+0000 7fac09627640 1 --2- 172.21.15.103:0/3772530170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac041069c0 0x7fac04106da0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009930 tx=0x7fabf402a420 comp rx=0 tx=0).stop 2024-09-19T06:07:29.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.196+0000 7fac09627640 1 -- 172.21.15.103:0/3772530170 shutdown_connections 2024-09-19T06:07:29.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.196+0000 7fac09627640 1 --2- 172.21.15.103:0/3772530170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac04101350 0x7fac0410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.196+0000 7fac09627640 1 --2- 172.21.15.103:0/3772530170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac041009b0 0x7fac04100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.196+0000 7fac09627640 1 --2- 172.21.15.103:0/3772530170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac041069c0 0x7fac04106da0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.196+0000 7fac09627640 1 -- 172.21.15.103:0/3772530170 >> 172.21.15.103:0/3772530170 conn(0x7fac04077990 msgr2=0x7fac040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:29.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.196+0000 7fac09627640 1 -- 172.21.15.103:0/3772530170 shutdown_connections 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.196+0000 7fac09627640 1 -- 172.21.15.103:0/3772530170 wait complete. 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.196+0000 7fac09627640 1 Processor -- start 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac09627640 1 -- start start 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac09627640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac041009b0 0x7fac04197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac09627640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac04101350 0x7fac04197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac09627640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041069c0 0x7fac0419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac09627640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fac04110c70 con 0x7fac04101350 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac09627640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac04110af0 con 0x7fac041069c0 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac09627640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fac04110df0 con 0x7fac041009b0 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac027fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac04101350 0x7fac04197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac027fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac04101350 0x7fac04197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40468/0 (socket says 172.21.15.103:40468) 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac027fc640 1 -- 172.21.15.103:0/2704226608 learned_addr learned my addr 172.21.15.103:0/2704226608 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac02ffd640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac041009b0 0x7fac04197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac037fe640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041069c0 0x7fac0419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac027fc640 1 -- 172.21.15.103:0/2704226608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac041009b0 msgr2=0x7fac04197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac027fc640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac041009b0 0x7fac04197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac027fc640 1 -- 172.21.15.103:0/2704226608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041069c0 msgr2=0x7fac0419bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac027fc640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041069c0 0x7fac0419bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac027fc640 1 -- 172.21.15.103:0/2704226608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0419c210 con 0x7fac04101350 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.197+0000 7fac027fc640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac04101350 0x7fac04197760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fabec00e9f0 tx=0x7fabec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.198+0000 7fabfbfff640 1 -- 172.21.15.103:0/2704226608 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec00cd80 con 0x7fac04101350 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.198+0000 7fabfbfff640 1 -- 172.21.15.103:0/2704226608 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabec0108e0 con 0x7fac04101350 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.198+0000 7fac09627640 1 -- 172.21.15.103:0/2704226608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0419c500 con 0x7fac04101350 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.198+0000 7fabfbfff640 1 -- 172.21.15.103:0/2704226608 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec018920 con 0x7fac04101350 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.198+0000 7fac09627640 1 -- 172.21.15.103:0/2704226608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac041a3d90 con 0x7fac04101350 2024-09-19T06:07:29.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.199+0000 7fac09627640 1 -- 172.21.15.103:0/2704226608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac04100e10 con 0x7fac04101350 2024-09-19T06:07:29.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.200+0000 7fabfbfff640 1 -- 172.21.15.103:0/2704226608 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7fabec010a90 con 0x7fac04101350 2024-09-19T06:07:29.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.200+0000 7fabfbfff640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fabf00a3500 0x7fabf00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.201+0000 7fac02ffd640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fabf00a3500 0x7fabf00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.201+0000 7fabfbfff640 1 -- 172.21.15.103:0/2704226608 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fabec0d0670 con 0x7fac04101350 2024-09-19T06:07:29.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.201+0000 7fac02ffd640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fabf00a3500 0x7fabf00a59c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009900 tx=0x7fabf4000bc0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:29.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.204+0000 7fabfbfff640 1 -- 172.21.15.103:0/2704226608 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fabec09c8e0 con 0x7fac04101350 2024-09-19T06:07:29.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.326+0000 7f0883b0d640 1 -- 172.21.15.103:0/473670275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087c1082e0 msgr2=0x7f087c10ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.326+0000 7f0883b0d640 1 --2- 172.21.15.103:0/473670275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087c1082e0 0x7f087c10ec50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0874009cd0 tx=0x7f087402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.326+0000 7f0883b0d640 1 -- 172.21.15.103:0/473670275 shutdown_connections 2024-09-19T06:07:29.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.326+0000 7f0883b0d640 1 --2- 172.21.15.103:0/473670275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087c1082e0 0x7f087c10ec50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.326+0000 7f0883b0d640 1 --2- 172.21.15.103:0/473670275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f087c103760 0x7f087c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.326+0000 7f0883b0d640 1 --2- 172.21.15.103:0/473670275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c102db0 0x7f087c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 -- 172.21.15.103:0/473670275 >> 172.21.15.103:0/473670275 conn(0x7f087c0fc7d0 msgr2=0x7f087c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 -- 172.21.15.103:0/473670275 shutdown_connections 2024-09-19T06:07:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 -- 172.21.15.103:0/473670275 wait complete. 2024-09-19T06:07:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 Processor -- start 2024-09-19T06:07:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 -- start start 2024-09-19T06:07:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087c102db0 0x7f087c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c103760 0x7f087c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f087c1082e0 0x7f087c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f087c111f60 con 0x7f087c102db0 2024-09-19T06:07:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f087c111de0 con 0x7f087c103760 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.327+0000 7f0883b0d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1120e0 con 0x7f087c1082e0 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08818a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087c102db0 0x7f087c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08818a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087c102db0 0x7f087c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40486/0 (socket says 172.21.15.103:40486) 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08818a9640 1 -- 172.21.15.103:0/4294923651 learned_addr learned my addr 172.21.15.103:0/4294923651 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08810a8640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c103760 0x7f087c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08820aa640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f087c1082e0 0x7f087c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08818a9640 1 -- 172.21.15.103:0/4294923651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f087c1082e0 msgr2=0x7f087c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08818a9640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f087c1082e0 0x7f087c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08818a9640 1 -- 172.21.15.103:0/4294923651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c103760 msgr2=0x7f087c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08818a9640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c103760 0x7f087c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08818a9640 1 -- 172.21.15.103:0/4294923651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087c19d440 con 0x7f087c102db0 2024-09-19T06:07:29.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08810a8640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c103760 0x7f087c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:29.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08820aa640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f087c1082e0 0x7f087c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:29.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f08818a9640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087c102db0 0x7f087c198490 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f087800c920 tx=0x7f087800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:29.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f0872ffd640 1 -- 172.21.15.103:0/4294923651 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878007c70 con 0x7f087c102db0 2024-09-19T06:07:29.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f0883b0d640 1 -- 172.21.15.103:0/4294923651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087c19d730 con 0x7f087c102db0 2024-09-19T06:07:29.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f0872ffd640 1 -- 172.21.15.103:0/4294923651 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0878007e10 con 0x7f087c102db0 2024-09-19T06:07:29.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f0872ffd640 1 -- 172.21.15.103:0/4294923651 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878018820 con 0x7f087c102db0 2024-09-19T06:07:29.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.328+0000 7f0883b0d640 1 -- 172.21.15.103:0/4294923651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f087c1a5010 con 0x7f087c102db0 2024-09-19T06:07:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.330+0000 7f0872ffd640 1 -- 172.21.15.103:0/4294923651 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7f08780189c0 con 0x7f087c102db0 2024-09-19T06:07:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f0885ee6740 1 Processor -- start 2024-09-19T06:07:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f0885ee6740 1 -- start start 2024-09-19T06:07:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392da140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392dca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f0885ee6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f5392352e0 con 0x55f5392cf4a0 2024-09-19T06:07:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f0885ee6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f5391dcce0 con 0x55f5392cfdc0 2024-09-19T06:07:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f0885ee6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f5392312a0 con 0x55f5392da680 2024-09-19T06:07:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f08820aa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f08820aa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40498/0 (socket says 172.21.15.103:40498) 2024-09-19T06:07:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f08820aa640 1 -- 172.21.15.103:0/2401285118 learned_addr learned my addr 172.21.15.103:0/2401285118 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f0872ffd640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f08680a3440 0x7f08680a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.331+0000 7f08818a9640 1 --2- 172.21.15.103:0/2401285118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392da140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f08820aa640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f08680a3440 0x7f08680a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f08810a8640 1 --2- 172.21.15.103:0/2401285118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f08820aa640 1 -- 172.21.15.103:0/2401285118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 msgr2=0x55f5392dca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f08820aa640 1 --2- 172.21.15.103:0/2401285118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392dca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f08820aa640 1 -- 172.21.15.103:0/2401285118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 msgr2=0x55f5392da140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f08820aa640 1 --2- 172.21.15.103:0/2401285118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392da140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f08820aa640 1 -- 172.21.15.103:0/2401285118 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5391c1440 con 0x55f5392cf4a0 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f0872ffd640 1 -- 172.21.15.103:0/4294923651 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f08780d0090 con 0x7f087c102db0 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f08820aa640 1 --2- 172.21.15.103:0/2401285118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392cf880 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f08740094e0 tx=0x7f0874031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927eea984abe3b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f0867fff640 1 -- 172.21.15.103:0/2401285118 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087404f070 con 0x55f5392cf4a0 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f0867fff640 1 -- 172.21.15.103:0/2401285118 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0874036040 con 0x55f5392cf4a0 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.332+0000 7f0867fff640 1 -- 172.21.15.103:0/2401285118 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874030ae0 con 0x55f5392cf4a0 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 -- 172.21.15.103:0/2401285118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 msgr2=0x55f5392cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f08820aa640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f08680a3440 0x7f08680a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f087404c000 tx=0x7f0874048000 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 --2- 172.21.15.103:0/2401285118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392cf880 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f08740094e0 tx=0x7f0874031c70 comp rx=0 tx=0).stop 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 -- 172.21.15.103:0/2401285118 shutdown_connections 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 --2- 172.21.15.103:0/2401285118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392dca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 --2- 172.21.15.103:0/2401285118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392da140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 --2- 172.21.15.103:0/2401285118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392cf880 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 -- 172.21.15.103:0/2401285118 >> 172.21.15.103:0/2401285118 conn(0x55f5392cba30 msgr2=0x55f5392cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 -- 172.21.15.103:0/2401285118 shutdown_connections 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 -- 172.21.15.103:0/2401285118 wait complete. 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 -- start start 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.333+0000 7f0885ee6740 1 Processor -- start 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392d9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392d7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392d7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f0885ee6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f5392dd250 con 0x55f5392cf4a0 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f0885ee6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f5391f0050 con 0x55f5392cfdc0 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f0885ee6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f5392dd3d0 con 0x55f5392da680 2024-09-19T06:07:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f0885ee6740 10 client.0 _ll_register_callbacks cb 0x55f539230160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08818a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392d9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08818a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392d9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40502/0 (socket says 172.21.15.103:40502) 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08818a9640 1 -- 172.21.15.103:0/1481879414 learned_addr learned my addr 172.21.15.103:0/1481879414 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08810a8640 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392d7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08820aa640 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392d7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08818a9640 1 -- 172.21.15.103:0/1481879414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 msgr2=0x55f5392d7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08818a9640 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392d7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08818a9640 1 -- 172.21.15.103:0/1481879414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 msgr2=0x55f5392d7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08818a9640 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392d7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08818a9640 1 -- 172.21.15.103:0/1481879414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f538fa63c0 con 0x55f5392cf4a0 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08818a9640 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392d9fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0878098c20 tx=0x7f087809bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c698175b3bf2ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.334+0000 7f08657fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:29.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f08657fa640 1 -- 172.21.15.103:0/1481879414 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08780b4020 con 0x55f5392cf4a0 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f08657fa640 1 -- 172.21.15.103:0/1481879414 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f08780bc0d0 con 0x55f5392cf4a0 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f0885ee6740 1 -- 172.21.15.103:0/1481879414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0874036040 con 0x55f5392cf4a0 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f08657fa640 1 -- 172.21.15.103:0/1481879414 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f08780b5250 con 0x55f5392cf4a0 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f0885ee6740 10 client.15375 fetch_fsmap learned FSMap version 25 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f0885ee6740 1 -- 172.21.15.103:0/1481879414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f5392e8c30 con 0x55f5392cf4a0 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f08657fa640 1 -- 172.21.15.103:0/1481879414 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0874036040 con 0x55f5392cf4a0 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f08657fa640 1 -- 172.21.15.103:0/1481879414 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f08780a4a30 con 0x55f5392cf4a0 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f0885ee6740 10 client.15375 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f0885ee6740 10 client.15375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f0885ee6740 20 client.15375 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f0885ee6740 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f5392ea040 0x55f5392ec450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f0885ee6740 4 client.15375 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.335+0000 7f0885ee6740 1 -- 172.21.15.103:0/1481879414 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f539242850 con 0x55f5392ea040 2024-09-19T06:07:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.336+0000 7f08810a8640 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f5392ea040 0x55f5392ec450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.336+0000 7f08657fa640 10 client.15375 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.336+0000 7f08810a8640 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f5392ea040 0x55f5392ec450 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=693442fda764c9ef server_cookie=f5916d7f6715b362 in_seq=0 out_seq=0 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f08657fa640 1 -- 172.21.15.103:0/1481879414 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f539242850 con 0x55f5392ea040 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f08657fa640 10 client.15375 handle_command_reply: tid=0 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 client.15375 shutdown 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 -- 172.21.15.103:0/1481879414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 msgr2=0x55f5392d9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392d9fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0878098c20 tx=0x7f087809bbb0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 -- 172.21.15.103:0/1481879414 shutdown_connections 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f5392ea040 0x55f5392ec450 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392d7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392d7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 --2- 172.21.15.103:0/1481879414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392d9fa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f08657fa640 0 client.15375 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 -- 172.21.15.103:0/1481879414 >> 172.21.15.103:0/1481879414 conn(0x55f5392cba30 msgr2=0x55f5392cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:29.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 -- 172.21.15.103:0/1481879414 shutdown_connections 2024-09-19T06:07:29.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 1 -- 172.21.15.103:0/1481879414 wait complete. 2024-09-19T06:07:29.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.337+0000 7f0885ee6740 20 client.15375 trim_cache size 0 max 16384 2024-09-19T06:07:29.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.354+0000 7f0885ee6740 1 Processor -- start 2024-09-19T06:07:29.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.354+0000 7f0885ee6740 1 -- start start 2024-09-19T06:07:29.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.354+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.354+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.354+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392f2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.354+0000 7f0885ee6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1aff20 con 0x55f5392cf4a0 2024-09-19T06:07:29.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.354+0000 7f0885ee6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1ad7f0 con 0x55f5392cfdc0 2024-09-19T06:07:29.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.354+0000 7f0885ee6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1ab640 con 0x55f5392da680 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.354+0000 7f08818a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08818a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40504/0 (socket says 172.21.15.103:40504) 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08818a9640 1 -- 172.21.15.103:0/1102955785 learned_addr learned my addr 172.21.15.103:0/1102955785 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08810a8640 1 --2- 172.21.15.103:0/1102955785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08820aa640 1 --2- 172.21.15.103:0/1102955785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08818a9640 1 -- 172.21.15.103:0/1102955785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 msgr2=0x55f5392f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08818a9640 1 --2- 172.21.15.103:0/1102955785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392f2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08818a9640 1 -- 172.21.15.103:0/1102955785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 msgr2=0x55f5392f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08818a9640 1 --2- 172.21.15.103:0/1102955785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08818a9640 1 -- 172.21.15.103:0/1102955785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5392cb4d0 con 0x55f5392cf4a0 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08810a8640 1 --2- 172.21.15.103:0/1102955785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08818a9640 1 --2- 172.21.15.103:0/1102955785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392caa60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f087809c1e0 tx=0x7f087809a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfaba7615e48ac31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:29.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08677fe640 1 -- 172.21.15.103:0/1102955785 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08780b4030 con 0x55f5392cf4a0 2024-09-19T06:07:29.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08677fe640 1 -- 172.21.15.103:0/1102955785 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f087809c950 con 0x55f5392cf4a0 2024-09-19T06:07:29.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.355+0000 7f08677fe640 1 -- 172.21.15.103:0/1102955785 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08780a00c0 con 0x55f5392cf4a0 2024-09-19T06:07:29.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 -- 172.21.15.103:0/1102955785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 msgr2=0x55f5392caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 --2- 172.21.15.103:0/1102955785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392caa60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f087809c1e0 tx=0x7f087809a760 comp rx=0 tx=0).stop 2024-09-19T06:07:29.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 -- 172.21.15.103:0/1102955785 shutdown_connections 2024-09-19T06:07:29.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 --2- 172.21.15.103:0/1102955785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 --2- 172.21.15.103:0/1102955785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cfdc0 0x55f5392f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 --2- 172.21.15.103:0/1102955785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cf4a0 0x55f5392caa60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 -- 172.21.15.103:0/1102955785 >> 172.21.15.103:0/1102955785 conn(0x55f5392cba30 msgr2=0x55f5392ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 -- 172.21.15.103:0/1102955785 shutdown_connections 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 -- 172.21.15.103:0/1102955785 wait complete. 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 -- start start 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.356+0000 7f0885ee6740 1 Processor -- start 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cf4a0 0x55f5392e2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cfdc0 0x55f5392e0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f0885ee6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392e0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f0885ee6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1abcb0 con 0x55f5392cfdc0 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f0885ee6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1ad120 con 0x55f5392cf4a0 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f0885ee6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1ac380 con 0x55f5392da680 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f0885ee6740 10 client.0 _ll_register_callbacks cb 0x7f087800fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08810a8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cfdc0 0x55f5392e0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08810a8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cfdc0 0x55f5392e0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40512/0 (socket says 172.21.15.103:40512) 2024-09-19T06:07:29.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08810a8640 1 -- 172.21.15.103:0/3298954670 learned_addr learned my addr 172.21.15.103:0/3298954670 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08818a9640 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cf4a0 0x55f5392e2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08820aa640 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392e0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08810a8640 1 -- 172.21.15.103:0/3298954670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 msgr2=0x55f5392e0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08810a8640 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392e0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08810a8640 1 -- 172.21.15.103:0/3298954670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cf4a0 msgr2=0x55f5392e2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08810a8640 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cf4a0 0x55f5392e2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08810a8640 1 -- 172.21.15.103:0/3298954670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5392e0d80 con 0x55f5392cfdc0 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08818a9640 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cf4a0 0x55f5392e2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08820aa640 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392e0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08810a8640 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cfdc0 0x55f5392e0010 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f087c06a2f0 tx=0x7f086c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aeb68e9bebd7580 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.357+0000 7f08657fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f08657fa640 1 -- 172.21.15.103:0/3298954670 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c0035f0 con 0x55f5392cfdc0 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f08657fa640 1 -- 172.21.15.103:0/3298954670 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f086c003790 con 0x55f5392cfdc0 2024-09-19T06:07:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f0885ee6740 1 -- 172.21.15.103:0/3298954670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f087809c950 con 0x55f5392cfdc0 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f08657fa640 1 -- 172.21.15.103:0/3298954670 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f086c027020 con 0x55f5392cfdc0 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f0885ee6740 10 client.15381 fetch_fsmap learned FSMap version 25 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f0885ee6740 1 -- 172.21.15.103:0/3298954670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f539354d10 con 0x55f5392cfdc0 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f08657fa640 1 -- 172.21.15.103:0/3298954670 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f087809c950 con 0x55f5392cfdc0 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f08657fa640 1 -- 172.21.15.103:0/3298954670 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f086c010b00 con 0x55f5392cfdc0 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f0885ee6740 10 client.15381 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f0885ee6740 10 client.15381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f0885ee6740 20 client.15381 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f0885ee6740 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f539355470 0x55f539357890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f0885ee6740 4 client.15381 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.358+0000 7f0885ee6740 1 -- 172.21.15.103:0/3298954670 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f5392d7b20 con 0x55f539355470 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.359+0000 7f08818a9640 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f539355470 0x55f539357890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.359+0000 7f08818a9640 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f539355470 0x55f539357890 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=542a0145d2cc8d2a server_cookie=817ba56433624b44 in_seq=0 out_seq=0 2024-09-19T06:07:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.359+0000 7f08657fa640 10 client.15381 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.359+0000 7f08657fa640 1 -- 172.21.15.103:0/3298954670 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f5392d7b20 con 0x55f539355470 2024-09-19T06:07:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.359+0000 7f08657fa640 10 client.15381 handle_command_reply: tid=0 2024-09-19T06:07:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.359+0000 7f0885ee6740 1 client.15381 shutdown 2024-09-19T06:07:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.359+0000 7f0885ee6740 1 -- 172.21.15.103:0/3298954670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cfdc0 msgr2=0x55f5392e0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.359+0000 7f0885ee6740 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cfdc0 0x55f5392e0010 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f087c06a2f0 tx=0x7f086c011ae0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0885ee6740 1 -- 172.21.15.103:0/3298954670 shutdown_connections 2024-09-19T06:07:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0885ee6740 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f539355470 0x55f539357890 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0885ee6740 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5392da680 0x55f5392e0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0885ee6740 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f5392cfdc0 0x55f5392e0010 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0885ee6740 1 --2- 172.21.15.103:0/3298954670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5392cf4a0 0x55f5392e2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0885ee6740 1 -- 172.21.15.103:0/3298954670 >> 172.21.15.103:0/3298954670 conn(0x55f5392cba30 msgr2=0x55f5392ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:29.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f08657fa640 0 client.15381 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:29.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0885ee6740 1 -- 172.21.15.103:0/3298954670 shutdown_connections 2024-09-19T06:07:29.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0885ee6740 1 -- 172.21.15.103:0/3298954670 wait complete. 2024-09-19T06:07:29.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0885ee6740 20 client.15381 trim_cache size 0 max 16384 2024-09-19T06:07:29.378 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:07:29.379 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:07:29.379 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-19T06:07:29.379 INFO:teuthology.orchestra.run.smithi103.stdout: "882ea971-db04-4cdb-ba5c-51a698e76c8c": { 2024-09-19T06:07:29.379 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/", 2024-09-19T06:07:29.379 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "882ea971-db04-4cdb-ba5c-51a698e76c8c", 2024-09-19T06:07:29.379 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-19T06:07:29.379 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:07:29.379 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:07:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:07:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0883b0d640 1 -- 172.21.15.103:0/4294923651 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f08680a3440 msgr2=0x7f08680a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0883b0d640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f08680a3440 0x7f08680a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f087404c000 tx=0x7f0874048000 comp rx=0 tx=0).stop 2024-09-19T06:07:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0883b0d640 1 -- 172.21.15.103:0/4294923651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087c102db0 msgr2=0x7f087c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0883b0d640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087c102db0 0x7f087c198490 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f087800c920 tx=0x7f087800cde0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0883b0d640 1 -- 172.21.15.103:0/4294923651 shutdown_connections 2024-09-19T06:07:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0883b0d640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f08680a3440 0x7f08680a5900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0883b0d640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f087c1082e0 0x7f087c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0883b0d640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c103760 0x7f087c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0883b0d640 1 --2- 172.21.15.103:0/4294923651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087c102db0 0x7f087c198490 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.360+0000 7f0883b0d640 1 -- 172.21.15.103:0/4294923651 >> 172.21.15.103:0/4294923651 conn(0x7f087c0fc7d0 msgr2=0x7f087c106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:29.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.361+0000 7f0883b0d640 1 -- 172.21.15.103:0/4294923651 shutdown_connections 2024-09-19T06:07:29.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.361+0000 7f0883b0d640 1 -- 172.21.15.103:0/4294923651 wait complete. 2024-09-19T06:07:29.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.407+0000 7fac09627640 1 -- 172.21.15.103:0/2704226608 --> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fac04108f80 con 0x7fabf00a3500 2024-09-19T06:07:29.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.413+0000 7fabfbfff640 1 -- 172.21.15.103:0/2704226608 <== mgr.15189 v2:172.21.15.103:6800/266758959 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fac04108f80 con 0x7fabf00a3500 2024-09-19T06:07:29.416 INFO:teuthology.orchestra.run.smithi103.stdout:/ 1m 6m3h 2024-09-19T06:07:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 -- 172.21.15.103:0/2704226608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fabf00a3500 msgr2=0x7fabf00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fabf00a3500 0x7fabf00a59c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009900 tx=0x7fabf4000bc0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 -- 172.21.15.103:0/2704226608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac04101350 msgr2=0x7fac04197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac04101350 0x7fac04197760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fabec00e9f0 tx=0x7fabec00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 -- 172.21.15.103:0/2704226608 shutdown_connections 2024-09-19T06:07:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fabf00a3500 0x7fabf00a59c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041069c0 0x7fac0419bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac04101350 0x7fac04197760 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 --2- 172.21.15.103:0/2704226608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac041009b0 0x7fac04197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 -- 172.21.15.103:0/2704226608 >> 172.21.15.103:0/2704226608 conn(0x7fac04077990 msgr2=0x7fac041039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:29.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 -- 172.21.15.103:0/2704226608 shutdown_connections 2024-09-19T06:07:29.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:07:29.416+0000 7fac09627640 1 -- 172.21.15.103:0/2704226608 wait complete. 2024-09-19T06:07:29.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T06:07:29.456 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T06:07:29.466 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T06:07:29.475 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T06:07:29.475 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T06:07:29.498 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T06:07:29.512 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:07:29.513 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T06:07:29.513 INFO:tasks.workunit:timeout=3h 2024-09-19T06:07:29.513 INFO:tasks.workunit:cleanup=True 2024-09-19T06:07:29.513 DEBUG:teuthology.orchestra.run.smithi103:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T06:07:29.529 INFO:teuthology.orchestra.run.smithi103.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T06:07:29.529 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T06:07:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-19T06:07:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T06:07:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-19 06:05:40.078293915 +0000 2024-09-19T06:07:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-19 06:05:40.078293915 +0000 2024-09-19T06:07:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-19 06:07:18.311401617 +0000 2024-09-19T06:07:29.530 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2024-09-19T06:07:29.530 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T06:07:29.530 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T06:07:29.600 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:07:29.655 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T06:07:29.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:29 smithi174 ceph-mon[34488]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 146 B/s wr, 22 op/s 2024-09-19T06:07:29.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:29 smithi174 ceph-mon[34488]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:29.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:29 smithi174 ceph-mon[34488]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:29.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:29 smithi103 ceph-mon[30925]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 146 B/s wr, 22 op/s 2024-09-19T06:07:29.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:29 smithi103 ceph-mon[30925]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:29.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:29 smithi103 ceph-mon[30925]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:30.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:29 smithi169 ceph-mon[34350]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 146 B/s wr, 22 op/s 2024-09-19T06:07:30.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:29 smithi169 ceph-mon[34350]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:30.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:29 smithi169 ceph-mon[34350]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:30.262 INFO:tasks.cephfs.filesystem:scrub status for tag:882ea971-db04-4cdb-ba5c-51a698e76c8c - {'path': '/', 'tag': '882ea971-db04-4cdb-ba5c-51a698e76c8c', 'options': 'recursive,force'} 2024-09-19T06:07:30.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:30 smithi174 ceph-mon[34488]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:30.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:30 smithi174 ceph-mon[34488]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:30.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:30 smithi103 ceph-mon[30925]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:30.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:30 smithi103 ceph-mon[30925]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:31.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:30 smithi169 ceph-mon[34350]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:31.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:30 smithi169 ceph-mon[34350]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:31.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:31 smithi174 ceph-mon[34488]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 113 B/s wr, 17 op/s 2024-09-19T06:07:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:31 smithi103 ceph-mon[30925]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 113 B/s wr, 17 op/s 2024-09-19T06:07:32.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:31 smithi169 ceph-mon[34350]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 113 B/s wr, 17 op/s 2024-09-19T06:07:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:33 smithi174 ceph-mon[34488]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-09-19T06:07:33.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:33 smithi103 ceph-mon[30925]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-09-19T06:07:34.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:33 smithi169 ceph-mon[34350]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-09-19T06:07:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:35 smithi169 ceph-mon[34350]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-09-19T06:07:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:35 smithi174 ceph-mon[34488]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-09-19T06:07:35.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:35 smithi103 ceph-mon[30925]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-09-19T06:07:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:37 smithi174 ceph-mon[34488]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-09-19T06:07:37.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:37 smithi103 ceph-mon[30925]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-09-19T06:07:38.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:37 smithi169 ceph-mon[34350]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-09-19T06:07:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:39 smithi174 ceph-mon[34488]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 49 op/s 2024-09-19T06:07:39.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:39 smithi103 ceph-mon[30925]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 49 op/s 2024-09-19T06:07:40.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:39 smithi169 ceph-mon[34350]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 49 op/s 2024-09-19T06:07:40.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:40 smithi174 ceph-mon[34488]: scrub summary: idle 2024-09-19T06:07:40.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:40 smithi103 ceph-mon[30925]: scrub summary: idle 2024-09-19T06:07:41.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:40 smithi169 ceph-mon[34350]: scrub summary: idle 2024-09-19T06:07:41.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:41 smithi174 ceph-mon[34488]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T06:07:41.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:41 smithi103 ceph-mon[30925]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T06:07:42.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:41 smithi169 ceph-mon[34350]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T06:07:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 -- 172.21.15.103:0/3038612736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66b81011c0 msgr2=0x7f66b810dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 --2- 172.21.15.103:0/3038612736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66b81011c0 0x7f66b810dda0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009900 tx=0x7f66a802a410 comp rx=0 tx=0).stop 2024-09-19T06:07:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 -- 172.21.15.103:0/3038612736 shutdown_connections 2024-09-19T06:07:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 --2- 172.21.15.103:0/3038612736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66b810e410 0x7f66b8110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 --2- 172.21.15.103:0/3038612736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66b81011c0 0x7f66b810dda0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 --2- 172.21.15.103:0/3038612736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b81008a0 0x7f66b8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 -- 172.21.15.103:0/3038612736 >> 172.21.15.103:0/3038612736 conn(0x7f66b8075ef0 msgr2=0x7f66b8076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 -- 172.21.15.103:0/3038612736 shutdown_connections 2024-09-19T06:07:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 -- 172.21.15.103:0/3038612736 wait complete. 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 Processor -- start 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.635+0000 7f66c003c640 1 -- start start 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66c003c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66b81008a0 0x7f66b819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66c003c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66b81011c0 0x7f66b819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66c003c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b810e410 0x7f66b819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66c003c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66b8114010 con 0x7f66b81008a0 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66c003c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66b8113e90 con 0x7f66b81011c0 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66c003c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66b8114190 con 0x7f66b810e410 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bddd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66b81008a0 0x7f66b819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bddd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66b81008a0 0x7f66b819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55128/0 (socket says 172.21.15.103:55128) 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bddd8640 1 -- 172.21.15.103:0/834920495 learned_addr learned my addr 172.21.15.103:0/834920495 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66be5d9640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b810e410 0x7f66b819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66b81011c0 0x7f66b819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bddd8640 1 -- 172.21.15.103:0/834920495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b810e410 msgr2=0x7f66b819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bddd8640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b810e410 0x7f66b819ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bddd8640 1 -- 172.21.15.103:0/834920495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66b81011c0 msgr2=0x7f66b819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bddd8640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66b81011c0 0x7f66b819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bddd8640 1 -- 172.21.15.103:0/834920495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b819f5b0 con 0x7f66b81008a0 2024-09-19T06:07:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66b81011c0 0x7f66b819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.636+0000 7f66bddd8640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66b81008a0 0x7f66b819a5c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f66b400d770 tx=0x7f66b400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.638+0000 7f66aeffd640 1 -- 172.21.15.103:0/834920495 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4017070 con 0x7f66b81008a0 2024-09-19T06:07:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.638+0000 7f66aeffd640 1 -- 172.21.15.103:0/834920495 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66b40054d0 con 0x7f66b81008a0 2024-09-19T06:07:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.638+0000 7f66c003c640 1 -- 172.21.15.103:0/834920495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b819f8a0 con 0x7f66b81008a0 2024-09-19T06:07:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.638+0000 7f66aeffd640 1 -- 172.21.15.103:0/834920495 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4004cf0 con 0x7f66b81008a0 2024-09-19T06:07:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.638+0000 7f66c003c640 1 -- 172.21.15.103:0/834920495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b81a7130 con 0x7f66b81008a0 2024-09-19T06:07:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.641+0000 7f66aeffd640 1 -- 172.21.15.103:0/834920495 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7f66b4004e90 con 0x7f66b81008a0 2024-09-19T06:07:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.641+0000 7f66c2dd6740 1 Processor -- start 2024-09-19T06:07:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.641+0000 7f66c2dd6740 1 -- start start 2024-09-19T06:07:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.641+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b0ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 0x55eaf3b18770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55eaf3a722f0 con 0x55eaf3b18cb0 2024-09-19T06:07:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55eaf3a1a270 con 0x55eaf3b0e410 2024-09-19T06:07:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eaf3a6e2b0 con 0x55eaf3b0daf0 2024-09-19T06:07:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bd5d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bd5d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55144/0 (socket says 172.21.15.103:55144) 2024-09-19T06:07:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bd5d7640 1 -- 172.21.15.103:0/3290407430 learned_addr learned my addr 172.21.15.103:0/3290407430 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66aeffd640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66a40a3500 0x7f66a40a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66be5d9640 1 --2- 172.21.15.103:0/3290407430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b0ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bddd8640 1 --2- 172.21.15.103:0/3290407430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 0x55eaf3b18770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66be5d9640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66a40a3500 0x7f66a40a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bd5d7640 1 -- 172.21.15.103:0/3290407430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0daf0 msgr2=0x55eaf3b0ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/3290407430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b0ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bd5d7640 1 -- 172.21.15.103:0/3290407430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 msgr2=0x55eaf3b18770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/3290407430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 0x55eaf3b18770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bd5d7640 1 -- 172.21.15.103:0/3290407430 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaf3a19340 con 0x55eaf3b18cb0 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bddd8640 1 --2- 172.21.15.103:0/3290407430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 0x55eaf3b18770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66aeffd640 1 -- 172.21.15.103:0/834920495 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f66b40cf8e0 con 0x7f66b81008a0 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/3290407430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1b0a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009900 tx=0x7f66a8032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be4aeee959f3c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66be5d9640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66a40a3500 0x7f66a40a59c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66b0005fd0 tx=0x7f66b0004ab0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.642+0000 7f66a3fff640 1 -- 172.21.15.103:0/3290407430 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a803f070 con 0x55eaf3b18cb0 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66a3fff640 1 -- 172.21.15.103:0/3290407430 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66a80316a0 con 0x55eaf3b18cb0 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66a3fff640 1 -- 172.21.15.103:0/3290407430 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8035070 con 0x55eaf3b18cb0 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66c2dd6740 1 -- 172.21.15.103:0/3290407430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 msgr2=0x55eaf3b1b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/3290407430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1b0a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009900 tx=0x7f66a8032cb0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66c2dd6740 1 -- 172.21.15.103:0/3290407430 shutdown_connections 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/3290407430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1b0a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/3290407430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 0x55eaf3b18770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/3290407430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b0ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66c2dd6740 1 -- 172.21.15.103:0/3290407430 >> 172.21.15.103:0/3290407430 conn(0x55eaf3b0a060 msgr2=0x55eaf3b0a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66c2dd6740 1 -- 172.21.15.103:0/3290407430 shutdown_connections 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.643+0000 7f66c2dd6740 1 -- 172.21.15.103:0/3290407430 wait complete. 2024-09-19T06:07:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66c2dd6740 1 -- start start 2024-09-19T06:07:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66c2dd6740 1 Processor -- start 2024-09-19T06:07:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b15b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 0x55eaf3b160d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b16610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55eaf3b1b880 con 0x55eaf3b0daf0 2024-09-19T06:07:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55eaf39fb290 con 0x55eaf3b0e410 2024-09-19T06:07:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eaf3b1ba00 con 0x55eaf3b18cb0 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66c2dd6740 10 client.0 _ll_register_callbacks cb 0x55eaf3a2c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66bddd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b15b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66bddd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b15b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55146/0 (socket says 172.21.15.103:55146) 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.644+0000 7f66bddd8640 1 -- 172.21.15.103:0/495676548 learned_addr learned my addr 172.21.15.103:0/495676548 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 0x55eaf3b160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66be5d9640 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b16610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66bddd8640 1 -- 172.21.15.103:0/495676548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b18cb0 msgr2=0x55eaf3b16610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66bddd8640 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b16610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66bddd8640 1 -- 172.21.15.103:0/495676548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 msgr2=0x55eaf3b160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66bddd8640 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 0x55eaf3b160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66bddd8640 1 -- 172.21.15.103:0/495676548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaf3785210 con 0x55eaf3b0daf0 2024-09-19T06:07:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66be5d9640 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b16610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66bddd8640 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b15b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f66b40cd050 tx=0x7f66b4004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c1e2f859321fcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66a17fa640 1 -- 172.21.15.103:0/495676548 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4020040 con 0x55eaf3b0daf0 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66a17fa640 1 -- 172.21.15.103:0/495676548 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f66b40cd270 con 0x55eaf3b0daf0 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66c2dd6740 1 -- 172.21.15.103:0/495676548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66a80316a0 con 0x55eaf3b0daf0 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66a17fa640 1 -- 172.21.15.103:0/495676548 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f66b40b4050 con 0x55eaf3b0daf0 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66c2dd6740 10 client.15393 fetch_fsmap learned FSMap version 25 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66c2dd6740 1 -- 172.21.15.103:0/495676548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eaf3851620 con 0x55eaf3b0daf0 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.645+0000 7f66a17fa640 1 -- 172.21.15.103:0/495676548 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66a80316a0 con 0x55eaf3b0daf0 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.646+0000 7f66a17fa640 1 -- 172.21.15.103:0/495676548 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f66b40a4280 con 0x55eaf3b0daf0 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.646+0000 7f66c2dd6740 10 client.15393 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.646+0000 7f66c2dd6740 10 client.15393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.646+0000 7f66c2dd6740 20 client.15393 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.646+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eaf3b28bf0 0x55eaf3b2afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.646+0000 7f66c2dd6740 4 client.15393 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.646+0000 7f66c2dd6740 1 -- 172.21.15.103:0/495676548 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eaf3a7fa20 con 0x55eaf3b28bf0 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.646+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eaf3b28bf0 0x55eaf3b2afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.646+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eaf3b28bf0 0x55eaf3b2afe0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ca93cd2230c0ddf server_cookie=cfd275df452ad6c5 in_seq=0 out_seq=0 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.646+0000 7f66a17fa640 10 client.15393 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66a17fa640 1 -- 172.21.15.103:0/495676548 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eaf3a7fa20 con 0x55eaf3b28bf0 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66a17fa640 10 client.15393 handle_command_reply: tid=0 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 client.15393 shutdown 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 -- 172.21.15.103:0/495676548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 msgr2=0x55eaf3b15b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b15b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f66b40cd050 tx=0x7f66b4004780 comp rx=0 tx=0).stop 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 -- 172.21.15.103:0/495676548 shutdown_connections 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eaf3b28bf0 0x55eaf3b2afe0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b16610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0e410 0x55eaf3b160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/495676548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b15b90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66a17fa640 0 client.15393 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 -- 172.21.15.103:0/495676548 >> 172.21.15.103:0/495676548 conn(0x55eaf3b0a060 msgr2=0x55eaf3b0fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 -- 172.21.15.103:0/495676548 shutdown_connections 2024-09-19T06:07:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.647+0000 7f66c2dd6740 1 -- 172.21.15.103:0/495676548 wait complete. 2024-09-19T06:07:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.648+0000 7f66c2dd6740 20 client.15393 trim_cache size 0 max 16384 2024-09-19T06:07:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66c2dd6740 1 Processor -- start 2024-09-19T06:07:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66c2dd6740 1 -- start start 2024-09-19T06:07:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b16440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0e410 0x55eaf3b30890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b30dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81b2010 con 0x55eaf3b18cb0 2024-09-19T06:07:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81af8e0 con 0x55eaf3b0daf0 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81ad730 con 0x55eaf3b0e410 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66be5d9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b30dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66bddd8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b16440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66be5d9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b30dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55158/0 (socket says 172.21.15.103:55158) 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66be5d9640 1 -- 172.21.15.103:0/4151499644 learned_addr learned my addr 172.21.15.103:0/4151499644 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/4151499644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0e410 0x55eaf3b30890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66be5d9640 1 -- 172.21.15.103:0/4151499644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0e410 msgr2=0x55eaf3b30890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66be5d9640 1 --2- 172.21.15.103:0/4151499644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0e410 0x55eaf3b30890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66be5d9640 1 -- 172.21.15.103:0/4151499644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0daf0 msgr2=0x55eaf3b16440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66be5d9640 1 --2- 172.21.15.103:0/4151499644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b16440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.662+0000 7f66be5d9640 1 -- 172.21.15.103:0/4151499644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaf3b09e90 con 0x55eaf3b18cb0 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66be5d9640 1 --2- 172.21.15.103:0/4151499644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b30dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009fc0 tx=0x7f66b0009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8846cf5d2096df36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66a37fe640 1 -- 172.21.15.103:0/4151499644 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0011930 con 0x55eaf3b18cb0 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66a37fe640 1 -- 172.21.15.103:0/4151499644 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66b0021450 con 0x55eaf3b18cb0 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66a37fe640 1 -- 172.21.15.103:0/4151499644 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0029660 con 0x55eaf3b18cb0 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66c2dd6740 1 -- 172.21.15.103:0/4151499644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 msgr2=0x55eaf3b30dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/4151499644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b30dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009fc0 tx=0x7f66b0009ab0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66c2dd6740 1 -- 172.21.15.103:0/4151499644 shutdown_connections 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/4151499644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b30dd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/4151499644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0e410 0x55eaf3b30890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/4151499644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b16440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66c2dd6740 1 -- 172.21.15.103:0/4151499644 >> 172.21.15.103:0/4151499644 conn(0x55eaf3b0a060 msgr2=0x55eaf3b17c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.663+0000 7f66c2dd6740 1 -- 172.21.15.103:0/4151499644 shutdown_connections 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66c2dd6740 1 -- 172.21.15.103:0/4151499644 wait complete. 2024-09-19T06:07:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66c2dd6740 1 -- start start 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66c2dd6740 1 Processor -- start 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b1c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0e410 0x55eaf3b1cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66c2dd6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81adda0 con 0x55eaf3b0daf0 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81af210 con 0x55eaf3b18cb0 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66c2dd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81ae470 con 0x55eaf3b0e410 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66c2dd6740 10 client.0 _ll_register_callbacks cb 0x7f66b40cce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66bddd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b1c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66bddd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b1c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55170/0 (socket says 172.21.15.103:55170) 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.664+0000 7f66bddd8640 1 -- 172.21.15.103:0/1686906825 learned_addr learned my addr 172.21.15.103:0/1686906825 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66bddd8640 1 -- 172.21.15.103:0/1686906825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0e410 msgr2=0x55eaf3b1cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66be5d9640 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66bddd8640 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0e410 0x55eaf3b1cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66bddd8640 1 -- 172.21.15.103:0/1686906825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b18cb0 msgr2=0x55eaf3b1d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66bddd8640 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66bddd8640 1 -- 172.21.15.103:0/1686906825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaf3b92860 con 0x55eaf3b0daf0 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66be5d9640 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66bddd8640 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b1c9f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f66b40cd680 tx=0x7f66b40862e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bb7dd247966fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66a17fa640 1 -- 172.21.15.103:0/1686906825 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4014020 con 0x55eaf3b0daf0 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66a17fa640 1 -- 172.21.15.103:0/1686906825 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f66b409b100 con 0x55eaf3b0daf0 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66c2dd6740 1 -- 172.21.15.103:0/1686906825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66b0021450 con 0x55eaf3b0daf0 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66a17fa640 1 -- 172.21.15.103:0/1686906825 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f66b4020040 con 0x55eaf3b0daf0 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66c2dd6740 10 client.15399 fetch_fsmap learned FSMap version 25 2024-09-19T06:07:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66c2dd6740 1 -- 172.21.15.103:0/1686906825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eaf3b93b20 con 0x55eaf3b0daf0 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66a17fa640 1 -- 172.21.15.103:0/1686906825 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66b0021450 con 0x55eaf3b0daf0 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66a17fa640 1 -- 172.21.15.103:0/1686906825 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f66b40ba300 con 0x55eaf3b0daf0 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66c2dd6740 10 client.15399 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66c2dd6740 10 client.15399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66c2dd6740 20 client.15399 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eaf3b94290 0x55eaf3b966f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.665+0000 7f66c2dd6740 4 client.15399 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.666+0000 7f66c2dd6740 1 -- 172.21.15.103:0/1686906825 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eaf3a79d70 con 0x55eaf3b94290 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.666+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eaf3b94290 0x55eaf3b966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.666+0000 7f66bd5d7640 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eaf3b94290 0x55eaf3b966f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a48bab0508e5b46b server_cookie=23fb04a3d9efa9f7 in_seq=0 out_seq=0 2024-09-19T06:07:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.666+0000 7f66a17fa640 10 client.15399 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66a17fa640 1 -- 172.21.15.103:0/1686906825 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eaf3a79d70 con 0x55eaf3b94290 2024-09-19T06:07:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66a17fa640 10 client.15399 handle_command_reply: tid=0 2024-09-19T06:07:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 client.15399 shutdown 2024-09-19T06:07:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 -- 172.21.15.103:0/1686906825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 msgr2=0x55eaf3b1c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b1c9f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f66b40cd680 tx=0x7f66b40862e0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 -- 172.21.15.103:0/1686906825 shutdown_connections 2024-09-19T06:07:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eaf3b94290 0x55eaf3b966f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eaf3b18cb0 0x55eaf3b1d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66a17fa640 0 client.15399 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eaf3b0e410 0x55eaf3b1cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 --2- 172.21.15.103:0/1686906825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eaf3b0daf0 0x55eaf3b1c9f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 -- 172.21.15.103:0/1686906825 >> 172.21.15.103:0/1686906825 conn(0x55eaf3b0a060 msgr2=0x55eaf3b0f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 -- 172.21.15.103:0/1686906825 shutdown_connections 2024-09-19T06:07:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 1 -- 172.21.15.103:0/1686906825 wait complete. 2024-09-19T06:07:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.678+0000 7f66c2dd6740 20 client.15399 trim_cache size 0 max 16384 2024-09-19T06:07:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:07:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:07:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:07:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:07:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 -- 172.21.15.103:0/834920495 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66a40a3500 msgr2=0x7f66a40a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66a40a3500 0x7f66a40a59c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66b0005fd0 tx=0x7f66b0004ab0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 -- 172.21.15.103:0/834920495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66b81008a0 msgr2=0x7f66b819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66b81008a0 0x7f66b819a5c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f66b400d770 tx=0x7f66b400dc30 comp rx=0 tx=0).stop 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 -- 172.21.15.103:0/834920495 shutdown_connections 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66a40a3500 0x7f66a40a59c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b810e410 0x7f66b819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66b81011c0 0x7f66b819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 --2- 172.21.15.103:0/834920495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66b81008a0 0x7f66b819a5c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 -- 172.21.15.103:0/834920495 >> 172.21.15.103:0/834920495 conn(0x7f66b8075ef0 msgr2=0x7f66b810e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 -- 172.21.15.103:0/834920495 shutdown_connections 2024-09-19T06:07:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:42.679+0000 7f66c003c640 1 -- 172.21.15.103:0/834920495 wait complete. 2024-09-19T06:07:43.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:43 smithi174 ceph-mon[34488]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-09-19T06:07:43.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:43 smithi103 ceph-mon[30925]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-09-19T06:07:44.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:43 smithi169 ceph-mon[34350]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-09-19T06:07:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:45 smithi174 ceph-mon[34488]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-19T06:07:45.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:45 smithi103 ceph-mon[30925]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-19T06:07:46.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:45 smithi169 ceph-mon[34350]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-19T06:07:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:47 smithi174 ceph-mon[34488]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T06:07:47.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:47 smithi103 ceph-mon[30925]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T06:07:48.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:47 smithi169 ceph-mon[34350]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T06:07:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:49 smithi174 ceph-mon[34488]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-09-19T06:07:49.996 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:49 smithi103 ceph-mon[30925]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-09-19T06:07:50.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:49 smithi169 ceph-mon[34350]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-09-19T06:07:51.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:51 smithi174 ceph-mon[34488]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-19T06:07:51.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:51 smithi103 ceph-mon[30925]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-19T06:07:52.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:51 smithi169 ceph-mon[34350]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-19T06:07:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:53 smithi174 ceph-mon[34488]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:07:53.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:53 smithi103 ceph-mon[30925]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:07:54.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:53 smithi169 ceph-mon[34350]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:07:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.774+0000 7f3661c5e640 1 -- 172.21.15.103:0/3232292061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365c102470 msgr2=0x7f365c10e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.774+0000 7f3661c5e640 1 --2- 172.21.15.103:0/3232292061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365c102470 0x7f365c10e9a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3654009cd0 tx=0x7f365402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.774+0000 7f3661c5e640 1 -- 172.21.15.103:0/3232292061 shutdown_connections 2024-09-19T06:07:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.774+0000 7f3661c5e640 1 --2- 172.21.15.103:0/3232292061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365c102470 0x7f365c10e9a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.774+0000 7f3661c5e640 1 --2- 172.21.15.103:0/3232292061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f365c101ad0 0x7f365c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.774+0000 7f3661c5e640 1 --2- 172.21.15.103:0/3232292061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365c107b70 0x7f365c107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.774+0000 7f3661c5e640 1 -- 172.21.15.103:0/3232292061 >> 172.21.15.103:0/3232292061 conn(0x7f365c0fd7d0 msgr2=0x7f365c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.774+0000 7f3661c5e640 1 -- 172.21.15.103:0/3232292061 shutdown_connections 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.774+0000 7f3661c5e640 1 -- 172.21.15.103:0/3232292061 wait complete. 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.774+0000 7f3661c5e640 1 Processor -- start 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f3661c5e640 1 -- start start 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f3661c5e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365c101ad0 0x7f365c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f3661c5e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f365c102470 0x7f365c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f3661c5e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365c107b70 0x7f365c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f3661c5e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f365c111de0 con 0x7f365c107b70 2024-09-19T06:07:55.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f3661c5e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f365c111c60 con 0x7f365c101ad0 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f3661c5e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f365c111f60 con 0x7f365c102470 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365c107b70 0x7f365c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365c107b70 0x7f365c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56130/0 (socket says 172.21.15.103:56130) 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365bfff640 1 -- 172.21.15.103:0/1292524203 learned_addr learned my addr 172.21.15.103:0/1292524203 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365b7fe640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365c101ad0 0x7f365c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365affd640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f365c102470 0x7f365c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365bfff640 1 -- 172.21.15.103:0/1292524203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f365c102470 msgr2=0x7f365c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365bfff640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f365c102470 0x7f365c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365bfff640 1 -- 172.21.15.103:0/1292524203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365c101ad0 msgr2=0x7f365c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365bfff640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365c101ad0 0x7f365c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365bfff640 1 -- 172.21.15.103:0/1292524203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c1a6720 con 0x7f365c107b70 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.775+0000 7f365bfff640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365c107b70 0x7f365c074f70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3654005e30 tx=0x7f3654003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.776+0000 7f3658ff9640 1 -- 172.21.15.103:0/1292524203 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654004240 con 0x7f365c107b70 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.776+0000 7f3658ff9640 1 -- 172.21.15.103:0/1292524203 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3654031ce0 con 0x7f365c107b70 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.776+0000 7f3661c5e640 1 -- 172.21.15.103:0/1292524203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c1a69b0 con 0x7f365c107b70 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.776+0000 7f3658ff9640 1 -- 172.21.15.103:0/1292524203 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654046480 con 0x7f365c107b70 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.776+0000 7f3661c5e640 1 -- 172.21.15.103:0/1292524203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c1a6f00 con 0x7f365c107b70 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.778+0000 7f3658ff9640 1 -- 172.21.15.103:0/1292524203 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7f36540043e0 con 0x7f365c107b70 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.778+0000 7f36649f9740 1 Processor -- start 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.778+0000 7f36649f9740 1 -- start start 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f36649f9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e459ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f36649f9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 0x55eb9e464770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f36649f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e464cb0 0x55eb9e4670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f36649f9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e3be2f0 con 0x55eb9e459af0 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f36649f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e366270 con 0x55eb9e464cb0 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f36649f9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e3ba2b0 con 0x55eb9e45a410 2024-09-19T06:07:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f3658ff9640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f36440a3500 0x7f36440a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e459ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e459ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56146/0 (socket says 172.21.15.103:56146) 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365affd640 1 -- 172.21.15.103:0/1998187913 learned_addr learned my addr 172.21.15.103:0/1998187913 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365bfff640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f36440a3500 0x7f36440a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365b7fe640 1 --2- 172.21.15.103:0/1998187913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 0x55eb9e464770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365affd640 1 --2- 172.21.15.103:0/1998187913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e464cb0 0x55eb9e4670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365affd640 1 -- 172.21.15.103:0/1998187913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 msgr2=0x55eb9e464770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365affd640 1 --2- 172.21.15.103:0/1998187913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 0x55eb9e464770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365affd640 1 -- 172.21.15.103:0/1998187913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e464cb0 msgr2=0x55eb9e4670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365affd640 1 --2- 172.21.15.103:0/1998187913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e464cb0 0x55eb9e4670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365affd640 1 -- 172.21.15.103:0/1998187913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9e365340 con 0x55eb9e459af0 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365b7fe640 1 --2- 172.21.15.103:0/1998187913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 0x55eb9e464770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f3658ff9640 1 -- 172.21.15.103:0/1292524203 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f365402e030 con 0x7f365c107b70 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365affd640 1 --2- 172.21.15.103:0/1998187913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e459ed0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f365000bc20 tx=0x7f3650004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e114b316a7a60e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f365bfff640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f36440a3500 0x7f36440a59c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36540ee8e0 tx=0x7f3654090190 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.779+0000 7f3641ffb640 1 -- 172.21.15.103:0/1998187913 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650005020 con 0x55eb9e459af0 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f3641ffb640 1 -- 172.21.15.103:0/1998187913 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3650005670 con 0x55eb9e459af0 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f3641ffb640 1 -- 172.21.15.103:0/1998187913 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650010460 con 0x55eb9e459af0 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f36649f9740 1 -- 172.21.15.103:0/1998187913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 msgr2=0x55eb9e459ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f36649f9740 1 --2- 172.21.15.103:0/1998187913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e459ed0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f365000bc20 tx=0x7f3650004250 comp rx=0 tx=0).stop 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f36649f9740 1 -- 172.21.15.103:0/1998187913 shutdown_connections 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f36649f9740 1 --2- 172.21.15.103:0/1998187913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e464cb0 0x55eb9e4670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f36649f9740 1 --2- 172.21.15.103:0/1998187913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 0x55eb9e464770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f36649f9740 1 --2- 172.21.15.103:0/1998187913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e459ed0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f36649f9740 1 -- 172.21.15.103:0/1998187913 >> 172.21.15.103:0/1998187913 conn(0x55eb9e456060 msgr2=0x55eb9e456440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:55.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f36649f9740 1 -- 172.21.15.103:0/1998187913 shutdown_connections 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.780+0000 7f36649f9740 1 -- 172.21.15.103:0/1998187913 wait complete. 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f36649f9740 1 -- start start 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f36649f9740 1 Processor -- start 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f36649f9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e461ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f36649f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 0x55eb9e462020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f36649f9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e464cb0 0x55eb9e462560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f36649f9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e467880 con 0x55eb9e459af0 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f36649f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e347290 con 0x55eb9e45a410 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f36649f9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e467a00 con 0x55eb9e464cb0 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f36649f9740 10 client.0 _ll_register_callbacks cb 0x55eb9e378140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f365affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e461ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f365affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e461ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56160/0 (socket says 172.21.15.103:56160) 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.781+0000 7f365affd640 1 -- 172.21.15.103:0/532338379 learned_addr learned my addr 172.21.15.103:0/532338379 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:55.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f365b7fe640 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 0x55eb9e462020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f365affd640 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e464cb0 0x55eb9e462560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f365affd640 1 -- 172.21.15.103:0/532338379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e464cb0 msgr2=0x55eb9e462560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f365affd640 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e464cb0 0x55eb9e462560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f365affd640 1 -- 172.21.15.103:0/532338379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 msgr2=0x55eb9e462020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f365affd640 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 0x55eb9e462020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f365affd640 1 -- 172.21.15.103:0/532338379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb9e0d1210 con 0x55eb9e459af0 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f365b7fe640 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 0x55eb9e462020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f365affd640 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e461ae0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3650004410 tx=0x7f36500042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa142825fa61c8a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f363affd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f363affd640 1 -- 172.21.15.103:0/532338379 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500048c0 con 0x55eb9e459af0 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f363affd640 1 -- 172.21.15.103:0/532338379 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f3650004a60 con 0x55eb9e459af0 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f36649f9740 1 -- 172.21.15.103:0/532338379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3650005670 con 0x55eb9e459af0 2024-09-19T06:07:55.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f363affd640 1 -- 172.21.15.103:0/532338379 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3650020480 con 0x55eb9e459af0 2024-09-19T06:07:55.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f36649f9740 10 client.15411 fetch_fsmap learned FSMap version 25 2024-09-19T06:07:55.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.782+0000 7f36649f9740 1 -- 172.21.15.103:0/532338379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eb9e19d620 con 0x55eb9e459af0 2024-09-19T06:07:55.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.783+0000 7f363affd640 1 -- 172.21.15.103:0/532338379 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3650005670 con 0x55eb9e459af0 2024-09-19T06:07:55.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.783+0000 7f363affd640 1 -- 172.21.15.103:0/532338379 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3650010560 con 0x55eb9e459af0 2024-09-19T06:07:55.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.783+0000 7f36649f9740 10 client.15411 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:07:55.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.783+0000 7f36649f9740 10 client.15411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:07:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.783+0000 7f36649f9740 20 client.15411 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.783+0000 7f36649f9740 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eb9e474a60 0x55eb9e476e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.783+0000 7f36649f9740 4 client.15411 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:07:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.783+0000 7f36649f9740 1 -- 172.21.15.103:0/532338379 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb9e3cba20 con 0x55eb9e474a60 2024-09-19T06:07:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.783+0000 7f365b7fe640 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eb9e474a60 0x55eb9e476e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.784+0000 7f365b7fe640 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eb9e474a60 0x55eb9e476e50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2519447ca7878ea server_cookie=c3acda5c83b7cd71 in_seq=0 out_seq=0 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.784+0000 7f363affd640 10 client.15411 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.784+0000 7f363affd640 1 -- 172.21.15.103:0/532338379 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb9e3cba20 con 0x55eb9e474a60 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.784+0000 7f363affd640 10 client.15411 handle_command_reply: tid=0 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.784+0000 7f36649f9740 1 client.15411 shutdown 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 1 -- 172.21.15.103:0/532338379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 msgr2=0x55eb9e461ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e461ae0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3650004410 tx=0x7f36500042c0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 1 -- 172.21.15.103:0/532338379 shutdown_connections 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eb9e474a60 0x55eb9e476e50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e464cb0 0x55eb9e462560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 0x55eb9e462020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f363affd640 0 client.15411 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 1 --2- 172.21.15.103:0/532338379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e459af0 0x55eb9e461ae0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 1 -- 172.21.15.103:0/532338379 >> 172.21.15.103:0/532338379 conn(0x55eb9e456060 msgr2=0x55eb9e45bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 1 -- 172.21.15.103:0/532338379 shutdown_connections 2024-09-19T06:07:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 1 -- 172.21.15.103:0/532338379 wait complete. 2024-09-19T06:07:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.785+0000 7f36649f9740 20 client.15411 trim_cache size 0 max 16384 2024-09-19T06:07:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f36649f9740 1 Processor -- start 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f36649f9740 1 -- start start 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f36649f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e459af0 0x55eb9e460390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f36649f9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 0x55eb9e462390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f36649f9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e47c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f36649f9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f365c1b1fe0 con 0x55eb9e464cb0 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f36649f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f365c1af8b0 con 0x55eb9e459af0 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f36649f9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f365c1ad700 con 0x55eb9e45a410 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f365affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e47c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f365affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e47c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56172/0 (socket says 172.21.15.103:56172) 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f365affd640 1 -- 172.21.15.103:0/1343189591 learned_addr learned my addr 172.21.15.103:0/1343189591 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f365b7fe640 1 --2- 172.21.15.103:0/1343189591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 0x55eb9e462390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.799+0000 7f365affd640 1 --2- 172.21.15.103:0/1343189591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e459af0 0x55eb9e460390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.800+0000 7f365affd640 1 -- 172.21.15.103:0/1343189591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 msgr2=0x55eb9e462390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.800+0000 7f365affd640 1 --2- 172.21.15.103:0/1343189591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 0x55eb9e462390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.800+0000 7f365affd640 1 -- 172.21.15.103:0/1343189591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e459af0 msgr2=0x55eb9e460390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.800+0000 7f365affd640 1 --2- 172.21.15.103:0/1343189591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e459af0 0x55eb9e460390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.800+0000 7f365affd640 1 -- 172.21.15.103:0/1343189591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9e455e90 con 0x55eb9e464cb0 2024-09-19T06:07:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.800+0000 7f365b7fe640 1 --2- 172.21.15.103:0/1343189591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 0x55eb9e462390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.800+0000 7f365affd640 1 --2- 172.21.15.103:0/1343189591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e47c570 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f365000bdb0 tx=0x7f3650004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989169800307670a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.800+0000 7f36417fa640 1 -- 172.21.15.103:0/1343189591 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650035020 con 0x55eb9e464cb0 2024-09-19T06:07:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.800+0000 7f36417fa640 1 -- 172.21.15.103:0/1343189591 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3650025070 con 0x55eb9e464cb0 2024-09-19T06:07:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.800+0000 7f36417fa640 1 -- 172.21.15.103:0/1343189591 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650004790 con 0x55eb9e464cb0 2024-09-19T06:07:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 -- 172.21.15.103:0/1343189591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 msgr2=0x55eb9e47c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 --2- 172.21.15.103:0/1343189591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e47c570 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f365000bdb0 tx=0x7f3650004250 comp rx=0 tx=0).stop 2024-09-19T06:07:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 -- 172.21.15.103:0/1343189591 shutdown_connections 2024-09-19T06:07:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 --2- 172.21.15.103:0/1343189591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e47c570 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 --2- 172.21.15.103:0/1343189591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e45a410 0x55eb9e462390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 --2- 172.21.15.103:0/1343189591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e459af0 0x55eb9e460390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 -- 172.21.15.103:0/1343189591 >> 172.21.15.103:0/1343189591 conn(0x55eb9e456060 msgr2=0x55eb9e463b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 -- 172.21.15.103:0/1343189591 shutdown_connections 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 -- 172.21.15.103:0/1343189591 wait complete. 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 -- start start 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.801+0000 7f36649f9740 1 Processor -- start 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f36649f9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e459af0 0x55eb9e46cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f36649f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 0x55eb9e46d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f36649f9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e45e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f36649f9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f365c1add70 con 0x55eb9e464cb0 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f36649f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f365c1af1e0 con 0x55eb9e45a410 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f36649f9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f365c1ae440 con 0x55eb9e459af0 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f36649f9740 10 client.0 _ll_register_callbacks cb 0x7f365000ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e45e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e45e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56182/0 (socket says 172.21.15.103:56182) 2024-09-19T06:07:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365affd640 1 -- 172.21.15.103:0/2358141911 learned_addr learned my addr 172.21.15.103:0/2358141911 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:07:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365affd640 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e459af0 0x55eb9e46cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365b7fe640 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 0x55eb9e46d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365affd640 1 -- 172.21.15.103:0/2358141911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e459af0 msgr2=0x55eb9e46cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365affd640 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e459af0 0x55eb9e46cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365affd640 1 -- 172.21.15.103:0/2358141911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 msgr2=0x55eb9e46d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365affd640 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 0x55eb9e46d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365affd640 1 -- 172.21.15.103:0/2358141911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb9e45ebc0 con 0x55eb9e464cb0 2024-09-19T06:07:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f365affd640 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e45e390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3650004410 tx=0x7f365000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f1646396284018 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f363affd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:07:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f363affd640 1 -- 172.21.15.103:0/2358141911 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650035020 con 0x55eb9e464cb0 2024-09-19T06:07:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f363affd640 1 -- 172.21.15.103:0/2358141911 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f3650010cb0 con 0x55eb9e464cb0 2024-09-19T06:07:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f36649f9740 1 -- 172.21.15.103:0/2358141911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3650025070 con 0x55eb9e464cb0 2024-09-19T06:07:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f363affd640 1 -- 172.21.15.103:0/2358141911 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3650043050 con 0x55eb9e464cb0 2024-09-19T06:07:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f36649f9740 10 client.15417 fetch_fsmap learned FSMap version 25 2024-09-19T06:07:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.802+0000 7f36649f9740 1 -- 172.21.15.103:0/2358141911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eb9e4df090 con 0x55eb9e464cb0 2024-09-19T06:07:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f363affd640 1 -- 172.21.15.103:0/2358141911 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3650025070 con 0x55eb9e464cb0 2024-09-19T06:07:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f363affd640 1 -- 172.21.15.103:0/2358141911 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f365003a040 con 0x55eb9e464cb0 2024-09-19T06:07:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f36649f9740 10 client.15417 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:07:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f36649f9740 10 client.15417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:07:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f36649f9740 20 client.15417 populate_metadata read hostname 'smithi103' 2024-09-19T06:07:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f36649f9740 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eb9e4df700 0x55eb9e4e1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f36649f9740 4 client.15417 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:07:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f36649f9740 1 -- 172.21.15.103:0/2358141911 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb9e3c5d70 con 0x55eb9e4df700 2024-09-19T06:07:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f365b7fe640 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eb9e4df700 0x55eb9e4e1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f363affd640 10 client.15417 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.803+0000 7f365b7fe640 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eb9e4df700 0x55eb9e4e1b20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffdad50c704ad3b1 server_cookie=bfcb8bc6195fccce in_seq=0 out_seq=0 2024-09-19T06:07:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f363affd640 1 -- 172.21.15.103:0/2358141911 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb9e3c5d70 con 0x55eb9e4df700 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f363affd640 10 client.15417 handle_command_reply: tid=0 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 client.15417 shutdown 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 -- 172.21.15.103:0/2358141911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 msgr2=0x55eb9e45e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e45e390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3650004410 tx=0x7f365000b5b0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 -- 172.21.15.103:0/2358141911 shutdown_connections 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55eb9e4df700 0x55eb9e4e1b20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eb9e464cb0 0x55eb9e45e390 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb9e45a410 0x55eb9e46d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 --2- 172.21.15.103:0/2358141911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb9e459af0 0x55eb9e46cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 -- 172.21.15.103:0/2358141911 >> 172.21.15.103:0/2358141911 conn(0x55eb9e456060 msgr2=0x55eb9e45b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f363affd640 0 client.15417 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:07:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 -- 172.21.15.103:0/2358141911 shutdown_connections 2024-09-19T06:07:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 1 -- 172.21.15.103:0/2358141911 wait complete. 2024-09-19T06:07:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.811+0000 7f36649f9740 20 client.15417 trim_cache size 0 max 16384 2024-09-19T06:07:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:07:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:07:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:07:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:07:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 -- 172.21.15.103:0/1292524203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f36440a3500 msgr2=0x7f36440a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f36440a3500 0x7f36440a59c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36540ee8e0 tx=0x7f3654090190 comp rx=0 tx=0).stop 2024-09-19T06:07:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 -- 172.21.15.103:0/1292524203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365c107b70 msgr2=0x7f365c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365c107b70 0x7f365c074f70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3654005e30 tx=0x7f3654003ba0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 -- 172.21.15.103:0/1292524203 shutdown_connections 2024-09-19T06:07:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f36440a3500 0x7f36440a59c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365c107b70 0x7f365c074f70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f365c102470 0x7f365c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 --2- 172.21.15.103:0/1292524203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365c101ad0 0x7f365c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 -- 172.21.15.103:0/1292524203 >> 172.21.15.103:0/1292524203 conn(0x7f365c0fd7d0 msgr2=0x7f365c0fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 -- 172.21.15.103:0/1292524203 shutdown_connections 2024-09-19T06:07:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:07:55.812+0000 7f3661c5e640 1 -- 172.21.15.103:0/1292524203 wait complete. 2024-09-19T06:07:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:55 smithi174 ceph-mon[34488]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-19T06:07:55.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:55 smithi103 ceph-mon[30925]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-19T06:07:56.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:55 smithi169 ceph-mon[34350]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-19T06:07:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:57 smithi174 ceph-mon[34488]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-19T06:07:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:57 smithi103 ceph-mon[30925]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-19T06:07:58.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:57 smithi169 ceph-mon[34350]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-19T06:07:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:07:59 smithi174 ceph-mon[34488]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T06:07:59.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:07:59 smithi103 ceph-mon[30925]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T06:08:00.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:07:59 smithi169 ceph-mon[34350]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T06:08:00.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:08:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:00.982 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:00 smithi103 ceph-mon[30925]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:08:00.983 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:08:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:08:00.699+0000 7fcede65f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:08:00.983 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:08:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:08:00.699+0000 7fcede65f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:08:00.983 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:08:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:08:00.699+0000 7fcede65f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:08:00.983 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:08:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:08:00.699+0000 7fcede65f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:08:00.983 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:08:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:08:00.699+0000 7fcede65f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:08:01.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:00 smithi169 ceph-mon[34350]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:08:01.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.065+0000 7fa49040d640 1 -- 172.21.15.103:0/306096641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa488103740 msgr2=0x7fa488107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.065+0000 7fa49040d640 1 --2- 172.21.15.103:0/306096641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa488103740 0x7fa488107b80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa478009930 tx=0x7fa47802a420 comp rx=0 tx=0).stop 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.065+0000 7fa49040d640 1 -- 172.21.15.103:0/306096641 shutdown_connections 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.065+0000 7fa49040d640 1 --2- 172.21.15.103:0/306096641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488108290 0x7fa48810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.065+0000 7fa49040d640 1 --2- 172.21.15.103:0/306096641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa488103740 0x7fa488107b80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.065+0000 7fa49040d640 1 --2- 172.21.15.103:0/306096641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa488102d90 0x7fa488103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.065+0000 7fa49040d640 1 -- 172.21.15.103:0/306096641 >> 172.21.15.103:0/306096641 conn(0x7fa4880fc7d0 msgr2=0x7fa4880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.065+0000 7fa49040d640 1 -- 172.21.15.103:0/306096641 shutdown_connections 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.065+0000 7fa49040d640 1 -- 172.21.15.103:0/306096641 wait complete. 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.066+0000 7fa49040d640 1 Processor -- start 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.066+0000 7fa49040d640 1 -- start start 2024-09-19T06:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa49040d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa488102d90 0x7fa488198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa49040d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488103740 0x7fa488198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa49040d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa488108290 0x7fa48819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa49040d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa488111f40 con 0x7fa488102d90 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa49040d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa488111dc0 con 0x7fa488108290 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa49040d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881120c0 con 0x7fa488103740 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48e1a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa488102d90 0x7fa488198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48e1a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa488102d90 0x7fa488198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34574/0 (socket says 172.21.15.103:34574) 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48e1a9640 1 -- 172.21.15.103:0/3295124203 learned_addr learned my addr 172.21.15.103:0/3295124203 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa488108290 0x7fa48819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48d9a8640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488103740 0x7fa488198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48e1a9640 1 -- 172.21.15.103:0/3295124203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488103740 msgr2=0x7fa488198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488103740 0x7fa488198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48e1a9640 1 -- 172.21.15.103:0/3295124203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa488108290 msgr2=0x7fa48819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa488108290 0x7fa48819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48e1a9640 1 -- 172.21.15.103:0/3295124203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48819d4b0 con 0x7fa488102d90 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.067+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa488102d90 0x7fa488198500 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa48400d950 tx=0x7fa48400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.068+0000 7fa47f7fe640 1 -- 172.21.15.103:0/3295124203 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484017030 con 0x7fa488102d90 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.068+0000 7fa47f7fe640 1 -- 172.21.15.103:0/3295124203 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa484004020 con 0x7fa488102d90 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.068+0000 7fa47f7fe640 1 -- 172.21.15.103:0/3295124203 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840047a0 con 0x7fa488102d90 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.068+0000 7fa49040d640 1 -- 172.21.15.103:0/3295124203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48819d7a0 con 0x7fa488102d90 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.068+0000 7fa49040d640 1 -- 172.21.15.103:0/3295124203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4881a5080 con 0x7fa488102d90 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.071+0000 7fa47f7fe640 1 -- 172.21.15.103:0/3295124203 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138532+0+0 (secure 0 0 0) 0x7fa4840041d0 con 0x7fa488102d90 2024-09-19T06:08:01.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.071+0000 7fa4927e6740 1 Processor -- start 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.071+0000 7fa4927e6740 1 -- start start 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82380 0x5614f2a82760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82ca0 0x5614f2a91550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 0x5614f2a93e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa4927e6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5614f29e82e0 con 0x5614f2a82ca0 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa4927e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5614f298fce0 con 0x5614f2a91a90 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa4927e6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5614f29e42a0 con 0x5614f2a82380 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa48d9a8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 0x5614f2a93e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa48e9aa640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82380 0x5614f2a82760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa47f7fe640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa4740a34c0 0x7fa4740a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa48e9aa640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82380 0x5614f2a82760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:53918/0 (socket says 172.21.15.103:53918) 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa48e9aa640 1 -- 172.21.15.103:0/2565968025 learned_addr learned my addr 172.21.15.103:0/2565968025 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa47f7fe640 1 -- 172.21.15.103:0/3295124203 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fa4840cf890 con 0x7fa488102d90 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa4740a34c0 0x7fa4740a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa48e9aa640 1 -- 172.21.15.103:0/2565968025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 msgr2=0x5614f2a93e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/2565968025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 0x5614f2a93e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.072+0000 7fa48e9aa640 1 -- 172.21.15.103:0/2565968025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82ca0 msgr2=0x5614f2a91550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.073+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/2565968025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82ca0 0x5614f2a91550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.073+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/2565968025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82ca0 0x5614f2a91550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.073+0000 7fa48e9aa640 1 -- 172.21.15.103:0/2565968025 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f2974440 con 0x5614f2a82380 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.073+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/2565968025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82380 0x5614f2a82760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa480005c40 tx=0x7fa480013f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be3df98db4a09d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.073+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa4740a34c0 0x7fa4740a5980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa48001d000 tx=0x7fa48001f000 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.073+0000 7fa47cdea640 1 -- 172.21.15.103:0/2565968025 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48000fe00 con 0x5614f2a82380 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.073+0000 7fa47cdea640 1 -- 172.21.15.103:0/2565968025 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa480022020 con 0x5614f2a82380 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.073+0000 7fa47cdea640 1 -- 172.21.15.103:0/2565968025 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480010650 con 0x5614f2a82380 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.074+0000 7fa4927e6740 1 -- 172.21.15.103:0/2565968025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82380 msgr2=0x5614f2a82760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.074+0000 7fa4927e6740 1 --2- 172.21.15.103:0/2565968025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82380 0x5614f2a82760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa480005c40 tx=0x7fa480013f50 comp rx=0 tx=0).stop 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.074+0000 7fa4927e6740 1 -- 172.21.15.103:0/2565968025 shutdown_connections 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.074+0000 7fa4927e6740 1 --2- 172.21.15.103:0/2565968025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 0x5614f2a93e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.074+0000 7fa4927e6740 1 --2- 172.21.15.103:0/2565968025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82ca0 0x5614f2a91550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.074+0000 7fa4927e6740 1 --2- 172.21.15.103:0/2565968025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82380 0x5614f2a82760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.074+0000 7fa4927e6740 1 -- 172.21.15.103:0/2565968025 >> 172.21.15.103:0/2565968025 conn(0x5614f2a7ea30 msgr2=0x5614f2a7ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.074+0000 7fa4927e6740 1 -- 172.21.15.103:0/2565968025 shutdown_connections 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.074+0000 7fa4927e6740 1 -- 172.21.15.103:0/2565968025 wait complete. 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.074+0000 7fa4927e6740 1 -- start start 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa4927e6740 1 Processor -- start 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a8a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82ca0 0x5614f2a8af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a91a90 0x5614f2a8b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa4927e6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5614f2a85320 con 0x5614f2a82380 2024-09-19T06:08:01.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa4927e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5614f29a3050 con 0x5614f2a82ca0 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa4927e6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5614f2a854a0 con 0x5614f2a91a90 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa4927e6740 10 client.0 _ll_register_callbacks cb 0x5614f29e3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48e1a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a8a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48e1a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a8a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34594/0 (socket says 172.21.15.103:34594) 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48e1a9640 1 -- 172.21.15.103:0/4162249040 learned_addr learned my addr 172.21.15.103:0/4162249040 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48d9a8640 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82ca0 0x5614f2a8af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a91a90 0x5614f2a8b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48e1a9640 1 -- 172.21.15.103:0/4162249040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a91a90 msgr2=0x5614f2a8b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a91a90 0x5614f2a8b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48e1a9640 1 -- 172.21.15.103:0/4162249040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82ca0 msgr2=0x5614f2a8af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82ca0 0x5614f2a8af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48e1a9640 1 -- 172.21.15.103:0/4162249040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f27593c0 con 0x5614f2a82380 2024-09-19T06:08:01.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.075+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a91a90 0x5614f2a8b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.076+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a8a9d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4840cd630 tx=0x7fa48409b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2cfc87b43e6d25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.076+0000 7fa471ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.076+0000 7fa471ffb640 1 -- 172.21.15.103:0/4162249040 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840b4060 con 0x5614f2a82380 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.076+0000 7fa471ffb640 1 -- 172.21.15.103:0/4162249040 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fa4840cd220 con 0x5614f2a82380 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.076+0000 7fa4927e6740 1 -- 172.21.15.103:0/4162249040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa480022020 con 0x5614f2a82380 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.076+0000 7fa471ffb640 1 -- 172.21.15.103:0/4162249040 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa484014070 con 0x5614f2a82380 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.076+0000 7fa4927e6740 10 client.15432 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.076+0000 7fa4927e6740 1 -- 172.21.15.103:0/4162249040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5614f2aa4510 con 0x5614f2a82380 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.077+0000 7fa471ffb640 1 -- 172.21.15.103:0/4162249040 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa480022020 con 0x5614f2a82380 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.077+0000 7fa471ffb640 1 -- 172.21.15.103:0/4162249040 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa4840ba170 con 0x5614f2a82380 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.077+0000 7fa4927e6740 10 client.15432 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.077+0000 7fa4927e6740 10 client.15432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.077+0000 7fa4927e6740 20 client.15432 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.077+0000 7fa4927e6740 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5614f2aa5920 0x5614f2aa7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.077+0000 7fa4927e6740 4 client.15432 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.077+0000 7fa4927e6740 1 -- 172.21.15.103:0/4162249040 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614f29f5850 con 0x5614f2aa5920 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.078+0000 7fa48d9a8640 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5614f2aa5920 0x5614f2aa7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.078+0000 7fa471ffb640 10 client.15432 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.078+0000 7fa48d9a8640 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5614f2aa5920 0x5614f2aa7d50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b385df396615ef server_cookie=a2a6515b9fb80afa in_seq=0 out_seq=0 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa471ffb640 1 -- 172.21.15.103:0/4162249040 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614f29f5850 con 0x5614f2aa5920 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa471ffb640 10 client.15432 handle_command_reply: tid=0 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 client.15432 shutdown 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 -- 172.21.15.103:0/4162249040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 msgr2=0x5614f2a8a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a8a9d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4840cd630 tx=0x7fa48409b4a0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 -- 172.21.15.103:0/4162249040 shutdown_connections 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5614f2aa5920 0x5614f2aa7d50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa471ffb640 0 client.15432 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a91a90 0x5614f2a8b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82ca0 0x5614f2a8af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 --2- 172.21.15.103:0/4162249040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a8a9d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 -- 172.21.15.103:0/4162249040 >> 172.21.15.103:0/4162249040 conn(0x5614f2a7ea30 msgr2=0x5614f2a84790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:01.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 -- 172.21.15.103:0/4162249040 shutdown_connections 2024-09-19T06:08:01.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 1 -- 172.21.15.103:0/4162249040 wait complete. 2024-09-19T06:08:01.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.079+0000 7fa4927e6740 20 client.15432 trim_cache size 0 max 16384 2024-09-19T06:08:01.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa4927e6740 1 Processor -- start 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa4927e6740 1 -- start start 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a861c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82ca0 0x5614f2aad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 0x5614f2aadb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa4927e6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ade00 con 0x5614f2a82380 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa4927e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ab6d0 con 0x5614f2a91a90 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa4927e6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881a9520 con 0x5614f2a82ca0 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa48e1a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a861c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa48e1a9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a861c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34596/0 (socket says 172.21.15.103:34596) 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa48e1a9640 1 -- 172.21.15.103:0/1317500980 learned_addr learned my addr 172.21.15.103:0/1317500980 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/1317500980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 0x5614f2aadb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.103+0000 7fa48d9a8640 1 --2- 172.21.15.103:0/1317500980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82ca0 0x5614f2aad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.104+0000 7fa48e1a9640 1 -- 172.21.15.103:0/1317500980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82ca0 msgr2=0x5614f2aad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:01.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.104+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/1317500980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82ca0 0x5614f2aad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.104+0000 7fa48e1a9640 1 -- 172.21.15.103:0/1317500980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 msgr2=0x5614f2aadb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.104+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/1317500980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 0x5614f2aadb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.104+0000 7fa48e1a9640 1 -- 172.21.15.103:0/1317500980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f2a84ef0 con 0x5614f2a82380 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.104+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/1317500980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 0x5614f2aadb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.104+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/1317500980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a861c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa4840a4190 tx=0x7fa484005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f6339bdf978e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.104+0000 7fa473fff640 1 -- 172.21.15.103:0/1317500980 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840b4040 con 0x5614f2a82380 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.104+0000 7fa473fff640 1 -- 172.21.15.103:0/1317500980 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4840a46c0 con 0x5614f2a82380 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.104+0000 7fa473fff640 1 -- 172.21.15.103:0/1317500980 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840ba170 con 0x5614f2a82380 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 -- 172.21.15.103:0/1317500980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 msgr2=0x5614f2a861c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 --2- 172.21.15.103:0/1317500980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a861c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa4840a4190 tx=0x7fa484005130 comp rx=0 tx=0).stop 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 -- 172.21.15.103:0/1317500980 shutdown_connections 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 --2- 172.21.15.103:0/1317500980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a91a90 0x5614f2aadb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 --2- 172.21.15.103:0/1317500980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82ca0 0x5614f2aad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 --2- 172.21.15.103:0/1317500980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a82380 0x5614f2a861c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 -- 172.21.15.103:0/1317500980 >> 172.21.15.103:0/1317500980 conn(0x5614f2a7ea30 msgr2=0x5614f2a7db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 -- 172.21.15.103:0/1317500980 shutdown_connections 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 -- 172.21.15.103:0/1317500980 wait complete. 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 -- start start 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.105+0000 7fa4927e6740 1 Processor -- start 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82380 0x5614f2a9fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82ca0 0x5614f2aa0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa4927e6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a91a90 0x5614f2aa0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa4927e6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881a9b90 con 0x5614f2a91a90 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa4927e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ab000 con 0x5614f2a82380 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa4927e6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881aa260 con 0x5614f2a82ca0 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa4927e6740 10 client.0 _ll_register_callbacks cb 0x7fa4840cce00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48e9aa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a91a90 0x5614f2aa0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48e9aa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a91a90 0x5614f2aa0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34610/0 (socket says 172.21.15.103:34610) 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48e9aa640 1 -- 172.21.15.103:0/1165885660 learned_addr learned my addr 172.21.15.103:0/1165885660 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48d9a8640 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82ca0 0x5614f2aa0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82380 0x5614f2a9fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48e9aa640 1 -- 172.21.15.103:0/1165885660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82ca0 msgr2=0x5614f2aa0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82ca0 0x5614f2aa0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48e9aa640 1 -- 172.21.15.103:0/1165885660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82380 msgr2=0x5614f2a9fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82380 0x5614f2a9fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48e9aa640 1 -- 172.21.15.103:0/1165885660 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f2b0f890 con 0x5614f2a91a90 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.106+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82380 0x5614f2a9fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.107+0000 7fa48e9aa640 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a91a90 0x5614f2aa0870 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa480005c10 tx=0x7fa480012f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a190671918824b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.107+0000 7fa471ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:01.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.107+0000 7fa471ffb640 1 -- 172.21.15.103:0/1165885660 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48000fe80 con 0x5614f2a91a90 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.107+0000 7fa471ffb640 1 -- 172.21.15.103:0/1165885660 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fa480012a30 con 0x5614f2a91a90 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.107+0000 7fa4927e6740 1 -- 172.21.15.103:0/1165885660 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4840a46c0 con 0x5614f2a91a90 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.107+0000 7fa471ffb640 1 -- 172.21.15.103:0/1165885660 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa480036020 con 0x5614f2a91a90 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.107+0000 7fa4927e6740 10 client.15438 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.107+0000 7fa4927e6740 1 -- 172.21.15.103:0/1165885660 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5614f2b10b20 con 0x5614f2a91a90 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.107+0000 7fa471ffb640 1 -- 172.21.15.103:0/1165885660 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa480022040 con 0x5614f2a91a90 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.108+0000 7fa471ffb640 1 -- 172.21.15.103:0/1165885660 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa480005480 con 0x5614f2a91a90 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.108+0000 7fa4927e6740 10 client.15438 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.108+0000 7fa4927e6740 10 client.15438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.108+0000 7fa4927e6740 20 client.15438 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.108+0000 7fa4927e6740 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5614f2aa5920 0x5614f2b13170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.108+0000 7fa4927e6740 4 client.15438 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.108+0000 7fa4927e6740 1 -- 172.21.15.103:0/1165885660 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa4840a46c0 con 0x5614f2aa5920 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.108+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5614f2aa5920 0x5614f2b13170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.108+0000 7fa471ffb640 10 client.15438 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.108+0000 7fa48e1a9640 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5614f2aa5920 0x5614f2b13170 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f46fce13dec99aa6 server_cookie=93d1c663132a64c9 in_seq=0 out_seq=0 2024-09-19T06:08:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa471ffb640 1 -- 172.21.15.103:0/1165885660 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fa4840a46c0 con 0x5614f2aa5920 2024-09-19T06:08:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa471ffb640 10 client.15438 handle_command_reply: tid=0 2024-09-19T06:08:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 client.15438 shutdown 2024-09-19T06:08:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 -- 172.21.15.103:0/1165885660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a91a90 msgr2=0x5614f2aa0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a91a90 0x5614f2aa0870 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa480005c10 tx=0x7fa480012f80 comp rx=0 tx=0).stop 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 -- 172.21.15.103:0/1165885660 shutdown_connections 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5614f2aa5920 0x5614f2b13170 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614f2a91a90 0x5614f2aa0870 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5614f2a82ca0 0x5614f2aa0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa471ffb640 0 client.15438 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 --2- 172.21.15.103:0/1165885660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614f2a82380 0x5614f2a9fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 -- 172.21.15.103:0/1165885660 >> 172.21.15.103:0/1165885660 conn(0x5614f2a7ea30 msgr2=0x5614f2a7d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 -- 172.21.15.103:0/1165885660 shutdown_connections 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 1 -- 172.21.15.103:0/1165885660 wait complete. 2024-09-19T06:08:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.109+0000 7fa4927e6740 20 client.15438 trim_cache size 0 max 16384 2024-09-19T06:08:01.117 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:08:01.117 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-19T06:08:01.117 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-09-19T06:08:01.117 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:08:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 -- 172.21.15.103:0/3295124203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa4740a34c0 msgr2=0x7fa4740a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa4740a34c0 0x7fa4740a5980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa48001d000 tx=0x7fa48001f000 comp rx=0 tx=0).stop 2024-09-19T06:08:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 -- 172.21.15.103:0/3295124203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa488102d90 msgr2=0x7fa488198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa488102d90 0x7fa488198500 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa48400d950 tx=0x7fa48400de10 comp rx=0 tx=0).stop 2024-09-19T06:08:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 -- 172.21.15.103:0/3295124203 shutdown_connections 2024-09-19T06:08:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa4740a34c0 0x7fa4740a5980 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa488108290 0x7fa48819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488103740 0x7fa488198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 --2- 172.21.15.103:0/3295124203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa488102d90 0x7fa488198500 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 -- 172.21.15.103:0/3295124203 >> 172.21.15.103:0/3295124203 conn(0x7fa4880fc7d0 msgr2=0x7fa488105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 -- 172.21.15.103:0/3295124203 shutdown_connections 2024-09-19T06:08:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:01.110+0000 7fa49040d640 1 -- 172.21.15.103:0/3295124203 wait complete. 2024-09-19T06:08:01.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:00 smithi174 ceph-mon[34488]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:08:01.910 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:08:01.910 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:08:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:02.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.756+0000 7f5a815b5640 1 -- 172.21.15.103:0/901882814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c102570 msgr2=0x7f5a7c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:02.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.756+0000 7f5a815b5640 1 --2- 172.21.15.103:0/901882814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c102570 0x7f5a7c1029b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009900 tx=0x7f5a7002a480 comp rx=0 tx=0).stop 2024-09-19T06:08:02.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.756+0000 7f5a815b5640 1 -- 172.21.15.103:0/901882814 shutdown_connections 2024-09-19T06:08:02.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.756+0000 7f5a815b5640 1 --2- 172.21.15.103:0/901882814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a7c102ef0 0x7f5a7c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:02.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.756+0000 7f5a815b5640 1 --2- 172.21.15.103:0/901882814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c102570 0x7f5a7c1029b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:02.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.756+0000 7f5a815b5640 1 --2- 172.21.15.103:0/901882814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a7c100e20 0x7f5a7c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:02.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.756+0000 7f5a815b5640 1 -- 172.21.15.103:0/901882814 >> 172.21.15.103:0/901882814 conn(0x7f5a7c0fc7d0 msgr2=0x7f5a7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:02.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.756+0000 7f5a815b5640 1 -- 172.21.15.103:0/901882814 shutdown_connections 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.756+0000 7f5a815b5640 1 -- 172.21.15.103:0/901882814 wait complete. 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.757+0000 7f5a815b5640 1 Processor -- start 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.757+0000 7f5a815b5640 1 -- start start 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.757+0000 7f5a815b5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a7c100e20 0x7f5a7c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.757+0000 7f5a815b5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a7c102570 0x7f5a7c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.757+0000 7f5a815b5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c102ef0 0x7f5a7c1a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.757+0000 7f5a815b5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c110e30 con 0x7f5a7c102ef0 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a815b5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c110cb0 con 0x7f5a7c102570 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a815b5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c110fb0 con 0x7f5a7c100e20 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c102ef0 0x7f5a7c1a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c102ef0 0x7f5a7c1a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34624/0 (socket says 172.21.15.103:34624) 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7b7fe640 1 -- 172.21.15.103:0/1596487834 learned_addr learned my addr 172.21.15.103:0/1596487834 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7affd640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a7c100e20 0x7f5a7c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7a7fc640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a7c102570 0x7f5a7c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7b7fe640 1 -- 172.21.15.103:0/1596487834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a7c100e20 msgr2=0x7f5a7c199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7b7fe640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a7c100e20 0x7f5a7c199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7b7fe640 1 -- 172.21.15.103:0/1596487834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a7c102570 msgr2=0x7f5a7c199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7b7fe640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a7c102570 0x7f5a7c199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7b7fe640 1 -- 172.21.15.103:0/1596487834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c1a47c0 con 0x7f5a7c102ef0 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.758+0000 7f5a7b7fe640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c102ef0 0x7f5a7c1a4280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400cce0 tx=0x7f5a7400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.759+0000 7f5a63fff640 1 -- 172.21.15.103:0/1596487834 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400f450 con 0x7f5a7c102ef0 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.759+0000 7f5a815b5640 1 -- 172.21.15.103:0/1596487834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c1a4990 con 0x7f5a7c102ef0 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.759+0000 7f5a63fff640 1 -- 172.21.15.103:0/1596487834 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a7400faa0 con 0x7f5a7c102ef0 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.759+0000 7f5a63fff640 1 -- 172.21.15.103:0/1596487834 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74018b70 con 0x7f5a7c102ef0 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.760+0000 7f5a815b5640 1 -- 172.21.15.103:0/1596487834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c1a4e50 con 0x7f5a7c102ef0 2024-09-19T06:08:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.761+0000 7f5a815b5640 1 -- 172.21.15.103:0/1596487834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7c101200 con 0x7f5a7c102ef0 2024-09-19T06:08:02.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.761+0000 7f5a63fff640 1 -- 172.21.15.103:0/1596487834 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7f5a74018d10 con 0x7f5a7c102ef0 2024-09-19T06:08:02.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.762+0000 7f5a63fff640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5a640a3550 0x7f5a640a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:02.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.763+0000 7f5a63fff640 1 -- 172.21.15.103:0/1596487834 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f5a740d0270 con 0x7f5a7c102ef0 2024-09-19T06:08:02.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.763+0000 7f5a7affd640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5a640a3550 0x7f5a640a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:02.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.763+0000 7f5a7affd640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5a640a3550 0x7f5a640a5a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00bbe0 tx=0x7f5a6c00b390 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:02.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:02.767+0000 7f5a63fff640 1 -- 172.21.15.103:0/1596487834 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a74014030 con 0x7f5a7c102ef0 2024-09-19T06:08:02.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:02 smithi103 ceph-mon[30925]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T06:08:02.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:02 smithi103 ceph-mon[30925]: mgrmap e25: x(active, since 42s), standbys: y, z 2024-09-19T06:08:03.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.002+0000 7f5a815b5640 1 -- 172.21.15.103:0/1596487834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a7c109090 con 0x7f5a7c102ef0 2024-09-19T06:08:03.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.003+0000 7f5a63fff640 1 -- 172.21.15.103:0/1596487834 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11933 (secure 0 0 0) 0x7f5a7409ca50 con 0x7f5a7c102ef0 2024-09-19T06:08:03.005 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:08:03.005 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-09-19T06:07:18:721714+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:07:18.671540+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24488,24475,24463]},"id":1}]} 2024-09-19T06:08:03.006 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-19T06:08:03.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 -- 172.21.15.103:0/1596487834 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5a640a3550 msgr2=0x7f5a640a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:03.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5a640a3550 0x7f5a640a5a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00bbe0 tx=0x7f5a6c00b390 comp rx=0 tx=0).stop 2024-09-19T06:08:03.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 -- 172.21.15.103:0/1596487834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c102ef0 msgr2=0x7f5a7c1a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:03.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c102ef0 0x7f5a7c1a4280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400cce0 tx=0x7f5a7400a620 comp rx=0 tx=0).stop 2024-09-19T06:08:03.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 -- 172.21.15.103:0/1596487834 shutdown_connections 2024-09-19T06:08:03.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5a640a3550 0x7f5a640a5a10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c102ef0 0x7f5a7c1a4280 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a7c102570 0x7f5a7c199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 --2- 172.21.15.103:0/1596487834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a7c100e20 0x7f5a7c199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 -- 172.21.15.103:0/1596487834 >> 172.21.15.103:0/1596487834 conn(0x7f5a7c0fc7d0 msgr2=0x7f5a7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:03.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 -- 172.21.15.103:0/1596487834 shutdown_connections 2024-09-19T06:08:03.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:03.005+0000 7f5a815b5640 1 -- 172.21.15.103:0/1596487834 wait complete. 2024-09-19T06:08:03.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:02 smithi174 ceph-mon[34488]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T06:08:03.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:02 smithi174 ceph-mon[34488]: mgrmap e25: x(active, since 42s), standbys: y, z 2024-09-19T06:08:03.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:02 smithi169 ceph-mon[34350]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T06:08:03.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:02 smithi169 ceph-mon[34350]: mgrmap e25: x(active, since 42s), standbys: y, z 2024-09-19T06:08:03.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:08:03.954 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:03.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:03 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1596487834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:08:04.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:03 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1596487834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:08:04.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:03 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1596487834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:08:04.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.475+0000 7fbe98e48640 1 -- 172.21.15.103:0/1543831175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9410e7f0 msgr2=0x7fbe94110be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.475+0000 7fbe98e48640 1 --2- 172.21.15.103:0/1543831175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9410e7f0 0x7fbe94110be0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009ca0 tx=0x7fbe8c02a8b0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.475+0000 7fbe98e48640 1 -- 172.21.15.103:0/1543831175 shutdown_connections 2024-09-19T06:08:04.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.475+0000 7fbe98e48640 1 --2- 172.21.15.103:0/1543831175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9410e7f0 0x7fbe94110be0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.475+0000 7fbe98e48640 1 --2- 172.21.15.103:0/1543831175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe94102fa0 0x7fbe941005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.475+0000 7fbe98e48640 1 --2- 172.21.15.103:0/1543831175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe94102b30 0x7fbe94100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.475+0000 7fbe98e48640 1 -- 172.21.15.103:0/1543831175 >> 172.21.15.103:0/1543831175 conn(0x7fbe940fbee0 msgr2=0x7fbe940fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.475+0000 7fbe98e48640 1 -- 172.21.15.103:0/1543831175 shutdown_connections 2024-09-19T06:08:04.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.475+0000 7fbe98e48640 1 -- 172.21.15.103:0/1543831175 wait complete. 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.476+0000 7fbe98e48640 1 Processor -- start 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.476+0000 7fbe98e48640 1 -- start start 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.476+0000 7fbe98e48640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe94102b30 0x7fbe9419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.476+0000 7fbe98e48640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe9410e7f0 0x7fbe9419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.476+0000 7fbe98e48640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9419edb0 0x7fbe9419f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.476+0000 7fbe98e48640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94114060 con 0x7fbe9419edb0 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.476+0000 7fbe98e48640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94113ee0 con 0x7fbe94102b30 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.476+0000 7fbe98e48640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941141e0 con 0x7fbe9410e7f0 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe92d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9419edb0 0x7fbe9419f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe92d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9419edb0 0x7fbe9419f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34648/0 (socket says 172.21.15.103:34648) 2024-09-19T06:08:04.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe92d9d640 1 -- 172.21.15.103:0/1153695769 learned_addr learned my addr 172.21.15.103:0/1153695769 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe9259c640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe94102b30 0x7fbe9419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe91d9b640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe9410e7f0 0x7fbe9419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe92d9d640 1 -- 172.21.15.103:0/1153695769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe9410e7f0 msgr2=0x7fbe9419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe9410e7f0 0x7fbe9419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe92d9d640 1 -- 172.21.15.103:0/1153695769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe94102b30 msgr2=0x7fbe9419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe94102b30 0x7fbe9419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe92d9d640 1 -- 172.21.15.103:0/1153695769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9419f870 con 0x7fbe9419edb0 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe9259c640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe94102b30 0x7fbe9419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9419edb0 0x7fbe9419f260 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005cc0 tx=0x7fbe8c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.477+0000 7fbe837fe640 1 -- 172.21.15.103:0/1153695769 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c004040 con 0x7fbe9419edb0 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.478+0000 7fbe98e48640 1 -- 172.21.15.103:0/1153695769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9419fb00 con 0x7fbe9419edb0 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.478+0000 7fbe98e48640 1 -- 172.21.15.103:0/1153695769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe941a7340 con 0x7fbe9419edb0 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.478+0000 7fbe837fe640 1 -- 172.21.15.103:0/1153695769 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe8c040070 con 0x7fbe9419edb0 2024-09-19T06:08:04.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.478+0000 7fbe837fe640 1 -- 172.21.15.103:0/1153695769 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c03ca30 con 0x7fbe9419edb0 2024-09-19T06:08:04.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.480+0000 7fbe9b221740 1 Processor -- start 2024-09-19T06:08:04.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.481+0000 7fbe837fe640 1 -- 172.21.15.103:0/1153695769 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7fbe8c03ccd0 con 0x7fbe9419edb0 2024-09-19T06:08:04.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.481+0000 7fbe9b221740 1 -- start start 2024-09-19T06:08:04.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbbd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbbda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9b221740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b9ffb232f0 con 0x55b9ffbc8370 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9b221740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b9ffacacf0 con 0x55b9ffbbeb40 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9b221740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b9ffb1f2b0 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe91d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbbda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbbda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:53966/0 (socket says 172.21.15.103:53966) 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9259c640 1 -- 172.21.15.103:0/3437307228 learned_addr learned my addr 172.21.15.103:0/3437307228 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9259c640 1 -- 172.21.15.103:0/3437307228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbeb40 msgr2=0x55b9ffbbd090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9259c640 1 --2- 172.21.15.103:0/3437307228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbbd090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9259c640 1 -- 172.21.15.103:0/3437307228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 msgr2=0x55b9ffbca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9259c640 1 --2- 172.21.15.103:0/3437307228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe9259c640 1 -- 172.21.15.103:0/3437307228 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ffaaf3a0 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.482+0000 7fbe91d9b640 1 --2- 172.21.15.103:0/3437307228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.483+0000 7fbe837fe640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbe7c0a3550 0x7fbe7c0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.483+0000 7fbe837fe640 1 -- 172.21.15.103:0/1153695769 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fbe8c0f0bb0 con 0x7fbe9419edb0 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.483+0000 7fbe91d9b640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbe7c0a3550 0x7fbe7c0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.483+0000 7fbe9259c640 1 --2- 172.21.15.103:0/3437307228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbbda10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe840115f0 tx=0x7fbe84011ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e746a2167f601d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.484+0000 7fbe80ff9640 1 -- 172.21.15.103:0/3437307228 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8401e070 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.484+0000 7fbe80ff9640 1 -- 172.21.15.103:0/3437307228 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe8400faf0 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.484+0000 7fbe80ff9640 1 -- 172.21.15.103:0/3437307228 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84019b20 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.485+0000 7fbe9b221740 1 -- 172.21.15.103:0/3437307228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbd5d0 msgr2=0x55b9ffbbda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.485+0000 7fbe9b221740 1 --2- 172.21.15.103:0/3437307228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbbda10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe840115f0 tx=0x7fbe84011ab0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.485+0000 7fbe91d9b640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbe7c0a3550 0x7fbe7c0a5a10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55b9ffbbe070 tx=0x7fbe8800b6b0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.485+0000 7fbe9b221740 1 -- 172.21.15.103:0/3437307228 shutdown_connections 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.485+0000 7fbe9b221740 1 --2- 172.21.15.103:0/3437307228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.485+0000 7fbe9b221740 1 --2- 172.21.15.103:0/3437307228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbbda10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.485+0000 7fbe9b221740 1 --2- 172.21.15.103:0/3437307228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.485+0000 7fbe9b221740 1 -- 172.21.15.103:0/3437307228 >> 172.21.15.103:0/3437307228 conn(0x55b9ffb86310 msgr2=0x55b9ffbb9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.485+0000 7fbe9b221740 1 -- 172.21.15.103:0/3437307228 shutdown_connections 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.485+0000 7fbe9b221740 1 -- 172.21.15.103:0/3437307228 wait complete. 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.486+0000 7fbe9b221740 1 -- start start 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.486+0000 7fbe9b221740 1 Processor -- start 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.486+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.486+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbc4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.486+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.486+0000 7fbe9b221740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b9ffbcb070 con 0x55b9ffbbeb40 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.486+0000 7fbe9b221740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b9ffade060 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.486+0000 7fbe9b221740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b9ffbcb1f0 con 0x55b9ffbc8370 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.486+0000 7fbe9b221740 10 client.0 _ll_register_callbacks cb 0x55b9ff8318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe92d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe9259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe91d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbc4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe92d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:53978/0 (socket says 172.21.15.103:53978) 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe92d9d640 1 -- 172.21.15.103:0/348271826 learned_addr learned my addr 172.21.15.103:0/348271826 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe92d9d640 1 -- 172.21.15.103:0/348271826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 msgr2=0x55b9ffbc7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe92d9d640 1 -- 172.21.15.103:0/348271826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbbeb40 msgr2=0x55b9ffbc4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbc4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe92d9d640 1 -- 172.21.15.103:0/348271826 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ff8943c0 con 0x55b9ffbc8370 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe91d9b640 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbc4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc5460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0bca40 tx=0x7fbe8c0bc760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c53ffaa441c3ba39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.487+0000 7fbe79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe79ffb640 1 -- 172.21.15.103:0/348271826 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0bd440 con 0x55b9ffbc8370 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe9b221740 1 -- 172.21.15.103:0/348271826 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe8400faf0 con 0x55b9ffbc8370 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe79ffb640 1 -- 172.21.15.103:0/348271826 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fbe8c0c5520 con 0x55b9ffbc8370 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe79ffb640 1 -- 172.21.15.103:0/348271826 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbe8c0bcd40 con 0x55b9ffbc8370 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe9b221740 10 client.25084 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe9b221740 1 -- 172.21.15.103:0/348271826 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b9ffbcb120 con 0x55b9ffbc8370 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe79ffb640 1 -- 172.21.15.103:0/348271826 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe8400faf0 con 0x55b9ffbc8370 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe79ffb640 1 -- 172.21.15.103:0/348271826 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbe8c04c020 con 0x55b9ffbc8370 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe9b221740 10 client.25084 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:04.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe9b221740 10 client.25084 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe9b221740 20 client.25084 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe9b221740 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b9ffbd7fc0 0x55b9ffbda440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe9b221740 4 client.25084 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.488+0000 7fbe9b221740 1 -- 172.21.15.103:0/348271826 --> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9ffb30860 con 0x55b9ffbd7fc0 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.489+0000 7fbe9259c640 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b9ffbd7fc0 0x55b9ffbda440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.489+0000 7fbe79ffb640 10 client.25084 ms_handle_connect on v2:172.21.15.174:6836/2575162107 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.489+0000 7fbe9259c640 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b9ffbd7fc0 0x55b9ffbda440 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=908f12987fe1c968 server_cookie=2d0943824239bb12 in_seq=0 out_seq=0 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.490+0000 7fbe79ffb640 1 -- 172.21.15.103:0/348271826 <== mds.2 v2:172.21.15.174:6836/2575162107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9ffb30860 con 0x55b9ffbd7fc0 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.490+0000 7fbe79ffb640 10 client.25084 handle_command_reply: tid=0 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.490+0000 7fbe9b221740 1 client.25084 shutdown 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.490+0000 7fbe9b221740 1 -- 172.21.15.103:0/348271826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbc8370 msgr2=0x55b9ffbc5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.490+0000 7fbe9b221740 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc5460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0bca40 tx=0x7fbe8c0bc760 comp rx=0 tx=0).stop 2024-09-19T06:08:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.490+0000 7fbe9b221740 1 -- 172.21.15.103:0/348271826 shutdown_connections 2024-09-19T06:08:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.490+0000 7fbe9b221740 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc5460 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.491+0000 7fbe9b221740 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b9ffbd7fc0 0x55b9ffbda440 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.491+0000 7fbe9b221740 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbc4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.491+0000 7fbe9b221740 1 --2- 172.21.15.103:0/348271826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.491+0000 7fbe79ffb640 0 client.25084 ms_handle_reset on v2:172.21.15.174:6836/2575162107 2024-09-19T06:08:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.491+0000 7fbe9b221740 1 -- 172.21.15.103:0/348271826 >> 172.21.15.103:0/348271826 conn(0x55b9ffb86310 msgr2=0x55b9ffbbf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.491+0000 7fbe9b221740 1 -- 172.21.15.103:0/348271826 shutdown_connections 2024-09-19T06:08:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.491+0000 7fbe9b221740 1 -- 172.21.15.103:0/348271826 wait complete. 2024-09-19T06:08:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.491+0000 7fbe9b221740 20 client.25084 trim_cache size 0 max 16384 2024-09-19T06:08:04.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.516+0000 7fbe9b221740 1 Processor -- start 2024-09-19T06:08:04.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.516+0000 7fbe9b221740 1 -- start start 2024-09-19T06:08:04.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.516+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.516+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbc9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.516+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe9b221740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbe74010ec0 con 0x55b9ffbc8370 2024-09-19T06:08:04.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe9b221740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400e790 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe9b221740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400c5e0 con 0x55b9ffbbeb40 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe92d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe92d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34662/0 (socket says 172.21.15.103:34662) 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe92d9d640 1 -- 172.21.15.103:0/1112731415 learned_addr learned my addr 172.21.15.103:0/1112731415 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe9259c640 1 --2- 172.21.15.103:0/1112731415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe91d9b640 1 --2- 172.21.15.103:0/1112731415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbc9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe92d9d640 1 -- 172.21.15.103:0/1112731415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 msgr2=0x55b9ffbc9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/1112731415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbc9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe92d9d640 1 -- 172.21.15.103:0/1112731415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 msgr2=0x55b9ffbc6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/1112731415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe92d9d640 1 -- 172.21.15.103:0/1112731415 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ffbb9ed0 con 0x55b9ffbc8370 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.517+0000 7fbe91d9b640 1 --2- 172.21.15.103:0/1112731415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbc9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:04.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.518+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/1112731415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc9ca0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0baff0 tx=0x7fbe8c0bc7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc964cfb2cda65f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.518+0000 7fbe7bfff640 1 -- 172.21.15.103:0/1112731415 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0c59b0 con 0x55b9ffbc8370 2024-09-19T06:08:04.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.518+0000 7fbe7bfff640 1 -- 172.21.15.103:0/1112731415 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe8c036040 con 0x55b9ffbc8370 2024-09-19T06:08:04.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.518+0000 7fbe7bfff640 1 -- 172.21.15.103:0/1112731415 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0c5520 con 0x55b9ffbc8370 2024-09-19T06:08:04.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 -- 172.21.15.103:0/1112731415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 msgr2=0x55b9ffbc9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 --2- 172.21.15.103:0/1112731415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc9ca0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0baff0 tx=0x7fbe8c0bc7d0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 -- 172.21.15.103:0/1112731415 shutdown_connections 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 --2- 172.21.15.103:0/1112731415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbc9ca0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 --2- 172.21.15.103:0/1112731415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbc9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 --2- 172.21.15.103:0/1112731415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 -- 172.21.15.103:0/1112731415 >> 172.21.15.103:0/1112731415 conn(0x55b9ffb86310 msgr2=0x55b9ffbc6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 -- 172.21.15.103:0/1112731415 shutdown_connections 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 -- 172.21.15.103:0/1112731415 wait complete. 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 -- start start 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.519+0000 7fbe9b221740 1 Processor -- start 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbd0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9b221740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbd0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9b221740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400cc50 con 0x55b9ffbc8370 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9b221740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400e0c0 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9b221740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400d320 con 0x55b9ffbbeb40 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9b221740 10 client.0 _ll_register_callbacks cb 0x7fbe8c030e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:40616/0 (socket says 172.21.15.103:40616) 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9259c640 1 -- 172.21.15.103:0/3322505803 learned_addr learned my addr 172.21.15.103:0/3322505803 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe91d9b640 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbd0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbd0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9259c640 1 -- 172.21.15.103:0/3322505803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 msgr2=0x55b9ffbd0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9259c640 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbd0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9259c640 1 -- 172.21.15.103:0/3322505803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 msgr2=0x55b9ffbd0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.520+0000 7fbe9259c640 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbd0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.521+0000 7fbe9259c640 1 -- 172.21.15.103:0/3322505803 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ffbd1090 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.521+0000 7fbe92d9d640 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbd0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:04.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.521+0000 7fbe9b221740 1 -- 172.21.15.103:0/3322505803 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe8c036040 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.521+0000 7fbe9259c640 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc2850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe840196d0 tx=0x7fbe84019530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d7f6a549a7c9a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.521+0000 7fbe79ffb640 10 client.25028 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:08:04.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.521+0000 7fbe79ffb640 1 -- 172.21.15.103:0/3322505803 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8401e040 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.521+0000 7fbe79ffb640 1 -- 172.21.15.103:0/3322505803 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fbe8400fe40 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.522+0000 7fbe79ffb640 1 -- 172.21.15.103:0/3322505803 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbe8400f640 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.522+0000 7fbe9b221740 10 client.25028 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.522+0000 7fbe9b221740 1 -- 172.21.15.103:0/3322505803 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55b9ffc42ce0 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.522+0000 7fbe79ffb640 1 -- 172.21.15.103:0/3322505803 <== mon.2 v2:172.21.15.169:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbe8400f7e0 con 0x55b9ffbbd5d0 2024-09-19T06:08:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.522+0000 7fbe9b221740 10 client.25028 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.522+0000 7fbe9b221740 10 client.25028 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.522+0000 7fbe9b221740 20 client.25028 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.522+0000 7fbe9b221740 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b9ffc42fc0 0x55b9ffc453f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.523+0000 7fbe9b221740 4 client.25028 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.523+0000 7fbe9b221740 1 -- 172.21.15.103:0/3322505803 --> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9ffb2ad70 con 0x55b9ffc42fc0 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.523+0000 7fbe91d9b640 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b9ffc42fc0 0x55b9ffc453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.523+0000 7fbe91d9b640 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b9ffc42fc0 0x55b9ffc453f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5335e55c21f3bc8b server_cookie=aae2d0b77660f805 in_seq=0 out_seq=0 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.523+0000 7fbe79ffb640 10 client.25028 ms_handle_connect on v2:172.21.15.174:6836/2575162107 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe79ffb640 1 -- 172.21.15.103:0/3322505803 <== mds.2 v2:172.21.15.174:6836/2575162107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9ffb2ad70 con 0x55b9ffc42fc0 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe79ffb640 10 client.25028 handle_command_reply: tid=0 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 client.25028 shutdown 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 -- 172.21.15.103:0/3322505803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 msgr2=0x55b9ffbc2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc2850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe840196d0 tx=0x7fbe84019530 comp rx=0 tx=0).stop 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 -- 172.21.15.103:0/3322505803 shutdown_connections 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55b9ffc42fc0 0x55b9ffc453f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b9ffbc8370 0x55b9ffbd0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b9ffbbeb40 0x55b9ffbd0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 --2- 172.21.15.103:0/3322505803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9ffbbd5d0 0x55b9ffbc2850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe79ffb640 0 client.25028 ms_handle_reset on v2:172.21.15.174:6836/2575162107 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 -- 172.21.15.103:0/3322505803 >> 172.21.15.103:0/3322505803 conn(0x55b9ffb86310 msgr2=0x55b9ffbc6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 -- 172.21.15.103:0/3322505803 shutdown_connections 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 1 -- 172.21.15.103:0/3322505803 wait complete. 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.524+0000 7fbe9b221740 20 client.25028 trim_cache size 0 max 16384 2024-09-19T06:08:04.530 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-09-19T06:08:04.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 -- 172.21.15.103:0/1153695769 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbe7c0a3550 msgr2=0x7fbe7c0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbe7c0a3550 0x7fbe7c0a5a10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55b9ffbbe070 tx=0x7fbe8800b6b0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 -- 172.21.15.103:0/1153695769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9419edb0 msgr2=0x7fbe9419f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9419edb0 0x7fbe9419f260 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005cc0 tx=0x7fbe8c0093d0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 -- 172.21.15.103:0/1153695769 shutdown_connections 2024-09-19T06:08:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbe7c0a3550 0x7fbe7c0a5a10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9419edb0 0x7fbe9419f260 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe9410e7f0 0x7fbe9419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 --2- 172.21.15.103:0/1153695769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe94102b30 0x7fbe9419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 -- 172.21.15.103:0/1153695769 >> 172.21.15.103:0/1153695769 conn(0x7fbe940fbee0 msgr2=0x7fbe9410eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 -- 172.21.15.103:0/1153695769 shutdown_connections 2024-09-19T06:08:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:04.525+0000 7fbe98e48640 1 -- 172.21.15.103:0/1153695769 wait complete. 2024-09-19T06:08:05.117 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:04 smithi103 ceph-mon[30925]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-19T06:08:05.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:04 smithi174 ceph-mon[34488]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-19T06:08:05.218 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:08:05.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:04 smithi169 ceph-mon[34350]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-19T06:08:05.588 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:06.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.099+0000 7f1102688640 1 -- 172.21.15.103:0/818129104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10fc102ef0 msgr2=0x7f10fc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.099+0000 7f1102688640 1 --2- 172.21.15.103:0/818129104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10fc102ef0 0x7f10fc10da40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009ca0 tx=0x7f10f402a950 comp rx=0 tx=0).stop 2024-09-19T06:08:06.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.099+0000 7f1102688640 1 -- 172.21.15.103:0/818129104 shutdown_connections 2024-09-19T06:08:06.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.099+0000 7f1102688640 1 --2- 172.21.15.103:0/818129104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10fc102ef0 0x7f10fc10da40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.099+0000 7f1102688640 1 --2- 172.21.15.103:0/818129104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10fc102570 0x7f10fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.099+0000 7f1102688640 1 --2- 172.21.15.103:0/818129104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10fc100e20 0x7f10fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.099+0000 7f1102688640 1 -- 172.21.15.103:0/818129104 >> 172.21.15.103:0/818129104 conn(0x7f10fc0fc7d0 msgr2=0x7f10fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:06.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.099+0000 7f1102688640 1 -- 172.21.15.103:0/818129104 shutdown_connections 2024-09-19T06:08:06.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.099+0000 7f1102688640 1 -- 172.21.15.103:0/818129104 wait complete. 2024-09-19T06:08:06.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f1102688640 1 Processor -- start 2024-09-19T06:08:06.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f1102688640 1 -- start start 2024-09-19T06:08:06.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f1102688640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10fc100e20 0x7f10fc10e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f1102688640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10fc102570 0x7f10fc10e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f1102688640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10fc102ef0 0x7f10fc10edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f1102688640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc111f40 con 0x7f10fc100e20 2024-09-19T06:08:06.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f1102688640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc111dc0 con 0x7f10fc102ef0 2024-09-19T06:08:06.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f1102688640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1120c0 con 0x7f10fc102570 2024-09-19T06:08:06.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f10fbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10fc100e20 0x7f10fc10e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f10fbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10fc100e20 0x7f10fc10e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34686/0 (socket says 172.21.15.103:34686) 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f10fbfff640 1 -- 172.21.15.103:0/1008133037 learned_addr learned my addr 172.21.15.103:0/1008133037 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.100+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10fc102570 0x7f10fc10e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f1100c25640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10fc102ef0 0x7f10fc10edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f10fb7fe640 1 -- 172.21.15.103:0/1008133037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10fc102ef0 msgr2=0x7f10fc10edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10fc102ef0 0x7f10fc10edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f10fb7fe640 1 -- 172.21.15.103:0/1008133037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10fc100e20 msgr2=0x7f10fc10e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10fc100e20 0x7f10fc10e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f10fb7fe640 1 -- 172.21.15.103:0/1008133037 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc1a6900 con 0x7f10fc102570 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f10fbfff640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10fc100e20 0x7f10fc10e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10fc102570 0x7f10fc10e890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f10f000e9f0 tx=0x7f10f000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f10f97fa640 1 -- 172.21.15.103:0/1008133037 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f000ccc0 con 0x7f10fc102570 2024-09-19T06:08:06.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f10f97fa640 1 -- 172.21.15.103:0/1008133037 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10f00108e0 con 0x7f10fc102570 2024-09-19T06:08:06.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f1102688640 1 -- 172.21.15.103:0/1008133037 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10fc1a6bf0 con 0x7f10fc102570 2024-09-19T06:08:06.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.101+0000 7f10f97fa640 1 -- 172.21.15.103:0/1008133037 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0018880 con 0x7f10fc102570 2024-09-19T06:08:06.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.102+0000 7f1102688640 1 -- 172.21.15.103:0/1008133037 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10fc1a7070 con 0x7f10fc102570 2024-09-19T06:08:06.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.105+0000 7f10f97fa640 1 -- 172.21.15.103:0/1008133037 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7f10f0010a90 con 0x7f10fc102570 2024-09-19T06:08:06.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f1104a61740 1 Processor -- start 2024-09-19T06:08:06.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f1104a61740 1 -- start start 2024-09-19T06:08:06.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f10f97fa640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10e40a3550 0x7f10e40a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f1104a61740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f1104a61740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084bda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f1104a61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 0x563d084ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f1104a61740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563d084232f0 con 0x563d084bd5d0 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f1104a61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563d083cacf0 con 0x563d084c8370 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f1104a61740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563d0841f2b0 con 0x563d084beb40 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f10f97fa640 1 -- 172.21.15.103:0/1008133037 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f10f00d02b0 con 0x7f10fc102570 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.106+0000 7f10fbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f10fbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084bd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:54036/0 (socket says 172.21.15.103:54036) 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f10fbfff640 1 -- 172.21.15.103:0/1299542176 learned_addr learned my addr 172.21.15.103:0/1299542176 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f1100c25640 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 0x563d084ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f10fbfff640 1 -- 172.21.15.103:0/1299542176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 msgr2=0x563d084ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f10fbfff640 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 0x563d084ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f10fbfff640 1 -- 172.21.15.103:0/1299542176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 msgr2=0x563d084bda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084bda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f10fbfff640 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084bda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f10fbfff640 1 -- 172.21.15.103:0/1299542176 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d083af3a0 con 0x563d084beb40 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f1100c25640 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 0x563d084ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f1100c25640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10e40a3550 0x7f10e40a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084bda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.107+0000 7f10fbfff640 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084bd090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009fd0 tx=0x7f10ec011ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3925c0cfd694ea0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.108+0000 7f10e27fc640 1 -- 172.21.15.103:0/1299542176 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec01e070 con 0x563d084beb40 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.108+0000 7f10e27fc640 1 -- 172.21.15.103:0/1299542176 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10ec00fba0 con 0x563d084beb40 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.108+0000 7f1100c25640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10e40a3550 0x7f10e40a5a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f10f4004af0 tx=0x7f10f402a950 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.108+0000 7f10e27fc640 1 -- 172.21.15.103:0/1299542176 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec019cd0 con 0x563d084beb40 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.109+0000 7f1104a61740 1 -- 172.21.15.103:0/1299542176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 msgr2=0x563d084bd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.109+0000 7f1104a61740 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084bd090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009fd0 tx=0x7f10ec011ae0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.109+0000 7f1104a61740 1 -- 172.21.15.103:0/1299542176 shutdown_connections 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.109+0000 7f1104a61740 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 0x563d084ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.109+0000 7f1104a61740 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084bda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.109+0000 7f1104a61740 1 --2- 172.21.15.103:0/1299542176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084bd090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.109+0000 7f1104a61740 1 -- 172.21.15.103:0/1299542176 >> 172.21.15.103:0/1299542176 conn(0x563d08486310 msgr2=0x563d084b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.109+0000 7f1104a61740 1 -- 172.21.15.103:0/1299542176 shutdown_connections 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.109+0000 7f1104a61740 1 -- 172.21.15.103:0/1299542176 wait complete. 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.109+0000 7f1104a61740 1 -- start start 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f1104a61740 1 Processor -- start 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f1104a61740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f1104a61740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f1104a61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 0x563d084c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f1104a61740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563d084cb070 con 0x563d084bd5d0 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f1104a61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563d083de060 con 0x563d084c8370 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f1104a61740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563d084cb1f0 con 0x563d084beb40 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f1104a61740 10 client.0 _ll_register_callbacks cb 0x563d081318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f10fb7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f10fbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f10fbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34702/0 (socket says 172.21.15.103:34702) 2024-09-19T06:08:06.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f10fbfff640 1 -- 172.21.15.103:0/3966207429 learned_addr learned my addr 172.21.15.103:0/3966207429 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.110+0000 7f1100c25640 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 0x563d084c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10fb7fe640 1 -- 172.21.15.103:0/3966207429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 msgr2=0x563d084c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 0x563d084c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10fb7fe640 1 -- 172.21.15.103:0/3966207429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 msgr2=0x563d084c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10fb7fe640 1 -- 172.21.15.103:0/3966207429 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d081943c0 con 0x563d084beb40 2024-09-19T06:08:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10fbfff640 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084c4f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10f00cd870 tx=0x7f10f009bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af8da5743a9ef0cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10db7fe640 1 -- 172.21.15.103:0/3966207429 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0010630 con 0x563d084beb40 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f1104a61740 1 -- 172.21.15.103:0/3966207429 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10ec00fba0 con 0x563d084beb40 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10db7fe640 1 -- 172.21.15.103:0/3966207429 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f10f00cdb50 con 0x563d084beb40 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f10db7fe640 1 -- 172.21.15.103:0/3966207429 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f10f00a4fa0 con 0x563d084beb40 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f1104a61740 10 client.25099 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.111+0000 7f1104a61740 1 -- 172.21.15.103:0/3966207429 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563d084df1b0 con 0x563d084beb40 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.112+0000 7f10db7fe640 1 -- 172.21.15.103:0/3966207429 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10ec00fba0 con 0x563d084beb40 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.112+0000 7f10db7fe640 1 -- 172.21.15.103:0/3966207429 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f10f00bc260 con 0x563d084beb40 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.112+0000 7f1104a61740 10 client.25099 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.112+0000 7f1104a61740 10 client.25099 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:08:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.112+0000 7f1104a61740 20 client.25099 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.112+0000 7f1104a61740 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x563d084e0610 0x563d084e2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.112+0000 7f1104a61740 4 client.25099 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.112+0000 7f1104a61740 1 -- 172.21.15.103:0/3966207429 --> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d08430860 con 0x563d084e0610 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.112+0000 7f10fbfff640 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x563d084e0610 0x563d084e2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.112+0000 7f10db7fe640 10 client.25099 ms_handle_connect on v2:172.21.15.174:6838/1070224661 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.113+0000 7f10fbfff640 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x563d084e0610 0x563d084e2a80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3919eee6c6c001a5 server_cookie=43894a19c69bc3be in_seq=0 out_seq=0 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f10db7fe640 1 -- 172.21.15.103:0/3966207429 <== mds.1 v2:172.21.15.174:6838/1070224661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d08430860 con 0x563d084e0610 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f10db7fe640 10 client.25099 handle_command_reply: tid=0 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 client.25099 shutdown 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 -- 172.21.15.103:0/3966207429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 msgr2=0x563d084c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084c4f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10f00cd870 tx=0x7f10f009bf80 comp rx=0 tx=0).stop 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 -- 172.21.15.103:0/3966207429 shutdown_connections 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x563d084e0610 0x563d084e2a80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f10db7fe640 0 client.25099 ms_handle_reset on v2:172.21.15.174:6838/1070224661 2024-09-19T06:08:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084c8370 0x563d084c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084c4f00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 --2- 172.21.15.103:0/3966207429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084bd5d0 0x563d084c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 -- 172.21.15.103:0/3966207429 >> 172.21.15.103:0/3966207429 conn(0x563d08486310 msgr2=0x563d084bf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 -- 172.21.15.103:0/3966207429 shutdown_connections 2024-09-19T06:08:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.114+0000 7f1104a61740 1 -- 172.21.15.103:0/3966207429 wait complete. 2024-09-19T06:08:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.115+0000 7f1104a61740 20 client.25099 trim_cache size 0 max 16384 2024-09-19T06:08:06.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.127+0000 7f1104a61740 1 Processor -- start 2024-09-19T06:08:06.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.127+0000 7f1104a61740 1 -- start start 2024-09-19T06:08:06.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1104a61740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084bd5d0 0x563d084d4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1104a61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084beb40 0x563d084e8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1104a61740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084e8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1104a61740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1add30 con 0x563d084c8370 2024-09-19T06:08:06.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1104a61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1ab600 con 0x563d084beb40 2024-09-19T06:08:06.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1104a61740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1a9470 con 0x563d084bd5d0 2024-09-19T06:08:06.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1100c25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1100c25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084e8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34710/0 (socket says 172.21.15.103:34710) 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1100c25640 1 -- 172.21.15.103:0/2656516303 learned_addr learned my addr 172.21.15.103:0/2656516303 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f10fbfff640 1 --2- 172.21.15.103:0/2656516303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084bd5d0 0x563d084d4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/2656516303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084beb40 0x563d084e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1100c25640 1 -- 172.21.15.103:0/2656516303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084bd5d0 msgr2=0x563d084d4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1100c25640 1 --2- 172.21.15.103:0/2656516303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084bd5d0 0x563d084d4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1100c25640 1 -- 172.21.15.103:0/2656516303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084beb40 msgr2=0x563d084e8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1100c25640 1 --2- 172.21.15.103:0/2656516303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084beb40 0x563d084e8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1100c25640 1 -- 172.21.15.103:0/2656516303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d084e3100 con 0x563d084c8370 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.128+0000 7f1100c25640 1 --2- 172.21.15.103:0/2656516303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084e8890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009ca0 tx=0x7f10f403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986a1dea5bff13d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.129+0000 7f10e1ffb640 1 -- 172.21.15.103:0/2656516303 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4034040 con 0x563d084c8370 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.129+0000 7f10e1ffb640 1 -- 172.21.15.103:0/2656516303 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10f4003b70 con 0x563d084c8370 2024-09-19T06:08:06.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.129+0000 7f10e1ffb640 1 -- 172.21.15.103:0/2656516303 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f403b680 con 0x563d084c8370 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.130+0000 7f1104a61740 1 -- 172.21.15.103:0/2656516303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 msgr2=0x563d084e8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.130+0000 7f1104a61740 1 --2- 172.21.15.103:0/2656516303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084e8890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009ca0 tx=0x7f10f403e040 comp rx=0 tx=0).stop 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.130+0000 7f1104a61740 1 -- 172.21.15.103:0/2656516303 shutdown_connections 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.130+0000 7f1104a61740 1 --2- 172.21.15.103:0/2656516303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084e8890 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.130+0000 7f1104a61740 1 --2- 172.21.15.103:0/2656516303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084beb40 0x563d084e8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.130+0000 7f1104a61740 1 --2- 172.21.15.103:0/2656516303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084bd5d0 0x563d084d4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.130+0000 7f1104a61740 1 -- 172.21.15.103:0/2656516303 >> 172.21.15.103:0/2656516303 conn(0x563d08486310 msgr2=0x563d084c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.130+0000 7f1104a61740 1 -- 172.21.15.103:0/2656516303 shutdown_connections 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.130+0000 7f1104a61740 1 -- 172.21.15.103:0/2656516303 wait complete. 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.130+0000 7f1104a61740 1 -- start start 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.131+0000 7f1104a61740 1 Processor -- start 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.131+0000 7f1104a61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084bd5d0 0x563d084d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.131+0000 7f1104a61740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1104a61740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1104a61740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1a9ac0 con 0x563d084c8370 2024-09-19T06:08:06.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1104a61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1aaf30 con 0x563d084bd5d0 2024-09-19T06:08:06.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1100c25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1100c25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34726/0 (socket says 172.21.15.103:34726) 2024-09-19T06:08:06.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1100c25640 1 -- 172.21.15.103:0/1525988324 learned_addr learned my addr 172.21.15.103:0/1525988324 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:06.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f10fbfff640 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084bd5d0 0x563d084d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f10fb7fe640 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1104a61740 1 -- 172.21.15.103:0/1525988324 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1aa190 con 0x563d084beb40 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1104a61740 10 client.0 _ll_register_callbacks cb 0x7f10f00985d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1100c25640 1 -- 172.21.15.103:0/1525988324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 msgr2=0x563d084cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1100c25640 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1100c25640 1 -- 172.21.15.103:0/1525988324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084bd5d0 msgr2=0x563d084d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1100c25640 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084bd5d0 0x563d084d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1100c25640 1 -- 172.21.15.103:0/1525988324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d084cc910 con 0x563d084c8370 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.132+0000 7f1104a61740 1 -- 172.21.15.103:0/1525988324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10f4003b70 con 0x563d084c8370 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.133+0000 7f1100c25640 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084cc2d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f10f4030040 tx=0x7f10f4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac37f29a6953ee01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.133+0000 7f10db7fe640 10 client.15474 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.133+0000 7f10db7fe640 1 -- 172.21.15.103:0/1525988324 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4034070 con 0x563d084c8370 2024-09-19T06:08:06.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.133+0000 7f10db7fe640 1 -- 172.21.15.103:0/1525988324 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f10f405d450 con 0x563d084c8370 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.133+0000 7f10db7fe640 1 -- 172.21.15.103:0/1525988324 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f10f405d650 con 0x563d084c8370 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.133+0000 7f1104a61740 10 client.15474 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.133+0000 7f1104a61740 1 -- 172.21.15.103:0/1525988324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=25}) -- 0x563d0854aff0 con 0x563d084c8370 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.134+0000 7f10db7fe640 1 -- 172.21.15.103:0/1525988324 <== mon.0 v2:172.21.15.103:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f10f405d7f0 con 0x563d084c8370 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.134+0000 7f1104a61740 10 client.15474 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.134+0000 7f1104a61740 10 client.15474 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.134+0000 7f1104a61740 20 client.15474 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.134+0000 7f1104a61740 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x563d0854b460 0x563d0854d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.134+0000 7f1104a61740 4 client.15474 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.134+0000 7f1104a61740 1 -- 172.21.15.103:0/1525988324 --> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d0842ad70 con 0x563d0854b460 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.134+0000 7f10fbfff640 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x563d0854b460 0x563d0854d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.134+0000 7f10fbfff640 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x563d0854b460 0x563d0854d850 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37a4f051fca82a14 server_cookie=b9daac599f6aabd9 in_seq=0 out_seq=0 2024-09-19T06:08:06.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.134+0000 7f10db7fe640 10 client.15474 ms_handle_connect on v2:172.21.15.174:6838/1070224661 2024-09-19T06:08:06.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f10db7fe640 1 -- 172.21.15.103:0/1525988324 <== mds.1 v2:172.21.15.174:6838/1070224661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d0842ad70 con 0x563d0854b460 2024-09-19T06:08:06.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f10db7fe640 10 client.15474 handle_command_reply: tid=0 2024-09-19T06:08:06.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f1104a61740 1 client.15474 shutdown 2024-09-19T06:08:06.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f1104a61740 1 -- 172.21.15.103:0/1525988324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 msgr2=0x563d084cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f1104a61740 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084cc2d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f10f4030040 tx=0x7f10f4004610 comp rx=0 tx=0).stop 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f1104a61740 1 -- 172.21.15.103:0/1525988324 shutdown_connections 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f1104a61740 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d084c8370 0x563d084cc2d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f1104a61740 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d084beb40 0x563d084cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f1104a61740 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x563d0854b460 0x563d0854d850 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f10db7fe640 0 client.15474 ms_handle_reset on v2:172.21.15.174:6838/1070224661 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f1104a61740 1 --2- 172.21.15.103:0/1525988324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d084bd5d0 0x563d084d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f1104a61740 1 -- 172.21.15.103:0/1525988324 >> 172.21.15.103:0/1525988324 conn(0x563d08486310 msgr2=0x563d084c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.135+0000 7f1104a61740 1 -- 172.21.15.103:0/1525988324 shutdown_connections 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.136+0000 7f1104a61740 1 -- 172.21.15.103:0/1525988324 wait complete. 2024-09-19T06:08:06.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.136+0000 7f1104a61740 20 client.15474 trim_cache size 0 max 16384 2024-09-19T06:08:06.142 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-09-19T06:08:06.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 -- 172.21.15.103:0/1008133037 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10e40a3550 msgr2=0x7f10e40a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10e40a3550 0x7f10e40a5a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f10f4004af0 tx=0x7f10f402a950 comp rx=0 tx=0).stop 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 -- 172.21.15.103:0/1008133037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10fc102570 msgr2=0x7f10fc10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10fc102570 0x7f10fc10e890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f10f000e9f0 tx=0x7f10f000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 -- 172.21.15.103:0/1008133037 shutdown_connections 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10e40a3550 0x7f10e40a5a10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10fc102ef0 0x7f10fc10edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10fc102570 0x7f10fc10e890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 --2- 172.21.15.103:0/1008133037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10fc100e20 0x7f10fc10e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 -- 172.21.15.103:0/1008133037 >> 172.21.15.103:0/1008133037 conn(0x7f10fc0fc7d0 msgr2=0x7f10fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 -- 172.21.15.103:0/1008133037 shutdown_connections 2024-09-19T06:08:06.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:06.137+0000 7f1102688640 1 -- 172.21.15.103:0/1008133037 wait complete. 2024-09-19T06:08:06.873 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:06 smithi103 ceph-mon[30925]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T06:08:06.874 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:08:07.141 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:07.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:06 smithi174 ceph-mon[34488]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T06:08:07.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:06 smithi169 ceph-mon[34350]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T06:08:07.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.657+0000 7f9585cd0640 1 -- 172.21.15.103:0/2642922361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9580102570 msgr2=0x7f95801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:07.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.657+0000 7f9585cd0640 1 --2- 172.21.15.103:0/2642922361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9580102570 0x7f95801029b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9574009900 tx=0x7f957402a480 comp rx=0 tx=0).stop 2024-09-19T06:08:07.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.657+0000 7f9585cd0640 1 -- 172.21.15.103:0/2642922361 shutdown_connections 2024-09-19T06:08:07.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.657+0000 7f9585cd0640 1 --2- 172.21.15.103:0/2642922361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580102ef0 0x7f958010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.657+0000 7f9585cd0640 1 --2- 172.21.15.103:0/2642922361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9580102570 0x7f95801029b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.657+0000 7f9585cd0640 1 --2- 172.21.15.103:0/2642922361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9580100e20 0x7f9580101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.657+0000 7f9585cd0640 1 -- 172.21.15.103:0/2642922361 >> 172.21.15.103:0/2642922361 conn(0x7f95800fc7d0 msgr2=0x7f95800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:07.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.657+0000 7f9585cd0640 1 -- 172.21.15.103:0/2642922361 shutdown_connections 2024-09-19T06:08:07.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.657+0000 7f9585cd0640 1 -- 172.21.15.103:0/2642922361 wait complete. 2024-09-19T06:08:07.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f9585cd0640 1 Processor -- start 2024-09-19T06:08:07.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f9585cd0640 1 -- start start 2024-09-19T06:08:07.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f9585cd0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580100e20 0x7f958019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f9585cd0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9580102570 0x7f958019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f9585cd0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9580102ef0 0x7f958019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f9585cd0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f958010fd30 con 0x7f9580102570 2024-09-19T06:08:07.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f9585cd0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f958010fbb0 con 0x7f9580102ef0 2024-09-19T06:08:07.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f9585cd0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f958010feb0 con 0x7f9580100e20 2024-09-19T06:08:07.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f957effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9580102570 0x7f958019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f957effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9580102570 0x7f958019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34750/0 (socket says 172.21.15.103:34750) 2024-09-19T06:08:07.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.658+0000 7f957effd640 1 -- 172.21.15.103:0/1162622759 learned_addr learned my addr 172.21.15.103:0/1162622759 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:07.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.659+0000 7f957f7fe640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580100e20 0x7f958019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.659+0000 7f957ffff640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9580102ef0 0x7f958019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.659+0000 7f957effd640 1 -- 172.21.15.103:0/1162622759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580100e20 msgr2=0x7f958019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.659+0000 7f957effd640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580100e20 0x7f958019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.659+0000 7f957effd640 1 -- 172.21.15.103:0/1162622759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9580102ef0 msgr2=0x7f958019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.659+0000 7f957effd640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9580102ef0 0x7f958019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.659+0000 7f957effd640 1 -- 172.21.15.103:0/1162622759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958019f5f0 con 0x7f9580102570 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.659+0000 7f957effd640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9580102570 0x7f958019ab80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f957402aa70 tx=0x7f9574003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.659+0000 7f957cff9640 1 -- 172.21.15.103:0/1162622759 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957403f070 con 0x7f9580102570 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.659+0000 7f957cff9640 1 -- 172.21.15.103:0/1162622759 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f957403bb20 con 0x7f9580102570 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.660+0000 7f957cff9640 1 -- 172.21.15.103:0/1162622759 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574035030 con 0x7f9580102570 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.660+0000 7f9585cd0640 1 -- 172.21.15.103:0/1162622759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958019f880 con 0x7f9580102570 2024-09-19T06:08:07.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.660+0000 7f9585cd0640 1 -- 172.21.15.103:0/1162622759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95801a71c0 con 0x7f9580102570 2024-09-19T06:08:07.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.662+0000 7f957cff9640 1 -- 172.21.15.103:0/1162622759 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7f9574042070 con 0x7f9580102570 2024-09-19T06:08:07.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.663+0000 7f957cff9640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f95680a3550 0x7f95680a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.663+0000 7f95880a9740 1 Processor -- start 2024-09-19T06:08:07.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.663+0000 7f95880a9740 1 -- start start 2024-09-19T06:08:07.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.663+0000 7f957cff9640 1 -- 172.21.15.103:0/1162622759 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f95740f0480 con 0x7f9580102570 2024-09-19T06:08:07.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.663+0000 7f95880a9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736fb40 0x55ad6736e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.663+0000 7f95880a9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736e5d0 0x55ad6736ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.663+0000 7f95880a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad6737b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.663+0000 7f95880a9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ad672d42f0 con 0x55ad6736e5d0 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.663+0000 7f95880a9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ad6727bcf0 con 0x55ad6736fb40 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.663+0000 7f95880a9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ad672d02b0 con 0x55ad67379370 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957f7fe640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f95680a3550 0x7f95680a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736e5d0 0x55ad6736ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad6737b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736e5d0 0x55ad6736ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34764/0 (socket says 172.21.15.103:34764) 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957effd640 1 -- 172.21.15.103:0/3147915402 learned_addr learned my addr 172.21.15.103:0/3147915402 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad6737b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:54074/0 (socket says 172.21.15.103:54074) 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957f7fe640 1 --2- 172.21.15.103:0/3147915402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736fb40 0x55ad6736e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957ffff640 1 -- 172.21.15.103:0/3147915402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736fb40 msgr2=0x55ad6736e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957ffff640 1 --2- 172.21.15.103:0/3147915402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736fb40 0x55ad6736e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957ffff640 1 -- 172.21.15.103:0/3147915402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736e5d0 msgr2=0x55ad6736ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:07.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957ffff640 1 --2- 172.21.15.103:0/3147915402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736e5d0 0x55ad6736ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957ffff640 1 -- 172.21.15.103:0/3147915402 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad672603a0 con 0x55ad67379370 2024-09-19T06:08:07.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957f7fe640 1 --2- 172.21.15.103:0/3147915402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736fb40 0x55ad6736e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:07.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.664+0000 7f957effd640 1 --2- 172.21.15.103:0/3147915402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736e5d0 0x55ad6736ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.665+0000 7f957ffff640 1 --2- 172.21.15.103:0/3147915402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad6737b760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9578009fa0 tx=0x7f9578009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8219de735851773c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.665+0000 7f9565ffb640 1 -- 172.21.15.103:0/3147915402 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957801c070 con 0x55ad67379370 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.665+0000 7f957f7fe640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f95680a3550 0x7f95680a5a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f95700058a0 tx=0x7f957000b770 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.665+0000 7f9565ffb640 1 -- 172.21.15.103:0/3147915402 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9578017900 con 0x55ad67379370 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.665+0000 7f9565ffb640 1 -- 172.21.15.103:0/3147915402 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578016920 con 0x55ad67379370 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.666+0000 7f95880a9740 1 -- 172.21.15.103:0/3147915402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 msgr2=0x55ad6737b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.666+0000 7f95880a9740 1 --2- 172.21.15.103:0/3147915402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad6737b760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9578009fa0 tx=0x7f9578009500 comp rx=0 tx=0).stop 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.666+0000 7f95880a9740 1 -- 172.21.15.103:0/3147915402 shutdown_connections 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.666+0000 7f95880a9740 1 --2- 172.21.15.103:0/3147915402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad6737b760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.666+0000 7f95880a9740 1 --2- 172.21.15.103:0/3147915402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736e5d0 0x55ad6736ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.666+0000 7f95880a9740 1 --2- 172.21.15.103:0/3147915402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736fb40 0x55ad6736e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.666+0000 7f95880a9740 1 -- 172.21.15.103:0/3147915402 >> 172.21.15.103:0/3147915402 conn(0x55ad67337310 msgr2=0x55ad6736ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.666+0000 7f95880a9740 1 -- 172.21.15.103:0/3147915402 shutdown_connections 2024-09-19T06:08:07.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.666+0000 7f95880a9740 1 -- 172.21.15.103:0/3147915402 wait complete. 2024-09-19T06:08:07.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.666+0000 7f95880a9740 1 -- start start 2024-09-19T06:08:07.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f95880a9740 1 Processor -- start 2024-09-19T06:08:07.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f95880a9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67378d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f95880a9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad67376000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f95880a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad673765d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f957f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67378d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f957f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67378d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:40706/0 (socket says 172.21.15.103:40706) 2024-09-19T06:08:07.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f957f7fe640 1 -- 172.21.15.103:0/3180922335 learned_addr learned my addr 172.21.15.103:0/3180922335 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:07.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f957effd640 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad67376000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ad6737c070 con 0x55ad6736fb40 2024-09-19T06:08:07.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ad6728f060 con 0x55ad6736e5d0 2024-09-19T06:08:07.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ad6737c1f0 con 0x55ad67379370 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.667+0000 7f957ffff640 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad673765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f95880a9740 10 client.0 _ll_register_callbacks cb 0x55ad66fe28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f957f7fe640 1 -- 172.21.15.103:0/3180922335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 msgr2=0x55ad673765d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f957f7fe640 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad673765d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f957f7fe640 1 -- 172.21.15.103:0/3180922335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 msgr2=0x55ad67376000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f957f7fe640 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad67376000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f957f7fe640 1 -- 172.21.15.103:0/3180922335 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad670453c0 con 0x55ad6736e5d0 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9578017900 con 0x55ad6736e5d0 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f957f7fe640 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67378d50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95700106b0 tx=0x7f95700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9963279393ec5404 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f955effd640 10 client.25052 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f955effd640 1 -- 172.21.15.103:0/3180922335 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957001e6d0 con 0x55ad6736e5d0 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f955effd640 1 -- 172.21.15.103:0/3180922335 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f957001e870 con 0x55ad6736e5d0 2024-09-19T06:08:07.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f955effd640 1 -- 172.21.15.103:0/3180922335 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f957001ea70 con 0x55ad6736e5d0 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f95880a9740 10 client.25052 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.668+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55ad673879f0 con 0x55ad6736e5d0 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.669+0000 7f955effd640 1 -- 172.21.15.103:0/3180922335 <== mon.2 v2:172.21.15.169:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f957001ec10 con 0x55ad6736e5d0 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.669+0000 7f95880a9740 10 client.25052 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.669+0000 7f95880a9740 10 client.25052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.669+0000 7f95880a9740 20 client.25052 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.669+0000 7f95880a9740 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ad67388d90 0x55ad6738b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.669+0000 7f95880a9740 4 client.25052 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.669+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad672e1860 con 0x55ad67388d90 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.670+0000 7f957effd640 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ad67388d90 0x55ad6738b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.670+0000 7f957effd640 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ad67388d90 0x55ad6738b220 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a2421332b98a9b server_cookie=3114fd34eda405f7 in_seq=0 out_seq=0 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.670+0000 7f955effd640 10 client.25052 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:07.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f955effd640 1 -- 172.21.15.103:0/3180922335 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad672e1860 con 0x55ad67388d90 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f955effd640 10 client.25052 handle_command_reply: tid=0 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 client.25052 shutdown 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 msgr2=0x55ad67378d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67378d50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95700106b0 tx=0x7f95700046c0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 shutdown_connections 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ad67388d90 0x55ad6738b220 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad673765d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad67376000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 --2- 172.21.15.103:0/3180922335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67378d50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 >> 172.21.15.103:0/3180922335 conn(0x55ad67337310 msgr2=0x55ad67370960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f955effd640 0 client.25052 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 shutdown_connections 2024-09-19T06:08:07.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.671+0000 7f95880a9740 1 -- 172.21.15.103:0/3180922335 wait complete. 2024-09-19T06:08:07.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.672+0000 7f95880a9740 20 client.25052 trim_cache size 0 max 16384 2024-09-19T06:08:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f95880a9740 1 Processor -- start 2024-09-19T06:08:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f95880a9740 1 -- start start 2024-09-19T06:08:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f95880a9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67385310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f95880a9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad673758c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f95880a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad67371120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f95880a9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f95801b2110 con 0x55ad6736fb40 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f95880a9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f95801af9e0 con 0x55ad6736e5d0 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f95880a9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f95801ad830 con 0x55ad67379370 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f957effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad673758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f957effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad673758c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34772/0 (socket says 172.21.15.103:34772) 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f957effd640 1 -- 172.21.15.103:0/1177328818 learned_addr learned my addr 172.21.15.103:0/1177328818 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f957f7fe640 1 --2- 172.21.15.103:0/1177328818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67385310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.697+0000 7f957ffff640 1 --2- 172.21.15.103:0/1177328818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad67371120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.698+0000 7f957effd640 1 -- 172.21.15.103:0/1177328818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 msgr2=0x55ad67371120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.698+0000 7f957effd640 1 --2- 172.21.15.103:0/1177328818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad67371120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.698+0000 7f957effd640 1 -- 172.21.15.103:0/1177328818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 msgr2=0x55ad67385310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.698+0000 7f957effd640 1 --2- 172.21.15.103:0/1177328818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67385310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.698+0000 7f957effd640 1 -- 172.21.15.103:0/1177328818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad67374550 con 0x55ad6736fb40 2024-09-19T06:08:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.698+0000 7f957effd640 1 --2- 172.21.15.103:0/1177328818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad673758c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f95740edbb0 tx=0x7f957402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b529bd90ba26b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.698+0000 7f95657fa640 1 -- 172.21.15.103:0/1177328818 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574049040 con 0x55ad6736fb40 2024-09-19T06:08:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.698+0000 7f95657fa640 1 -- 172.21.15.103:0/1177328818 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95740d5070 con 0x55ad6736fb40 2024-09-19T06:08:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.698+0000 7f95657fa640 1 -- 172.21.15.103:0/1177328818 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95740c5070 con 0x55ad6736fb40 2024-09-19T06:08:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.699+0000 7f95880a9740 1 -- 172.21.15.103:0/1177328818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 msgr2=0x55ad673758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.699+0000 7f95880a9740 1 --2- 172.21.15.103:0/1177328818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad673758c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f95740edbb0 tx=0x7f957402a480 comp rx=0 tx=0).stop 2024-09-19T06:08:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.699+0000 7f95880a9740 1 -- 172.21.15.103:0/1177328818 shutdown_connections 2024-09-19T06:08:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.699+0000 7f95880a9740 1 --2- 172.21.15.103:0/1177328818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad67371120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.699+0000 7f95880a9740 1 --2- 172.21.15.103:0/1177328818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad673758c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.699+0000 7f95880a9740 1 --2- 172.21.15.103:0/1177328818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67385310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.699+0000 7f95880a9740 1 -- 172.21.15.103:0/1177328818 >> 172.21.15.103:0/1177328818 conn(0x55ad67337310 msgr2=0x55ad673748d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:07.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.699+0000 7f95880a9740 1 -- 172.21.15.103:0/1177328818 shutdown_connections 2024-09-19T06:08:07.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.699+0000 7f95880a9740 1 -- 172.21.15.103:0/1177328818 wait complete. 2024-09-19T06:08:07.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.700+0000 7f95880a9740 1 -- start start 2024-09-19T06:08:07.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.700+0000 7f95880a9740 1 Processor -- start 2024-09-19T06:08:07.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.700+0000 7f95880a9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67381a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f95880a9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad6737cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f95880a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad6737d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad6737cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67381a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad6737cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34786/0 (socket says 172.21.15.103:34786) 2024-09-19T06:08:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957effd640 1 -- 172.21.15.103:0/3409284203 learned_addr learned my addr 172.21.15.103:0/3409284203 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67381a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:40718/0 (socket says 172.21.15.103:40718) 2024-09-19T06:08:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f95801adea0 con 0x55ad6736fb40 2024-09-19T06:08:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f95801af310 con 0x55ad6736e5d0 2024-09-19T06:08:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f95801ae570 con 0x55ad67379370 2024-09-19T06:08:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f95880a9740 10 client.0 _ll_register_callbacks cb 0x7f957000eeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957ffff640 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad6737d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957f7fe640 1 -- 172.21.15.103:0/3409284203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 msgr2=0x55ad6737d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957f7fe640 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad6737d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957f7fe640 1 -- 172.21.15.103:0/3409284203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 msgr2=0x55ad6737cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957f7fe640 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad6737cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.701+0000 7f957f7fe640 1 -- 172.21.15.103:0/3409284203 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad6737d920 con 0x55ad6736e5d0 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.702+0000 7f957f7fe640 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67381a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f957001f010 tx=0x7f9570019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f9acc8bb978ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.702+0000 7f955effd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.702+0000 7f955effd640 1 -- 172.21.15.103:0/3409284203 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957003d020 con 0x55ad6736e5d0 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.702+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95740d5070 con 0x55ad6736e5d0 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.702+0000 7f955effd640 1 -- 172.21.15.103:0/3409284203 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f9570005220 con 0x55ad6736e5d0 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.702+0000 7f955effd640 1 -- 172.21.15.103:0/3409284203 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9570005420 con 0x55ad6736e5d0 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.702+0000 7f95880a9740 10 client.25055 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.702+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad673fc120 con 0x55ad6736e5d0 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.702+0000 7f955effd640 1 -- 172.21.15.103:0/3409284203 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95740d5070 con 0x55ad6736e5d0 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.702+0000 7f955effd640 1 -- 172.21.15.103:0/3409284203 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95700275a0 con 0x55ad6736e5d0 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.703+0000 7f95880a9740 10 client.25055 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.703+0000 7f95880a9740 10 client.25055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.703+0000 7f95880a9740 20 client.25055 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.703+0000 7f95880a9740 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ad673fc890 0x55ad673fec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.703+0000 7f95880a9740 4 client.25055 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.703+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad6736e420 con 0x55ad673fc890 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.703+0000 7f957effd640 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ad673fc890 0x55ad673fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f957effd640 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ad673fc890 0x55ad673fec80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=537a9eaae0a4baa8 server_cookie=1b9b16f75795a803 in_seq=0 out_seq=0 2024-09-19T06:08:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f955effd640 10 client.25055 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f955effd640 1 -- 172.21.15.103:0/3409284203 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad6736e420 con 0x55ad673fc890 2024-09-19T06:08:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f955effd640 10 client.25055 handle_command_reply: tid=0 2024-09-19T06:08:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 client.25055 shutdown 2024-09-19T06:08:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 msgr2=0x55ad67381a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67381a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f957001f010 tx=0x7f9570019000 comp rx=0 tx=0).stop 2024-09-19T06:08:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 shutdown_connections 2024-09-19T06:08:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ad673fc890 0x55ad673fec80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad67379370 0x55ad6737d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad6736fb40 0x55ad6737cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f955effd640 0 client.25055 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 --2- 172.21.15.103:0/3409284203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad6736e5d0 0x55ad67381a40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 >> 172.21.15.103:0/3409284203 conn(0x55ad67337310 msgr2=0x55ad67374890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 shutdown_connections 2024-09-19T06:08:07.711 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-09-19T06:08:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.704+0000 7f95880a9740 1 -- 172.21.15.103:0/3409284203 wait complete. 2024-09-19T06:08:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f95880a9740 20 client.25055 trim_cache size 0 max 16384 2024-09-19T06:08:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 -- 172.21.15.103:0/1162622759 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f95680a3550 msgr2=0x7f95680a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f95680a3550 0x7f95680a5a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f95700058a0 tx=0x7f957000b770 comp rx=0 tx=0).stop 2024-09-19T06:08:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 -- 172.21.15.103:0/1162622759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9580102570 msgr2=0x7f958019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9580102570 0x7f958019ab80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f957402aa70 tx=0x7f9574003c10 comp rx=0 tx=0).stop 2024-09-19T06:08:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 -- 172.21.15.103:0/1162622759 shutdown_connections 2024-09-19T06:08:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f95680a3550 0x7f95680a5a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9580102ef0 0x7f958019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9580102570 0x7f958019ab80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 --2- 172.21.15.103:0/1162622759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580100e20 0x7f958019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 -- 172.21.15.103:0/1162622759 >> 172.21.15.103:0/1162622759 conn(0x7f95800fc7d0 msgr2=0x7f95800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 -- 172.21.15.103:0/1162622759 shutdown_connections 2024-09-19T06:08:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:07.705+0000 7f9585cd0640 1 -- 172.21.15.103:0/1162622759 wait complete. 2024-09-19T06:08:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.942+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/1825764010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fe0100490 msgr2=0x7f7fe0100870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.942+0000 7f7fe4ff8640 1 --2- 172.21.15.103:0/1825764010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fe0100490 0x7f7fe0100870 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009900 tx=0x7f7fd002a410 comp rx=0 tx=0).stop 2024-09-19T06:08:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.943+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/1825764010 shutdown_connections 2024-09-19T06:08:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.943+0000 7f7fe4ff8640 1 --2- 172.21.15.103:0/1825764010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fe01026f0 0x7f7fe010d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.943+0000 7f7fe4ff8640 1 --2- 172.21.15.103:0/1825764010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe0101d70 0x7f7fe01021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.943+0000 7f7fe4ff8640 1 --2- 172.21.15.103:0/1825764010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fe0100490 0x7f7fe0100870 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.943+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/1825764010 >> 172.21.15.103:0/1825764010 conn(0x7f7fe00770f0 msgr2=0x7f7fe00fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.943+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/1825764010 shutdown_connections 2024-09-19T06:08:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.943+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/1825764010 wait complete. 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fe4ff8640 1 Processor -- start 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fe4ff8640 1 -- start start 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fe4ff8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fe0100490 0x7f7fe019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fe4ff8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fe0101d70 0x7f7fe019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fe4ff8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe01026f0 0x7f7fe019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fe4ff8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe0111e70 con 0x7f7fe0100490 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fe4ff8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe0111cf0 con 0x7f7fe0101d70 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fe4ff8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe0111ff0 con 0x7f7fe01026f0 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fde59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fe0100490 0x7f7fe019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fde59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fe0100490 0x7f7fe019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34800/0 (socket says 172.21.15.103:34800) 2024-09-19T06:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fded9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe01026f0 0x7f7fe019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fddd9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fe0101d70 0x7f7fe019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.944+0000 7f7fde59c640 1 -- 172.21.15.103:0/965661887 learned_addr learned my addr 172.21.15.103:0/965661887 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fded9d640 1 -- 172.21.15.103:0/965661887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fe0101d70 msgr2=0x7f7fe019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fded9d640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fe0101d70 0x7f7fe019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fded9d640 1 -- 172.21.15.103:0/965661887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fe0100490 msgr2=0x7f7fe019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fded9d640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fe0100490 0x7f7fe019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fded9d640 1 -- 172.21.15.103:0/965661887 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe019f530 con 0x7f7fe01026f0 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fde59c640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fe0100490 0x7f7fe019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fded9d640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe01026f0 0x7f7fe019ee00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800e940 tx=0x7f7fd800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fcf7fe640 1 -- 172.21.15.103:0/965661887 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8004d20 con 0x7f7fe01026f0 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/965661887 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe019f820 con 0x7f7fe01026f0 2024-09-19T06:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fcf7fe640 1 -- 172.21.15.103:0/965661887 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fd8005020 con 0x7f7fe01026f0 2024-09-19T06:08:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fcf7fe640 1 -- 172.21.15.103:0/965661887 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80116d0 con 0x7f7fe01026f0 2024-09-19T06:08:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.945+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/965661887 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe01a70b0 con 0x7f7fe01026f0 2024-09-19T06:08:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.948+0000 7f7fcf7fe640 1 -- 172.21.15.103:0/965661887 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7f7fd800cb20 con 0x7f7fe01026f0 2024-09-19T06:08:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.949+0000 7f7fe7e66740 1 Processor -- start 2024-09-19T06:08:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.949+0000 7f7fe7e66740 1 -- start start 2024-09-19T06:08:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.949+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa5eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.949+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa69770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.949+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 0x5566baa6c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.949+0000 7f7fe7e66740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5566ba9c32f0 con 0x5566baa5eaf0 2024-09-19T06:08:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.949+0000 7f7fe7e66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5566ba96b270 con 0x5566baa5f410 2024-09-19T06:08:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.949+0000 7f7fe7e66740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5566ba9bf2b0 con 0x5566baa69cb0 2024-09-19T06:08:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fcf7fe640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7fc80a3600 0x7f7fc80a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fddd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa5eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fddd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa5eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34810/0 (socket says 172.21.15.103:34810) 2024-09-19T06:08:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fddd9b640 1 -- 172.21.15.103:0/858197847 learned_addr learned my addr 172.21.15.103:0/858197847 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fde59c640 1 --2- 172.21.15.103:0/858197847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa69770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fcf7fe640 1 -- 172.21.15.103:0/965661887 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f7fd80cfff0 con 0x7f7fe01026f0 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fded9d640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7fc80a3600 0x7f7fc80a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fde59c640 1 -- 172.21.15.103:0/858197847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 msgr2=0x5566baa6c0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fde59c640 1 --2- 172.21.15.103:0/858197847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 0x5566baa6c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fde59c640 1 -- 172.21.15.103:0/858197847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 msgr2=0x5566baa5eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fde59c640 1 --2- 172.21.15.103:0/858197847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa5eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fde59c640 1 -- 172.21.15.103:0/858197847 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566ba96a340 con 0x5566baa5f410 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fddd9b640 1 --2- 172.21.15.103:0/858197847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa5eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fded9d640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7fc80a3600 0x7f7fc80a5ac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80cd610 tx=0x7f7fd800ef30 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.950+0000 7f7fde59c640 1 --2- 172.21.15.103:0/858197847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa69770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0004770 tx=0x7f7fd0032f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65a85d128a4e995 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.951+0000 7f7fccff9640 1 -- 172.21.15.103:0/858197847 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0035040 con 0x5566baa5f410 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.951+0000 7f7fccff9640 1 -- 172.21.15.103:0/858197847 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fd0031820 con 0x5566baa5f410 2024-09-19T06:08:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.951+0000 7f7fccff9640 1 -- 172.21.15.103:0/858197847 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0004a00 con 0x5566baa5f410 2024-09-19T06:08:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 -- 172.21.15.103:0/858197847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 msgr2=0x5566baa69770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/858197847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa69770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0004770 tx=0x7f7fd0032f60 comp rx=0 tx=0).stop 2024-09-19T06:08:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 -- 172.21.15.103:0/858197847 shutdown_connections 2024-09-19T06:08:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/858197847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 0x5566baa6c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/858197847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa69770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/858197847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa5eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 -- 172.21.15.103:0/858197847 >> 172.21.15.103:0/858197847 conn(0x5566baa5b060 msgr2=0x5566baa5b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 -- 172.21.15.103:0/858197847 shutdown_connections 2024-09-19T06:08:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 -- 172.21.15.103:0/858197847 wait complete. 2024-09-19T06:08:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 -- start start 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.952+0000 7f7fe7e66740 1 Processor -- start 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa66bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fddd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa66bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fddd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa66bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34816/0 (socket says 172.21.15.103:34816) 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa67110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fddd9b640 1 -- 172.21.15.103:0/1957414640 learned_addr learned my addr 172.21.15.103:0/1957414640 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 0x5566baa67650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5566baa6c880 con 0x5566baa5eaf0 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5566ba94c290 con 0x5566baa5f410 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5566baa6ca00 con 0x5566baa69cb0 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fde59c640 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa67110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fddd9b640 1 -- 172.21.15.103:0/1957414640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 msgr2=0x5566baa67650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:08:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fddd9b640 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 0x5566baa67650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fddd9b640 1 -- 172.21.15.103:0/1957414640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 msgr2=0x5566baa67110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.953+0000 7f7fddd9b640 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa67110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fddd9b640 1 -- 172.21.15.103:0/1957414640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566ba6d6210 con 0x5566baa5eaf0 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fde59c640 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa67110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fddd9b640 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa66bd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40126e0 tx=0x7f7fd4012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8591b16c2a21878 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fc5ffb640 1 -- 172.21.15.103:0/1957414640 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4020060 con 0x5566baa5eaf0 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fc5ffb640 1 -- 172.21.15.103:0/1957414640 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f7fd40120d0 con 0x5566baa5eaf0 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fe7e66740 10 client.0 _ll_register_callbacks cb 0x5566ba97d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fd0031820 con 0x5566baa5eaf0 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fc5ffb640 1 -- 172.21.15.103:0/1957414640 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7fd400f920 con 0x5566baa5eaf0 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fe7e66740 10 client.15504 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.954+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5566ba7a2620 con 0x5566baa5eaf0 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.955+0000 7f7fc5ffb640 1 -- 172.21.15.103:0/1957414640 <== mon.0 v2:172.21.15.103:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7fd400fac0 con 0x5566baa5eaf0 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.955+0000 7f7fe7e66740 10 client.15504 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.955+0000 7f7fe7e66740 10 client.15504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.955+0000 7f7fe7e66740 20 client.15504 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.955+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5566baa79920 0x5566baa7bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.955+0000 7f7fe7e66740 4 client.15504 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.955+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7fd0031820 con 0x5566baa79920 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.955+0000 7f7fde59c640 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5566baa79920 0x5566baa7bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fc5ffb640 10 client.15504 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fde59c640 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5566baa79920 0x5566baa7bde0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=563cd3b58dec7205 server_cookie=5a09067124e95443 in_seq=0 out_seq=0 2024-09-19T06:08:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fc5ffb640 1 -- 172.21.15.103:0/1957414640 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7fd0031820 con 0x5566baa79920 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fc5ffb640 10 client.15504 handle_command_reply: tid=0 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fe7e66740 1 client.15504 shutdown 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 msgr2=0x5566baa66bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa66bd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40126e0 tx=0x7f7fd4012ba0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 shutdown_connections 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5566baa79920 0x5566baa7bde0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 0x5566baa67650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa67110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.956+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/1957414640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa5eaf0 0x5566baa66bd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.957+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 >> 172.21.15.103:0/1957414640 conn(0x5566baa5b060 msgr2=0x5566baa60dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.957+0000 7f7fc5ffb640 0 client.15504 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.957+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 shutdown_connections 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.957+0000 7f7fe7e66740 1 -- 172.21.15.103:0/1957414640 wait complete. 2024-09-19T06:08:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.957+0000 7f7fe7e66740 20 client.15504 trim_cache size 0 max 16384 2024-09-19T06:08:08.988 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.984+0000 7f7fe7e66740 1 Processor -- start 2024-09-19T06:08:08.988 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.984+0000 7f7fe7e66740 1 -- start start 2024-09-19T06:08:08.988 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa5f410 0x5566baa61560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.988 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa69cb0 0x5566baa67450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.988 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa816f0 0x5566baa81b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.988 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fe7e66740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01b2000 con 0x5566baa69cb0 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fe7e66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01af8d0 con 0x5566baa816f0 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fe7e66740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01ad720 con 0x5566baa5f410 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fde59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa69cb0 0x5566baa67450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fde59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa69cb0 0x5566baa67450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34822/0 (socket says 172.21.15.103:34822) 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fde59c640 1 -- 172.21.15.103:0/492093370 learned_addr learned my addr 172.21.15.103:0/492093370 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fddd9b640 1 --2- 172.21.15.103:0/492093370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa5f410 0x5566baa61560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fddd9b640 1 --2- 172.21.15.103:0/492093370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa816f0 0x5566baa81b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fde59c640 1 -- 172.21.15.103:0/492093370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa5f410 msgr2=0x5566baa61560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fde59c640 1 --2- 172.21.15.103:0/492093370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa5f410 0x5566baa61560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fde59c640 1 -- 172.21.15.103:0/492093370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa816f0 msgr2=0x5566baa81b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fde59c640 1 --2- 172.21.15.103:0/492093370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa816f0 0x5566baa81b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.985+0000 7f7fde59c640 1 -- 172.21.15.103:0/492093370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566baa5e870 con 0x5566baa69cb0 2024-09-19T06:08:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.986+0000 7f7fde59c640 1 --2- 172.21.15.103:0/492093370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa69cb0 0x5566baa67450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000c00 tx=0x7f7fd002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624399d87f45ef1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.986+0000 7f7fc7fff640 1 -- 172.21.15.103:0/492093370 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0035040 con 0x5566baa69cb0 2024-09-19T06:08:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.986+0000 7f7fc7fff640 1 -- 172.21.15.103:0/492093370 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fd0004300 con 0x5566baa69cb0 2024-09-19T06:08:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.986+0000 7f7fc7fff640 1 -- 172.21.15.103:0/492093370 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0003b10 con 0x5566baa69cb0 2024-09-19T06:08:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.987+0000 7f7fe7e66740 1 -- 172.21.15.103:0/492093370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa69cb0 msgr2=0x5566baa67450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.987+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/492093370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa69cb0 0x5566baa67450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000c00 tx=0x7f7fd002a410 comp rx=0 tx=0).stop 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.987+0000 7f7fe7e66740 1 -- 172.21.15.103:0/492093370 shutdown_connections 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.987+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/492093370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa816f0 0x5566baa81b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.987+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/492093370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa69cb0 0x5566baa67450 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.987+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/492093370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa5f410 0x5566baa61560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.987+0000 7f7fe7e66740 1 -- 172.21.15.103:0/492093370 >> 172.21.15.103:0/492093370 conn(0x5566baa5b060 msgr2=0x5566baa68c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.987+0000 7f7fe7e66740 1 -- 172.21.15.103:0/492093370 shutdown_connections 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.987+0000 7f7fe7e66740 1 -- 172.21.15.103:0/492093370 wait complete. 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.988+0000 7f7fe7e66740 1 -- start start 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.988+0000 7f7fe7e66740 1 Processor -- start 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.988+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa72480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.988+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 0x5566baa6d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.988+0000 7f7fe7e66740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa816f0 0x5566baa6dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.988+0000 7f7fddd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa816f0 0x5566baa6dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fddd9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa72480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fddd9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa72480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:40774/0 (socket says 172.21.15.103:40774) 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fddd9b640 1 -- 172.21.15.103:0/3919164335 learned_addr learned my addr 172.21.15.103:0/3919164335 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01add90 con 0x5566baa816f0 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01af200 con 0x5566baa5f410 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01ae460 con 0x5566baa69cb0 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fde59c640 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 0x5566baa6d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fe7e66740 10 client.0 _ll_register_callbacks cb 0x7f7fd4009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fddd9b640 1 -- 172.21.15.103:0/3919164335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 msgr2=0x5566baa6d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fddd9b640 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 0x5566baa6d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fddd9b640 1 -- 172.21.15.103:0/3919164335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 msgr2=0x5566baa72480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fddd9b640 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa72480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fddd9b640 1 -- 172.21.15.103:0/3919164335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566baa6e550 con 0x5566baa816f0 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fddd9b640 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa816f0 0x5566baa6dd20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4001eb0 tx=0x7f7fd4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff26ce5d9cd59908 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fd0004300 con 0x5566baa816f0 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fc5ffb640 1 -- 172.21.15.103:0/3919164335 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4020040 con 0x5566baa816f0 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.989+0000 7f7fc5ffb640 1 -- 172.21.15.103:0/3919164335 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f7fd40272d0 con 0x5566baa816f0 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fc5ffb640 1 -- 172.21.15.103:0/3919164335 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7fd4027ab0 con 0x5566baa816f0 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fe7e66740 10 client.15510 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5566baae45f0 con 0x5566baa816f0 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fc5ffb640 1 -- 172.21.15.103:0/3919164335 <== mon.0 v2:172.21.15.103:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7fd4027c50 con 0x5566baa816f0 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fe7e66740 10 client.15510 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fe7e66740 10 client.15510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fe7e66740 20 client.15510 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5566baae4c60 0x5566baae70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fe7e66740 4 client.15510 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:08:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f7fd0004300 con 0x5566baae4c60 2024-09-19T06:08:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.990+0000 7f7fde59c640 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5566baae4c60 0x5566baae70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.991+0000 7f7fc5ffb640 10 client.15510 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.991+0000 7f7fde59c640 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5566baae4c60 0x5566baae70c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a7abdde36a47d1a server_cookie=46451b1b2cd9f57b in_seq=0 out_seq=0 2024-09-19T06:08:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.997+0000 7f7fc5ffb640 1 -- 172.21.15.103:0/3919164335 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f7fd0004300 con 0x5566baae4c60 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.997+0000 7f7fc5ffb640 10 client.15510 handle_command_reply: tid=0 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.997+0000 7f7fe7e66740 1 client.15510 shutdown 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa816f0 msgr2=0x5566baa6dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa816f0 0x5566baa6dd20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4001eb0 tx=0x7f7fd4005f90 comp rx=0 tx=0).stop 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 shutdown_connections 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5566baae4c60 0x5566baae70c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566baa816f0 0x5566baa6dd20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fc5ffb640 0 client.15510 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5566baa69cb0 0x5566baa6d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 1 --2- 172.21.15.103:0/3919164335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566baa5f410 0x5566baa72480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 >> 172.21.15.103:0/3919164335 conn(0x5566baa5b060 msgr2=0x5566baa68c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 shutdown_connections 2024-09-19T06:08:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 1 -- 172.21.15.103:0/3919164335 wait complete. 2024-09-19T06:08:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.998+0000 7f7fe7e66740 20 client.15510 trim_cache size 0 max 16384 2024-09-19T06:08:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:08:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:08:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:08:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/965661887 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7fc80a3600 msgr2=0x7f7fc80a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7fc80a3600 0x7f7fc80a5ac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80cd610 tx=0x7f7fd800ef30 comp rx=0 tx=0).stop 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/965661887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe01026f0 msgr2=0x7f7fe019ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe01026f0 0x7f7fe019ee00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800e940 tx=0x7f7fd800ee00 comp rx=0 tx=0).stop 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/965661887 shutdown_connections 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7fc80a3600 0x7f7fc80a5ac0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fe01026f0 0x7f7fe019ee00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fe0101d70 0x7f7fe019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 --2- 172.21.15.103:0/965661887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fe0100490 0x7f7fe019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/965661887 >> 172.21.15.103:0/965661887 conn(0x7f7fe00770f0 msgr2=0x7f7fe01044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/965661887 shutdown_connections 2024-09-19T06:08:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:08.999+0000 7f7fe4ff8640 1 -- 172.21.15.103:0/965661887 wait complete. 2024-09-19T06:08:09.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:08 smithi174 ceph-mon[34488]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T06:08:09.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:08 smithi103 ceph-mon[30925]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T06:08:09.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:08 smithi169 ceph-mon[34350]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T06:08:09.490 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:08:09.490 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:08:09.770 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.338+0000 7f34717b1640 1 -- 172.21.15.103:0/3387826351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f346c100e20 msgr2=0x7f346c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.338+0000 7f34717b1640 1 --2- 172.21.15.103:0/3387826351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f346c100e20 0x7f346c101200 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f345c009900 tx=0x7f345c02a480 comp rx=0 tx=0).stop 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.338+0000 7f34717b1640 1 -- 172.21.15.103:0/3387826351 shutdown_connections 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.338+0000 7f34717b1640 1 --2- 172.21.15.103:0/3387826351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f346c102ef0 0x7f346c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.338+0000 7f34717b1640 1 --2- 172.21.15.103:0/3387826351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c102570 0x7f346c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.338+0000 7f34717b1640 1 --2- 172.21.15.103:0/3387826351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f346c100e20 0x7f346c101200 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.338+0000 7f34717b1640 1 -- 172.21.15.103:0/3387826351 >> 172.21.15.103:0/3387826351 conn(0x7f346c0fc7d0 msgr2=0x7f346c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.338+0000 7f34717b1640 1 -- 172.21.15.103:0/3387826351 shutdown_connections 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.338+0000 7f34717b1640 1 -- 172.21.15.103:0/3387826351 wait complete. 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.339+0000 7f34717b1640 1 Processor -- start 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.339+0000 7f34717b1640 1 -- start start 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f34717b1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100e20 0x7f346c19f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f34717b1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f346c102570 0x7f346c19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f34717b1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f346c102ef0 0x7f346c10cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f34717b1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f346c111f50 con 0x7f346c102570 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f34717b1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f346c111dd0 con 0x7f346c100e20 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f34717b1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f346c1120d0 con 0x7f346c102ef0 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f3463fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f346c102570 0x7f346c19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f3463fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f346c102570 0x7f346c19f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50686/0 (socket says 172.21.15.103:50686) 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f3463fff640 1 -- 172.21.15.103:0/3147690135 learned_addr learned my addr 172.21.15.103:0/3147690135 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f346affd640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100e20 0x7f346c19f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f346b7fe640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f346c102ef0 0x7f346c10cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f3463fff640 1 -- 172.21.15.103:0/3147690135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f346c102ef0 msgr2=0x7f346c10cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f3463fff640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f346c102ef0 0x7f346c10cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f3463fff640 1 -- 172.21.15.103:0/3147690135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100e20 msgr2=0x7f346c19f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f3463fff640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100e20 0x7f346c19f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f3463fff640 1 -- 172.21.15.103:0/3147690135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c10d520 con 0x7f346c102570 2024-09-19T06:08:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.340+0000 7f346affd640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100e20 0x7f346c19f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:10.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.341+0000 7f3463fff640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f346c102570 0x7f346c19f5d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f345400ea60 tx=0x7f345400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:10.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.341+0000 7f3468ff9640 1 -- 172.21.15.103:0/3147690135 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345400cde0 con 0x7f346c102570 2024-09-19T06:08:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.341+0000 7f3468ff9640 1 -- 172.21.15.103:0/3147690135 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f34540035f0 con 0x7f346c102570 2024-09-19T06:08:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.341+0000 7f34717b1640 1 -- 172.21.15.103:0/3147690135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346c10d810 con 0x7f346c102570 2024-09-19T06:08:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.341+0000 7f3468ff9640 1 -- 172.21.15.103:0/3147690135 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454010690 con 0x7f346c102570 2024-09-19T06:08:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.341+0000 7f34717b1640 1 -- 172.21.15.103:0/3147690135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f346c19acb0 con 0x7f346c102570 2024-09-19T06:08:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.343+0000 7f3468ff9640 1 -- 172.21.15.103:0/3147690135 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7f3454010830 con 0x7f346c102570 2024-09-19T06:08:10.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.344+0000 7f3468ff9640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34580a3550 0x7f34580a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.344+0000 7f3468ff9640 1 -- 172.21.15.103:0/3147690135 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f34540d0170 con 0x7f346c102570 2024-09-19T06:08:10.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.344+0000 7f346affd640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34580a3550 0x7f34580a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.345+0000 7f346affd640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34580a3550 0x7f34580a5a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f345c000c00 tx=0x7f345c005e60 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:10.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.346+0000 7f3473b8a740 1 Processor -- start 2024-09-19T06:08:10.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.346+0000 7f3473b8a740 1 -- start start 2024-09-19T06:08:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.346+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 0x55a65560af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.346+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655615800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.346+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a655618130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3463fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655615800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3463fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655615800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50702/0 (socket says 172.21.15.103:50702) 2024-09-19T06:08:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3473b8a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a655570280 con 0x55a65560b480 2024-09-19T06:08:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3463fff640 1 -- 172.21.15.103:0/3458058705 learned_addr learned my addr 172.21.15.103:0/3458058705 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3473b8a740 1 -- 172.21.15.103:0/3458058705 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a655517b10 con 0x55a655615d40 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3473b8a740 1 -- 172.21.15.103:0/3458058705 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a65556c240 con 0x55a65560ab60 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f346affd640 1 --2- 172.21.15.103:0/3458058705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 0x55a65560af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f346b7fe640 1 --2- 172.21.15.103:0/3458058705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a655618130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3463fff640 1 -- 172.21.15.103:0/3458058705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 msgr2=0x55a65560af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3463fff640 1 --2- 172.21.15.103:0/3458058705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 0x55a65560af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3463fff640 1 -- 172.21.15.103:0/3458058705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 msgr2=0x55a655618130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3463fff640 1 --2- 172.21.15.103:0/3458058705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a655618130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3463fff640 1 -- 172.21.15.103:0/3458058705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6555241f0 con 0x55a65560b480 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f346affd640 1 --2- 172.21.15.103:0/3458058705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 0x55a65560af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.347+0000 7f3463fff640 1 --2- 172.21.15.103:0/3458058705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655615800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3454098650 tx=0x7f345409bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c70c89c8f7a696 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.348+0000 7f34617fa640 1 -- 172.21.15.103:0/3458058705 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34540a05a0 con 0x55a65560b480 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.348+0000 7f34617fa640 1 -- 172.21.15.103:0/3458058705 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f34540a4e60 con 0x55a65560b480 2024-09-19T06:08:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.348+0000 7f34617fa640 1 -- 172.21.15.103:0/3458058705 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34540cda10 con 0x55a65560b480 2024-09-19T06:08:10.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.349+0000 7f3473b8a740 1 -- 172.21.15.103:0/3458058705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 msgr2=0x55a655615800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.349+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3458058705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655615800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3454098650 tx=0x7f345409bb50 comp rx=0 tx=0).stop 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.349+0000 7f3473b8a740 1 -- 172.21.15.103:0/3458058705 shutdown_connections 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.349+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3458058705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a655618130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.349+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3458058705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655615800 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.349+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3458058705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 0x55a65560af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.349+0000 7f3473b8a740 1 -- 172.21.15.103:0/3458058705 >> 172.21.15.103:0/3458058705 conn(0x55a6556070f0 msgr2=0x55a6556074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.349+0000 7f3473b8a740 1 -- 172.21.15.103:0/3458058705 shutdown_connections 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.349+0000 7f3473b8a740 1 -- 172.21.15.103:0/3458058705 wait complete. 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3473b8a740 1 -- start start 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3473b8a740 1 Processor -- start 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 0x55a655612c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65560b480 0x55a655613160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a655615d40 0x55a6556136a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3473b8a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a655618910 con 0x55a65560ab60 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3473b8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a65552af10 con 0x55a65560b480 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3473b8a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a655618a90 con 0x55a655615d40 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3473b8a740 10 client.0 _ll_register_callbacks cb 0x55a6554f3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3463fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65560b480 0x55a655613160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f346affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 0x55a655612c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f346b7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a655615d40 0x55a6556136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3463fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65560b480 0x55a655613160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:36920/0 (socket says 172.21.15.103:36920) 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.350+0000 7f3463fff640 1 -- 172.21.15.103:0/13784638 learned_addr learned my addr 172.21.15.103:0/13784638 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.351+0000 7f346b7fe640 1 -- 172.21.15.103:0/13784638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65560b480 msgr2=0x55a655613160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.351+0000 7f346b7fe640 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65560b480 0x55a655613160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.351+0000 7f346b7fe640 1 -- 172.21.15.103:0/13784638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 msgr2=0x55a655612c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.351+0000 7f346b7fe640 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 0x55a655612c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.351+0000 7f346b7fe640 1 -- 172.21.15.103:0/13784638 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6552e16a0 con 0x55a655615d40 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.351+0000 7f346affd640 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 0x55a655612c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.351+0000 7f346b7fe640 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a655615d40 0x55a6556136a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3464005fd0 tx=0x7f3464012e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39b6e68946d7bebf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.351+0000 7f34527fc640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.352+0000 7f34527fc640 1 -- 172.21.15.103:0/13784638 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464003970 con 0x55a655615d40 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.352+0000 7f3473b8a740 1 -- 172.21.15.103:0/13784638 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34540a4e60 con 0x55a655615d40 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.352+0000 7f34527fc640 1 -- 172.21.15.103:0/13784638 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f3464003b10 con 0x55a655615d40 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.352+0000 7f34527fc640 1 -- 172.21.15.103:0/13784638 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3464003d10 con 0x55a655615d40 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.352+0000 7f3473b8a740 10 client.25147 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.352+0000 7f3473b8a740 1 -- 172.21.15.103:0/13784638 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a655624620 con 0x55a655615d40 2024-09-19T06:08:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.352+0000 7f34527fc640 1 -- 172.21.15.103:0/13784638 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f34540a4e60 con 0x55a655615d40 2024-09-19T06:08:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.353+0000 7f34527fc640 1 -- 172.21.15.103:0/13784638 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3464004570 con 0x55a655615d40 2024-09-19T06:08:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.353+0000 7f3473b8a740 10 client.25147 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.353+0000 7f3473b8a740 10 client.25147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.353+0000 7f3473b8a740 20 client.25147 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.353+0000 7f3473b8a740 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a655625a30 0x55a655627e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.353+0000 7f3473b8a740 4 client.25147 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.353+0000 7f3473b8a740 1 -- 172.21.15.103:0/13784638 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a65557d7f0 con 0x55a655625a30 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.353+0000 7f346affd640 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a655625a30 0x55a655627e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.354+0000 7f34527fc640 10 client.25147 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.354+0000 7f346affd640 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a655625a30 0x55a655627e50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c9245a05bea0353 server_cookie=759f21986e32807a in_seq=0 out_seq=0 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f34527fc640 1 -- 172.21.15.103:0/13784638 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a65557d7f0 con 0x55a655625a30 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f34527fc640 10 client.25147 handle_command_reply: tid=0 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 client.25147 shutdown 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 -- 172.21.15.103:0/13784638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a655615d40 msgr2=0x55a6556136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a655615d40 0x55a6556136a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3464005fd0 tx=0x7f3464012e70 comp rx=0 tx=0).stop 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 -- 172.21.15.103:0/13784638 shutdown_connections 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a655625a30 0x55a655627e50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a655615d40 0x55a6556136a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65560b480 0x55a655613160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 --2- 172.21.15.103:0/13784638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 0x55a655612c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 -- 172.21.15.103:0/13784638 >> 172.21.15.103:0/13784638 conn(0x55a6556070f0 msgr2=0x55a65560cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f34527fc640 0 client.25147 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 -- 172.21.15.103:0/13784638 shutdown_connections 2024-09-19T06:08:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 1 -- 172.21.15.103:0/13784638 wait complete. 2024-09-19T06:08:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.355+0000 7f3473b8a740 20 client.25147 trim_cache size 0 max 16384 2024-09-19T06:08:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.387+0000 7f3473b8a740 1 Processor -- start 2024-09-19T06:08:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.387+0000 7f3473b8a740 1 -- start start 2024-09-19T06:08:10.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 0x55a6556134f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560b480 0x55a655614a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a65562d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f3473b8a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f344c010f10 con 0x55a65560ab60 2024-09-19T06:08:10.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f3473b8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f344c00e7e0 con 0x55a655615d40 2024-09-19T06:08:10.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f3473b8a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f344c00c630 con 0x55a65560b480 2024-09-19T06:08:10.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f3463fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560b480 0x55a655614a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f346affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 0x55a6556134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f3463fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560b480 0x55a655614a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:59712/0 (socket says 172.21.15.103:59712) 2024-09-19T06:08:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f3463fff640 1 -- 172.21.15.103:0/700340062 learned_addr learned my addr 172.21.15.103:0/700340062 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.388+0000 7f346b7fe640 1 --2- 172.21.15.103:0/700340062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a65562d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.389+0000 7f346b7fe640 1 -- 172.21.15.103:0/700340062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560b480 msgr2=0x55a655614a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.389+0000 7f346b7fe640 1 --2- 172.21.15.103:0/700340062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560b480 0x55a655614a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.389+0000 7f346b7fe640 1 -- 172.21.15.103:0/700340062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 msgr2=0x55a6556134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.389+0000 7f346b7fe640 1 --2- 172.21.15.103:0/700340062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 0x55a6556134f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.389+0000 7f346b7fe640 1 -- 172.21.15.103:0/700340062 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a655606b90 con 0x55a655615d40 2024-09-19T06:08:10.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.390+0000 7f346b7fe640 1 --2- 172.21.15.103:0/700340062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a65562d720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f34640265c0 tx=0x7f3464012600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=711826d78cdd3d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:10.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.390+0000 7f3460ff9640 1 -- 172.21.15.103:0/700340062 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346402c070 con 0x55a655615d40 2024-09-19T06:08:10.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.390+0000 7f3460ff9640 1 -- 172.21.15.103:0/700340062 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3464003970 con 0x55a655615d40 2024-09-19T06:08:10.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.390+0000 7f3460ff9640 1 -- 172.21.15.103:0/700340062 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346400fb30 con 0x55a655615d40 2024-09-19T06:08:10.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.391+0000 7f3473b8a740 1 -- 172.21.15.103:0/700340062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 msgr2=0x55a65562d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.391+0000 7f3473b8a740 1 --2- 172.21.15.103:0/700340062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a65562d720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f34640265c0 tx=0x7f3464012600 comp rx=0 tx=0).stop 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.391+0000 7f3473b8a740 1 -- 172.21.15.103:0/700340062 shutdown_connections 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.391+0000 7f3473b8a740 1 --2- 172.21.15.103:0/700340062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a65562d720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.391+0000 7f3473b8a740 1 --2- 172.21.15.103:0/700340062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560b480 0x55a655614a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.391+0000 7f3473b8a740 1 --2- 172.21.15.103:0/700340062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560ab60 0x55a6556134f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.391+0000 7f3473b8a740 1 -- 172.21.15.103:0/700340062 >> 172.21.15.103:0/700340062 conn(0x55a6556070f0 msgr2=0x55a655614370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.391+0000 7f3473b8a740 1 -- 172.21.15.103:0/700340062 shutdown_connections 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.391+0000 7f3473b8a740 1 -- 172.21.15.103:0/700340062 wait complete. 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.392+0000 7f3473b8a740 1 -- start start 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.392+0000 7f3473b8a740 1 Processor -- start 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.392+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 0x55a65561e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.392+0000 7f3473b8a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655619550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3463fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655619550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3463fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655619550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50732/0 (socket says 172.21.15.103:50732) 2024-09-19T06:08:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3463fff640 1 -- 172.21.15.103:0/3612902659 learned_addr learned my addr 172.21.15.103:0/3612902659 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a655619a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f344c00cca0 con 0x55a65560b480 2024-09-19T06:08:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f344c00e110 con 0x55a655615d40 2024-09-19T06:08:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f344c00d370 con 0x55a65560ab60 2024-09-19T06:08:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f346affd640 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 0x55a65561e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3463fff640 1 -- 172.21.15.103:0/3612902659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 msgr2=0x55a65561e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3463fff640 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 0x55a65561e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3473b8a740 10 client.0 _ll_register_callbacks cb 0x7f3464009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3463fff640 1 -- 172.21.15.103:0/3612902659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 msgr2=0x55a655619a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3463fff640 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a655619a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3463fff640 1 -- 172.21.15.103:0/3612902659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a65561a050 con 0x55a65560b480 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3464003970 con 0x55a65560b480 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f3463fff640 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655619550 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f345409c180 tx=0x7f34540095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41053064737cdce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.393+0000 7f34527fc640 10 client.15528 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.394+0000 7f34527fc640 1 -- 172.21.15.103:0/3612902659 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345407f060 con 0x55a65560b480 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.394+0000 7f34527fc640 1 -- 172.21.15.103:0/3612902659 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f34540a0170 con 0x55a65560b480 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.394+0000 7f34527fc640 1 -- 172.21.15.103:0/3612902659 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f34540b5040 con 0x55a65560b480 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.394+0000 7f3473b8a740 10 client.15528 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.394+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55a6556903c0 con 0x55a65560b480 2024-09-19T06:08:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.395+0000 7f34527fc640 1 -- 172.21.15.103:0/3612902659 <== mon.0 v2:172.21.15.103:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f34540cda10 con 0x55a65560b480 2024-09-19T06:08:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.395+0000 7f3473b8a740 10 client.15528 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.395+0000 7f3473b8a740 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.395+0000 7f3473b8a740 20 client.15528 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.395+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a6556906a0 0x55a655692a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.395+0000 7f3473b8a740 4 client.15528 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:08:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.395+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a655577d00 con 0x55a6556906a0 2024-09-19T06:08:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.395+0000 7f346affd640 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a6556906a0 0x55a655692a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.395+0000 7f34527fc640 10 client.15528 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.395+0000 7f346affd640 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a6556906a0 0x55a655692a90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cfeb87b5a0b034 server_cookie=9d24c1ea3bdd7a05 in_seq=0 out_seq=0 2024-09-19T06:08:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.396+0000 7f34527fc640 1 -- 172.21.15.103:0/3612902659 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a655577d00 con 0x55a6556906a0 2024-09-19T06:08:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.396+0000 7f34527fc640 10 client.15528 handle_command_reply: tid=0 2024-09-19T06:08:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.396+0000 7f3473b8a740 1 client.15528 shutdown 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 msgr2=0x55a655619550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655619550 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f345409c180 tx=0x7f34540095a0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 shutdown_connections 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a6556906a0 0x55a655692a90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a655615d40 0x55a655619a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f34527fc640 0 client.15528 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a65560b480 0x55a655619550 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 1 --2- 172.21.15.103:0/3612902659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a65560ab60 0x55a65561e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 >> 172.21.15.103:0/3612902659 conn(0x55a6556070f0 msgr2=0x55a655606270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 shutdown_connections 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 1 -- 172.21.15.103:0/3612902659 wait complete. 2024-09-19T06:08:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.397+0000 7f3473b8a740 20 client.15528 trim_cache size 0 max 16384 2024-09-19T06:08:10.402 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:08:10.402 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-09-19T06:08:10.402 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "3552a747-7f0d-4a6e-bbae-1b434cb73f3d", 2024-09-19T06:08:10.402 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-09-19T06:08:10.402 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.398+0000 7f34717b1640 1 -- 172.21.15.103:0/3147690135 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34580a3550 msgr2=0x7f34580a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.398+0000 7f34717b1640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34580a3550 0x7f34580a5a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f345c000c00 tx=0x7f345c005e60 comp rx=0 tx=0).stop 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.398+0000 7f34717b1640 1 -- 172.21.15.103:0/3147690135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f346c102570 msgr2=0x7f346c19f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.398+0000 7f34717b1640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f346c102570 0x7f346c19f5d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f345400ea60 tx=0x7f345400ef20 comp rx=0 tx=0).stop 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.398+0000 7f34717b1640 1 -- 172.21.15.103:0/3147690135 shutdown_connections 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.398+0000 7f34717b1640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34580a3550 0x7f34580a5a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.398+0000 7f34717b1640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f346c102ef0 0x7f346c10cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.398+0000 7f34717b1640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f346c102570 0x7f346c19f5d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.398+0000 7f34717b1640 1 --2- 172.21.15.103:0/3147690135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100e20 0x7f346c19f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.398+0000 7f34717b1640 1 -- 172.21.15.103:0/3147690135 >> 172.21.15.103:0/3147690135 conn(0x7f346c0fc7d0 msgr2=0x7f346c105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.399+0000 7f34717b1640 1 -- 172.21.15.103:0/3147690135 shutdown_connections 2024-09-19T06:08:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:10.399+0000 7f34717b1640 1 -- 172.21.15.103:0/3147690135 wait complete. 2024-09-19T06:08:11.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:10 smithi103 ceph-mon[30925]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T06:08:11.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:08:11.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:10 smithi174 ceph-mon[34488]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T06:08:11.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:10 smithi169 ceph-mon[34350]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T06:08:11.589 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:11 smithi103 ceph-mon[30925]: scrub queued for path: / 2024-09-19T06:08:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:11 smithi103 ceph-mon[30925]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:11 smithi103 ceph-mon[30925]: scrub summary: active paths [/] 2024-09-19T06:08:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:11 smithi103 ceph-mon[30925]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.131+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3133313770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0100a70 msgr2=0x7f1aa0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.131+0000 7f1aa81e7640 1 --2- 172.21.15.103:0/3133313770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0100a70 0x7f1aa0100ed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009980 tx=0x7f1a9002c620 comp rx=0 tx=0).stop 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.131+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3133313770 shutdown_connections 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.131+0000 7f1aa81e7640 1 --2- 172.21.15.103:0/3133313770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0101410 0x7f1aa010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.131+0000 7f1aa81e7640 1 --2- 172.21.15.103:0/3133313770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0100a70 0x7f1aa0100ed0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.131+0000 7f1aa81e7640 1 --2- 172.21.15.103:0/3133313770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1aa0106a70 0x7f1aa0106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.131+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3133313770 >> 172.21.15.103:0/3133313770 conn(0x7f1aa00fc7d0 msgr2=0x7f1aa00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.131+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3133313770 shutdown_connections 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.131+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3133313770 wait complete. 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.132+0000 7f1aa81e7640 1 Processor -- start 2024-09-19T06:08:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.132+0000 7f1aa81e7640 1 -- start start 2024-09-19T06:08:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa81e7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0100a70 0x7f1aa019ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa81e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0101410 0x7f1aa019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa81e7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1aa0106a70 0x7f1aa01a3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa81e7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa010fc10 con 0x7f1aa0106a70 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa81e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa010fa90 con 0x7f1aa0101410 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa81e7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa010fd90 con 0x7f1aa0100a70 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa6784640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1aa0106a70 0x7f1aa01a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa5782640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0101410 0x7f1aa019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa6784640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1aa0106a70 0x7f1aa01a3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50752/0 (socket says 172.21.15.103:50752) 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa6784640 1 -- 172.21.15.103:0/3498893140 learned_addr learned my addr 172.21.15.103:0/3498893140 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0100a70 0x7f1aa019ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa6784640 1 -- 172.21.15.103:0/3498893140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0100a70 msgr2=0x7f1aa019ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa6784640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0100a70 0x7f1aa019ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa6784640 1 -- 172.21.15.103:0/3498893140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0101410 msgr2=0x7f1aa019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa6784640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0101410 0x7f1aa019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa6784640 1 -- 172.21.15.103:0/3498893140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa01a3a70 con 0x7f1aa0106a70 2024-09-19T06:08:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.133+0000 7f1aa5782640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0101410 0x7f1aa019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.134+0000 7f1aa6784640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1aa0106a70 0x7f1aa01a3340 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009fd0 tx=0x7f1a9800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.134+0000 7f1a96ffd640 1 -- 172.21.15.103:0/3498893140 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98017070 con 0x7f1aa0106a70 2024-09-19T06:08:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.134+0000 7f1a96ffd640 1 -- 172.21.15.103:0/3498893140 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a98003e20 con 0x7f1aa0106a70 2024-09-19T06:08:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.134+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3498893140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa01a3d60 con 0x7f1aa0106a70 2024-09-19T06:08:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.134+0000 7f1a96ffd640 1 -- 172.21.15.103:0/3498893140 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98010460 con 0x7f1aa0106a70 2024-09-19T06:08:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.134+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3498893140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa01ab5f0 con 0x7f1aa0106a70 2024-09-19T06:08:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.137+0000 7f1aaa5c0740 1 Processor -- start 2024-09-19T06:08:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1a96ffd640 1 -- 172.21.15.103:0/3498893140 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7f1a98003970 con 0x7f1aa0106a70 2024-09-19T06:08:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aaa5c0740 1 -- start start 2024-09-19T06:08:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f9644a0 0x562a6f964880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 0x562a6f96f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f971a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aaa5c0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562a6f8ca2e0 con 0x562a6f96f680 2024-09-19T06:08:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aaa5c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562a6f871ce0 con 0x562a6f964dc0 2024-09-19T06:08:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aaa5c0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562a6f8c62a0 con 0x562a6f9644a0 2024-09-19T06:08:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aa5782640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f971a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aa5782640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f9644a0 0x562a6f964880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aa5782640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f9644a0 0x562a6f964880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:59752/0 (socket says 172.21.15.103:59752) 2024-09-19T06:08:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.139+0000 7f1aa5782640 1 -- 172.21.15.103:0/2946911144 learned_addr learned my addr 172.21.15.103:0/2946911144 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.140+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/2946911144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 0x562a6f96f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.140+0000 7f1aa5f83640 1 -- 172.21.15.103:0/2946911144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f9644a0 msgr2=0x562a6f964880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.140+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/2946911144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f9644a0 0x562a6f964880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.140+0000 7f1aa5f83640 1 -- 172.21.15.103:0/2946911144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 msgr2=0x562a6f971a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.140+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/2946911144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f971a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.140+0000 7f1aa5f83640 1 -- 172.21.15.103:0/2946911144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6f856440 con 0x562a6f964dc0 2024-09-19T06:08:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.140+0000 7f1aa5782640 1 --2- 172.21.15.103:0/2946911144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f971a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.140+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/2946911144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 0x562a6f96f140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009c20 tx=0x7f1a9c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=217e4d43500c4405 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.140+0000 7f1a8bfff640 1 -- 172.21.15.103:0/2946911144 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c004030 con 0x562a6f964dc0 2024-09-19T06:08:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.140+0000 7f1a96ffd640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f1a8c0a3550 0x7f1a8c0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.141+0000 7f1a8bfff640 1 -- 172.21.15.103:0/2946911144 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a9c0035f0 con 0x562a6f964dc0 2024-09-19T06:08:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.141+0000 7f1aa5782640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f1a8c0a3550 0x7f1a8c0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.141+0000 7f1a96ffd640 1 -- 172.21.15.103:0/3498893140 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f1a980cf8a0 con 0x7f1aa0106a70 2024-09-19T06:08:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.141+0000 7f1a8bfff640 1 -- 172.21.15.103:0/2946911144 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c019640 con 0x562a6f964dc0 2024-09-19T06:08:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.142+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/2946911144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 msgr2=0x562a6f96f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.142+0000 7f1aa5782640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f1a8c0a3550 0x7f1a8c0a5a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x562a6f961db0 tx=0x7f1a90000bc0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.142+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/2946911144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 0x562a6f96f140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009c20 tx=0x7f1a9c011810 comp rx=0 tx=0).stop 2024-09-19T06:08:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.142+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/2946911144 shutdown_connections 2024-09-19T06:08:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.142+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/2946911144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f971a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.142+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/2946911144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 0x562a6f96f140 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.142+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/2946911144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f9644a0 0x562a6f964880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.142+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/2946911144 >> 172.21.15.103:0/2946911144 conn(0x562a6f960a30 msgr2=0x562a6f960e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.142+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/2946911144 shutdown_connections 2024-09-19T06:08:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.143+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/2946911144 wait complete. 2024-09-19T06:08:12.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.143+0000 7f1aaa5c0740 1 -- start start 2024-09-19T06:08:12.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.143+0000 7f1aaa5c0740 1 Processor -- start 2024-09-19T06:08:12.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.144+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f9644a0 0x562a6f96ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.144+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 0x562a6f96c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.144+0000 7f1aa5f83640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f9644a0 0x562a6f96ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.144+0000 7f1aa5f83640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f9644a0 0x562a6f96ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50774/0 (socket says 172.21.15.103:50774) 2024-09-19T06:08:12.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.144+0000 7f1aa5f83640 1 -- 172.21.15.103:0/1951250955 learned_addr learned my addr 172.21.15.103:0/1951250955 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.144+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f96f680 0x562a6f96c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562a6f9722a0 con 0x562a6f9644a0 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562a6f885050 con 0x562a6f964dc0 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562a6f972420 con 0x562a6f96f680 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aaa5c0740 10 client.0 _ll_register_callbacks cb 0x562a6f8c5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aa5782640 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 0x562a6f96c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aa6784640 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f96f680 0x562a6f96c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aa5f83640 1 -- 172.21.15.103:0/1951250955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f96f680 msgr2=0x562a6f96c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f96f680 0x562a6f96c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aa5f83640 1 -- 172.21.15.103:0/1951250955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 msgr2=0x562a6f96c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 0x562a6f96c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.145+0000 7f1aa5f83640 1 -- 172.21.15.103:0/1951250955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6f63b3c0 con 0x562a6f9644a0 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.146+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f9644a0 0x562a6f96ef30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009460 tx=0x7f1a9c0042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f898d7ee12b105ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:12.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.146+0000 7f1a897fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:12.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.146+0000 7f1a897fa640 1 -- 172.21.15.103:0/1951250955 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c028020 con 0x562a6f9644a0 2024-09-19T06:08:12.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.146+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a9c0035f0 con 0x562a6f9644a0 2024-09-19T06:08:12.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.146+0000 7f1a897fa640 1 -- 172.21.15.103:0/1951250955 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f1a9c005040 con 0x562a6f9644a0 2024-09-19T06:08:12.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.146+0000 7f1a897fa640 1 -- 172.21.15.103:0/1951250955 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a9c033050 con 0x562a6f9644a0 2024-09-19T06:08:12.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.146+0000 7f1aaa5c0740 10 client.15540 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:12.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.146+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a6f97dba0 con 0x562a6f9644a0 2024-09-19T06:08:12.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.147+0000 7f1a897fa640 1 -- 172.21.15.103:0/1951250955 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a9c0035f0 con 0x562a6f9644a0 2024-09-19T06:08:12.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.148+0000 7f1a897fa640 1 -- 172.21.15.103:0/1951250955 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a9c018070 con 0x562a6f9644a0 2024-09-19T06:08:12.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.148+0000 7f1aaa5c0740 10 client.15540 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:12.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.148+0000 7f1aaa5c0740 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:12.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.148+0000 7f1aaa5c0740 20 client.15540 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.148+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562a6f97efb0 0x562a6f9813a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.148+0000 7f1aaa5c0740 4 client.15540 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.148+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a6f8d7850 con 0x562a6f97efb0 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.148+0000 7f1aa5782640 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562a6f97efb0 0x562a6f9813a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.148+0000 7f1a897fa640 10 client.15540 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.148+0000 7f1aa5782640 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562a6f97efb0 0x562a6f9813a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db521e7a6b58f05e server_cookie=7e535aeeaba25fe9 in_seq=0 out_seq=0 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.149+0000 7f1a897fa640 1 -- 172.21.15.103:0/1951250955 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a6f8d7850 con 0x562a6f97efb0 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.149+0000 7f1a897fa640 10 client.15540 handle_command_reply: tid=0 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.149+0000 7f1aaa5c0740 1 client.15540 shutdown 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f9644a0 msgr2=0x562a6f96ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f9644a0 0x562a6f96ef30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009460 tx=0x7f1a9c0042b0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 shutdown_connections 2024-09-19T06:08:12.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562a6f97efb0 0x562a6f9813a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f96f680 0x562a6f96c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f964dc0 0x562a6f96c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/1951250955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f9644a0 0x562a6f96ef30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 >> 172.21.15.103:0/1951250955 conn(0x562a6f960a30 msgr2=0x562a6f966710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:12.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1a897fa640 0 client.15540 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:12.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 shutdown_connections 2024-09-19T06:08:12.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/1951250955 wait complete. 2024-09-19T06:08:12.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.150+0000 7f1aaa5c0740 20 client.15540 trim_cache size 0 max 16384 2024-09-19T06:08:12.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.184+0000 7f1aaa5c0740 1 Processor -- start 2024-09-19T06:08:12.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.184+0000 7f1aaa5c0740 1 -- start start 2024-09-19T06:08:12.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.184+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 0x562a6f97b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.184+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f964dc0 0x562a6f986b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.184+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f9870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.184+0000 7f1aaa5c0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa01b66b0 con 0x562a6f96f680 2024-09-19T06:08:12.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.184+0000 7f1aaa5c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa01b3f80 con 0x562a6f9644a0 2024-09-19T06:08:12.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.184+0000 7f1aaa5c0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa01b1dd0 con 0x562a6f964dc0 2024-09-19T06:08:12.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa6784640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f9870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa6784640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f9870a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50776/0 (socket says 172.21.15.103:50776) 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa6784640 1 -- 172.21.15.103:0/2056573734 learned_addr learned my addr 172.21.15.103:0/2056573734 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/2056573734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 0x562a6f97b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa5782640 1 --2- 172.21.15.103:0/2056573734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f964dc0 0x562a6f986b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa6784640 1 -- 172.21.15.103:0/2056573734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f964dc0 msgr2=0x562a6f986b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa6784640 1 --2- 172.21.15.103:0/2056573734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f964dc0 0x562a6f986b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa6784640 1 -- 172.21.15.103:0/2056573734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 msgr2=0x562a6f97b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa6784640 1 --2- 172.21.15.103:0/2056573734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 0x562a6f97b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa6784640 1 -- 172.21.15.103:0/2056573734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6f960860 con 0x562a6f96f680 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1aa6784640 1 --2- 172.21.15.103:0/2056573734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f9870a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1a9809b960 tx=0x7f1a98003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac534ce3f06fa3dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.185+0000 7f1a8b7fe640 1 -- 172.21.15.103:0/2056573734 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98099cd0 con 0x562a6f96f680 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.186+0000 7f1a8b7fe640 1 -- 172.21.15.103:0/2056573734 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a98003fd0 con 0x562a6f96f680 2024-09-19T06:08:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.186+0000 7f1a8b7fe640 1 -- 172.21.15.103:0/2056573734 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98097720 con 0x562a6f96f680 2024-09-19T06:08:12.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/2056573734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 msgr2=0x562a6f9870a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:12.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/2056573734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f9870a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1a9809b960 tx=0x7f1a98003da0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/2056573734 shutdown_connections 2024-09-19T06:08:12.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/2056573734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f96f680 0x562a6f9870a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/2056573734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f964dc0 0x562a6f986b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/2056573734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 0x562a6f97b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/2056573734 >> 172.21.15.103:0/2056573734 conn(0x562a6f960a30 msgr2=0x562a6f96b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/2056573734 shutdown_connections 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/2056573734 wait complete. 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 -- start start 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.187+0000 7f1aaa5c0740 1 Processor -- start 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 0x562a6f974bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f964dc0 0x562a6f9750f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aaa5c0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f96f680 0x562a6f9e7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aaa5c0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa01b2440 con 0x562a6f964dc0 2024-09-19T06:08:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aaa5c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa01b38b0 con 0x562a6f9644a0 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aaa5c0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa01b2b10 con 0x562a6f96f680 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aaa5c0740 10 client.0 _ll_register_callbacks cb 0x7f1a900097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aa5f83640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 0x562a6f974bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aa5f83640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 0x562a6f974bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:36998/0 (socket says 172.21.15.103:36998) 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aa5f83640 1 -- 172.21.15.103:0/780139220 learned_addr learned my addr 172.21.15.103:0/780139220 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.188+0000 7f1aa6784640 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f96f680 0x562a6f9e7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1aa5f83640 1 -- 172.21.15.103:0/780139220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f96f680 msgr2=0x562a6f9e7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f96f680 0x562a6f9e7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1aa5782640 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f964dc0 0x562a6f9750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1aa5f83640 1 -- 172.21.15.103:0/780139220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f964dc0 msgr2=0x562a6f9750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f964dc0 0x562a6f9750f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1aa5f83640 1 -- 172.21.15.103:0/780139220 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6f9e8120 con 0x562a6f9644a0 2024-09-19T06:08:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1aa5782640 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f964dc0 0x562a6f9750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1aa5f83640 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 0x562a6f974bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c003af0 tx=0x7f1a9c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=771d08be49e35c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1a897fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:08:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1a897fa640 1 -- 172.21.15.103:0/780139220 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c028070 con 0x562a6f9644a0 2024-09-19T06:08:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1a897fa640 1 -- 172.21.15.103:0/780139220 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f1a9c01aab0 con 0x562a6f9644a0 2024-09-19T06:08:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.189+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/780139220 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a98003fd0 con 0x562a6f9644a0 2024-09-19T06:08:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.190+0000 7f1a897fa640 1 -- 172.21.15.103:0/780139220 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a9c01f040 con 0x562a6f9644a0 2024-09-19T06:08:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.190+0000 7f1aaa5c0740 10 client.25106 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.190+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/780139220 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a6f9e9410 con 0x562a6f9644a0 2024-09-19T06:08:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.190+0000 7f1a897fa640 1 -- 172.21.15.103:0/780139220 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a98003fd0 con 0x562a6f9644a0 2024-09-19T06:08:12.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.190+0000 7f1a897fa640 1 -- 172.21.15.103:0/780139220 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a9c018040 con 0x562a6f9644a0 2024-09-19T06:08:12.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.190+0000 7f1aaa5c0740 10 client.25106 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.190+0000 7f1aaa5c0740 10 client.25106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.190+0000 7f1aaa5c0740 20 client.25106 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.191+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562a6f9e9a80 0x562a6f9ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.191+0000 7f1aaa5c0740 4 client.25106 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.191+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/780139220 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562a6f8d1d60 con 0x562a6f9e9a80 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.191+0000 7f1aa5782640 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562a6f9e9a80 0x562a6f9ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.191+0000 7f1a897fa640 10 client.25106 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.191+0000 7f1aa5782640 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562a6f9e9a80 0x562a6f9ebea0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7f6527f796e855e server_cookie=8dddaa73704ebcf3 in_seq=0 out_seq=0 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1a897fa640 1 -- 172.21.15.103:0/780139220 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562a6f8d1d60 con 0x562a6f9e9a80 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1a897fa640 10 client.25106 handle_command_reply: tid=0 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1aaa5c0740 1 client.25106 shutdown 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/780139220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 msgr2=0x562a6f974bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 0x562a6f974bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c003af0 tx=0x7f1a9c005f90 comp rx=0 tx=0).stop 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/780139220 shutdown_connections 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562a6f9e9a80 0x562a6f9ebea0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6f96f680 0x562a6f9e7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562a6f964dc0 0x562a6f9750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1aaa5c0740 1 --2- 172.21.15.103:0/780139220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562a6f9644a0 0x562a6f974bb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/780139220 >> 172.21.15.103:0/780139220 conn(0x562a6f960a30 msgr2=0x562a6f95f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.192+0000 7f1a897fa640 0 client.25106 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.193+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/780139220 shutdown_connections 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.193+0000 7f1aaa5c0740 1 -- 172.21.15.103:0/780139220 wait complete. 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.193+0000 7f1aaa5c0740 20 client.25106 trim_cache size 0 max 16384 2024-09-19T06:08:12.198 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:08:12.199 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:08:12.199 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-19T06:08:12.199 INFO:teuthology.orchestra.run.smithi103.stdout: "3552a747-7f0d-4a6e-bbae-1b434cb73f3d": { 2024-09-19T06:08:12.199 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/", 2024-09-19T06:08:12.199 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "3552a747-7f0d-4a6e-bbae-1b434cb73f3d", 2024-09-19T06:08:12.199 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-19T06:08:12.199 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:08:12.199 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:08:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.193+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3498893140 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f1a8c0a3550 msgr2=0x7f1a8c0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.193+0000 7f1aa81e7640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f1a8c0a3550 0x7f1a8c0a5a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x562a6f961db0 tx=0x7f1a90000bc0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.194+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3498893140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1aa0106a70 msgr2=0x7f1aa01a3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.194+0000 7f1aa81e7640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1aa0106a70 0x7f1aa01a3340 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009fd0 tx=0x7f1a9800b260 comp rx=0 tx=0).stop 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.194+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3498893140 shutdown_connections 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.194+0000 7f1aa81e7640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f1a8c0a3550 0x7f1a8c0a5a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.194+0000 7f1aa81e7640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1aa0106a70 0x7f1aa01a3340 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.194+0000 7f1aa81e7640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0101410 0x7f1aa019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.194+0000 7f1aa81e7640 1 --2- 172.21.15.103:0/3498893140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0100a70 0x7f1aa019ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.194+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3498893140 >> 172.21.15.103:0/3498893140 conn(0x7f1aa00fc7d0 msgr2=0x7f1aa00fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.194+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3498893140 shutdown_connections 2024-09-19T06:08:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:12.194+0000 7f1aa81e7640 1 -- 172.21.15.103:0/3498893140 wait complete. 2024-09-19T06:08:12.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:11 smithi174 ceph-mon[34488]: scrub queued for path: / 2024-09-19T06:08:12.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:11 smithi174 ceph-mon[34488]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:12.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:11 smithi174 ceph-mon[34488]: scrub summary: active paths [/] 2024-09-19T06:08:12.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:11 smithi174 ceph-mon[34488]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:12.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:11 smithi169 ceph-mon[34350]: scrub queued for path: / 2024-09-19T06:08:12.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:11 smithi169 ceph-mon[34350]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:12.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:11 smithi169 ceph-mon[34350]: scrub summary: active paths [/] 2024-09-19T06:08:12.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:11 smithi169 ceph-mon[34350]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:12.932 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:12 smithi103 ceph-mon[30925]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-09-19T06:08:12.975 INFO:tasks.cephfs.filesystem:scrub status for tag:3552a747-7f0d-4a6e-bbae-1b434cb73f3d - {'path': '/', 'tag': '3552a747-7f0d-4a6e-bbae-1b434cb73f3d', 'options': 'recursive,force'} 2024-09-19T06:08:13.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:12 smithi174 ceph-mon[34488]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-09-19T06:08:13.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:12 smithi169 ceph-mon[34350]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-09-19T06:08:15.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:14 smithi174 ceph-mon[34488]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-19T06:08:15.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:14 smithi103 ceph-mon[30925]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-19T06:08:15.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:14 smithi169 ceph-mon[34350]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-19T06:08:16.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:15 smithi174 ceph-mon[34488]: scrub summary: idle 2024-09-19T06:08:16.214 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:15 smithi103 ceph-mon[30925]: scrub summary: idle 2024-09-19T06:08:16.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:15 smithi169 ceph-mon[34350]: scrub summary: idle 2024-09-19T06:08:17.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:16 smithi174 ceph-mon[34488]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 682 B/s wr, 14 op/s 2024-09-19T06:08:17.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:16 smithi103 ceph-mon[30925]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 682 B/s wr, 14 op/s 2024-09-19T06:08:17.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:16 smithi169 ceph-mon[34350]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 682 B/s wr, 14 op/s 2024-09-19T06:08:19.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:18 smithi174 ceph-mon[34488]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T06:08:19.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:18 smithi103 ceph-mon[30925]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T06:08:19.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:18 smithi169 ceph-mon[34350]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T06:08:21.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:20 smithi174 ceph-mon[34488]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T06:08:21.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:20 smithi103 ceph-mon[30925]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T06:08:21.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:20 smithi169 ceph-mon[34350]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T06:08:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.133+0000 7f03e920e640 1 -- 172.21.15.103:0/3914694580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03e41069c0 msgr2=0x7f03e4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.133+0000 7f03e920e640 1 --2- 172.21.15.103:0/3914694580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03e41069c0 0x7f03e4106da0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009930 tx=0x7f03d402a420 comp rx=0 tx=0).stop 2024-09-19T06:08:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.133+0000 7f03e920e640 1 -- 172.21.15.103:0/3914694580 shutdown_connections 2024-09-19T06:08:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.134+0000 7f03e920e640 1 --2- 172.21.15.103:0/3914694580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e4101350 0x7f03e410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.134+0000 7f03e920e640 1 --2- 172.21.15.103:0/3914694580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e41009b0 0x7f03e4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.134+0000 7f03e920e640 1 --2- 172.21.15.103:0/3914694580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03e41069c0 0x7f03e4106da0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.134+0000 7f03e920e640 1 -- 172.21.15.103:0/3914694580 >> 172.21.15.103:0/3914694580 conn(0x7f03e4077990 msgr2=0x7f03e40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.134+0000 7f03e920e640 1 -- 172.21.15.103:0/3914694580 shutdown_connections 2024-09-19T06:08:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.134+0000 7f03e920e640 1 -- 172.21.15.103:0/3914694580 wait complete. 2024-09-19T06:08:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e920e640 1 Processor -- start 2024-09-19T06:08:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e920e640 1 -- start start 2024-09-19T06:08:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e920e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03e41009b0 0x7f03e4199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e920e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e4101350 0x7f03e4199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e920e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e41069c0 0x7f03e41a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e920e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f03e4110cb0 con 0x7f03e41009b0 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03e41009b0 0x7f03e4199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e4101350 0x7f03e4199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e4101350 0x7f03e4199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:52756/0 (socket says 172.21.15.103:52756) 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e259c640 1 -- 172.21.15.103:0/700863772 learned_addr learned my addr 172.21.15.103:0/700863772 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e920e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03e4110b30 con 0x7f03e41069c0 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.135+0000 7f03e920e640 1 -- 172.21.15.103:0/700863772 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f03e4110e30 con 0x7f03e4101350 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03e359e640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e41069c0 0x7f03e41a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03e259c640 1 -- 172.21.15.103:0/700863772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e41069c0 msgr2=0x7f03e41a4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03e259c640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e41069c0 0x7f03e41a4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03e259c640 1 -- 172.21.15.103:0/700863772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03e41009b0 msgr2=0x7f03e4199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03e259c640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03e41009b0 0x7f03e4199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03e259c640 1 -- 172.21.15.103:0/700863772 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e41a46c0 con 0x7f03e4101350 2024-09-19T06:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03e359e640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e41069c0 0x7f03e41a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03e41009b0 0x7f03e4199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03e259c640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e4101350 0x7f03e4199640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e9f0 tx=0x7f03d800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03cbfff640 1 -- 172.21.15.103:0/700863772 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d800cd80 con 0x7f03e4101350 2024-09-19T06:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03cbfff640 1 -- 172.21.15.103:0/700863772 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03d80108e0 con 0x7f03e4101350 2024-09-19T06:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.136+0000 7f03cbfff640 1 -- 172.21.15.103:0/700863772 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8018920 con 0x7f03e4101350 2024-09-19T06:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.137+0000 7f03e920e640 1 -- 172.21.15.103:0/700863772 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e41a4890 con 0x7f03e4101350 2024-09-19T06:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.137+0000 7f03e920e640 1 -- 172.21.15.103:0/700863772 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e41a4ca0 con 0x7f03e4101350 2024-09-19T06:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.139+0000 7f03cbfff640 1 -- 172.21.15.103:0/700863772 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7f03d8010a90 con 0x7f03e4101350 2024-09-19T06:08:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.140+0000 7f03cbfff640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f03cc0a3580 0x7f03cc0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.140+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f03cc0a3580 0x7f03cc0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.140+0000 7f03cbfff640 1 -- 172.21.15.103:0/700863772 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f03d80d0360 con 0x7f03e4101350 2024-09-19T06:08:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.140+0000 7f03ec083740 1 Processor -- start 2024-09-19T06:08:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.140+0000 7f03ec083740 1 -- start start 2024-09-19T06:08:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f03cc0a3580 0x7f03cc0a5a40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009900 tx=0x7f03d4000bc0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03ec083740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03ec083740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61ab770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03ec083740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03ec083740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560ec61052f0 con 0x560ec61a1410 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03ec083740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560ec60ad270 con 0x560ec61a0af0 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03ec083740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560ec61012b0 con 0x560ec61abcb0 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61ab770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54118/0 (socket says 172.21.15.103:54118) 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e259c640 1 -- 172.21.15.103:0/3436938969 learned_addr learned my addr 172.21.15.103:0/3436938969 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/3436938969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e359e640 1 --2- 172.21.15.103:0/3436938969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e259c640 1 -- 172.21.15.103:0/3436938969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 msgr2=0x560ec61ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e259c640 1 --2- 172.21.15.103:0/3436938969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e259c640 1 -- 172.21.15.103:0/3436938969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 msgr2=0x560ec61a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e259c640 1 --2- 172.21.15.103:0/3436938969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e259c640 1 -- 172.21.15.103:0/3436938969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec60ac340 con 0x560ec61a1410 2024-09-19T06:08:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e359e640 1 --2- 172.21.15.103:0/3436938969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.141+0000 7f03e259c640 1 --2- 172.21.15.103:0/3436938969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61ab770 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f03d809c0e0 tx=0x7f03d8010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd865daf2aede52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.142+0000 7f03c97fa640 1 -- 172.21.15.103:0/3436938969 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d80b5070 con 0x560ec61a1410 2024-09-19T06:08:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.142+0000 7f03c97fa640 1 -- 172.21.15.103:0/3436938969 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03d80a5050 con 0x560ec61a1410 2024-09-19T06:08:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.142+0000 7f03c97fa640 1 -- 172.21.15.103:0/3436938969 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d80cde60 con 0x560ec61a1410 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 -- 172.21.15.103:0/3436938969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 msgr2=0x560ec61ab770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 --2- 172.21.15.103:0/3436938969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61ab770 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f03d809c0e0 tx=0x7f03d8010f20 comp rx=0 tx=0).stop 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 -- 172.21.15.103:0/3436938969 shutdown_connections 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 --2- 172.21.15.103:0/3436938969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 --2- 172.21.15.103:0/3436938969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61ab770 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 --2- 172.21.15.103:0/3436938969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 -- 172.21.15.103:0/3436938969 >> 172.21.15.103:0/3436938969 conn(0x560ec619d060 msgr2=0x560ec619d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 -- 172.21.15.103:0/3436938969 shutdown_connections 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 -- 172.21.15.103:0/3436938969 wait complete. 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 -- start start 2024-09-19T06:08:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.143+0000 7f03ec083740 1 Processor -- start 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03ec083740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03ec083740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61a91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54134/0 (socket says 172.21.15.103:54134) 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03ec083740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e259c640 1 -- 172.21.15.103:0/590884985 learned_addr learned my addr 172.21.15.103:0/590884985 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560ec61ae880 con 0x560ec61a1410 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560ec608e290 con 0x560ec61a0af0 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560ec61aea00 con 0x560ec61abcb0 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03ec083740 10 client.0 _ll_register_callbacks cb 0x560ec60bf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e359e640 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e259c640 1 -- 172.21.15.103:0/590884985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 msgr2=0x560ec61a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e259c640 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e259c640 1 -- 172.21.15.103:0/590884985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 msgr2=0x560ec61a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e259c640 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e259c640 1 -- 172.21.15.103:0/590884985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ec5e18210 con 0x560ec61a1410 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e359e640 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03d80a5050 con 0x560ec61a1410 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03e259c640 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61a91d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f03d80987f0 tx=0x7f03d80b5390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dceff914ac825a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03c6ff5640 10 client.15555 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.144+0000 7f03c6ff5640 1 -- 172.21.15.103:0/590884985 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d80ad050 con 0x560ec61a1410 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03c6ff5640 1 -- 172.21.15.103:0/590884985 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f03d80cde10 con 0x560ec61a1410 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03c6ff5640 1 -- 172.21.15.103:0/590884985 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f03d80b9020 con 0x560ec61a1410 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03ec083740 10 client.15555 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=25}) -- 0x560ec5ee4620 con 0x560ec61a1410 2024-09-19T06:08:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03c6ff5640 1 -- 172.21.15.103:0/590884985 <== mon.0 v2:172.21.15.103:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f03d80b0020 con 0x560ec61a1410 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03ec083740 10 client.15555 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03ec083740 10 client.15555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03ec083740 20 client.15555 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03ec083740 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x560ec61bba80 0x560ec61bde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03ec083740 4 client.15555 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ec6112a20 con 0x560ec61bba80 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.145+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x560ec61bba80 0x560ec61bde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.146+0000 7f03c6ff5640 10 client.15555 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.146+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x560ec61bba80 0x560ec61bde70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15c8ed481d80c6cf server_cookie=15b04534785e3693 in_seq=0 out_seq=0 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03c6ff5640 1 -- 172.21.15.103:0/590884985 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ec6112a20 con 0x560ec61bba80 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03c6ff5640 10 client.15555 handle_command_reply: tid=0 2024-09-19T06:08:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 client.15555 shutdown 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 msgr2=0x560ec61a91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61a91d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f03d80987f0 tx=0x7f03d80b5390 comp rx=0 tx=0).stop 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 shutdown_connections 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x560ec61bba80 0x560ec61bde70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61a91d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03c6ff5640 0 client.15555 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 --2- 172.21.15.103:0/590884985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 >> 172.21.15.103:0/590884985 conn(0x560ec619d060 msgr2=0x560ec61a2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 shutdown_connections 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 1 -- 172.21.15.103:0/590884985 wait complete. 2024-09-19T06:08:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.147+0000 7f03ec083740 20 client.15555 trim_cache size 0 max 16384 2024-09-19T06:08:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03ec083740 1 Processor -- start 2024-09-19T06:08:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03ec083740 1 -- start start 2024-09-19T06:08:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03ec083740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03ec083740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03ec083740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61c0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54142/0 (socket says 172.21.15.103:54142) 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03ec083740 1 -- 172.21.15.103:0/4160750531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f03e41aff20 con 0x560ec61a1410 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03e259c640 1 -- 172.21.15.103:0/4160750531 learned_addr learned my addr 172.21.15.103:0/4160750531 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03ec083740 1 -- 172.21.15.103:0/4160750531 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03e41ad7f0 con 0x560ec61a0af0 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03ec083740 1 -- 172.21.15.103:0/4160750531 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f03e41ab640 con 0x560ec61abcb0 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.172+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/4160750531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.173+0000 7f03e259c640 1 -- 172.21.15.103:0/4160750531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 msgr2=0x560ec61c13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.173+0000 7f03e259c640 1 --2- 172.21.15.103:0/4160750531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.173+0000 7f03e259c640 1 -- 172.21.15.103:0/4160750531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 msgr2=0x560ec61a9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.173+0000 7f03e259c640 1 --2- 172.21.15.103:0/4160750531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.173+0000 7f03e259c640 1 -- 172.21.15.103:0/4160750531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec61a9a80 con 0x560ec61a1410 2024-09-19T06:08:22.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.173+0000 7f03e259c640 1 --2- 172.21.15.103:0/4160750531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61c0e90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f03d8098db0 tx=0x7f03d80b1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a84165c41debb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:22.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.173+0000 7f03c8ff9640 1 -- 172.21.15.103:0/4160750531 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d80ad070 con 0x560ec61a1410 2024-09-19T06:08:22.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.173+0000 7f03c8ff9640 1 -- 172.21.15.103:0/4160750531 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03d80a5050 con 0x560ec61a1410 2024-09-19T06:08:22.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.173+0000 7f03c8ff9640 1 -- 172.21.15.103:0/4160750531 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8086e60 con 0x560ec61a1410 2024-09-19T06:08:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 -- 172.21.15.103:0/4160750531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 msgr2=0x560ec61c0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 --2- 172.21.15.103:0/4160750531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61c0e90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f03d8098db0 tx=0x7f03d80b1000 comp rx=0 tx=0).stop 2024-09-19T06:08:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 -- 172.21.15.103:0/4160750531 shutdown_connections 2024-09-19T06:08:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 --2- 172.21.15.103:0/4160750531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61abcb0 0x560ec61c13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 --2- 172.21.15.103:0/4160750531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61a1410 0x560ec61c0e90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 --2- 172.21.15.103:0/4160750531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a0af0 0x560ec61a9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 -- 172.21.15.103:0/4160750531 >> 172.21.15.103:0/4160750531 conn(0x560ec619d060 msgr2=0x560ec61b74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 -- 172.21.15.103:0/4160750531 shutdown_connections 2024-09-19T06:08:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 -- 172.21.15.103:0/4160750531 wait complete. 2024-09-19T06:08:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 -- start start 2024-09-19T06:08:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.174+0000 7f03ec083740 1 Processor -- start 2024-09-19T06:08:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03ec083740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61a0af0 0x560ec61c1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03ec083740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a1410 0x560ec61be6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03ec083740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61abcb0 0x560ec61bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03ec083740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f03e41abcb0 con 0x560ec61abcb0 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03ec083740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03e41ad120 con 0x560ec61a1410 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03ec083740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f03e41ac380 con 0x560ec61a0af0 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03ec083740 10 client.0 _ll_register_callbacks cb 0x7f03d8096f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61abcb0 0x560ec61bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61abcb0 0x560ec61bec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54154/0 (socket says 172.21.15.103:54154) 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e359e640 1 -- 172.21.15.103:0/462419280 learned_addr learned my addr 172.21.15.103:0/462419280 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e259c640 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a1410 0x560ec61be6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61a0af0 0x560ec61c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e259c640 1 -- 172.21.15.103:0/462419280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61a0af0 msgr2=0x560ec61c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e259c640 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61a0af0 0x560ec61c1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e259c640 1 -- 172.21.15.103:0/462419280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61abcb0 msgr2=0x560ec61bec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e259c640 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61abcb0 0x560ec61bec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e259c640 1 -- 172.21.15.103:0/462419280 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ec61bf1d0 con 0x560ec61a1410 2024-09-19T06:08:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e359e640 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61abcb0 0x560ec61bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03e259c640 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a1410 0x560ec61be6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x560ec61a3580 tx=0x7f03d8098700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d457d3e0d2d2cc57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.175+0000 7f03c6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03c6ff5640 1 -- 172.21.15.103:0/462419280 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8086e60 con 0x560ec61a1410 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03c6ff5640 1 -- 172.21.15.103:0/462419280 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f03d80cde10 con 0x560ec61a1410 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03ec083740 1 -- 172.21.15.103:0/462419280 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03d80a5050 con 0x560ec61a1410 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03c6ff5640 1 -- 172.21.15.103:0/462419280 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f03d80ad070 con 0x560ec61a1410 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03ec083740 10 client.25124 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03ec083740 1 -- 172.21.15.103:0/462419280 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560ec61bf1d0 con 0x560ec61a1410 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03c6ff5640 1 -- 172.21.15.103:0/462419280 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03d80a5050 con 0x560ec61a1410 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03c6ff5640 1 -- 172.21.15.103:0/462419280 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f03d80b0040 con 0x560ec61a1410 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03ec083740 10 client.25124 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03ec083740 10 client.25124 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03ec083740 20 client.25124 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03ec083740 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x560ec62264a0 0x560ec62288c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03ec083740 4 client.25124 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:08:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.176+0000 7f03ec083740 1 -- 172.21.15.103:0/462419280 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560ec610cd70 con 0x560ec62264a0 2024-09-19T06:08:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.177+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x560ec62264a0 0x560ec62288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.177+0000 7f03c6ff5640 10 client.25124 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.177+0000 7f03e2d9d640 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x560ec62264a0 0x560ec62288c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cc44c6083d53d9e server_cookie=3a30991fb068623d in_seq=0 out_seq=0 2024-09-19T06:08:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03c6ff5640 1 -- 172.21.15.103:0/462419280 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560ec610cd70 con 0x560ec62264a0 2024-09-19T06:08:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03c6ff5640 10 client.25124 handle_command_reply: tid=0 2024-09-19T06:08:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 client.25124 shutdown 2024-09-19T06:08:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 -- 172.21.15.103:0/462419280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a1410 msgr2=0x560ec61be6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a1410 0x560ec61be6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x560ec61a3580 tx=0x7f03d8098700 comp rx=0 tx=0).stop 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 -- 172.21.15.103:0/462419280 shutdown_connections 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x560ec62264a0 0x560ec62288c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560ec61abcb0 0x560ec61bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec61a1410 0x560ec61be6d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 --2- 172.21.15.103:0/462419280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560ec61a0af0 0x560ec61c1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 -- 172.21.15.103:0/462419280 >> 172.21.15.103:0/462419280 conn(0x560ec619d060 msgr2=0x560ec61a24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03c6ff5640 0 client.25124 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 -- 172.21.15.103:0/462419280 shutdown_connections 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 1 -- 172.21.15.103:0/462419280 wait complete. 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.181+0000 7f03ec083740 20 client.25124 trim_cache size 0 max 16384 2024-09-19T06:08:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:08:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:08:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:08:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:08:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 -- 172.21.15.103:0/700863772 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f03cc0a3580 msgr2=0x7f03cc0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f03cc0a3580 0x7f03cc0a5a40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009900 tx=0x7f03d4000bc0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 -- 172.21.15.103:0/700863772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e4101350 msgr2=0x7f03e4199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e4101350 0x7f03e4199640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e9f0 tx=0x7f03d800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 -- 172.21.15.103:0/700863772 shutdown_connections 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f03cc0a3580 0x7f03cc0a5a40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e41069c0 0x7f03e41a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e4101350 0x7f03e4199640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 --2- 172.21.15.103:0/700863772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03e41009b0 0x7f03e4199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 -- 172.21.15.103:0/700863772 >> 172.21.15.103:0/700863772 conn(0x7f03e4077990 msgr2=0x7f03e40ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 -- 172.21.15.103:0/700863772 shutdown_connections 2024-09-19T06:08:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:22.182+0000 7f03e920e640 1 -- 172.21.15.103:0/700863772 wait complete. 2024-09-19T06:08:23.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:22 smithi174 ceph-mon[34488]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T06:08:23.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:22 smithi103 ceph-mon[30925]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T06:08:23.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:22 smithi169 ceph-mon[34350]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T06:08:25.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:24 smithi174 ceph-mon[34488]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:08:25.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:24 smithi103 ceph-mon[30925]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:08:25.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:24 smithi169 ceph-mon[34350]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:08:27.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:26 smithi174 ceph-mon[34488]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:08:27.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:26 smithi103 ceph-mon[30925]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:08:27.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:26 smithi169 ceph-mon[34350]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr: git switch -c 2024-09-19T06:08:28.716 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:08:28.717 INFO:tasks.workunit.client.0.smithi103.stderr:Or undo this operation with: 2024-09-19T06:08:28.717 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:08:28.717 INFO:tasks.workunit.client.0.smithi103.stderr: git switch - 2024-09-19T06:08:28.717 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:08:28.717 INFO:tasks.workunit.client.0.smithi103.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T06:08:28.717 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:08:28.717 INFO:tasks.workunit.client.0.smithi103.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T06:08:28.722 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T06:08:28.843 INFO:tasks.workunit.client.0.smithi103.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T06:08:28.845 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:08:28.846 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T06:08:29.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:28 smithi174 ceph-mon[34488]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:08:29.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:29.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:29.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:29.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:08:29.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:28 smithi103 ceph-mon[30925]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:08:29.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:29.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:29.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:29.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:08:29.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:28 smithi169 ceph-mon[34350]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:08:29.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:29.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:29.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:29.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:08:29.552 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T06:08:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T06:08:29.658 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:08:29.660 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:08:29.660 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T06:08:29.699 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:08:29.702 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T06:08:29.703 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T06:08:29.718 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-09-19T06:08:29.719 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-09-19T06:08:29.720 DEBUG:teuthology.orchestra.run.smithi103:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-09-19T06:08:29.783 INFO:tasks.workunit.client.0.smithi103.stderr:+ set -e 2024-09-19T06:08:29.784 INFO:tasks.workunit.client.0.smithi103.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-09-19T06:08:29.787 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into 'xfstests-dev'... 2024-09-19T06:08:31.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:30 smithi174 ceph-mon[34488]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:08:31.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:30 smithi103 ceph-mon[30925]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:08:31.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:30 smithi169 ceph-mon[34350]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:08:33.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:32 smithi174 ceph-mon[34488]: pgmap v39: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-09-19T06:08:33.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:32 smithi103 ceph-mon[30925]: pgmap v39: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-09-19T06:08:33.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:32 smithi169 ceph-mon[34350]: pgmap v39: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-09-19T06:08:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:34 smithi174 ceph-mon[34488]: pgmap v40: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-09-19T06:08:35.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:34 smithi103 ceph-mon[30925]: pgmap v40: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.272+0000 7fae3d84c640 1 -- 172.21.15.103:0/2895672073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae38100850 msgr2=0x7fae38100c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.272+0000 7fae3d84c640 1 --2- 172.21.15.103:0/2895672073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae38100850 0x7fae38100c30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fae28009930 tx=0x7fae2802a420 comp rx=0 tx=0).stop 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.272+0000 7fae3d84c640 1 -- 172.21.15.103:0/2895672073 shutdown_connections 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.272+0000 7fae3d84c640 1 --2- 172.21.15.103:0/2895672073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae38108110 0x7fae3810ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.272+0000 7fae3d84c640 1 --2- 172.21.15.103:0/2895672073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae38101200 0x7fae381079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.272+0000 7fae3d84c640 1 --2- 172.21.15.103:0/2895672073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae38100850 0x7fae38100c30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.272+0000 7fae3d84c640 1 -- 172.21.15.103:0/2895672073 >> 172.21.15.103:0/2895672073 conn(0x7fae38075db0 msgr2=0x7fae380761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.272+0000 7fae3d84c640 1 -- 172.21.15.103:0/2895672073 shutdown_connections 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.272+0000 7fae3d84c640 1 -- 172.21.15.103:0/2895672073 wait complete. 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.272+0000 7fae3d84c640 1 Processor -- start 2024-09-19T06:08:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae3d84c640 1 -- start start 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae3d84c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae38100850 0x7fae38196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae3d84c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae38108110 0x7fae381965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae3d84c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae3819a920 0x7fae3819add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae3d84c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae3810fbd0 con 0x7fae38108110 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae3d84c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae3810fa50 con 0x7fae3819a920 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae3d84c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fae3810fd50 con 0x7fae38100850 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae367fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae38108110 0x7fae381965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae367fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae38108110 0x7fae381965a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34982/0 (socket says 172.21.15.103:34982) 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae367fc640 1 -- 172.21.15.103:0/2264325105 learned_addr learned my addr 172.21.15.103:0/2264325105 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae377fe640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae3819a920 0x7fae3819add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae36ffd640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae38100850 0x7fae38196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae367fc640 1 -- 172.21.15.103:0/2264325105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae38100850 msgr2=0x7fae38196060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae367fc640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae38100850 0x7fae38196060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae367fc640 1 -- 172.21.15.103:0/2264325105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae3819a920 msgr2=0x7fae3819add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae367fc640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae3819a920 0x7fae3819add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae367fc640 1 -- 172.21.15.103:0/2264325105 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3819b410 con 0x7fae38108110 2024-09-19T06:08:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae36ffd640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae38100850 0x7fae38196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.273+0000 7fae367fc640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae38108110 0x7fae381965a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fae20011b20 tx=0x7fae2000f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.274+0000 7fae3c84a640 1 -- 172.21.15.103:0/2264325105 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2001e070 con 0x7fae38108110 2024-09-19T06:08:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.274+0000 7fae3c84a640 1 -- 172.21.15.103:0/2264325105 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae2000fc90 con 0x7fae38108110 2024-09-19T06:08:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.274+0000 7fae3d84c640 1 -- 172.21.15.103:0/2264325105 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3819b700 con 0x7fae38108110 2024-09-19T06:08:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.274+0000 7fae3c84a640 1 -- 172.21.15.103:0/2264325105 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20018700 con 0x7fae38108110 2024-09-19T06:08:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.274+0000 7fae3d84c640 1 -- 172.21.15.103:0/2264325105 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae381a2f40 con 0x7fae38108110 2024-09-19T06:08:35.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:34 smithi169 ceph-mon[34350]: pgmap v40: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-09-19T06:08:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae405e6740 1 Processor -- start 2024-09-19T06:08:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae405e6740 1 -- start start 2024-09-19T06:08:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae3c84a640 1 -- 172.21.15.103:0/2264325105 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7fae20021070 con 0x7fae38108110 2024-09-19T06:08:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae405e6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d7af0 0x558eab7d7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae405e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d8410 0x558eab7e2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae405e6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae405e6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558eab73c2f0 con 0x558eab7e2cb0 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae405e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558eab6e4270 con 0x558eab7d8410 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae405e6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558eab7382b0 con 0x558eab7d7af0 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae367fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae367fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34988/0 (socket says 172.21.15.103:34988) 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae367fc640 1 -- 172.21.15.103:0/1446587610 learned_addr learned my addr 172.21.15.103:0/1446587610 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae36ffd640 1 --2- 172.21.15.103:0/1446587610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d8410 0x558eab7e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae377fe640 1 --2- 172.21.15.103:0/1446587610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d7af0 0x558eab7d7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae367fc640 1 -- 172.21.15.103:0/1446587610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d7af0 msgr2=0x558eab7d7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae367fc640 1 --2- 172.21.15.103:0/1446587610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d7af0 0x558eab7d7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae367fc640 1 -- 172.21.15.103:0/1446587610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d8410 msgr2=0x558eab7e2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.277+0000 7fae367fc640 1 --2- 172.21.15.103:0/1446587610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d8410 0x558eab7e2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.278+0000 7fae367fc640 1 -- 172.21.15.103:0/1446587610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eab6e3340 con 0x558eab7e2cb0 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.278+0000 7fae3c84a640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fae240a3600 0x7fae240a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.278+0000 7fae36ffd640 1 --2- 172.21.15.103:0/1446587610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d8410 0x558eab7e2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.278+0000 7fae377fe640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fae240a3600 0x7fae240a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.278+0000 7fae367fc640 1 --2- 172.21.15.103:0/1446587610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e50a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fae200d0cb0 tx=0x7fae2009b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e961dc3409fc048f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.278+0000 7fae3c84a640 1 -- 172.21.15.103:0/2264325105 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fae200d3580 con 0x7fae38108110 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.278+0000 7fae2dffb640 1 -- 172.21.15.103:0/1446587610 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20028020 con 0x558eab7e2cb0 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.278+0000 7fae377fe640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fae240a3600 0x7fae240a5ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae30005fd0 tx=0x7fae30009500 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.278+0000 7fae2dffb640 1 -- 172.21.15.103:0/1446587610 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae200a3a10 con 0x558eab7e2cb0 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.278+0000 7fae2dffb640 1 -- 172.21.15.103:0/1446587610 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2009f250 con 0x558eab7e2cb0 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 -- 172.21.15.103:0/1446587610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 msgr2=0x558eab7e50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 --2- 172.21.15.103:0/1446587610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e50a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fae200d0cb0 tx=0x7fae2009b9b0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.286 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 -- 172.21.15.103:0/1446587610 shutdown_connections 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 --2- 172.21.15.103:0/1446587610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e50a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 --2- 172.21.15.103:0/1446587610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d8410 0x558eab7e2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 --2- 172.21.15.103:0/1446587610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d7af0 0x558eab7d7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 -- 172.21.15.103:0/1446587610 >> 172.21.15.103:0/1446587610 conn(0x558eab7d4060 msgr2=0x558eab7d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 -- 172.21.15.103:0/1446587610 shutdown_connections 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 -- 172.21.15.103:0/1446587610 wait complete. 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 -- start start 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.279+0000 7fae405e6740 1 Processor -- start 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae405e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae405e6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d8410 0x558eab7e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae405e6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae405e6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558eab7e5880 con 0x558eab7e2cb0 2024-09-19T06:08:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae405e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558eab6c5290 con 0x558eab7d7af0 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae405e6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558eab7e5a00 con 0x558eab7d8410 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae405e6740 10 client.0 _ll_register_callbacks cb 0x558eab6f6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35002/0 (socket says 172.21.15.103:35002) 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae377fe640 1 -- 172.21.15.103:0/675434895 learned_addr learned my addr 172.21.15.103:0/675434895 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae367fc640 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d8410 0x558eab7e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae36ffd640 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae377fe640 1 -- 172.21.15.103:0/675434895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d8410 msgr2=0x558eab7e00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae377fe640 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d8410 0x558eab7e00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae377fe640 1 -- 172.21.15.103:0/675434895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 msgr2=0x558eab7dfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae377fe640 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7dfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae377fe640 1 -- 172.21.15.103:0/675434895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eab44f210 con 0x558eab7e2cb0 2024-09-19T06:08:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae36ffd640 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7dfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae377fe640 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e0600 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae30003fa0 tx=0x7fae30004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b4b90236ea7b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.280+0000 7fae16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae16ffd640 1 -- 172.21.15.103:0/675434895 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30020820 con 0x558eab7e2cb0 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae405e6740 1 -- 172.21.15.103:0/675434895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae200a3a10 con 0x558eab7e2cb0 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae16ffd640 1 -- 172.21.15.103:0/675434895 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fae300209c0 con 0x558eab7e2cb0 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae16ffd640 1 -- 172.21.15.103:0/675434895 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fae30020bc0 con 0x558eab7e2cb0 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae405e6740 10 client.15573 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae405e6740 1 -- 172.21.15.103:0/675434895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558eab51b620 con 0x558eab7e2cb0 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae16ffd640 1 -- 172.21.15.103:0/675434895 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae200a3a10 con 0x558eab7e2cb0 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae16ffd640 1 -- 172.21.15.103:0/675434895 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fae30027070 con 0x558eab7e2cb0 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae405e6740 10 client.15573 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae405e6740 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae405e6740 20 client.15573 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae405e6740 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558eab7f2ca0 0x558eab7f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae405e6740 4 client.15573 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae405e6740 1 -- 172.21.15.103:0/675434895 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eab749a20 con 0x558eab7f2ca0 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.281+0000 7fae36ffd640 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558eab7f2ca0 0x558eab7f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.282+0000 7fae16ffd640 10 client.15573 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.282+0000 7fae36ffd640 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558eab7f2ca0 0x558eab7f5090 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e87657b3c11f994 server_cookie=bca2ebdb65cc4ea2 in_seq=0 out_seq=0 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.282+0000 7fae16ffd640 1 -- 172.21.15.103:0/675434895 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558eab749a20 con 0x558eab7f2ca0 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.282+0000 7fae16ffd640 10 client.15573 handle_command_reply: tid=0 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.282+0000 7fae405e6740 1 client.15573 shutdown 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 1 -- 172.21.15.103:0/675434895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 msgr2=0x558eab7e0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e0600 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae30003fa0 tx=0x7fae30004ab0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 1 -- 172.21.15.103:0/675434895 shutdown_connections 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558eab7f2ca0 0x558eab7f5090 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7e2cb0 0x558eab7e0600 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae16ffd640 0 client.15573 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d8410 0x558eab7e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 1 --2- 172.21.15.103:0/675434895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7dfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 1 -- 172.21.15.103:0/675434895 >> 172.21.15.103:0/675434895 conn(0x558eab7d4060 msgr2=0x558eab7d9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 1 -- 172.21.15.103:0/675434895 shutdown_connections 2024-09-19T06:08:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 1 -- 172.21.15.103:0/675434895 wait complete. 2024-09-19T06:08:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.283+0000 7fae405e6740 20 client.15573 trim_cache size 0 max 16384 2024-09-19T06:08:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae405e6740 1 Processor -- start 2024-09-19T06:08:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae405e6740 1 -- start start 2024-09-19T06:08:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae405e6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d7af0 0x558eab7da560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae405e6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d8410 0x558eab7e00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae405e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7e2cb0 0x558eab7e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae405e6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae381adcb0 con 0x558eab7d7af0 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae405e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae381ab580 con 0x558eab7e2cb0 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae405e6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fae381a93d0 con 0x558eab7d8410 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae36ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d7af0 0x558eab7da560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae36ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d7af0 0x558eab7da560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35014/0 (socket says 172.21.15.103:35014) 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.297+0000 7fae36ffd640 1 -- 172.21.15.103:0/411087376 learned_addr learned my addr 172.21.15.103:0/411087376 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae377fe640 1 --2- 172.21.15.103:0/411087376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7e2cb0 0x558eab7e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae367fc640 1 --2- 172.21.15.103:0/411087376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d8410 0x558eab7e00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae36ffd640 1 -- 172.21.15.103:0/411087376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d8410 msgr2=0x558eab7e00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae36ffd640 1 --2- 172.21.15.103:0/411087376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d8410 0x558eab7e00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae36ffd640 1 -- 172.21.15.103:0/411087376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7e2cb0 msgr2=0x558eab7e05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae36ffd640 1 --2- 172.21.15.103:0/411087376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7e2cb0 0x558eab7e05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae36ffd640 1 -- 172.21.15.103:0/411087376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eab7cf2d0 con 0x558eab7d7af0 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae36ffd640 1 --2- 172.21.15.103:0/411087376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d7af0 0x558eab7da560 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fae2802a940 tx=0x7fae28009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14afcedff1d996f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae2d7fa640 1 -- 172.21.15.103:0/411087376 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28048070 con 0x558eab7d7af0 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae2d7fa640 1 -- 172.21.15.103:0/411087376 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae28004400 con 0x558eab7d7af0 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.298+0000 7fae2d7fa640 1 -- 172.21.15.103:0/411087376 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28035030 con 0x558eab7d7af0 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 -- 172.21.15.103:0/411087376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d7af0 msgr2=0x558eab7da560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 --2- 172.21.15.103:0/411087376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d7af0 0x558eab7da560 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fae2802a940 tx=0x7fae28009520 comp rx=0 tx=0).stop 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 -- 172.21.15.103:0/411087376 shutdown_connections 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 --2- 172.21.15.103:0/411087376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7e2cb0 0x558eab7e05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 --2- 172.21.15.103:0/411087376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7d8410 0x558eab7e00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 --2- 172.21.15.103:0/411087376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d7af0 0x558eab7da560 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 -- 172.21.15.103:0/411087376 >> 172.21.15.103:0/411087376 conn(0x558eab7d4060 msgr2=0x558eab7e1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 -- 172.21.15.103:0/411087376 shutdown_connections 2024-09-19T06:08:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 -- 172.21.15.103:0/411087376 wait complete. 2024-09-19T06:08:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 -- start start 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.299+0000 7fae405e6740 1 Processor -- start 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae405e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7eb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae405e6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d8410 0x558eab7e6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae405e6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7e2cb0 0x558eab7e6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae405e6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae381a9a40 con 0x558eab7d8410 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae405e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae381aaeb0 con 0x558eab7d7af0 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae405e6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fae381aa110 con 0x558eab7e2cb0 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae405e6740 10 client.0 _ll_register_callbacks cb 0x7fae30009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae367fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d8410 0x558eab7e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae36ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae36ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7eb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:53616/0 (socket says 172.21.15.103:53616) 2024-09-19T06:08:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae36ffd640 1 -- 172.21.15.103:0/2941884209 learned_addr learned my addr 172.21.15.103:0/2941884209 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae367fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d8410 0x558eab7e6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35016/0 (socket says 172.21.15.103:35016) 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae377fe640 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7e2cb0 0x558eab7e6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae367fc640 1 -- 172.21.15.103:0/2941884209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7e2cb0 msgr2=0x558eab7e6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae367fc640 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7e2cb0 0x558eab7e6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae367fc640 1 -- 172.21.15.103:0/2941884209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 msgr2=0x558eab7eb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae367fc640 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7eb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae367fc640 1 -- 172.21.15.103:0/2941884209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eab7e7470 con 0x558eab7d8410 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae36ffd640 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae367fc640 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d8410 0x558eab7e6730 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fae200d0c60 tx=0x7fae200d6dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c628d7722e10f8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.300+0000 7fae16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae16ffd640 1 -- 172.21.15.103:0/2941884209 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2009f070 con 0x558eab7d8410 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae16ffd640 1 -- 172.21.15.103:0/2941884209 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fae2009b460 con 0x558eab7d8410 2024-09-19T06:08:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae405e6740 1 -- 172.21.15.103:0/2941884209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae28004400 con 0x558eab7d8410 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae16ffd640 1 -- 172.21.15.103:0/2941884209 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fae2009f250 con 0x558eab7d8410 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae405e6740 10 client.15579 fetch_fsmap learned FSMap version 25 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae405e6740 1 -- 172.21.15.103:0/2941884209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558eab85d9f0 con 0x558eab7d8410 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae16ffd640 1 -- 172.21.15.103:0/2941884209 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae28004400 con 0x558eab7d8410 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae16ffd640 1 -- 172.21.15.103:0/2941884209 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fae2009f970 con 0x558eab7d8410 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae405e6740 10 client.15579 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae405e6740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae405e6740 20 client.15579 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae405e6740 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558eab85dd30 0x558eab860120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae405e6740 4 client.15579 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae405e6740 1 -- 172.21.15.103:0/2941884209 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558eab743d70 con 0x558eab85dd30 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.301+0000 7fae36ffd640 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558eab85dd30 0x558eab860120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.302+0000 7fae16ffd640 10 client.15579 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.302+0000 7fae36ffd640 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558eab85dd30 0x558eab860120 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=694478cbf79d0331 server_cookie=699fde1a56df361a in_seq=0 out_seq=0 2024-09-19T06:08:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.528+0000 7fae16ffd640 1 -- 172.21.15.103:0/2941884209 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558eab743d70 con 0x558eab85dd30 2024-09-19T06:08:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.528+0000 7fae16ffd640 10 client.15579 handle_command_reply: tid=0 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.528+0000 7fae405e6740 1 client.15579 shutdown 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 1 -- 172.21.15.103:0/2941884209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d8410 msgr2=0x558eab7e6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d8410 0x558eab7e6730 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fae200d0c60 tx=0x7fae200d6dc0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 1 -- 172.21.15.103:0/2941884209 shutdown_connections 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558eab85dd30 0x558eab860120 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558eab7e2cb0 0x558eab7e6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae16ffd640 0 client.15579 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558eab7d8410 0x558eab7e6730 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 1 --2- 172.21.15.103:0/2941884209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eab7d7af0 0x558eab7eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 1 -- 172.21.15.103:0/2941884209 >> 172.21.15.103:0/2941884209 conn(0x558eab7d4060 msgr2=0x558eab7d29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 1 -- 172.21.15.103:0/2941884209 shutdown_connections 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 1 -- 172.21.15.103:0/2941884209 wait complete. 2024-09-19T06:08:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae405e6740 20 client.15579 trim_cache size 0 max 16384 2024-09-19T06:08:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:08:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:08:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:08:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:08:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae3d84c640 1 -- 172.21.15.103:0/2264325105 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fae240a3600 msgr2=0x7fae240a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae3d84c640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fae240a3600 0x7fae240a5ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae30005fd0 tx=0x7fae30009500 comp rx=0 tx=0).stop 2024-09-19T06:08:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae3d84c640 1 -- 172.21.15.103:0/2264325105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae38108110 msgr2=0x7fae381965a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae3d84c640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae38108110 0x7fae381965a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fae20011b20 tx=0x7fae2000f050 comp rx=0 tx=0).stop 2024-09-19T06:08:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae3d84c640 1 -- 172.21.15.103:0/2264325105 shutdown_connections 2024-09-19T06:08:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae3d84c640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fae240a3600 0x7fae240a5ac0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae3d84c640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae3819a920 0x7fae3819add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae3d84c640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae38108110 0x7fae381965a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae3d84c640 1 --2- 172.21.15.103:0/2264325105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae38100850 0x7fae38196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.529+0000 7fae3d84c640 1 -- 172.21.15.103:0/2264325105 >> 172.21.15.103:0/2264325105 conn(0x7fae38075db0 msgr2=0x7fae38105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.530+0000 7fae3d84c640 1 -- 172.21.15.103:0/2264325105 shutdown_connections 2024-09-19T06:08:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:35.530+0000 7fae3d84c640 1 -- 172.21.15.103:0/2264325105 wait complete. 2024-09-19T06:08:37.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:36 smithi174 ceph-mon[34488]: pgmap v41: 97 pgs: 97 active+clean; 19 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-09-19T06:08:37.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:36 smithi103 ceph-mon[30925]: pgmap v41: 97 pgs: 97 active+clean; 19 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-09-19T06:08:37.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:36 smithi169 ceph-mon[34350]: pgmap v41: 97 pgs: 97 active+clean; 19 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-09-19T06:08:39.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:38 smithi174 ceph-mon[34488]: pgmap v42: 97 pgs: 97 active+clean; 19 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-19T06:08:39.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:38 smithi103 ceph-mon[30925]: pgmap v42: 97 pgs: 97 active+clean; 19 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-19T06:08:39.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:38 smithi169 ceph-mon[34350]: pgmap v42: 97 pgs: 97 active+clean; 19 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-19T06:08:41.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:40 smithi174 ceph-mon[34488]: pgmap v43: 97 pgs: 97 active+clean; 19 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-19T06:08:41.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:40 smithi103 ceph-mon[30925]: pgmap v43: 97 pgs: 97 active+clean; 19 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-19T06:08:41.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:40 smithi169 ceph-mon[34350]: pgmap v43: 97 pgs: 97 active+clean; 19 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-19T06:08:42.203 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:41 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:42.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:41 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:42.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:41 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:42.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:08:43.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:42 smithi174 ceph-mon[34488]: pgmap v44: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 1.6 MiB/s wr, 148 op/s 2024-09-19T06:08:43.230 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:43.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:42 smithi103 ceph-mon[30925]: pgmap v44: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 1.6 MiB/s wr, 148 op/s 2024-09-19T06:08:43.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:42 smithi169 ceph-mon[34350]: pgmap v44: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 1.6 MiB/s wr, 148 op/s 2024-09-19T06:08:43.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.725+0000 7fa86c0a2640 1 -- 172.21.15.103:0/4239166461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa864101420 msgr2=0x7fa86410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:43.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.725+0000 7fa86c0a2640 1 --2- 172.21.15.103:0/4239166461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa864101420 0x7fa86410d950 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009930 tx=0x7fa85c02a420 comp rx=0 tx=0).stop 2024-09-19T06:08:43.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.725+0000 7fa86c0a2640 1 -- 172.21.15.103:0/4239166461 shutdown_connections 2024-09-19T06:08:43.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.725+0000 7fa86c0a2640 1 --2- 172.21.15.103:0/4239166461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa864101420 0x7fa86410d950 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.725+0000 7fa86c0a2640 1 --2- 172.21.15.103:0/4239166461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa864100a80 0x7fa864100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.725+0000 7fa86c0a2640 1 --2- 172.21.15.103:0/4239166461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa864106a80 0x7fa864106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.725+0000 7fa86c0a2640 1 -- 172.21.15.103:0/4239166461 >> 172.21.15.103:0/4239166461 conn(0x7fa8640fc7a0 msgr2=0x7fa8640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:43.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.725+0000 7fa86c0a2640 1 -- 172.21.15.103:0/4239166461 shutdown_connections 2024-09-19T06:08:43.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.725+0000 7fa86c0a2640 1 -- 172.21.15.103:0/4239166461 wait complete. 2024-09-19T06:08:43.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86c0a2640 1 Processor -- start 2024-09-19T06:08:43.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86c0a2640 1 -- start start 2024-09-19T06:08:43.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86c0a2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa864100a80 0x7fa8641971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86c0a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa864101420 0x7fa8641976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86c0a2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa864106a80 0x7fa86419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86c0a2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa864110d30 con 0x7fa864101420 2024-09-19T06:08:43.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86c0a2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa864110bb0 con 0x7fa864106a80 2024-09-19T06:08:43.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86c0a2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa864110eb0 con 0x7fa864100a80 2024-09-19T06:08:43.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86963d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa864101420 0x7fa8641976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86963d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa864101420 0x7fa8641976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56448/0 (socket says 172.21.15.103:56448) 2024-09-19T06:08:43.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86963d640 1 -- 172.21.15.103:0/3248280777 learned_addr learned my addr 172.21.15.103:0/3248280777 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:43.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.726+0000 7fa86a63f640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa864106a80 0x7fa86419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa869e3e640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa864100a80 0x7fa8641971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa86963d640 1 -- 172.21.15.103:0/3248280777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa864100a80 msgr2=0x7fa8641971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:43.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa86963d640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa864100a80 0x7fa8641971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa86963d640 1 -- 172.21.15.103:0/3248280777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa864106a80 msgr2=0x7fa86419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:43.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa86963d640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa864106a80 0x7fa86419ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa86963d640 1 -- 172.21.15.103:0/3248280777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86419c160 con 0x7fa864101420 2024-09-19T06:08:43.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa869e3e640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa864100a80 0x7fa8641971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:43.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa86963d640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa864101420 0x7fa8641976f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa85800ea80 tx=0x7fa85800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:43.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa862ffd640 1 -- 172.21.15.103:0/3248280777 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85800ce40 con 0x7fa864101420 2024-09-19T06:08:43.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa862ffd640 1 -- 172.21.15.103:0/3248280777 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa858005020 con 0x7fa864101420 2024-09-19T06:08:43.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa86c0a2640 1 -- 172.21.15.103:0/3248280777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86419c450 con 0x7fa864101420 2024-09-19T06:08:43.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa862ffd640 1 -- 172.21.15.103:0/3248280777 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8580116d0 con 0x7fa864101420 2024-09-19T06:08:43.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.727+0000 7fa86c0a2640 1 -- 172.21.15.103:0/3248280777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8641a3d30 con 0x7fa864101420 2024-09-19T06:08:43.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.729+0000 7fa862ffd640 1 -- 172.21.15.103:0/3248280777 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7fa8580051d0 con 0x7fa864101420 2024-09-19T06:08:43.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86e47b740 1 Processor -- start 2024-09-19T06:08:43.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86e47b740 1 -- start start 2024-09-19T06:08:43.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b56a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa862ffd640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa84c0a34d0 0x7fa84c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b61350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b61890 0x561d85b63c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86e47b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561d85aba2e0 con 0x561d85b56fd0 2024-09-19T06:08:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86e47b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561d85a61ce0 con 0x561d85b566b0 2024-09-19T06:08:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86e47b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561d85ab62a0 con 0x561d85b61890 2024-09-19T06:08:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa869e3e640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa84c0a34d0 0x7fa84c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86963d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b61350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86963d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b61350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56456/0 (socket says 172.21.15.103:56456) 2024-09-19T06:08:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86963d640 1 -- 172.21.15.103:0/2174891630 learned_addr learned my addr 172.21.15.103:0/2174891630 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa862ffd640 1 -- 172.21.15.103:0/3248280777 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fa8580d02b0 con 0x7fa864101420 2024-09-19T06:08:43.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86a63f640 1 --2- 172.21.15.103:0/2174891630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b61890 0x561d85b63c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.730+0000 7fa86a63f640 1 --2- 172.21.15.103:0/2174891630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b56a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa86963d640 1 -- 172.21.15.103:0/2174891630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b61890 msgr2=0x561d85b63c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:43.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa86963d640 1 --2- 172.21.15.103:0/2174891630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b61890 0x561d85b63c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa86963d640 1 -- 172.21.15.103:0/2174891630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 msgr2=0x561d85b56a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:43.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa86963d640 1 --2- 172.21.15.103:0/2174891630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b56a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa86963d640 1 -- 172.21.15.103:0/2174891630 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d85a46440 con 0x561d85b56fd0 2024-09-19T06:08:43.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa86a63f640 1 --2- 172.21.15.103:0/2174891630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b56a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:43.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa869e3e640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa84c0a34d0 0x7fa84c0a5990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa854005e10 tx=0x7fa854005da0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:43.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa86963d640 1 --2- 172.21.15.103:0/2174891630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b61350 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa85800c700 tx=0x7fa85809bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d9c17fbef7cda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:43.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa84bfff640 1 -- 172.21.15.103:0/2174891630 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85801f040 con 0x561d85b56fd0 2024-09-19T06:08:43.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa84bfff640 1 -- 172.21.15.103:0/2174891630 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa85809ca90 con 0x561d85b56fd0 2024-09-19T06:08:43.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.731+0000 7fa84bfff640 1 -- 172.21.15.103:0/2174891630 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858098a00 con 0x561d85b56fd0 2024-09-19T06:08:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 -- 172.21.15.103:0/2174891630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 msgr2=0x561d85b61350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 --2- 172.21.15.103:0/2174891630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b61350 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa85800c700 tx=0x7fa85809bcf0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 -- 172.21.15.103:0/2174891630 shutdown_connections 2024-09-19T06:08:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 --2- 172.21.15.103:0/2174891630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b61890 0x561d85b63c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 --2- 172.21.15.103:0/2174891630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b61350 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 --2- 172.21.15.103:0/2174891630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b56a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 -- 172.21.15.103:0/2174891630 >> 172.21.15.103:0/2174891630 conn(0x561d85b52c40 msgr2=0x561d85b53020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 -- 172.21.15.103:0/2174891630 shutdown_connections 2024-09-19T06:08:43.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 -- 172.21.15.103:0/2174891630 wait complete. 2024-09-19T06:08:43.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 -- start start 2024-09-19T06:08:43.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.732+0000 7fa86e47b740 1 Processor -- start 2024-09-19T06:08:43.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 0x561d85b5e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b5e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86e47b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561d85b64460 con 0x561d85b61890 2024-09-19T06:08:43.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86e47b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561d85a75050 con 0x561d85b566b0 2024-09-19T06:08:43.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86e47b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561d85b645e0 con 0x561d85b56fd0 2024-09-19T06:08:43.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86e47b740 10 client.0 _ll_register_callbacks cb 0x561d85ab5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86a63f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b5e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86a63f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b5e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56472/0 (socket says 172.21.15.103:56472) 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86a63f640 1 -- 172.21.15.103:0/3272673572 learned_addr learned my addr 172.21.15.103:0/3272673572 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa869e3e640 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86963d640 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 0x561d85b5e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86a63f640 1 -- 172.21.15.103:0/3272673572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 msgr2=0x561d85b5e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86a63f640 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 0x561d85b5e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86a63f640 1 -- 172.21.15.103:0/3272673572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 msgr2=0x561d85b611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86a63f640 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86a63f640 1 -- 172.21.15.103:0/3272673572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d8582b3c0 con 0x561d85b61890 2024-09-19T06:08:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa869e3e640 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:43.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86963d640 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 0x561d85b5e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:43.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa86a63f640 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b5e9b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009230 tx=0x7fa85c0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24de0f364a36b91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:43.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa8497fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:43.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa8497fa640 1 -- 172.21.15.103:0/3272673572 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c035040 con 0x561d85b61890 2024-09-19T06:08:43.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.733+0000 7fa8497fa640 1 -- 172.21.15.103:0/3272673572 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fa85c004240 con 0x561d85b61890 2024-09-19T06:08:43.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa86e47b740 1 -- 172.21.15.103:0/3272673572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa85809ca90 con 0x561d85b61890 2024-09-19T06:08:43.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa8497fa640 1 -- 172.21.15.103:0/3272673572 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa85c051050 con 0x561d85b61890 2024-09-19T06:08:43.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa86e47b740 10 client.15591 fetch_fsmap learned FSMap version 26 2024-09-19T06:08:43.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa86e47b740 1 -- 172.21.15.103:0/3272673572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561d85b6fe10 con 0x561d85b61890 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa8497fa640 1 -- 172.21.15.103:0/3272673572 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa85809ca90 con 0x561d85b61890 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa8497fa640 1 -- 172.21.15.103:0/3272673572 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa85c03d450 con 0x561d85b61890 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa86e47b740 10 client.15591 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa86e47b740 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa86e47b740 20 client.15591 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa86e47b740 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x561d85b71270 0x561d85b736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa86e47b740 4 client.15591 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa86e47b740 1 -- 172.21.15.103:0/3272673572 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d85ac7850 con 0x561d85b71270 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.734+0000 7fa869e3e640 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x561d85b71270 0x561d85b736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.735+0000 7fa869e3e640 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x561d85b71270 0x561d85b736a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c1523daef76d35b server_cookie=f7ed63e824c2ab28 in_seq=0 out_seq=0 2024-09-19T06:08:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.735+0000 7fa8497fa640 10 client.15591 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa8497fa640 1 -- 172.21.15.103:0/3272673572 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d85ac7850 con 0x561d85b71270 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa8497fa640 10 client.15591 handle_command_reply: tid=0 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 client.15591 shutdown 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 -- 172.21.15.103:0/3272673572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 msgr2=0x561d85b5e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b5e9b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009230 tx=0x7fa85c0316d0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 -- 172.21.15.103:0/3272673572 shutdown_connections 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x561d85b71270 0x561d85b736a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b5e9b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa8497fa640 0 client.15591 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 0x561d85b5e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 --2- 172.21.15.103:0/3272673572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 -- 172.21.15.103:0/3272673572 >> 172.21.15.103:0/3272673572 conn(0x561d85b52c40 msgr2=0x561d85b4fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:43.776 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:08:43.776 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-19T06:08:43.776 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-09-19T06:08:43.776 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 -- 172.21.15.103:0/3272673572 shutdown_connections 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 1 -- 172.21.15.103:0/3272673572 wait complete. 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.736+0000 7fa86e47b740 20 client.15591 trim_cache size 0 max 16384 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86e47b740 1 Processor -- start 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86e47b740 1 -- start start 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b4fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b78f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b61890 0x561d85b794b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86e47b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641adcf0 con 0x561d85b56fd0 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86e47b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641ab5c0 con 0x561d85b566b0 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86e47b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641a9410 con 0x561d85b61890 2024-09-19T06:08:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86963d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b78f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86963d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b78f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56482/0 (socket says 172.21.15.103:56482) 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86963d640 1 -- 172.21.15.103:0/3694842510 learned_addr learned my addr 172.21.15.103:0/3694842510 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.753+0000 7fa86a63f640 1 --2- 172.21.15.103:0/3694842510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b61890 0x561d85b794b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa869e3e640 1 --2- 172.21.15.103:0/3694842510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b4fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa86963d640 1 -- 172.21.15.103:0/3694842510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b61890 msgr2=0x561d85b794b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa86963d640 1 --2- 172.21.15.103:0/3694842510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b61890 0x561d85b794b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa86963d640 1 -- 172.21.15.103:0/3694842510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 msgr2=0x561d85b4fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa86963d640 1 --2- 172.21.15.103:0/3694842510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b4fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa86963d640 1 -- 172.21.15.103:0/3694842510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d85b538d0 con 0x561d85b56fd0 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa86963d640 1 --2- 172.21.15.103:0/3694842510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b78f70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa85800efd0 tx=0x7fa85809be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c01cd5ce4a2ecc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa84b7fe640 1 -- 172.21.15.103:0/3694842510 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85801f040 con 0x561d85b56fd0 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa84b7fe640 1 -- 172.21.15.103:0/3694842510 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8580b4870 con 0x561d85b56fd0 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa84b7fe640 1 -- 172.21.15.103:0/3694842510 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8580b4040 con 0x561d85b56fd0 2024-09-19T06:08:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa86e47b740 1 -- 172.21.15.103:0/3694842510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 msgr2=0x561d85b78f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.754+0000 7fa86e47b740 1 --2- 172.21.15.103:0/3694842510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b78f70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa85800efd0 tx=0x7fa85809be20 comp rx=0 tx=0).stop 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 -- 172.21.15.103:0/3694842510 shutdown_connections 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 --2- 172.21.15.103:0/3694842510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b61890 0x561d85b794b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 --2- 172.21.15.103:0/3694842510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b56fd0 0x561d85b78f70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 --2- 172.21.15.103:0/3694842510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b4fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 -- 172.21.15.103:0/3694842510 >> 172.21.15.103:0/3694842510 conn(0x561d85b52c40 msgr2=0x561d85b4f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 -- 172.21.15.103:0/3694842510 shutdown_connections 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 -- 172.21.15.103:0/3694842510 wait complete. 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 -- start start 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 Processor -- start 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b69cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 0x561d85b67010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b67550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641a9a80 con 0x561d85b61890 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641aaef0 con 0x561d85b566b0 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641aa150 con 0x561d85b56fd0 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86e47b740 10 client.0 _ll_register_callbacks cb 0x7fa85c032dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.755+0000 7fa86a63f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b67550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86a63f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b67550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56494/0 (socket says 172.21.15.103:56494) 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86a63f640 1 -- 172.21.15.103:0/2016955356 learned_addr learned my addr 172.21.15.103:0/2016955356 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86963d640 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 0x561d85b67010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa869e3e640 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b69cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86a63f640 1 -- 172.21.15.103:0/2016955356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 msgr2=0x561d85b67010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86a63f640 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 0x561d85b67010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86a63f640 1 -- 172.21.15.103:0/2016955356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 msgr2=0x561d85b69cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86a63f640 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b69cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86a63f640 1 -- 172.21.15.103:0/2016955356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d85b67a90 con 0x561d85b61890 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa869e3e640 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b69cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86a63f640 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b67550 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa85c033000 tx=0x7fa85c03d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda3449d7d51d173 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa8497fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa8497fa640 1 -- 172.21.15.103:0/2016955356 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c035040 con 0x561d85b61890 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa8497fa640 1 -- 172.21.15.103:0/2016955356 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fa85c03da40 con 0x561d85b61890 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86e47b740 1 -- 172.21.15.103:0/2016955356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8580b4870 con 0x561d85b61890 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa8497fa640 1 -- 172.21.15.103:0/2016955356 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa85c000e60 con 0x561d85b61890 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86e47b740 10 client.15597 fetch_fsmap learned FSMap version 26 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa86e47b740 1 -- 172.21.15.103:0/2016955356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561d85bdbcb0 con 0x561d85b61890 2024-09-19T06:08:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.756+0000 7fa8497fa640 1 -- 172.21.15.103:0/2016955356 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8580b4870 con 0x561d85b61890 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.757+0000 7fa8497fa640 1 -- 172.21.15.103:0/2016955356 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa85c004860 con 0x561d85b61890 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.757+0000 7fa86e47b740 10 client.15597 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.757+0000 7fa86e47b740 10 client.15597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.757+0000 7fa86e47b740 20 client.15597 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.757+0000 7fa86e47b740 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x561d85bdc470 0x561d85bde890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.757+0000 7fa86e47b740 4 client.15597 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.757+0000 7fa86e47b740 1 -- 172.21.15.103:0/2016955356 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561d85b5ed40 con 0x561d85bdc470 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.757+0000 7fa869e3e640 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x561d85bdc470 0x561d85bde890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.757+0000 7fa869e3e640 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x561d85bdc470 0x561d85bde890 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a92dfcab6faa320 server_cookie=75a04a418656bc55 in_seq=0 out_seq=0 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.757+0000 7fa8497fa640 10 client.15597 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa8497fa640 1 -- 172.21.15.103:0/2016955356 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561d85b5ed40 con 0x561d85bdc470 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa8497fa640 10 client.15597 handle_command_reply: tid=0 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 client.15597 shutdown 2024-09-19T06:08:43.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 -- 172.21.15.103:0/2016955356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 msgr2=0x561d85b67550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:43.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b67550 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa85c033000 tx=0x7fa85c03d580 comp rx=0 tx=0).stop 2024-09-19T06:08:43.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 -- 172.21.15.103:0/2016955356 shutdown_connections 2024-09-19T06:08:43.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x561d85bdc470 0x561d85bde890 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561d85b61890 0x561d85b67550 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d85b56fd0 0x561d85b67010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa8497fa640 0 client.15597 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:43.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 --2- 172.21.15.103:0/2016955356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d85b566b0 0x561d85b69cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 -- 172.21.15.103:0/2016955356 >> 172.21.15.103:0/2016955356 conn(0x561d85b52c40 msgr2=0x561d85b5c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 -- 172.21.15.103:0/2016955356 shutdown_connections 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 1 -- 172.21.15.103:0/2016955356 wait complete. 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.758+0000 7fa86e47b740 20 client.15597 trim_cache size 0 max 16384 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 -- 172.21.15.103:0/3248280777 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa84c0a34d0 msgr2=0x7fa84c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa84c0a34d0 0x7fa84c0a5990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa854005e10 tx=0x7fa854005da0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 -- 172.21.15.103:0/3248280777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa864101420 msgr2=0x7fa8641976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa864101420 0x7fa8641976f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa85800ea80 tx=0x7fa85800ef40 comp rx=0 tx=0).stop 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 -- 172.21.15.103:0/3248280777 shutdown_connections 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fa84c0a34d0 0x7fa84c0a5990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa864106a80 0x7fa86419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa864101420 0x7fa8641976f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 --2- 172.21.15.103:0/3248280777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa864100a80 0x7fa8641971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:43.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 -- 172.21.15.103:0/3248280777 >> 172.21.15.103:0/3248280777 conn(0x7fa8640fc7a0 msgr2=0x7fa8640fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:43.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 -- 172.21.15.103:0/3248280777 shutdown_connections 2024-09-19T06:08:43.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:43.759+0000 7fa86c0a2640 1 -- 172.21.15.103:0/3248280777 wait complete. 2024-09-19T06:08:44.584 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:08:44.585 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:08:44.837 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:45.186 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:44 smithi103 ceph-mon[30925]: pgmap v45: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 1.6 MiB/s wr, 143 op/s 2024-09-19T06:08:45.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:44 smithi174 ceph-mon[34488]: pgmap v45: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 1.6 MiB/s wr, 143 op/s 2024-09-19T06:08:45.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.263+0000 7fc6f1509640 1 -- 172.21.15.103:0/1057613746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6ec102d30 msgr2=0x7fc6ec103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:45.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.263+0000 7fc6f1509640 1 --2- 172.21.15.103:0/1057613746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6ec102d30 0x7fc6ec103110 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009ca0 tx=0x7fc6dc02a950 comp rx=0 tx=0).stop 2024-09-19T06:08:45.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.263+0000 7fc6f1509640 1 -- 172.21.15.103:0/1057613746 shutdown_connections 2024-09-19T06:08:45.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.263+0000 7fc6f1509640 1 --2- 172.21.15.103:0/1057613746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6ec10c160 0x7fc6ec10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:45.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.263+0000 7fc6f1509640 1 --2- 172.21.15.103:0/1057613746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6ec103650 0x7fc6ec10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:45.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.263+0000 7fc6f1509640 1 --2- 172.21.15.103:0/1057613746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6ec102d30 0x7fc6ec103110 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:45.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.263+0000 7fc6f1509640 1 -- 172.21.15.103:0/1057613746 >> 172.21.15.103:0/1057613746 conn(0x7fc6ec0fc790 msgr2=0x7fc6ec0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:45.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.263+0000 7fc6f1509640 1 -- 172.21.15.103:0/1057613746 shutdown_connections 2024-09-19T06:08:45.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.263+0000 7fc6f1509640 1 -- 172.21.15.103:0/1057613746 wait complete. 2024-09-19T06:08:45.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.264+0000 7fc6f1509640 1 Processor -- start 2024-09-19T06:08:45.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.264+0000 7fc6f1509640 1 -- start start 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.264+0000 7fc6f1509640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6ec102d30 0x7fc6ec198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.264+0000 7fc6f1509640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6ec103650 0x7fc6ec198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.264+0000 7fc6f1509640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6ec10c160 0x7fc6ec19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.264+0000 7fc6f1509640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec111e10 con 0x7fc6ec102d30 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.264+0000 7fc6f1509640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec111c90 con 0x7fc6ec10c160 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.264+0000 7fc6f1509640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec111f90 con 0x7fc6ec103650 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6eaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6ec102d30 0x7fc6ec198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6eaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6ec102d30 0x7fc6ec198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56506/0 (socket says 172.21.15.103:56506) 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6eaffd640 1 -- 172.21.15.103:0/1606688889 learned_addr learned my addr 172.21.15.103:0/1606688889 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6ea7fc640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6ec103650 0x7fc6ec198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6eb7fe640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6ec10c160 0x7fc6ec19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6eaffd640 1 -- 172.21.15.103:0/1606688889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6ec103650 msgr2=0x7fc6ec198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:45.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6eaffd640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6ec103650 0x7fc6ec198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:45.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6eaffd640 1 -- 172.21.15.103:0/1606688889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6ec10c160 msgr2=0x7fc6ec19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:45.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6eaffd640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6ec10c160 0x7fc6ec19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:45.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6eaffd640 1 -- 172.21.15.103:0/1606688889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec19d2c0 con 0x7fc6ec102d30 2024-09-19T06:08:45.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6eaffd640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6ec102d30 0x7fc6ec198310 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc005cc0 tx=0x7fc6dc02f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:45.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6d3fff640 1 -- 172.21.15.103:0/1606688889 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc034040 con 0x7fc6ec102d30 2024-09-19T06:08:45.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6d3fff640 1 -- 172.21.15.103:0/1606688889 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc6dc003e40 con 0x7fc6ec102d30 2024-09-19T06:08:45.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6f1509640 1 -- 172.21.15.103:0/1606688889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ec19d550 con 0x7fc6ec102d30 2024-09-19T06:08:45.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6d3fff640 1 -- 172.21.15.103:0/1606688889 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc045480 con 0x7fc6ec102d30 2024-09-19T06:08:45.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.265+0000 7fc6f1509640 1 -- 172.21.15.103:0/1606688889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ec1a4e90 con 0x7fc6ec102d30 2024-09-19T06:08:45.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.266+0000 7fc6f1509640 1 -- 172.21.15.103:0/1606688889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ec103110 con 0x7fc6ec102d30 2024-09-19T06:08:45.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.267+0000 7fc6d3fff640 1 -- 172.21.15.103:0/1606688889 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7fc6dc037020 con 0x7fc6ec102d30 2024-09-19T06:08:45.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.268+0000 7fc6d3fff640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fc6d40a34d0 0x7fc6d40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:45.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.268+0000 7fc6ea7fc640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fc6d40a34d0 0x7fc6d40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:45.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.268+0000 7fc6d3fff640 1 -- 172.21.15.103:0/1606688889 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fc6dc0f1080 con 0x7fc6ec102d30 2024-09-19T06:08:45.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.269+0000 7fc6ea7fc640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fc6d40a34d0 0x7fc6d40a5990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0fed90 tx=0x7fc6e000a250 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:45.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.272+0000 7fc6d3fff640 1 -- 172.21.15.103:0/1606688889 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc6dc0bd970 con 0x7fc6ec102d30 2024-09-19T06:08:45.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:44 smithi169 ceph-mon[34350]: pgmap v45: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 1.6 MiB/s wr, 143 op/s 2024-09-19T06:08:45.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.489+0000 7fc6f1509640 1 -- 172.21.15.103:0/1606688889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6ec1071d0 con 0x7fc6ec102d30 2024-09-19T06:08:45.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.490+0000 7fc6d3fff640 1 -- 172.21.15.103:0/1606688889 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11934 (secure 0 0 0) 0x7fc6dc0bd270 con 0x7fc6ec102d30 2024-09-19T06:08:45.492 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:08:45.492 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-09-19T06:08:40:860412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:08:40.312903+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24463,24475,24488]},"id":1}]} 2024-09-19T06:08:45.492 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-09-19T06:08:45.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.492+0000 7fc6f1509640 1 -- 172.21.15.103:0/1606688889 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fc6d40a34d0 msgr2=0x7fc6d40a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:45.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.492+0000 7fc6f1509640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fc6d40a34d0 0x7fc6d40a5990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0fed90 tx=0x7fc6e000a250 comp rx=0 tx=0).stop 2024-09-19T06:08:45.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.492+0000 7fc6f1509640 1 -- 172.21.15.103:0/1606688889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6ec102d30 msgr2=0x7fc6ec198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:45.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.492+0000 7fc6f1509640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6ec102d30 0x7fc6ec198310 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc005cc0 tx=0x7fc6dc02f650 comp rx=0 tx=0).stop 2024-09-19T06:08:45.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.492+0000 7fc6f1509640 1 -- 172.21.15.103:0/1606688889 shutdown_connections 2024-09-19T06:08:45.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.492+0000 7fc6f1509640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fc6d40a34d0 0x7fc6d40a5990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:45.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.492+0000 7fc6f1509640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6ec10c160 0x7fc6ec19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:45.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.492+0000 7fc6f1509640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6ec103650 0x7fc6ec198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:45.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.492+0000 7fc6f1509640 1 --2- 172.21.15.103:0/1606688889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6ec102d30 0x7fc6ec198310 secure :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc005cc0 tx=0x7fc6dc02f650 comp rx=0 tx=0).stop 2024-09-19T06:08:45.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.493+0000 7fc6f1509640 1 -- 172.21.15.103:0/1606688889 >> 172.21.15.103:0/1606688889 conn(0x7fc6ec0fc790 msgr2=0x7fc6ec0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:45.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.493+0000 7fc6f1509640 1 -- 172.21.15.103:0/1606688889 shutdown_connections 2024-09-19T06:08:45.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:45.493+0000 7fc6f1509640 1 -- 172.21.15.103:0/1606688889 wait complete. 2024-09-19T06:08:46.199 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:45 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1606688889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:08:46.203 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:45 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1606688889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:08:46.233 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:08:46.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:45 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1606688889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:08:46.524 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:46.954 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:46 smithi103 ceph-mon[30925]: pgmap v46: 97 pgs: 97 active+clean; 23 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 1.9 MiB/s wr, 212 op/s 2024-09-19T06:08:46.954 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:46 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:47.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 -- 172.21.15.103:0/2155260669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e4106f10 msgr2=0x7fd9e410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 --2- 172.21.15.103:0/2155260669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e4106f10 0x7fd9e410ea90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009ca0 tx=0x7fd9dc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 -- 172.21.15.103:0/2155260669 shutdown_connections 2024-09-19T06:08:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 --2- 172.21.15.103:0/2155260669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e4106f10 0x7fd9e410ea90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 --2- 172.21.15.103:0/2155260669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e4102790 0x7fd9e41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 --2- 172.21.15.103:0/2155260669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e4101de0 0x7fd9e41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 -- 172.21.15.103:0/2155260669 >> 172.21.15.103:0/2155260669 conn(0x7fd9e40fd8c0 msgr2=0x7fd9e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 -- 172.21.15.103:0/2155260669 shutdown_connections 2024-09-19T06:08:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 -- 172.21.15.103:0/2155260669 wait complete. 2024-09-19T06:08:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 Processor -- start 2024-09-19T06:08:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.054+0000 7fd9e946d640 1 -- start start 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e946d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e4101de0 0x7fd9e4198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e946d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e4102790 0x7fd9e4198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e946d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e4106f10 0x7fd9e419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e946d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4111e20 con 0x7fd9e4106f10 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e946d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4111ca0 con 0x7fd9e4102790 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e946d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4111fa0 con 0x7fd9e4101de0 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e4106f10 0x7fd9e419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e4106f10 0x7fd9e419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56510/0 (socket says 172.21.15.103:56510) 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e37fe640 1 -- 172.21.15.103:0/3136827623 learned_addr learned my addr 172.21.15.103:0/3136827623 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e4102790 0x7fd9e4198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e4101de0 0x7fd9e4198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e37fe640 1 -- 172.21.15.103:0/3136827623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e4101de0 msgr2=0x7fd9e4198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e37fe640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e4101de0 0x7fd9e4198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e37fe640 1 -- 172.21.15.103:0/3136827623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e4102790 msgr2=0x7fd9e4198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e37fe640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e4102790 0x7fd9e4198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e37fe640 1 -- 172.21.15.103:0/3136827623 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e419d2d0 con 0x7fd9e4106f10 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e4102790 0x7fd9e4198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e37fe640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e4106f10 0x7fd9e419cbf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009dc0 tx=0x7fd9dc032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e0ff9640 1 -- 172.21.15.103:0/3136827623 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc003c30 con 0x7fd9e4106f10 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e0ff9640 1 -- 172.21.15.103:0/3136827623 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9dc003dd0 con 0x7fd9e4106f10 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e946d640 1 -- 172.21.15.103:0/3136827623 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e419d560 con 0x7fd9e4106f10 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.055+0000 7fd9e0ff9640 1 -- 172.21.15.103:0/3136827623 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc030aa0 con 0x7fd9e4106f10 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.056+0000 7fd9e946d640 1 -- 172.21.15.103:0/3136827623 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e41a4ea0 con 0x7fd9e4106f10 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.058+0000 7fd9e0ff9640 1 -- 172.21.15.103:0/3136827623 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7fd9dc030cc0 con 0x7fd9e4106f10 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.058+0000 7fd9eb846740 1 Processor -- start 2024-09-19T06:08:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.058+0000 7fd9eb846740 1 -- start start 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.058+0000 7fd9e0ff9640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9d00a34d0 0x7fd9d00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.058+0000 7fd9e0ff9640 1 -- 172.21.15.103:0/3136827623 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fd9dc0f1300 con 0x7fd9e4106f10 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.058+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9d00a34d0 0x7fd9d00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.058+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a44262b40 0x555a44261090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.058+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a442615d0 0x555a44261a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a4426c370 0x555a4426e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9eb846740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555a441c72f0 con 0x555a4426c370 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9eb846740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555a4416ecf0 con 0x555a44262b40 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9eb846740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555a441c32b0 con 0x555a442615d0 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e2ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a44262b40 0x555a44261090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9dbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a442615d0 0x555a44261a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a4426c370 0x555a4426e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e2ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a44262b40 0x555a44261090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:47990/0 (socket says 172.21.15.103:47990) 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9dbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a442615d0 0x555a44261a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:38604/0 (socket says 172.21.15.103:38604) 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e2ffd640 1 -- 172.21.15.103:0/3209075657 learned_addr learned my addr 172.21.15.103:0/3209075657 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e2ffd640 1 -- 172.21.15.103:0/3209075657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a442615d0 msgr2=0x555a44261a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/3209075657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a442615d0 0x555a44261a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e2ffd640 1 -- 172.21.15.103:0/3209075657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a4426c370 msgr2=0x555a4426e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9d00a34d0 0x7fd9d00a5990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40fdce0 tx=0x7fd9cc011c10 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/3209075657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a4426c370 0x555a4426e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e2ffd640 1 -- 172.21.15.103:0/3209075657 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a441533a0 con 0x555a44262b40 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e37fe640 1 --2- 172.21.15.103:0/3209075657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a4426c370 0x555a4426e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/3209075657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a44262b40 0x555a44261090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009ca0 tx=0x7fd9d4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=878989690f14c9ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9d97fa640 1 -- 172.21.15.103:0/3209075657 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d401e070 con 0x555a44262b40 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.059+0000 7fd9d97fa640 1 -- 172.21.15.103:0/3209075657 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9d4009e50 con 0x555a44262b40 2024-09-19T06:08:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.060+0000 7fd9d97fa640 1 -- 172.21.15.103:0/3209075657 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400e990 con 0x555a44262b40 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.060+0000 7fd9eb846740 1 -- 172.21.15.103:0/3209075657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a44262b40 msgr2=0x555a44261090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.060+0000 7fd9eb846740 1 --2- 172.21.15.103:0/3209075657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a44262b40 0x555a44261090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009ca0 tx=0x7fd9d4011810 comp rx=0 tx=0).stop 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.060+0000 7fd9eb846740 1 -- 172.21.15.103:0/3209075657 shutdown_connections 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.060+0000 7fd9eb846740 1 --2- 172.21.15.103:0/3209075657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a4426c370 0x555a4426e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.060+0000 7fd9eb846740 1 --2- 172.21.15.103:0/3209075657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a442615d0 0x555a44261a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.060+0000 7fd9eb846740 1 --2- 172.21.15.103:0/3209075657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a44262b40 0x555a44261090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.060+0000 7fd9eb846740 1 -- 172.21.15.103:0/3209075657 >> 172.21.15.103:0/3209075657 conn(0x555a4422a310 msgr2=0x555a4425dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.060+0000 7fd9eb846740 1 -- 172.21.15.103:0/3209075657 shutdown_connections 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.060+0000 7fd9eb846740 1 -- 172.21.15.103:0/3209075657 wait complete. 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9eb846740 1 -- start start 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9eb846740 1 Processor -- start 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a4426bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44268f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a442694f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9eb846740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555a4426f070 con 0x555a44262b40 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9eb846740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555a44182060 con 0x555a442615d0 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9eb846740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555a4426f1f0 con 0x555a4426c370 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9eb846740 10 client.0 _ll_register_callbacks cb 0x555a43ed58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9dbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44268f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9dbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44268f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56520/0 (socket says 172.21.15.103:56520) 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9dbfff640 1 -- 172.21.15.103:0/3926094492 learned_addr learned my addr 172.21.15.103:0/3926094492 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a4426bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9e37fe640 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a442694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9dbfff640 1 -- 172.21.15.103:0/3926094492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 msgr2=0x555a442694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a442694f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9dbfff640 1 -- 172.21.15.103:0/3926094492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 msgr2=0x555a4426bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a4426bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9dbfff640 1 -- 172.21.15.103:0/3926094492 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a43f383c0 con 0x555a44262b40 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.061+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a4426bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44268f90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00ff10 tx=0x7fd9cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af70888ccc6a60e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/3926094492 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc01a040 con 0x555a44262b40 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/3926094492 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fd9cc01f3b0 con 0x555a44262b40 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9eb846740 1 -- 172.21.15.103:0/3926094492 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9d4009e50 con 0x555a44262b40 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/3926094492 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd9cc028600 con 0x555a44262b40 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9eb846740 10 client.15615 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9eb846740 1 -- 172.21.15.103:0/3926094492 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a4427aa80 con 0x555a44262b40 2024-09-19T06:08:47.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/3926094492 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9d4009e50 con 0x555a44262b40 2024-09-19T06:08:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/3926094492 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fd9cc01d030 con 0x555a44262b40 2024-09-19T06:08:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9eb846740 10 client.15615 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9eb846740 10 client.15615 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:08:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.062+0000 7fd9eb846740 20 client.15615 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.063+0000 7fd9eb846740 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x555a4427bfe0 0x555a4427e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.063+0000 7fd9eb846740 4 client.15615 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.063+0000 7fd9eb846740 1 -- 172.21.15.103:0/3926094492 --> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a441d4860 con 0x555a4427bfe0 2024-09-19T06:08:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.063+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x555a4427bfe0 0x555a4427e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.063+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x555a4427bfe0 0x555a4427e440 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cd5c991abf20344c server_cookie=45a8bc837b3f1690 in_seq=0 out_seq=0 2024-09-19T06:08:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.063+0000 7fd9ca7fc640 10 client.15615 ms_handle_connect on v2:172.21.15.174:6836/2575162107 2024-09-19T06:08:47.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/3926094492 <== mds.2 v2:172.21.15.174:6836/2575162107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a441d4860 con 0x555a4427bfe0 2024-09-19T06:08:47.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9ca7fc640 10 client.15615 handle_command_reply: tid=0 2024-09-19T06:08:47.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 client.15615 shutdown 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 -- 172.21.15.103:0/3926094492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 msgr2=0x555a44268f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44268f90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00ff10 tx=0x7fd9cc004730 comp rx=0 tx=0).stop 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 -- 172.21.15.103:0/3926094492 shutdown_connections 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a442694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x555a4427bfe0 0x555a4427e440 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44268f90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 --2- 172.21.15.103:0/3926094492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a4426bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 -- 172.21.15.103:0/3926094492 >> 172.21.15.103:0/3926094492 conn(0x555a4422a310 msgr2=0x555a44263960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9ca7fc640 0 client.15615 ms_handle_reset on v2:172.21.15.174:6836/2575162107 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 -- 172.21.15.103:0/3926094492 shutdown_connections 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 1 -- 172.21.15.103:0/3926094492 wait complete. 2024-09-19T06:08:47.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.064+0000 7fd9eb846740 20 client.15615 trim_cache size 0 max 16384 2024-09-19T06:08:47.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.077+0000 7fd9eb846740 1 Processor -- start 2024-09-19T06:08:47.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.077+0000 7fd9eb846740 1 -- start start 2024-09-19T06:08:47.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.077+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a4426af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.077+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44264120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.077+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a44264660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.077+0000 7fd9eb846740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e41afee0 con 0x555a44262b40 2024-09-19T06:08:47.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.077+0000 7fd9eb846740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e41ad7b0 con 0x555a442615d0 2024-09-19T06:08:47.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.077+0000 7fd9eb846740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e41ab620 con 0x555a4426c370 2024-09-19T06:08:47.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9dbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44264120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9dbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44264120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56526/0 (socket says 172.21.15.103:56526) 2024-09-19T06:08:47.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9dbfff640 1 -- 172.21.15.103:0/709668947 learned_addr learned my addr 172.21.15.103:0/709668947 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:47.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/709668947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a4426af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9e37fe640 1 --2- 172.21.15.103:0/709668947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a44264660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9dbfff640 1 -- 172.21.15.103:0/709668947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 msgr2=0x555a44264660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/709668947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a44264660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9dbfff640 1 -- 172.21.15.103:0/709668947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 msgr2=0x555a4426af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/709668947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a4426af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9dbfff640 1 -- 172.21.15.103:0/709668947 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a44264ba0 con 0x555a44262b40 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/709668947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a4426af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/709668947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44264120 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc01fa60 tx=0x7fd9cc028590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4321a5cfa00ba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9d8ff9640 1 -- 172.21.15.103:0/709668947 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc035070 con 0x555a44262b40 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9d8ff9640 1 -- 172.21.15.103:0/709668947 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9cc01f860 con 0x555a44262b40 2024-09-19T06:08:47.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.078+0000 7fd9d8ff9640 1 -- 172.21.15.103:0/709668947 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc01a070 con 0x555a44262b40 2024-09-19T06:08:47.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 -- 172.21.15.103:0/709668947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 msgr2=0x555a44264120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:47.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 --2- 172.21.15.103:0/709668947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44264120 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc01fa60 tx=0x7fd9cc028590 comp rx=0 tx=0).stop 2024-09-19T06:08:47.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 -- 172.21.15.103:0/709668947 shutdown_connections 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 --2- 172.21.15.103:0/709668947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a44264660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 --2- 172.21.15.103:0/709668947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44264120 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 --2- 172.21.15.103:0/709668947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a4426af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 -- 172.21.15.103:0/709668947 >> 172.21.15.103:0/709668947 conn(0x555a4422a310 msgr2=0x555a4426a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 -- 172.21.15.103:0/709668947 shutdown_connections 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 -- 172.21.15.103:0/709668947 wait complete. 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 -- start start 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.079+0000 7fd9eb846740 1 Processor -- start 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a44274970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44265a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9eb846740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a44265fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9eb846740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e41abc70 con 0x555a44262b40 2024-09-19T06:08:47.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9eb846740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e41ad0e0 con 0x555a442615d0 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9eb846740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e41ac340 con 0x555a4426c370 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9dbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44265a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9eb846740 10 client.0 _ll_register_callbacks cb 0x7fd9cc00fe20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9dbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44265a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56534/0 (socket says 172.21.15.103:56534) 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9dbfff640 1 -- 172.21.15.103:0/954382647 learned_addr learned my addr 172.21.15.103:0/954382647 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a44274970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9e37fe640 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a44265fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9dbfff640 1 -- 172.21.15.103:0/954382647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 msgr2=0x555a44265fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a44265fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9dbfff640 1 -- 172.21.15.103:0/954382647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 msgr2=0x555a44274970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a44274970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9dbfff640 1 -- 172.21.15.103:0/954382647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a44266570 con 0x555a44262b40 2024-09-19T06:08:47.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9dbfff640 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44265a70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0058c0 tx=0x7fd9cc01ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d695397c63a064b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:47.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:47.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.080+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/954382647 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc03e070 con 0x555a44262b40 2024-09-19T06:08:47.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/954382647 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fd9cc01f3b0 con 0x555a44262b40 2024-09-19T06:08:47.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9eb846740 1 -- 172.21.15.103:0/954382647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9cc01f860 con 0x555a44262b40 2024-09-19T06:08:47.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/954382647 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd9cc04a050 con 0x555a44262b40 2024-09-19T06:08:47.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9eb846740 10 client.15621 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:47.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9eb846740 1 -- 172.21.15.103:0/954382647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a442e6a90 con 0x555a44262b40 2024-09-19T06:08:47.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/954382647 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9cc01f860 con 0x555a44262b40 2024-09-19T06:08:47.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/954382647 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fd9cc0046f0 con 0x555a44262b40 2024-09-19T06:08:47.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9eb846740 10 client.15621 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9eb846740 10 client.15621 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9eb846740 20 client.15621 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9eb846740 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x555a442e7090 0x555a442e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9eb846740 4 client.15621 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9eb846740 1 -- 172.21.15.103:0/954382647 --> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a441ced70 con 0x555a442e7090 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.081+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x555a442e7090 0x555a442e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9ca7fc640 10 client.15621 ms_handle_connect on v2:172.21.15.174:6836/2575162107 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9e2ffd640 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x555a442e7090 0x555a442e94b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b8bfbc3984c09fd1 server_cookie=32c281db34ad51ab in_seq=0 out_seq=0 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9ca7fc640 1 -- 172.21.15.103:0/954382647 <== mds.2 v2:172.21.15.174:6836/2575162107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a441ced70 con 0x555a442e7090 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9ca7fc640 10 client.15621 handle_command_reply: tid=0 2024-09-19T06:08:47.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 client.15621 shutdown 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 -- 172.21.15.103:0/954382647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 msgr2=0x555a44265a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44265a70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0058c0 tx=0x7fd9cc01ff00 comp rx=0 tx=0).stop 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 -- 172.21.15.103:0/954382647 shutdown_connections 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4426c370 0x555a44265fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x555a442e7090 0x555a442e94b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9ca7fc640 0 client.15621 ms_handle_reset on v2:172.21.15.174:6836/2575162107 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a44262b40 0x555a44265a70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 --2- 172.21.15.103:0/954382647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a442615d0 0x555a44274970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 -- 172.21.15.103:0/954382647 >> 172.21.15.103:0/954382647 conn(0x555a4422a310 msgr2=0x555a4425cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 -- 172.21.15.103:0/954382647 shutdown_connections 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 1 -- 172.21.15.103:0/954382647 wait complete. 2024-09-19T06:08:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.082+0000 7fd9eb846740 20 client.15621 trim_cache size 0 max 16384 2024-09-19T06:08:47.091 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-09-19T06:08:47.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 -- 172.21.15.103:0/3136827623 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9d00a34d0 msgr2=0x7fd9d00a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9d00a34d0 0x7fd9d00a5990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40fdce0 tx=0x7fd9cc011c10 comp rx=0 tx=0).stop 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 -- 172.21.15.103:0/3136827623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e4106f10 msgr2=0x7fd9e419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e4106f10 0x7fd9e419cbf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009dc0 tx=0x7fd9dc032ff0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 -- 172.21.15.103:0/3136827623 shutdown_connections 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9d00a34d0 0x7fd9d00a5990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e4106f10 0x7fd9e419cbf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e4102790 0x7fd9e4198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 --2- 172.21.15.103:0/3136827623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e4101de0 0x7fd9e4198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 -- 172.21.15.103:0/3136827623 >> 172.21.15.103:0/3136827623 conn(0x7fd9e40fd8c0 msgr2=0x7fd9e40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 -- 172.21.15.103:0/3136827623 shutdown_connections 2024-09-19T06:08:47.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:47.083+0000 7fd9e946d640 1 -- 172.21.15.103:0/3136827623 wait complete. 2024-09-19T06:08:47.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:46 smithi174 ceph-mon[34488]: pgmap v46: 97 pgs: 97 active+clean; 23 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 1.9 MiB/s wr, 212 op/s 2024-09-19T06:08:47.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:46 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:47.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:46 smithi169 ceph-mon[34350]: pgmap v46: 97 pgs: 97 active+clean; 23 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 1.9 MiB/s wr, 212 op/s 2024-09-19T06:08:47.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:46 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:47.784 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:08:48.092 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.636+0000 7f2908065640 1 -- 172.21.15.103:0/157914676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29001009b0 msgr2=0x7f2900100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.636+0000 7f2908065640 1 --2- 172.21.15.103:0/157914676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29001009b0 0x7f2900100e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009900 tx=0x7f28f002a410 comp rx=0 tx=0).stop 2024-09-19T06:08:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.636+0000 7f2908065640 1 -- 172.21.15.103:0/157914676 shutdown_connections 2024-09-19T06:08:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.636+0000 7f2908065640 1 --2- 172.21.15.103:0/157914676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2900101350 0x7f290010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.636+0000 7f2908065640 1 --2- 172.21.15.103:0/157914676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29001009b0 0x7f2900100e10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.636+0000 7f2908065640 1 --2- 172.21.15.103:0/157914676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29001069c0 0x7f2900106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.636+0000 7f2908065640 1 -- 172.21.15.103:0/157914676 >> 172.21.15.103:0/157914676 conn(0x7f2900077990 msgr2=0x7f29000fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.636+0000 7f2908065640 1 -- 172.21.15.103:0/157914676 shutdown_connections 2024-09-19T06:08:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.636+0000 7f2908065640 1 -- 172.21.15.103:0/157914676 wait complete. 2024-09-19T06:08:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.637+0000 7f2908065640 1 Processor -- start 2024-09-19T06:08:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.637+0000 7f2908065640 1 -- start start 2024-09-19T06:08:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.637+0000 7f2908065640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29001009b0 0x7f29001982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.637+0000 7f2908065640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2900101350 0x7f2900198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.637+0000 7f2908065640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29001069c0 0x7f290019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.637+0000 7f2908065640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2900110c70 con 0x7f29001069c0 2024-09-19T06:08:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.637+0000 7f2908065640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2900110af0 con 0x7f2900101350 2024-09-19T06:08:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2908065640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2900110df0 con 0x7f29001009b0 2024-09-19T06:08:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2906602640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29001069c0 0x7f290019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2905e01640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29001009b0 0x7f29001982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2906602640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29001069c0 0x7f290019cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56554/0 (socket says 172.21.15.103:56554) 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2906602640 1 -- 172.21.15.103:0/224782157 learned_addr learned my addr 172.21.15.103:0/224782157 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2905e01640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29001009b0 0x7f29001982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:38646/0 (socket says 172.21.15.103:38646) 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2905600640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2900101350 0x7f2900198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2905e01640 1 -- 172.21.15.103:0/224782157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2900101350 msgr2=0x7f2900198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2905e01640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2900101350 0x7f2900198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2905e01640 1 -- 172.21.15.103:0/224782157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29001069c0 msgr2=0x7f290019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2905e01640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29001069c0 0x7f290019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2905e01640 1 -- 172.21.15.103:0/224782157 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290019d2e0 con 0x7f29001009b0 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.638+0000 7f2905e01640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29001009b0 0x7f29001982f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00e9f0 tx=0x7f28fc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.639+0000 7f28f6ffd640 1 -- 172.21.15.103:0/224782157 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc00ccc0 con 0x7f29001009b0 2024-09-19T06:08:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.639+0000 7f28f6ffd640 1 -- 172.21.15.103:0/224782157 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28fc0108e0 con 0x7f29001009b0 2024-09-19T06:08:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.639+0000 7f2908065640 1 -- 172.21.15.103:0/224782157 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290019d5d0 con 0x7f29001009b0 2024-09-19T06:08:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.639+0000 7f28f6ffd640 1 -- 172.21.15.103:0/224782157 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc018880 con 0x7f29001009b0 2024-09-19T06:08:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.639+0000 7f2908065640 1 -- 172.21.15.103:0/224782157 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29000fcd10 con 0x7f29001009b0 2024-09-19T06:08:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.641+0000 7f28f6ffd640 1 -- 172.21.15.103:0/224782157 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7f28fc010a90 con 0x7f29001009b0 2024-09-19T06:08:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.641+0000 7f290ae00740 1 Processor -- start 2024-09-19T06:08:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f290ae00740 1 -- start start 2024-09-19T06:08:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f290ae00740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f290ae00740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8b0410 0x55f94f8ba770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f290ae00740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 0x55f94f8bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f290ae00740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f94f8142f0 con 0x55f94f8bacb0 2024-09-19T06:08:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f290ae00740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f94f7bc270 con 0x55f94f8b0410 2024-09-19T06:08:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f290ae00740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f94f8102b0 con 0x55f94f8afaf0 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f2906602640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f2906602640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:38658/0 (socket says 172.21.15.103:38658) 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f2906602640 1 -- 172.21.15.103:0/2405679011 learned_addr learned my addr 172.21.15.103:0/2405679011 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f2905600640 1 --2- 172.21.15.103:0/2405679011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 0x55f94f8bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f2905e01640 1 --2- 172.21.15.103:0/2405679011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8b0410 0x55f94f8ba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.642+0000 7f28f6ffd640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f28ec0a3580 0x7f28ec0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f2906602640 1 -- 172.21.15.103:0/2405679011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8b0410 msgr2=0x55f94f8ba770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f2906602640 1 --2- 172.21.15.103:0/2405679011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8b0410 0x55f94f8ba770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f2906602640 1 -- 172.21.15.103:0/2405679011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 msgr2=0x55f94f8bd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f2906602640 1 --2- 172.21.15.103:0/2405679011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 0x55f94f8bd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f2906602640 1 -- 172.21.15.103:0/2405679011 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f94f7bb340 con 0x55f94f8afaf0 2024-09-19T06:08:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f2905600640 1 --2- 172.21.15.103:0/2405679011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 0x55f94f8bd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f2906602640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f28ec0a3580 0x7f28ec0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f28f6ffd640 1 -- 172.21.15.103:0/224782157 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f28fc0d01f0 con 0x7f29001009b0 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f2906602640 1 --2- 172.21.15.103:0/2405679011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8afed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28f8011620 tx=0x7f28f8011ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f958fdc99d9b8c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f28ebfff640 1 -- 172.21.15.103:0/2405679011 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8017050 con 0x55f94f8afaf0 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f28ebfff640 1 -- 172.21.15.103:0/2405679011 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28f801bd80 con 0x55f94f8afaf0 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f28ebfff640 1 -- 172.21.15.103:0/2405679011 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8026bd0 con 0x55f94f8afaf0 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.643+0000 7f2906602640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f28ec0a3580 0x7f28ec0a5a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28f8023000 tx=0x7f28f8024000 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.644+0000 7f290ae00740 1 -- 172.21.15.103:0/2405679011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 msgr2=0x55f94f8afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.644+0000 7f290ae00740 1 --2- 172.21.15.103:0/2405679011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8afed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28f8011620 tx=0x7f28f8011ae0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.644+0000 7f290ae00740 1 -- 172.21.15.103:0/2405679011 shutdown_connections 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.644+0000 7f290ae00740 1 --2- 172.21.15.103:0/2405679011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 0x55f94f8bd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.644+0000 7f290ae00740 1 --2- 172.21.15.103:0/2405679011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8b0410 0x55f94f8ba770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.644+0000 7f290ae00740 1 --2- 172.21.15.103:0/2405679011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8afed0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.644+0000 7f290ae00740 1 -- 172.21.15.103:0/2405679011 >> 172.21.15.103:0/2405679011 conn(0x55f94f8ac060 msgr2=0x55f94f8ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.644+0000 7f290ae00740 1 -- 172.21.15.103:0/2405679011 shutdown_connections 2024-09-19T06:08:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.644+0000 7f290ae00740 1 -- 172.21.15.103:0/2405679011 wait complete. 2024-09-19T06:08:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.644+0000 7f290ae00740 1 -- start start 2024-09-19T06:08:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f290ae00740 1 Processor -- start 2024-09-19T06:08:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f290ae00740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8afaf0 0x55f94f8b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f290ae00740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8b0410 0x55f94f8b8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f290ae00740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8bacb0 0x55f94f8b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f290ae00740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f94f8bd880 con 0x55f94f8afaf0 2024-09-19T06:08:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f290ae00740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f94f79d290 con 0x55f94f8bacb0 2024-09-19T06:08:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f290ae00740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f94f8bda00 con 0x55f94f8b0410 2024-09-19T06:08:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f290ae00740 10 client.0 _ll_register_callbacks cb 0x55f94f7ce140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f2905e01640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8afaf0 0x55f94f8b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f2905e01640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8afaf0 0x55f94f8b7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56572/0 (socket says 172.21.15.103:56572) 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f2905e01640 1 -- 172.21.15.103:0/3491828540 learned_addr learned my addr 172.21.15.103:0/3491828540 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f2905600640 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8b0410 0x55f94f8b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.645+0000 7f2906602640 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8bacb0 0x55f94f8b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f2905600640 1 -- 172.21.15.103:0/3491828540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8bacb0 msgr2=0x55f94f8b85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f2905600640 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8bacb0 0x55f94f8b85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f2905600640 1 -- 172.21.15.103:0/3491828540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8afaf0 msgr2=0x55f94f8b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f2905600640 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8afaf0 0x55f94f8b7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f2905600640 1 -- 172.21.15.103:0/3491828540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f94f527210 con 0x55f94f8b0410 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f2905e01640 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8afaf0 0x55f94f8b7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f2906602640 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8bacb0 0x55f94f8b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f2905600640 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8b0410 0x55f94f8b8080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f28f0005940 tx=0x7f28f0031e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d341a289a9d7c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f28e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f28e97fa640 1 -- 172.21.15.103:0/3491828540 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0035040 con 0x55f94f8b0410 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f290ae00740 1 -- 172.21.15.103:0/3491828540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f801bd80 con 0x55f94f8b0410 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f28e97fa640 1 -- 172.21.15.103:0/3491828540 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f28f00316f0 con 0x55f94f8b0410 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f28e97fa640 1 -- 172.21.15.103:0/3491828540 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28f0004040 con 0x55f94f8b0410 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f290ae00740 10 client.25249 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.646+0000 7f290ae00740 1 -- 172.21.15.103:0/3491828540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f94f5f3620 con 0x55f94f8b0410 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f28e97fa640 1 -- 172.21.15.103:0/3491828540 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28f801bd80 con 0x55f94f8b0410 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f28e97fa640 1 -- 172.21.15.103:0/3491828540 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f28f0050480 con 0x55f94f8b0410 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f290ae00740 10 client.25249 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f290ae00740 10 client.25249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f290ae00740 20 client.25249 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f290ae00740 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f94f8cabf0 0x55f94f8cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f290ae00740 4 client.25249 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f290ae00740 1 -- 172.21.15.103:0/3491828540 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f94f821a20 con 0x55f94f8cabf0 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f2905e01640 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f94f8cabf0 0x55f94f8cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f28e97fa640 10 client.25249 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.647+0000 7f2905e01640 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f94f8cabf0 0x55f94f8cd000 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6adf15910cbbb6c server_cookie=d641a55206962bf7 in_seq=0 out_seq=0 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f28e97fa640 1 -- 172.21.15.103:0/3491828540 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f94f821a20 con 0x55f94f8cabf0 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f28e97fa640 10 client.25249 handle_command_reply: tid=0 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f290ae00740 1 client.25249 shutdown 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f290ae00740 1 -- 172.21.15.103:0/3491828540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8b0410 msgr2=0x55f94f8b8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f290ae00740 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8b0410 0x55f94f8b8080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f28f0005940 tx=0x7f28f0031e10 comp rx=0 tx=0).stop 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f290ae00740 1 -- 172.21.15.103:0/3491828540 shutdown_connections 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f290ae00740 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f94f8cabf0 0x55f94f8cd000 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f28e97fa640 0 client.25249 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f290ae00740 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8bacb0 0x55f94f8b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f290ae00740 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8b0410 0x55f94f8b8080 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f290ae00740 1 --2- 172.21.15.103:0/3491828540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8afaf0 0x55f94f8b7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.648+0000 7f290ae00740 1 -- 172.21.15.103:0/3491828540 >> 172.21.15.103:0/3491828540 conn(0x55f94f8ac060 msgr2=0x55f94f8b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.649+0000 7f290ae00740 1 -- 172.21.15.103:0/3491828540 shutdown_connections 2024-09-19T06:08:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.649+0000 7f290ae00740 1 -- 172.21.15.103:0/3491828540 wait complete. 2024-09-19T06:08:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.649+0000 7f290ae00740 20 client.25249 trim_cache size 0 max 16384 2024-09-19T06:08:48.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.660+0000 7f46aaf1c640 1 -- 172.21.15.103:0/890893051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46a4101df0 msgr2=0x7f46a41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.660+0000 7f46aaf1c640 1 --2- 172.21.15.103:0/890893051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46a4101df0 0x7f46a41021d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4698009900 tx=0x7f469802a410 comp rx=0 tx=0).stop 2024-09-19T06:08:48.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.660+0000 7f46aaf1c640 1 -- 172.21.15.103:0/890893051 shutdown_connections 2024-09-19T06:08:48.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.660+0000 7f46aaf1c640 1 --2- 172.21.15.103:0/890893051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a4106f20 0x7f46a410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.660+0000 7f46aaf1c640 1 --2- 172.21.15.103:0/890893051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41027a0 0x7f46a41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.660+0000 7f46aaf1c640 1 --2- 172.21.15.103:0/890893051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46a4101df0 0x7f46a41021d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.660+0000 7f46aaf1c640 1 -- 172.21.15.103:0/890893051 >> 172.21.15.103:0/890893051 conn(0x7f46a40fd8b0 msgr2=0x7f46a40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.660+0000 7f46aaf1c640 1 -- 172.21.15.103:0/890893051 shutdown_connections 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.660+0000 7f46aaf1c640 1 -- 172.21.15.103:0/890893051 wait complete. 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46aaf1c640 1 Processor -- start 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46aaf1c640 1 -- start start 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46aaf1c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46a4101df0 0x7f46a41983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46aaf1c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41027a0 0x7f46a41988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46aaf1c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a4106f20 0x7f46a419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46aaf1c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4111e30 con 0x7f46a4101df0 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46aaf1c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4111cb0 con 0x7f46a4106f20 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46a8cb8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46a4101df0 0x7f46a41983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46a8cb8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46a4101df0 0x7f46a41983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56600/0 (socket says 172.21.15.103:56600) 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1091117842 learned_addr learned my addr 172.21.15.103:0/1091117842 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46aaf1c640 1 -- 172.21.15.103:0/1091117842 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4111fb0 con 0x7f46a41027a0 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46a94b9640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a4106f20 0x7f46a419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.661+0000 7f46a3fff640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41027a0 0x7f46a41988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1091117842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41027a0 msgr2=0x7f46a41988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41027a0 0x7f46a41988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1091117842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a4106f20 msgr2=0x7f46a419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a4106f20 0x7f46a419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1091117842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a419d360 con 0x7f46a4101df0 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a3fff640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41027a0 0x7f46a41988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a94b9640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a4106f20 0x7f46a419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46a4101df0 0x7f46a41983b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4698005940 tx=0x7f46980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a1ffb640 1 -- 172.21.15.103:0/1091117842 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698035050 con 0x7f46a4101df0 2024-09-19T06:08:48.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46aaf1c640 1 -- 172.21.15.103:0/1091117842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a419d5f0 con 0x7f46a4101df0 2024-09-19T06:08:48.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a1ffb640 1 -- 172.21.15.103:0/1091117842 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46980044c0 con 0x7f46a4101df0 2024-09-19T06:08:48.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.662+0000 7f46a1ffb640 1 -- 172.21.15.103:0/1091117842 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698003de0 con 0x7f46a4101df0 2024-09-19T06:08:48.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.663+0000 7f46aaf1c640 1 -- 172.21.15.103:0/1091117842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a4074420 con 0x7f46a4101df0 2024-09-19T06:08:48.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.666+0000 7f46ad2f5740 1 Processor -- start 2024-09-19T06:08:48.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.666+0000 7f46a1ffb640 1 -- 172.21.15.103:0/1091117842 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7f46980035f0 con 0x7f46a4101df0 2024-09-19T06:08:48.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.666+0000 7f46ad2f5740 1 -- start start 2024-09-19T06:08:48.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831db40 0x55fca831c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 0x55fca831ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 0x55fca8329760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46ad2f5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fca82822f0 con 0x55fca831db40 2024-09-19T06:08:48.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46ad2f5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fca8229cf0 con 0x55fca831c5d0 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46ad2f5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fca827e2b0 con 0x55fca8327370 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 0x55fca8329760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 0x55fca8329760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:38704/0 (socket says 172.21.15.103:38704) 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a3fff640 1 -- 172.21.15.103:0/699153009 learned_addr learned my addr 172.21.15.103:0/699153009 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a94b9640 1 --2- 172.21.15.103:0/699153009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831db40 0x55fca831c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/699153009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 0x55fca831ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a3fff640 1 -- 172.21.15.103:0/699153009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 msgr2=0x55fca831ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a3fff640 1 --2- 172.21.15.103:0/699153009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 0x55fca831ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a3fff640 1 -- 172.21.15.103:0/699153009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831db40 msgr2=0x55fca831c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a3fff640 1 --2- 172.21.15.103:0/699153009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831db40 0x55fca831c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a3fff640 1 -- 172.21.15.103:0/699153009 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fca820e3a0 con 0x55fca8327370 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.667+0000 7f46a94b9640 1 --2- 172.21.15.103:0/699153009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831db40 0x55fca831c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:48.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.668+0000 7f46a1ffb640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f46940a34d0 0x7f46940a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.668+0000 7f46a1ffb640 1 -- 172.21.15.103:0/1091117842 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f46980f44a0 con 0x7f46a4101df0 2024-09-19T06:08:48.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.668+0000 7f46a3fff640 1 --2- 172.21.15.103:0/699153009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 0x55fca8329760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46900114f0 tx=0x7f46900119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ef5ed1fcb7059d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.668+0000 7f46a94b9640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f46940a34d0 0x7f46940a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.668+0000 7f468effd640 1 -- 172.21.15.103:0/699153009 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690004020 con 0x55fca8327370 2024-09-19T06:08:48.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.668+0000 7f468effd640 1 -- 172.21.15.103:0/699153009 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46900041c0 con 0x55fca8327370 2024-09-19T06:08:48.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.668+0000 7f468effd640 1 -- 172.21.15.103:0/699153009 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469000f8a0 con 0x55fca8327370 2024-09-19T06:08:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f290ae00740 1 Processor -- start 2024-09-19T06:08:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f290ae00740 1 -- start start 2024-09-19T06:08:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f290ae00740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8afaf0 0x55f94f8b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f290ae00740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8b0410 0x55f94f8b9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f290ae00740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8bacb0 0x55f94f8d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f290ae00740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f29001b1fd0 con 0x55f94f8b0410 2024-09-19T06:08:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f290ae00740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29001af8a0 con 0x55f94f8afaf0 2024-09-19T06:08:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f290ae00740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29001ad710 con 0x55f94f8bacb0 2024-09-19T06:08:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f2905e01640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8afaf0 0x55f94f8b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f2905600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8b0410 0x55f94f8b9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f2905600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8b0410 0x55f94f8b9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56612/0 (socket says 172.21.15.103:56612) 2024-09-19T06:08:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f2905e01640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8afaf0 0x55f94f8b83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:48104/0 (socket says 172.21.15.103:48104) 2024-09-19T06:08:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f2905600640 1 -- 172.21.15.103:0/3757444642 learned_addr learned my addr 172.21.15.103:0/3757444642 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f2906602640 1 --2- 172.21.15.103:0/3757444642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8bacb0 0x55f94f8d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f46ad2f5740 1 -- 172.21.15.103:0/699153009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 msgr2=0x55fca8329760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/699153009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 0x55fca8329760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46900114f0 tx=0x7f46900119b0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f2906602640 1 -- 172.21.15.103:0/3757444642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8afaf0 msgr2=0x55f94f8b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f2906602640 1 --2- 172.21.15.103:0/3757444642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8afaf0 0x55f94f8b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f2906602640 1 -- 172.21.15.103:0/3757444642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8b0410 msgr2=0x55f94f8b9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f2906602640 1 --2- 172.21.15.103:0/3757444642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8b0410 0x55f94f8b9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.669+0000 7f46a94b9640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f46940a34d0 0x7f46940a5990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f469c005fd0 tx=0x7f469c009500 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f2906602640 1 -- 172.21.15.103:0/3757444642 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f94f8abe90 con 0x55f94f8bacb0 2024-09-19T06:08:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f2905e01640 1 --2- 172.21.15.103:0/3757444642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8afaf0 0x55f94f8b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f2905600640 1 --2- 172.21.15.103:0/3757444642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8b0410 0x55f94f8b9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f2906602640 1 --2- 172.21.15.103:0/3757444642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8bacb0 0x55f94f8d28c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28f8026830 tx=0x7f28f8009cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a7efce70421a961 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f28eb7fe640 1 -- 172.21.15.103:0/3757444642 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8034070 con 0x55f94f8bacb0 2024-09-19T06:08:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f46ad2f5740 1 -- 172.21.15.103:0/699153009 shutdown_connections 2024-09-19T06:08:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/699153009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 0x55fca8329760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/699153009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 0x55fca831ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/699153009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831db40 0x55fca831c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f46ad2f5740 1 -- 172.21.15.103:0/699153009 >> 172.21.15.103:0/699153009 conn(0x55fca82e5310 msgr2=0x55fca8318c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f46ad2f5740 1 -- 172.21.15.103:0/699153009 shutdown_connections 2024-09-19T06:08:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f46ad2f5740 1 -- 172.21.15.103:0/699153009 wait complete. 2024-09-19T06:08:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f28eb7fe640 1 -- 172.21.15.103:0/3757444642 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28f801bd80 con 0x55f94f8bacb0 2024-09-19T06:08:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f28eb7fe640 1 -- 172.21.15.103:0/3757444642 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f802b040 con 0x55f94f8bacb0 2024-09-19T06:08:48.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f46ad2f5740 1 -- start start 2024-09-19T06:08:48.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.670+0000 7f46ad2f5740 1 Processor -- start 2024-09-19T06:08:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f290ae00740 1 -- 172.21.15.103:0/3757444642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8bacb0 msgr2=0x55f94f8d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f290ae00740 1 --2- 172.21.15.103:0/3757444642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8bacb0 0x55f94f8d28c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28f8026830 tx=0x7f28f8009cb0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f290ae00740 1 -- 172.21.15.103:0/3757444642 shutdown_connections 2024-09-19T06:08:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f290ae00740 1 --2- 172.21.15.103:0/3757444642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8bacb0 0x55f94f8d28c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f290ae00740 1 --2- 172.21.15.103:0/3757444642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8b0410 0x55f94f8b9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f290ae00740 1 --2- 172.21.15.103:0/3757444642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8afaf0 0x55f94f8b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f290ae00740 1 -- 172.21.15.103:0/3757444642 >> 172.21.15.103:0/3757444642 conn(0x55f94f8ac060 msgr2=0x55f94f8b93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 0x55fca8326d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca831db40 0x55fca8323ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca8327370 0x55fca83245e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46ad2f5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fca832a070 con 0x55fca8327370 2024-09-19T06:08:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f290ae00740 1 -- 172.21.15.103:0/3757444642 shutdown_connections 2024-09-19T06:08:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f290ae00740 1 -- 172.21.15.103:0/3757444642 wait complete. 2024-09-19T06:08:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f290ae00740 1 -- start start 2024-09-19T06:08:48.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46ad2f5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fca823d060 con 0x55fca831c5d0 2024-09-19T06:08:48.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46ad2f5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fca832a1f0 con 0x55fca831db40 2024-09-19T06:08:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f290ae00740 1 Processor -- start 2024-09-19T06:08:48.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46a8cb8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 0x55fca8326d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46a8cb8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 0x55fca8326d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:48118/0 (socket says 172.21.15.103:48118) 2024-09-19T06:08:48.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1875755335 learned_addr learned my addr 172.21.15.103:0/1875755335 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:48.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46ad2f5740 10 client.0 _ll_register_callbacks cb 0x55fca7f908c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f290ae00740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f290ae00740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8b0410 0x55f94f8c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.671+0000 7f46a94b9640 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca8327370 0x55fca83245e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f290ae00740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 0x55f94f8b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f290ae00740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f29001add60 con 0x55f94f8bacb0 2024-09-19T06:08:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f290ae00740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29001af1d0 con 0x55f94f8b0410 2024-09-19T06:08:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f290ae00740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29001ae430 con 0x55f94f8afaf0 2024-09-19T06:08:48.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46a3fff640 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca831db40 0x55fca8323ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f290ae00740 10 client.0 _ll_register_callbacks cb 0x7f28f0031aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f2905e01640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f2905e01640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:38736/0 (socket says 172.21.15.103:38736) 2024-09-19T06:08:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f2905e01640 1 -- 172.21.15.103:0/2703093776 learned_addr learned my addr 172.21.15.103:0/2703093776 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f2905600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8b0410 0x55f94f8c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1875755335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca831db40 msgr2=0x55fca8323ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f2906602640 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 0x55f94f8b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca831db40 0x55fca8323ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f2905e01640 1 -- 172.21.15.103:0/2703093776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8b0410 msgr2=0x55f94f8c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f2905e01640 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8b0410 0x55f94f8c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f2905e01640 1 -- 172.21.15.103:0/2703093776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 msgr2=0x55f94f8b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1875755335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca8327370 msgr2=0x55fca83245e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f2905e01640 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 0x55f94f8b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f2905e01640 1 -- 172.21.15.103:0/2703093776 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f94f8accf0 con 0x55f94f8afaf0 2024-09-19T06:08:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f2906602640 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 0x55f94f8b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca8327370 0x55fca83245e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1875755335 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fca7ff33c0 con 0x55fca831c5d0 2024-09-19T06:08:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f2905e01640 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8c2ce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0d01c0 tx=0x7f28fc009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cff9c050ebc049e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f28e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46a3fff640 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca831db40 0x55fca8323ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 0x55fca8326d40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46980c05e0 tx=0x7f46980bc8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23ed81cf6c151afc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f4683fff640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f4683fff640 1 -- 172.21.15.103:0/1875755335 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980bffb0 con 0x55fca831c5d0 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1875755335 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46900041c0 con 0x55fca831c5d0 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f4683fff640 1 -- 172.21.15.103:0/1875755335 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f46980c0ab0 con 0x55fca831c5d0 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f4683fff640 1 -- 172.21.15.103:0/1875755335 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f46980c0d50 con 0x55fca831c5d0 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46ad2f5740 10 client.25199 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.672+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1875755335 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fca832a070 con 0x55fca831c5d0 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f4683fff640 1 -- 172.21.15.103:0/1875755335 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46900041c0 con 0x55fca831c5d0 2024-09-19T06:08:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f4683fff640 1 -- 172.21.15.103:0/1875755335 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4698043070 con 0x55fca831c5d0 2024-09-19T06:08:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f46ad2f5740 10 client.25199 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f46ad2f5740 10 client.25199 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:08:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f28e97fa640 1 -- 172.21.15.103:0/2703093776 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc010e00 con 0x55f94f8afaf0 2024-09-19T06:08:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f28e97fa640 1 -- 172.21.15.103:0/2703093776 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f28fc0cdaf0 con 0x55f94f8afaf0 2024-09-19T06:08:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f46ad2f5740 20 client.25199 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55fca833f6f0 0x55fca8341b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f46ad2f5740 4 client.25199 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1875755335 --> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fca828f860 con 0x55fca833f6f0 2024-09-19T06:08:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f46a3fff640 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55fca833f6f0 0x55fca8341b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.673+0000 7f290ae00740 1 -- 172.21.15.103:0/2703093776 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f801bd80 con 0x55f94f8afaf0 2024-09-19T06:08:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f28e97fa640 1 -- 172.21.15.103:0/2703093776 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28fc09c380 con 0x55f94f8afaf0 2024-09-19T06:08:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f290ae00740 10 client.25264 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f290ae00740 1 -- 172.21.15.103:0/2703093776 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f94f93d460 con 0x55f94f8afaf0 2024-09-19T06:08:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f46a3fff640 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55fca833f6f0 0x55fca8341b90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8646e92f99d50b82 server_cookie=79cbf68d94217294 in_seq=0 out_seq=0 2024-09-19T06:08:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f28e97fa640 1 -- 172.21.15.103:0/2703093776 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28f801bd80 con 0x55f94f8afaf0 2024-09-19T06:08:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f4683fff640 10 client.25199 ms_handle_connect on v2:172.21.15.174:6838/1070224661 2024-09-19T06:08:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f28e97fa640 1 -- 172.21.15.103:0/2703093776 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f28fc0bc0b0 con 0x55f94f8afaf0 2024-09-19T06:08:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f290ae00740 10 client.25264 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f290ae00740 10 client.25264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f290ae00740 20 client.25264 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f290ae00740 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f94f93db60 0x55f94f93ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f290ae00740 4 client.25264 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:08:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f290ae00740 1 -- 172.21.15.103:0/2703093776 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f94f81bd70 con 0x55f94f93db60 2024-09-19T06:08:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f2905600640 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f94f93db60 0x55f94f93ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f4683fff640 1 -- 172.21.15.103:0/1875755335 <== mds.1 v2:172.21.15.174:6838/1070224661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fca828f860 con 0x55fca833f6f0 2024-09-19T06:08:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.674+0000 7f4683fff640 10 client.25199 handle_command_reply: tid=0 2024-09-19T06:08:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f28e97fa640 10 client.25264 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:48.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 client.25199 shutdown 2024-09-19T06:08:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f2905600640 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f94f93db60 0x55f94f93ff80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60083c76795386db server_cookie=6bd149ec4354d90e in_seq=0 out_seq=0 2024-09-19T06:08:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1875755335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 msgr2=0x55fca8326d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 0x55fca8326d40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46980c05e0 tx=0x7f46980bc8f0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1875755335 shutdown_connections 2024-09-19T06:08:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca8327370 0x55fca83245e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca831db40 0x55fca8323ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55fca833f6f0 0x55fca8341b90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/1875755335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831c5d0 0x55fca8326d40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1875755335 >> 172.21.15.103:0/1875755335 conn(0x55fca82e5310 msgr2=0x55fca831e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f4683fff640 0 client.25199 ms_handle_reset on v2:172.21.15.174:6838/1070224661 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1875755335 shutdown_connections 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1875755335 wait complete. 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.675+0000 7f46ad2f5740 20 client.25199 trim_cache size 0 max 16384 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46ad2f5740 1 Processor -- start 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46ad2f5740 1 -- start start 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca831f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46a8cb8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca831f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca831db40 0x55fca831f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca8327370 0x55fca83474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46a8cb8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca831f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56642/0 (socket says 172.21.15.103:56642) 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46ad2f5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41add50 con 0x55fca831c5d0 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1611722660 learned_addr learned my addr 172.21.15.103:0/1611722660 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1611722660 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41ab620 con 0x55fca8327370 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1611722660 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41a9470 con 0x55fca831db40 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46a94b9640 1 --2- 172.21.15.103:0/1611722660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca8327370 0x55fca83474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1611722660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca831db40 msgr2=0x55fca831f660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/1611722660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca831db40 0x55fca831f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1611722660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca8327370 msgr2=0x55fca83474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/1611722660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca8327370 0x55fca83474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.692+0000 7f46a8cb8640 1 -- 172.21.15.103:0/1611722660 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fca8322540 con 0x55fca831c5d0 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.693+0000 7f46a94b9640 1 --2- 172.21.15.103:0/1611722660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca8327370 0x55fca83474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.693+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/1611722660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca831f120 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f46980bcab0 tx=0x7f4698005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d66b695ef58437 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.693+0000 7f468e7fc640 1 -- 172.21.15.103:0/1611722660 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980bffb0 con 0x55fca831c5d0 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.693+0000 7f468e7fc640 1 -- 172.21.15.103:0/1611722660 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46980c0650 con 0x55fca831c5d0 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.693+0000 7f468e7fc640 1 -- 172.21.15.103:0/1611722660 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980c0420 con 0x55fca831c5d0 2024-09-19T06:08:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.694+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1611722660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 msgr2=0x55fca831f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.694+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/1611722660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca831f120 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f46980bcab0 tx=0x7f4698005cb0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.694+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1611722660 shutdown_connections 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.694+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/1611722660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca8327370 0x55fca83474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.694+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/1611722660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca831db40 0x55fca831f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.694+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/1611722660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca831f120 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.694+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1611722660 >> 172.21.15.103:0/1611722660 conn(0x55fca82e5310 msgr2=0x55fca8326070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.694+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1611722660 shutdown_connections 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.694+0000 7f46ad2f5740 1 -- 172.21.15.103:0/1611722660 wait complete. 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46ad2f5740 1 -- start start 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46ad2f5740 1 Processor -- start 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca8337ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831db40 0x55fca8338430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46ad2f5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 0x55fca8334ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46ad2f5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41a9ae0 con 0x55fca831c5d0 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46ad2f5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41aaf50 con 0x55fca831db40 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46ad2f5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41aa1b0 con 0x55fca8327370 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46ad2f5740 10 client.0 _ll_register_callbacks cb 0x7f4698005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46a8cb8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca8337ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46a8cb8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca8337ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56644/0 (socket says 172.21.15.103:56644) 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46a8cb8640 1 -- 172.21.15.103:0/3144466160 learned_addr learned my addr 172.21.15.103:0/3144466160 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.695+0000 7f46a3fff640 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831db40 0x55fca8338430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46a94b9640 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 0x55fca8334ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46a8cb8640 1 -- 172.21.15.103:0/3144466160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 msgr2=0x55fca8334ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 0x55fca8334ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46a8cb8640 1 -- 172.21.15.103:0/3144466160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831db40 msgr2=0x55fca8338430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831db40 0x55fca8338430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46a8cb8640 1 -- 172.21.15.103:0/3144466160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fca8335380 con 0x55fca831c5d0 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46a3fff640 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831db40 0x55fca8338430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46a8cb8640 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca8337ef0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f46980c0350 tx=0x7f46980c0ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb22fff50141a04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f4683fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f4683fff640 1 -- 172.21.15.103:0/3144466160 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980f2050 con 0x55fca831c5d0 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f4683fff640 1 -- 172.21.15.103:0/3144466160 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f46980bfaa0 con 0x55fca831c5d0 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46ad2f5740 1 -- 172.21.15.103:0/3144466160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46980c0650 con 0x55fca831c5d0 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f4683fff640 1 -- 172.21.15.103:0/3144466160 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f46980c92c0 con 0x55fca831c5d0 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46ad2f5740 10 client.15657 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.696+0000 7f46ad2f5740 1 -- 172.21.15.103:0/3144466160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fca8335380 con 0x55fca831c5d0 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.697+0000 7f4683fff640 1 -- 172.21.15.103:0/3144466160 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46980c0650 con 0x55fca831c5d0 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.697+0000 7f4683fff640 1 -- 172.21.15.103:0/3144466160 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4698043070 con 0x55fca831c5d0 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.697+0000 7f46ad2f5740 10 client.15657 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.697+0000 7f46ad2f5740 10 client.15657 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:08:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.697+0000 7f46ad2f5740 20 client.15657 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.697+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55fca83ab070 0x55fca83ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.697+0000 7f46ad2f5740 4 client.15657 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:08:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.697+0000 7f46ad2f5740 1 -- 172.21.15.103:0/3144466160 --> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fca8289d70 con 0x55fca83ab070 2024-09-19T06:08:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.697+0000 7f46a3fff640 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55fca83ab070 0x55fca83ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f46a3fff640 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55fca83ab070 0x55fca83ad460 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=729451ad84ad226d server_cookie=24847f0edb51ce72 in_seq=0 out_seq=0 2024-09-19T06:08:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f4683fff640 10 client.15657 ms_handle_connect on v2:172.21.15.174:6838/1070224661 2024-09-19T06:08:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f4683fff640 1 -- 172.21.15.103:0/3144466160 <== mds.1 v2:172.21.15.174:6838/1070224661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fca8289d70 con 0x55fca83ab070 2024-09-19T06:08:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f4683fff640 10 client.15657 handle_command_reply: tid=0 2024-09-19T06:08:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f46ad2f5740 1 client.15657 shutdown 2024-09-19T06:08:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f46ad2f5740 1 -- 172.21.15.103:0/3144466160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 msgr2=0x55fca8337ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca8337ef0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f46980c0350 tx=0x7f46980c0ae0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f46ad2f5740 1 -- 172.21.15.103:0/3144466160 shutdown_connections 2024-09-19T06:08:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fca8327370 0x55fca8334ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55fca83ab070 0x55fca83ad460 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fca831db40 0x55fca8338430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f46ad2f5740 1 --2- 172.21.15.103:0/3144466160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fca831c5d0 0x55fca8337ef0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f46ad2f5740 1 -- 172.21.15.103:0/3144466160 >> 172.21.15.103:0/3144466160 conn(0x55fca82e5310 msgr2=0x55fca8317310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.698+0000 7f4683fff640 0 client.15657 ms_handle_reset on v2:172.21.15.174:6838/1070224661 2024-09-19T06:08:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46ad2f5740 1 -- 172.21.15.103:0/3144466160 shutdown_connections 2024-09-19T06:08:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46ad2f5740 1 -- 172.21.15.103:0/3144466160 wait complete. 2024-09-19T06:08:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46ad2f5740 20 client.15657 trim_cache size 0 max 16384 2024-09-19T06:08:48.707 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-09-19T06:08:48.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46aaf1c640 1 -- 172.21.15.103:0/1091117842 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f46940a34d0 msgr2=0x7f46940a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46aaf1c640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f46940a34d0 0x7f46940a5990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f469c005fd0 tx=0x7f469c009500 comp rx=0 tx=0).stop 2024-09-19T06:08:48.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46aaf1c640 1 -- 172.21.15.103:0/1091117842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46a4101df0 msgr2=0x7f46a41983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46aaf1c640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46a4101df0 0x7f46a41983b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4698005940 tx=0x7f46980040c0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46aaf1c640 1 -- 172.21.15.103:0/1091117842 shutdown_connections 2024-09-19T06:08:48.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46aaf1c640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f46940a34d0 0x7f46940a5990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46aaf1c640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a4106f20 0x7f46a419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46aaf1c640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41027a0 0x7f46a41988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46aaf1c640 1 --2- 172.21.15.103:0/1091117842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46a4101df0 0x7f46a41983b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.699+0000 7f46aaf1c640 1 -- 172.21.15.103:0/1091117842 >> 172.21.15.103:0/1091117842 conn(0x7f46a40fd8b0 msgr2=0x7f46a40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.700+0000 7f46aaf1c640 1 -- 172.21.15.103:0/1091117842 shutdown_connections 2024-09-19T06:08:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:48.700+0000 7f46aaf1c640 1 -- 172.21.15.103:0/1091117842 wait complete. 2024-09-19T06:08:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f28e97fa640 1 -- 172.21.15.103:0/2703093776 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f94f81bd70 con 0x55f94f93db60 2024-09-19T06:08:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f28e97fa640 10 client.25264 handle_command_reply: tid=0 2024-09-19T06:08:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 client.25264 shutdown 2024-09-19T06:08:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 -- 172.21.15.103:0/2703093776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 msgr2=0x55f94f8c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8c2ce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0d01c0 tx=0x7f28fc009700 comp rx=0 tx=0).stop 2024-09-19T06:08:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 -- 172.21.15.103:0/2703093776 shutdown_connections 2024-09-19T06:08:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55f94f93db60 0x55f94f93ff80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f94f8bacb0 0x55f94f8b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f94f8b0410 0x55f94f8c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f28e97fa640 0 client.25264 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 --2- 172.21.15.103:0/2703093776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f94f8afaf0 0x55f94f8c2ce0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 -- 172.21.15.103:0/2703093776 >> 172.21.15.103:0/2703093776 conn(0x55f94f8ac060 msgr2=0x55f94f8b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 -- 172.21.15.103:0/2703093776 shutdown_connections 2024-09-19T06:08:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 1 -- 172.21.15.103:0/2703093776 wait complete. 2024-09-19T06:08:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.935+0000 7f290ae00740 20 client.25264 trim_cache size 0 max 16384 2024-09-19T06:08:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:08:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:08:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:08:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:08:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 -- 172.21.15.103:0/224782157 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f28ec0a3580 msgr2=0x7f28ec0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f28ec0a3580 0x7f28ec0a5a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28f8023000 tx=0x7f28f8024000 comp rx=0 tx=0).stop 2024-09-19T06:08:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 -- 172.21.15.103:0/224782157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29001009b0 msgr2=0x7f29001982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29001009b0 0x7f29001982f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00e9f0 tx=0x7f28fc00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 -- 172.21.15.103:0/224782157 shutdown_connections 2024-09-19T06:08:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f28ec0a3580 0x7f28ec0a5a40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29001069c0 0x7f290019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2900101350 0x7f2900198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 --2- 172.21.15.103:0/224782157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29001009b0 0x7f29001982f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 -- 172.21.15.103:0/224782157 >> 172.21.15.103:0/224782157 conn(0x7f2900077990 msgr2=0x7f2900069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 -- 172.21.15.103:0/224782157 shutdown_connections 2024-09-19T06:08:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:08:48.936+0000 7f2908065640 1 -- 172.21.15.103:0/224782157 wait complete. 2024-09-19T06:08:49.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:48 smithi174 ceph-mon[34488]: pgmap v47: 97 pgs: 97 active+clean; 23 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 450 KiB/s wr, 92 op/s 2024-09-19T06:08:49.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:48 smithi103 ceph-mon[30925]: pgmap v47: 97 pgs: 97 active+clean; 23 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 450 KiB/s wr, 92 op/s 2024-09-19T06:08:49.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:48 smithi169 ceph-mon[34350]: pgmap v47: 97 pgs: 97 active+clean; 23 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 450 KiB/s wr, 92 op/s 2024-09-19T06:08:49.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:08:49.740 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:50.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.279+0000 7fbbf55b3640 1 -- 172.21.15.103:0/3556638679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf0102570 msgr2=0x7fbbf01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:50.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.279+0000 7fbbf55b3640 1 --2- 172.21.15.103:0/3556638679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf0102570 0x7fbbf01029b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009930 tx=0x7fbbe402a4d0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.279+0000 7fbbf55b3640 1 -- 172.21.15.103:0/3556638679 shutdown_connections 2024-09-19T06:08:50.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.279+0000 7fbbf55b3640 1 --2- 172.21.15.103:0/3556638679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf0102ef0 0x7fbbf010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.279+0000 7fbbf55b3640 1 --2- 172.21.15.103:0/3556638679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf0102570 0x7fbbf01029b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.279+0000 7fbbf55b3640 1 --2- 172.21.15.103:0/3556638679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbf0100e20 0x7fbbf0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.279+0000 7fbbf55b3640 1 -- 172.21.15.103:0/3556638679 >> 172.21.15.103:0/3556638679 conn(0x7fbbf00fc7d0 msgr2=0x7fbbf00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:50.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.279+0000 7fbbf55b3640 1 -- 172.21.15.103:0/3556638679 shutdown_connections 2024-09-19T06:08:50.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.279+0000 7fbbf55b3640 1 -- 172.21.15.103:0/3556638679 wait complete. 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbf55b3640 1 Processor -- start 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbf55b3640 1 -- start start 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbf55b3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbf0100e20 0x7fbbf010e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbf55b3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf0102570 0x7fbbf010ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbf55b3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf0102ef0 0x7fbbf010f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbf55b3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0111ef0 con 0x7fbbf0102570 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbf55b3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0111d70 con 0x7fbbf0102ef0 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbf55b3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0112070 con 0x7fbbf0100e20 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbee7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf0102570 0x7fbbf010ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbee7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf0102570 0x7fbbf010ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45874/0 (socket says 172.21.15.103:45874) 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbee7fc640 1 -- 172.21.15.103:0/1953884771 learned_addr learned my addr 172.21.15.103:0/1953884771 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:50.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbef7fe640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf0102ef0 0x7fbbf010f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.280+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbf0100e20 0x7fbbf010e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbee7fc640 1 -- 172.21.15.103:0/1953884771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbf0100e20 msgr2=0x7fbbf010e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbf0100e20 0x7fbbf010e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbee7fc640 1 -- 172.21.15.103:0/1953884771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf0102ef0 msgr2=0x7fbbf010f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf0102ef0 0x7fbbf010f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbee7fc640 1 -- 172.21.15.103:0/1953884771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf01a6910 con 0x7fbbf0102570 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbef7fe640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf0102ef0 0x7fbbf010f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf0102570 0x7fbbf010ec40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4005940 tx=0x7fbbe40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbd7fff640 1 -- 172.21.15.103:0/1953884771 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe403f030 con 0x7fbbf0102570 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbd7fff640 1 -- 172.21.15.103:0/1953884771 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbe40318a0 con 0x7fbbf0102570 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbf55b3640 1 -- 172.21.15.103:0/1953884771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf01a6ba0 con 0x7fbbf0102570 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbd7fff640 1 -- 172.21.15.103:0/1953884771 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4035070 con 0x7fbbf0102570 2024-09-19T06:08:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.281+0000 7fbbf55b3640 1 -- 172.21.15.103:0/1953884771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf01a7080 con 0x7fbbf0102570 2024-09-19T06:08:50.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.283+0000 7fbbd7fff640 1 -- 172.21.15.103:0/1953884771 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138589+0+0 (secure 0 0 0) 0x7fbbe4042030 con 0x7fbbf0102570 2024-09-19T06:08:50.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbf798c740 1 Processor -- start 2024-09-19T06:08:50.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbf798c740 1 -- start start 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040d15d0 0x55d1040d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040dc370 0x55d1040de760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbf798c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d1040372f0 con 0x55d1040d15d0 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbf798c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d103fdecf0 con 0x55d1040d2b40 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbf798c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d1040332b0 con 0x55d1040dc370 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbeeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040d15d0 0x55d1040d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbef7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbeeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040d15d0 0x55d1040d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45890/0 (socket says 172.21.15.103:45890) 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbeeffd640 1 -- 172.21.15.103:0/491129511 learned_addr learned my addr 172.21.15.103:0/491129511 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.284+0000 7fbbd7fff640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbbd80a34d0 0x7fbbd80a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.285+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/491129511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040dc370 0x55d1040de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.285+0000 7fbbeeffd640 1 -- 172.21.15.103:0/491129511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040dc370 msgr2=0x55d1040de760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.285+0000 7fbbef7fe640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbbd80a34d0 0x7fbbd80a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.285+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/491129511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040dc370 0x55d1040de760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.285+0000 7fbbeeffd640 1 -- 172.21.15.103:0/491129511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 msgr2=0x55d1040d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.285+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/491129511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.285+0000 7fbbeeffd640 1 -- 172.21.15.103:0/491129511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d103fc33a0 con 0x55d1040d15d0 2024-09-19T06:08:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.285+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/491129511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040dc370 0x55d1040de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.285+0000 7fbbef7fe640 1 --2- 172.21.15.103:0/491129511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.285+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/491129511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040d15d0 0x55d1040d1a10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000bd10 tx=0x7fbbe00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745fba1d1fea62ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.286+0000 7fbbd7fff640 1 -- 172.21.15.103:0/1953884771 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fbbe40f01d0 con 0x7fbbf0102570 2024-09-19T06:08:50.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.286+0000 7fbbd57fa640 1 -- 172.21.15.103:0/491129511 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0004030 con 0x55d1040d15d0 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.286+0000 7fbbd57fa640 1 -- 172.21.15.103:0/491129511 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbe00035f0 con 0x55d1040d15d0 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.286+0000 7fbbd57fa640 1 -- 172.21.15.103:0/491129511 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0011770 con 0x55d1040d15d0 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.287+0000 7fbbf798c740 1 -- 172.21.15.103:0/491129511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040d15d0 msgr2=0x55d1040d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.287+0000 7fbbef7fe640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbbd80a34d0 0x7fbbd80a5990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8005fd0 tx=0x7fbbe8004ab0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.287+0000 7fbbf798c740 1 --2- 172.21.15.103:0/491129511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040d15d0 0x55d1040d1a10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000bd10 tx=0x7fbbe00107a0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.287+0000 7fbbf798c740 1 -- 172.21.15.103:0/491129511 shutdown_connections 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.287+0000 7fbbf798c740 1 --2- 172.21.15.103:0/491129511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040dc370 0x55d1040de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.287+0000 7fbbf798c740 1 --2- 172.21.15.103:0/491129511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040d15d0 0x55d1040d1a10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.287+0000 7fbbf798c740 1 --2- 172.21.15.103:0/491129511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.287+0000 7fbbf798c740 1 -- 172.21.15.103:0/491129511 >> 172.21.15.103:0/491129511 conn(0x55d10409a310 msgr2=0x55d1040cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:50.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.287+0000 7fbbf798c740 1 -- 172.21.15.103:0/491129511 shutdown_connections 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.287+0000 7fbbf798c740 1 -- 172.21.15.103:0/491129511 wait complete. 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbf798c740 1 -- start start 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbf798c740 1 Processor -- start 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d15d0 0x55d1040dbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040d95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbf798c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d1040df070 con 0x55d1040dc370 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbf798c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d103ff2060 con 0x55d1040d2b40 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbf798c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d1040df1f0 con 0x55d1040d15d0 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbee7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbf798c740 10 client.0 _ll_register_callbacks cb 0x55d103d458c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbee7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:43752/0 (socket says 172.21.15.103:43752) 2024-09-19T06:08:50.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbeeffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d15d0 0x55d1040dbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbee7fc640 1 -- 172.21.15.103:0/1761300825 learned_addr learned my addr 172.21.15.103:0/1761300825 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.288+0000 7fbbef7fe640 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040d95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbee7fc640 1 -- 172.21.15.103:0/1761300825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d15d0 msgr2=0x55d1040dbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d15d0 0x55d1040dbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbee7fc640 1 -- 172.21.15.103:0/1761300825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 msgr2=0x55d1040d95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040d95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbee7fc640 1 -- 172.21.15.103:0/1761300825 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d103da83c0 con 0x55d1040d2b40 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d15d0 0x55d1040dbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d9000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009900 tx=0x7fbbe40bc2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35414c18ced18427 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbd2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/1761300825 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40f0030 con 0x55d1040d2b40 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/1761300825 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fbbe40c4d60 con 0x55d1040d2b40 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbf798c740 1 -- 172.21.15.103:0/1761300825 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbe00035f0 con 0x55d1040d2b40 2024-09-19T06:08:50.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/1761300825 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbe4049050 con 0x55d1040d2b40 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbf798c740 10 client.25217 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbf798c740 1 -- 172.21.15.103:0/1761300825 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d1040eaa90 con 0x55d1040d2b40 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.289+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/1761300825 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbe00035f0 con 0x55d1040d2b40 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.290+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/1761300825 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbbe40d50f0 con 0x55d1040d2b40 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.290+0000 7fbbf798c740 10 client.25217 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.290+0000 7fbbf798c740 10 client.25217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.290+0000 7fbbf798c740 20 client.25217 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.290+0000 7fbbf798c740 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55d1040ebf20 0x55d1040ee360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.290+0000 7fbbf798c740 4 client.25217 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.290+0000 7fbbf798c740 1 -- 172.21.15.103:0/1761300825 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d104044860 con 0x55d1040ebf20 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.290+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55d1040ebf20 0x55d1040ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.290+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55d1040ebf20 0x55d1040ee360 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=178067b800317cf2 server_cookie=dd0917670b9debfd in_seq=0 out_seq=0 2024-09-19T06:08:50.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.290+0000 7fbbd2ff5640 10 client.25217 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/1761300825 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d104044860 con 0x55d1040ebf20 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbd2ff5640 10 client.25217 handle_command_reply: tid=0 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbf798c740 1 client.25217 shutdown 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbf798c740 1 -- 172.21.15.103:0/1761300825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 msgr2=0x55d1040d9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbf798c740 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d9000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009900 tx=0x7fbbe40bc2f0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbf798c740 1 -- 172.21.15.103:0/1761300825 shutdown_connections 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbf798c740 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55d1040ebf20 0x55d1040ee360 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbf798c740 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040d95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbd2ff5640 0 client.25217 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbf798c740 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d2b40 0x55d1040d9000 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbf798c740 1 --2- 172.21.15.103:0/1761300825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d15d0 0x55d1040dbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.291+0000 7fbbf798c740 1 -- 172.21.15.103:0/1761300825 >> 172.21.15.103:0/1761300825 conn(0x55d10409a310 msgr2=0x55d1040d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:50.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.292+0000 7fbbf798c740 1 -- 172.21.15.103:0/1761300825 shutdown_connections 2024-09-19T06:08:50.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.292+0000 7fbbf798c740 1 -- 172.21.15.103:0/1761300825 wait complete. 2024-09-19T06:08:50.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.292+0000 7fbbf798c740 20 client.25217 trim_cache size 0 max 16384 2024-09-19T06:08:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.307+0000 7fbbf798c740 1 Processor -- start 2024-09-19T06:08:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.307+0000 7fbbf798c740 1 -- start start 2024-09-19T06:08:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.307+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040d8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.307+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 0x55d1040d2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.307+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040e8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.307+0000 7fbbf798c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01b2280 con 0x55d1040dc370 2024-09-19T06:08:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.307+0000 7fbbf798c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01afb50 con 0x55d1040d15d0 2024-09-19T06:08:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.307+0000 7fbbf798c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01ad9c0 con 0x55d1040d2b40 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbeeffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040d8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbef7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040e8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbeeffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040d8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:43764/0 (socket says 172.21.15.103:43764) 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbeeffd640 1 -- 172.21.15.103:0/2243786029 learned_addr learned my addr 172.21.15.103:0/2243786029 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/2243786029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 0x55d1040d2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbeeffd640 1 -- 172.21.15.103:0/2243786029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 msgr2=0x55d1040d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/2243786029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 0x55d1040d2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbeeffd640 1 -- 172.21.15.103:0/2243786029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 msgr2=0x55d1040e8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/2243786029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040e8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbeeffd640 1 -- 172.21.15.103:0/2243786029 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1040d4120 con 0x55d1040d15d0 2024-09-19T06:08:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/2243786029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040d8fd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000bc30 tx=0x7fbbe0003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e80b38c7514ffead server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbd4ff9640 1 -- 172.21.15.103:0/2243786029 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00037f0 con 0x55d1040d15d0 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbd4ff9640 1 -- 172.21.15.103:0/2243786029 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbe00054f0 con 0x55d1040d15d0 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.308+0000 7fbbd4ff9640 1 -- 172.21.15.103:0/2243786029 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0011900 con 0x55d1040d15d0 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.309+0000 7fbbf798c740 1 -- 172.21.15.103:0/2243786029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 msgr2=0x55d1040d8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.309+0000 7fbbf798c740 1 --2- 172.21.15.103:0/2243786029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040d8fd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000bc30 tx=0x7fbbe0003cd0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.309+0000 7fbbf798c740 1 -- 172.21.15.103:0/2243786029 shutdown_connections 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.309+0000 7fbbf798c740 1 --2- 172.21.15.103:0/2243786029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040e8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.309+0000 7fbbf798c740 1 --2- 172.21.15.103:0/2243786029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 0x55d1040d2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.309+0000 7fbbf798c740 1 --2- 172.21.15.103:0/2243786029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040d8fd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.309+0000 7fbbf798c740 1 -- 172.21.15.103:0/2243786029 >> 172.21.15.103:0/2243786029 conn(0x55d10409a310 msgr2=0x55d1040d88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.309+0000 7fbbf798c740 1 -- 172.21.15.103:0/2243786029 shutdown_connections 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.309+0000 7fbbf798c740 1 -- 172.21.15.103:0/2243786029 wait complete. 2024-09-19T06:08:50.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbf798c740 1 -- start start 2024-09-19T06:08:50.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbf798c740 1 Processor -- start 2024-09-19T06:08:50.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040e49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 0x55d1040dfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbf798c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040e0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbf798c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01ae010 con 0x55d1040dc370 2024-09-19T06:08:50.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbf798c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01af480 con 0x55d1040d15d0 2024-09-19T06:08:50.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbf798c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01ae6e0 con 0x55d1040d2b40 2024-09-19T06:08:50.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbef7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040e0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbeeffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040e49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbeeffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040e49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:43780/0 (socket says 172.21.15.103:43780) 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbef7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040e0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45900/0 (socket says 172.21.15.103:45900) 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbeeffd640 1 -- 172.21.15.103:0/2388953591 learned_addr learned my addr 172.21.15.103:0/2388953591 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbf798c740 10 client.0 _ll_register_callbacks cb 0x7fbbe40b8740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.310+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 0x55d1040dfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbeeffd640 1 -- 172.21.15.103:0/2388953591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 msgr2=0x55d1040dfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 0x55d1040dfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbeeffd640 1 -- 172.21.15.103:0/2388953591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 msgr2=0x55d1040e0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040e0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbeeffd640 1 -- 172.21.15.103:0/2388953591 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1040e0840 con 0x55d1040d15d0 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 0x55d1040dfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbeeffd640 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040e49e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0010ca0 tx=0x7fbbe000b970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cbc6653f6d351e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbd2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:08:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/2388953591 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0039020 con 0x55d1040d15d0 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/2388953591 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fbbe00035f0 con 0x55d1040d15d0 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbf798c740 1 -- 172.21.15.103:0/2388953591 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbe00054f0 con 0x55d1040d15d0 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.311+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/2388953591 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbe0003810 con 0x55d1040d15d0 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbf798c740 10 client.25223 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbf798c740 1 -- 172.21.15.103:0/2388953591 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d1041569e0 con 0x55d1040d15d0 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/2388953591 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbe00054f0 con 0x55d1040d15d0 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/2388953591 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbbe002f070 con 0x55d1040d15d0 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbf798c740 10 client.25223 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbf798c740 10 client.25223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbf798c740 20 client.25223 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbf798c740 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55d1040ebf20 0x55d104158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbf798c740 4 client.25223 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbf798c740 1 -- 172.21.15.103:0/2388953591 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d10403ed70 con 0x55d1040ebf20 2024-09-19T06:08:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.312+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55d1040ebf20 0x55d104158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:50.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.313+0000 7fbbee7fc640 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55d1040ebf20 0x55d104158eb0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6216bb087c4916d1 server_cookie=5da96995c401ae08 in_seq=0 out_seq=0 2024-09-19T06:08:50.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.313+0000 7fbbd2ff5640 10 client.25223 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:50.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbd2ff5640 1 -- 172.21.15.103:0/2388953591 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d10403ed70 con 0x55d1040ebf20 2024-09-19T06:08:50.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbd2ff5640 10 client.25223 handle_command_reply: tid=0 2024-09-19T06:08:50.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbf798c740 1 client.25223 shutdown 2024-09-19T06:08:50.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbf798c740 1 -- 172.21.15.103:0/2388953591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 msgr2=0x55d1040e49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:50.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbf798c740 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040e49e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0010ca0 tx=0x7fbbe000b970 comp rx=0 tx=0).stop 2024-09-19T06:08:50.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbf798c740 1 -- 172.21.15.103:0/2388953591 shutdown_connections 2024-09-19T06:08:50.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbf798c740 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55d1040ebf20 0x55d104158eb0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbf798c740 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1040dc370 0x55d1040e0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbf798c740 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1040d2b40 0x55d1040dfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbd2ff5640 0 client.25223 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:50.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.314+0000 7fbbf798c740 1 --2- 172.21.15.103:0/2388953591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1040d15d0 0x55d1040e49e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.315+0000 7fbbf798c740 1 -- 172.21.15.103:0/2388953591 >> 172.21.15.103:0/2388953591 conn(0x55d10409a310 msgr2=0x55d1040cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:50.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.315+0000 7fbbf798c740 1 -- 172.21.15.103:0/2388953591 shutdown_connections 2024-09-19T06:08:50.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.315+0000 7fbbf798c740 1 -- 172.21.15.103:0/2388953591 wait complete. 2024-09-19T06:08:50.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.315+0000 7fbbf798c740 20 client.25223 trim_cache size 0 max 16384 2024-09-19T06:08:50.320 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-09-19T06:08:50.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.315+0000 7fbbf55b3640 1 -- 172.21.15.103:0/1953884771 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbbd80a34d0 msgr2=0x7fbbd80a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:50.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.315+0000 7fbbf55b3640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbbd80a34d0 0x7fbbd80a5990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8005fd0 tx=0x7fbbe8004ab0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.315+0000 7fbbf55b3640 1 -- 172.21.15.103:0/1953884771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf0102570 msgr2=0x7fbbf010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:50.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.315+0000 7fbbf55b3640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf0102570 0x7fbbf010ec40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4005940 tx=0x7fbbe40042f0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.316+0000 7fbbf55b3640 1 -- 172.21.15.103:0/1953884771 shutdown_connections 2024-09-19T06:08:50.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.316+0000 7fbbf55b3640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbbd80a34d0 0x7fbbd80a5990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.316+0000 7fbbf55b3640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf0102ef0 0x7fbbf010f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.316+0000 7fbbf55b3640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf0102570 0x7fbbf010ec40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.316+0000 7fbbf55b3640 1 --2- 172.21.15.103:0/1953884771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbf0100e20 0x7fbbf010e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:50.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.316+0000 7fbbf55b3640 1 -- 172.21.15.103:0/1953884771 >> 172.21.15.103:0/1953884771 conn(0x7fbbf00fc7d0 msgr2=0x7fbbf0104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:50.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.316+0000 7fbbf55b3640 1 -- 172.21.15.103:0/1953884771 shutdown_connections 2024-09-19T06:08:50.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:50.316+0000 7fbbf55b3640 1 -- 172.21.15.103:0/1953884771 wait complete. 2024-09-19T06:08:51.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:50 smithi174 ceph-mon[34488]: pgmap v48: 97 pgs: 97 active+clean; 23 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 450 KiB/s wr, 92 op/s 2024-09-19T06:08:51.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:50 smithi103 ceph-mon[30925]: pgmap v48: 97 pgs: 97 active+clean; 23 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 450 KiB/s wr, 92 op/s 2024-09-19T06:08:51.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:50 smithi169 ceph-mon[34350]: pgmap v48: 97 pgs: 97 active+clean; 23 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 450 KiB/s wr, 92 op/s 2024-09-19T06:08:52.042 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:08:52.043 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:08:52.302 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:53.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:52 smithi174 ceph-mon[34488]: pgmap v49: 97 pgs: 97 active+clean; 27 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 1.3 MiB/s wr, 534 op/s 2024-09-19T06:08:53.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:52 smithi174 ceph-mon[34488]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-19T06:08:53.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:52 smithi103 ceph-mon[30925]: pgmap v49: 97 pgs: 97 active+clean; 27 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 1.3 MiB/s wr, 534 op/s 2024-09-19T06:08:53.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:52 smithi103 ceph-mon[30925]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-19T06:08:53.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:52 smithi169 ceph-mon[34350]: pgmap v49: 97 pgs: 97 active+clean; 27 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 1.3 MiB/s wr, 534 op/s 2024-09-19T06:08:53.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:52 smithi169 ceph-mon[34350]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-19T06:08:53.954 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.685+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023f [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/index.lock auth v213 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15201=0-4194304@2} caps={15201=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15201 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348b1c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023f:[<0x10000000008/index.lock v213>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000023f:[<0x10000000008/index.lock v213>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.954 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.686+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000009 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/description auth v219 ap=1 s=73 n(v0 rc2024-09-19T06:08:29.795660+0000 b73 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348b1cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000009:[<0x10000000008/description v219>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000009:[<0x10000000008/description v219>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.955 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i[65331]: 2024-09-19T06:08:53.686+0000 7fd1a2325640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000221 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/info/ auth v4 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/AsLsXsFsx@2},l=15201 | importingcaps=0 dirfrag=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f3009ef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000221:[<0x1000000021f/info v4>,<0x10000000008/objects v146>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000221:[<0x1000000021f/info v4>,<0x10000000008/objects v256>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":0} 2024-09-19T06:08:53.955 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i[65331]: 2024-09-19T06:08:53.686+0000 7fd1a2325640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000227 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.pack auth v162 ap=1 s=12653521 n(v0 rc2024-09-19T06:08:32.824692+0000 b12653521 1=1+0) (ifile excl) cr={15201=0-29360128@2} caps={15201=pAsLsXsFsxcrwb/pFscr@1},l=15201 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f300a82000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000227:[<0x10000000220/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.pack v162>,<0x1000000021f/pack v70>,<0x10000000008/objects v146>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000227:[<0x10000000220/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.pack v162>,<0x1000000021f/pack v70>,<0x10000000008/objects v256>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.955 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.686+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000205 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/ auth{0=1} v247 ap=1 f(v0 m2024-09-19T06:08:29.834720+0000 14=14+0) n(v0 rc2024-09-19T06:08:29.836267+0000 b25879 15=14+1) (inest mix) caps={15201=pAsLsXs/-@1},l=15201 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 authpin=1 scrubqueue=0 0x5573488f8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000205:[<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000205:[<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:29.834720+0000 14=14+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:29.836267+0000 b25879 15=14+1)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:29.834720+0000 14=14+0)","memory_value.rstat":"n(v0 rc2024-09-19T06:08:29.836267+0000 b25879 15=14+1)","error_str":""},"return_code":0} 2024-09-19T06:08:53.955 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.687+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000236 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/HEAD auth v270 ap=1 s=23 n(v0 rc2024-09-19T06:08:33.084957+0000 b23 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b1c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000236:[<0x10000000008/HEAD v183>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000236:[<0x10000000008/HEAD v270>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.955 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.687+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000231 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/ auth v278 ap=1 f(v0 m2024-09-19T06:08:33.109422+0000 2=1+1) n(v2 rc2024-09-19T06:08:33.117249+0000 b588 8=3+5) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/-@1},l=15201 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b1d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000231:[<0x10000000008/logs v187>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000231:[<0x10000000008/logs v278>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:33.109422+0000 2=1+1)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.117249+0000 b588 8=3+5)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:33.109422+0000 2=1+1)","memory_value.rstat":"n(v2 rc2024-09-19T06:08:33.117249+0000 b588 8=3+5)","error_str":""},"return_code":0} 2024-09-19T06:08:53.956 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i[65331]: 2024-09-19T06:08:53.686+0000 7fd1a2325640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000220 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/ auth{2=1} v70 ap=1 f(v0 m2024-09-19T06:08:33.148101+0000 3=3+0) n(v0 rc2024-09-19T06:08:33.148101+0000 b14273845 4=3+1) (inest mix) (ifile excl) caps={15201=pAsLsXsFsx/-@1},l=15201 | lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 authpin=1 discoverbase=0 scrubqueue=0 0x55f3009ee680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000220:[<0x1000000021f/pack v70>,<0x10000000008/objects v146>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000220:[<0x1000000021f/pack v70>,<0x10000000008/objects v256>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:33.148101+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.148101+0000 b14273845 4=3+1)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:33.148101+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-09-19T06:08:33.148101+0000 b14273845 4=3+1)","error_str":""},"return_code":0} 2024-09-19T06:08:53.956 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i[65331]: 2024-09-19T06:08:53.687+0000 7fd1a2325640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000229 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.rev auth v154 ap=1 s=202452 n(v0 rc2024-09-19T06:08:32.831809+0000 b202452 1=1+0) (ifile excl) caps={15201=pAsLsXsFsxcrwb/-@1},l=15201(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f300a82b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000229:[<0x10000000220/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.rev v154>,<0x1000000021f/pack v70>,<0x10000000008/objects v146>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000229:[<0x10000000220/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.rev v154>,<0x1000000021f/pack v70>,<0x10000000008/objects v256>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.956 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i[65331]: 2024-09-19T06:08:53.687+0000 7fd1a2325640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000228 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.idx auth v160 ap=1 s=1417872 n(v0 rc2024-09-19T06:08:32.839047+0000 b1417872 1=1+0) (ifile excl) cr={15201=0-4194304@2} caps={15201=pAsLsXsFsxcrwb/pFscr@1},l=15201 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f300a82580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000228:[<0x10000000220/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.idx v160>,<0x1000000021f/pack v70>,<0x10000000008/objects v146>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000228:[<0x10000000220/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.idx v160>,<0x1000000021f/pack v70>,<0x10000000008/objects v256>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.956 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i[65331]: 2024-09-19T06:08:53.688+0000 7fd1a2325640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000242 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/LICENSES/GPL-2.0 auth v4 ap=1 s=18549 n(v0 rc2024-09-19T06:08:33.173816+0000 b18549 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f3009ef180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000242:[<0x10000000241/GPL-2.0 v2>,<0x10000000007/LICENSES v186>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000242:[<0x10000000241/GPL-2.0 v4>,<0x10000000007/LICENSES v835>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.962 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.688+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022d [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/packed-refs auth v262 ap=1 s=7368 n(v0 rc2024-09-19T06:08:33.048670+0000 b7368 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b1d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000022d:[<0x10000000008/packed-refs v166>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000022d:[<0x10000000008/packed-refs v262>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.962 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.689+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023e [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/config auth v274 ap=1 s=262 n(v0 rc2024-09-19T06:08:33.143935+0000 b262 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b1bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023e:[<0x10000000008/config v211>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000023e:[<0x10000000008/config v274>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.962 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.689+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000203 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info/ auth v217 ap=1 f(v0 m2024-09-19T06:08:29.798578+0000 1=1+0) n(v0 rc2024-09-19T06:08:29.799839+0000 b240 2=1+1) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/AsLsXsFsx@1},l=15201 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348b1b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000203:[<0x10000000008/info v217>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000203:[<0x10000000008/info v217>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:29.798578+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:29.799839+0000 b240 2=1+1)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:29.798578+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-09-19T06:08:29.799839+0000 b240 2=1+1)","error_str":""},"return_code":0} 2024-09-19T06:08:53.962 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.689+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000215 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/ auth{0=1,1=1} v272 ap=1 f(v0 m2024-09-19T06:08:33.056561+0000 3=0+3) n(v1 rc2024-09-19T06:08:33.119074+0000 b73 7=2+5) (inest mix) caps={15201=pAsLsXs/-@1},l=15201 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x5573487ae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000215:[<0x10000000008/refs v170>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000215:[<0x10000000008/refs v272>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:33.056561+0000 3=0+3)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.119074+0000 b73 7=2+5)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:33.056561+0000 3=0+3)","memory_value.rstat":"n(v1 rc2024-09-19T06:08:33.119074+0000 b73 7=2+5)","error_str":""},"return_code":0} 2024-09-19T06:08:53.962 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.689+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022b [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/shallow auth v266 ap=1 s=41 n(v0 rc2024-09-19T06:08:32.869726+0000 b41 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b1b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000022b:[<0x10000000008/shallow v154>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000022b:[<0x10000000008/shallow v266>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.962 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.689+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000214 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/branches/ auth v38 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/AsLsXsFsx@2},l=15201 | importingcaps=0 dirfrag=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348b1ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000214:[<0x10000000008/branches v38>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000214:[<0x10000000008/branches v38>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":0} 2024-09-19T06:08:53.962 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.689+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000206 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample auth v30 ap=1 s=420 n(v0 rc2024-09-19T06:08:29.804397+0000 b420 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348948b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000206:[<0x10000000205/pre-merge-commit.sample v30>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000206:[<0x10000000205/pre-merge-commit.sample v30>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.962 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.690+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000208 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample auth v34 ap=1 s=900 n(v0 rc2024-09-19T06:08:29.809167+0000 b900 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348949b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000208:[<0x10000000205/commit-msg.sample v34>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000208:[<0x10000000205/commit-msg.sample v34>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.962 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.690+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020e [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample auth v46 ap=1 s=548 n(v0 rc2024-09-19T06:08:29.824202+0000 b548 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55734894a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020e:[<0x10000000205/pre-receive.sample v46>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000020e:[<0x10000000205/pre-receive.sample v46>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.963 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.690+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020a [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample auth v38 ap=1 s=1653 n(v0 rc2024-09-19T06:08:29.813922+0000 b1653 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348949080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020a:[<0x10000000205/pre-commit.sample v38>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000020a:[<0x10000000205/pre-commit.sample v38>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.963 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.690+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020b [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample auth v40 ap=1 s=4902 n(v0 rc2024-09-19T06:08:29.816632+0000 b4902 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55734894a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020b:[<0x10000000205/pre-rebase.sample v40>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000020b:[<0x10000000205/pre-rebase.sample v40>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.963 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.690+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000213 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample auth v56 ap=1 s=4726 n(v0 rc2024-09-19T06:08:29.836267+0000 b4726 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348949600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000213:[<0x10000000205/fsmonitor-watchman.sample v56>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000213:[<0x10000000205/fsmonitor-watchman.sample v56>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.963 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.691+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000209 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample auth v36 ap=1 s=1496 n(v0 rc2024-09-19T06:08:29.811592+0000 b1496 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55734894ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000209:[<0x10000000205/prepare-commit-msg.sample v36>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000209:[<0x10000000205/prepare-commit-msg.sample v36>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.963 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.691+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000212 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/update.sample auth v54 ap=1 s=3654 n(v0 rc2024-09-19T06:08:29.833578+0000 b3654 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55734894b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000212:[<0x10000000205/update.sample v54>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000212:[<0x10000000205/update.sample v54>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.963 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.691+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020f [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample auth v48 ap=1 s=1378 n(v0 rc2024-09-19T06:08:29.826420+0000 b1378 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55734894b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020f:[<0x10000000205/pre-push.sample v48>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000020f:[<0x10000000205/pre-push.sample v48>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.963 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.691+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020d [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/sendemail-validate.sample auth v44 ap=1 s=2312 n(v0 rc2024-09-19T06:08:29.821684+0000 b2312 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348968000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020d:[<0x10000000205/sendemail-validate.sample v44>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000020d:[<0x10000000205/sendemail-validate.sample v44>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.963 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.692+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000210 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample auth v50 ap=1 s=428 n(v0 rc2024-09-19T06:08:29.828738+0000 b428 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348968580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000210:[<0x10000000205/pre-applypatch.sample v50>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000210:[<0x10000000205/pre-applypatch.sample v50>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.963 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.692+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000207 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample auth v32 ap=1 s=2787 n(v0 rc2024-09-19T06:08:29.806817+0000 b2787 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348968b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000207:[<0x10000000205/push-to-checkout.sample v32>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000207:[<0x10000000205/push-to-checkout.sample v32>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.963 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.692+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000211 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample auth v52 ap=1 s=193 n(v0 rc2024-09-19T06:08:29.831238+0000 b193 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348969080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000211:[<0x10000000205/post-update.sample v52>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000211:[<0x10000000205/post-update.sample v52>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.964 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.692+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020c [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample auth v42 ap=1 s=482 n(v0 rc2024-09-19T06:08:29.818827+0000 b482 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348969600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020c:[<0x10000000205/applypatch-msg.sample v42>,<0x10000000008/hooks v247>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000020c:[<0x10000000205/applypatch-msg.sample v42>,<0x10000000008/hooks v247>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.964 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.693+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000239 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/HEAD auth v19 ap=1 s=196 n(v0 rc2024-09-19T06:08:33.110732+0000 b196 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348baa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000239:[<0x10000000231/HEAD v6>,<0x10000000008/logs v187>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000239:[<0x10000000231/HEAD v19>,<0x10000000008/logs v278>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.964 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.693+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000232 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/ auth v21 ap=1 f(v0 m2024-09-19T06:08:33.114302+0000 2=0+2) n(v2 rc2024-09-19T06:08:33.117249+0000 b392 6=2+4) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/-@1},l=15201 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348baa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000232:[<0x10000000231/refs v8>,<0x10000000008/logs v187>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000232:[<0x10000000231/refs v21>,<0x10000000008/logs v278>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:33.114302+0000 2=0+2)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.117249+0000 b392 6=2+4)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:33.114302+0000 2=0+2)","memory_value.rstat":"n(v2 rc2024-09-19T06:08:33.117249+0000 b392 6=2+4)","error_str":""},"return_code":0} 2024-09-19T06:08:53.964 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.693+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000281 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/repair auth v184 ap=1 s=4565 n(v0 rc2024-09-19T06:08:33.295220+0000 b4565 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348a98680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000281:[<0x10000000257/repair v84>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000281:[<0x10000000257/repair v184>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.964 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.693+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026e [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter.btrfs auth v146 ap=1 s=5374 n(v0 rc2024-09-19T06:08:33.256074+0000 b5374 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348a98c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026e:[<0x10000000257/filter.btrfs v46>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000026e:[<0x10000000257/filter.btrfs v146>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.964 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.693+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000282 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/report auth v186 ap=1 s=8402 n(v0 rc2024-09-19T06:08:33.297542+0000 b8402 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348a99180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000282:[<0x10000000257/report v86>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000282:[<0x10000000257/report v186>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.964 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.693+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000265 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmlogwrites auth v128 ap=1 s=5995 n(v0 rc2024-09-19T06:08:33.238549+0000 b5995 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348a99700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000265:[<0x10000000257/dmlogwrites v28>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000265:[<0x10000000257/dmlogwrites v128>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.964 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.694+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025b [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/casefold auth v108 ap=1 s=2067 n(v0 rc2024-09-19T06:08:33.219991+0000 b2067 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025b:[<0x10000000257/casefold v8>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000025b:[<0x10000000257/casefold v108>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.964 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.694+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000279 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/perf auth v168 ap=1 s=937 n(v0 rc2024-09-19T06:08:33.278300+0000 b937 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000279:[<0x10000000257/perf v68>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000279:[<0x10000000257/perf v168>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.965 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.694+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026b [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fail_make_request auth v140 ap=1 s=1907 n(v0 rc2024-09-19T06:08:33.250335+0000 b1907 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026b:[<0x10000000257/fail_make_request v40>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000026b:[<0x10000000257/fail_make_request v140>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.965 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.694+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000262 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmerror auth v122 ap=1 s=10761 n(v0 rc2024-09-19T06:08:33.233162+0000 b10761 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000262:[<0x10000000257/dmerror v22>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000262:[<0x10000000257/dmerror v122>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.965 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.695+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000278 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/parent auth v166 ap=1 s=5568 n(v0 rc2024-09-19T06:08:33.276402+0000 b5568 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000278:[<0x10000000257/parent v66>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000278:[<0x10000000257/parent v166>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.965 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.695+0000 7fb9a9d5b640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021f [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/ auth{0=1,1=1} v256 ap=2 f(v0 m2024-09-19T06:08:29.910827+0000 2=0+2) n(v1 rc2024-09-19T06:08:33.148101+0000 b14273845 6=3+3) (inest sync->mix g=0,1) caps={15201=pAsLsXs/-@1} | lock=0 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5573487ae100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000021f:[<0x10000000008/objects v146>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000021f:[<0x10000000008/objects v256>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:29.910827+0000 2=0+2)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.148101+0000 b14273845 6=3+3)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:29.910827+0000 2=0+2)","memory_value.rstat":"n(v1 rc2024-09-19T06:08:33.148101+0000 b14273845 6=3+3)","error_str":""},"return_code":0} 2024-09-19T06:08:53.965 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.695+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000283 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/scsi_debug auth v188 ap=1 s=2176 n(v0 rc2024-09-19T06:08:33.299683+0000 b2176 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000283:[<0x10000000257/scsi_debug v88>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000283:[<0x10000000257/scsi_debug v188>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.965 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.695+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000270 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/gcov auth v150 ap=1 s=2881 n(v0 rc2024-09-19T06:08:33.260307+0000 b2881 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000270:[<0x10000000257/gcov v50>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000270:[<0x10000000257/gcov v150>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.965 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.696+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000264 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmhugedisk auth v126 ap=1 s=1098 n(v0 rc2024-09-19T06:08:33.236764+0000 b1098 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000264:[<0x10000000257/dmhugedisk v26>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000264:[<0x10000000257/dmhugedisk v126>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.965 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.696+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000288 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/xfs auth v198 ap=1 s=51555 n(v0 rc2024-09-19T06:08:33.311976+0000 b51555 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000288:[<0x10000000257/xfs v98>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000288:[<0x10000000257/xfs v198>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.965 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.696+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000287 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/verity auth v196 ap=1 s=12284 n(v0 rc2024-09-19T06:08:33.309067+0000 b12284 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000287:[<0x10000000257/verity v96>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000287:[<0x10000000257/verity v196>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.965 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.696+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000272 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/locktest auth v154 ap=1 s=1856 n(v0 rc2024-09-19T06:08:33.263929+0000 b1856 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348af7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000272:[<0x10000000257/locktest v54>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000272:[<0x10000000257/locktest v154>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.697+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026c [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filestreams auth v142 ap=1 s=4999 n(v0 rc2024-09-19T06:08:33.252005+0000 b4999 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348afe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026c:[<0x10000000257/filestreams v42>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000026c:[<0x10000000257/filestreams v142>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.697+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000269 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ext4 auth v136 ap=1 s=5605 n(v0 rc2024-09-19T06:08:33.246686+0000 b5605 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348afe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000269:[<0x10000000257/ext4 v36>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000269:[<0x10000000257/ext4 v136>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.697+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000268 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/encrypt auth v134 ap=1 s=31115 n(v0 rc2024-09-19T06:08:33.245000+0000 b31115 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348afeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000268:[<0x10000000257/encrypt v34>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000268:[<0x10000000257/encrypt v134>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.697+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027b [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/preamble auth v172 ap=1 s=1327 n(v0 rc2024-09-19T06:08:33.282381+0000 b1327 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348aff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027b:[<0x10000000257/preamble v72>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000027b:[<0x10000000257/preamble v172>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.697+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025e [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/config auth v114 ap=1 s=29232 n(v0 rc2024-09-19T06:08:33.225439+0000 b29232 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348aff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025e:[<0x10000000257/config v14>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000025e:[<0x10000000257/config v114>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.697+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027e [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/rc auth v178 ap=1 s=134336 n(v0 rc2024-09-19T06:08:33.289409+0000 b134336 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348affb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027e:[<0x10000000257/rc v78>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000027e:[<0x10000000257/rc v178>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.698+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000267 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dump auth v132 ap=1 s=36169 n(v0 rc2024-09-19T06:08:33.242683+0000 b36169 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b00100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000267:[<0x10000000257/dump v32>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000267:[<0x10000000257/dump v132>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.698+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025d [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/cgroup2 auth v112 ap=1 s=493 n(v0 rc2024-09-19T06:08:33.223453+0000 b493 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b00680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025d:[<0x10000000257/cgroup2 v12>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000025d:[<0x10000000257/cgroup2 v112>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.698+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000289 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/zoned auth v200 ap=1 s=1090 n(v0 rc2024-09-19T06:08:33.314104+0000 b1090 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b00c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000289:[<0x10000000257/zoned v100>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000289:[<0x10000000257/zoned v200>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.698+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000280 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/renameat2 auth v182 ap=1 s=2520 n(v0 rc2024-09-19T06:08:33.293303+0000 b2520 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b01180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000280:[<0x10000000257/renameat2 v82>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000280:[<0x10000000257/renameat2 v182>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.966 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.698+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000274 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/metadump auth v158 ap=1 s=4321 n(v0 rc2024-09-19T06:08:33.268211+0000 b4321 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b08000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000274:[<0x10000000257/metadump v58>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000274:[<0x10000000257/metadump v158>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.967 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.698+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000258 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/Makefile auth v102 ap=1 s=305 n(v0 rc2024-09-19T06:08:33.214268+0000 b305 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b01700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000258:[<0x10000000257/Makefile v2>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000258:[<0x10000000257/Makefile v102>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.967 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.698+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027c [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/punch auth v174 ap=1 s=15403 n(v0 rc2024-09-19T06:08:33.284176+0000 b15403 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b08b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027c:[<0x10000000257/punch v74>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000027c:[<0x10000000257/punch v174>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.967 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.698+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025c [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ceph auth v110 ap=1 s=986 n(v0 rc2024-09-19T06:08:33.221662+0000 b986 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b08580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025c:[<0x10000000257/ceph v10>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000025c:[<0x10000000257/ceph v110>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.967 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.699+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000276 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/nfs auth v162 ap=1 s=794 n(v0 rc2024-09-19T06:08:33.272489+0000 b794 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b09080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000276:[<0x10000000257/nfs v62>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000276:[<0x10000000257/nfs v162>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.967 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.699+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000286 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ubifs auth v194 ap=1 s=145 n(v0 rc2024-09-19T06:08:33.306692+0000 b145 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b09600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000286:[<0x10000000257/ubifs v94>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000286:[<0x10000000257/ubifs v194>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.967 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.699+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000263 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmflakey auth v124 ap=1 s=6034 n(v0 rc2024-09-19T06:08:33.234849+0000 b6034 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b09b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000263:[<0x10000000257/dmflakey v24>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000263:[<0x10000000257/dmflakey v124>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.967 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.699+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026d [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter auth v144 ap=1 s=18600 n(v0 rc2024-09-19T06:08:33.254093+0000 b18600 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b0a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026d:[<0x10000000257/filter v44>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000026d:[<0x10000000257/filter v144>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.967 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.699+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000260 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdelay auth v118 ap=1 s=1776 n(v0 rc2024-09-19T06:08:33.229481+0000 b1776 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b0a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000260:[<0x10000000257/dmdelay v18>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000260:[<0x10000000257/dmdelay v118>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.967 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.699+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000275 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/module auth v160 ap=1 s=6439 n(v0 rc2024-09-19T06:08:33.270449+0000 b6439 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b0ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000275:[<0x10000000257/module v60>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000275:[<0x10000000257/module v160>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.968 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.699+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025a [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/btrfs auth v106 ap=1 s=26775 n(v0 rc2024-09-19T06:08:33.218180+0000 b26775 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b0b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025a:[<0x10000000257/btrfs v6>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000025a:[<0x10000000257/btrfs v106>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.968 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.699+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027f [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/reflink auth v180 ap=1 s=14649 n(v0 rc2024-09-19T06:08:33.291471+0000 b14649 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b0b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027f:[<0x10000000257/reflink v80>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000027f:[<0x10000000257/reflink v180>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.968 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.699+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026f [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fuzzy auth v148 ap=1 s=43015 n(v0 rc2024-09-19T06:08:33.258430+0000 b43015 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b12000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026f:[<0x10000000257/fuzzy v48>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000026f:[<0x10000000257/fuzzy v148>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.968 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.699+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000284 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/test_names auth v190 ap=1 s=312 n(v0 rc2024-09-19T06:08:33.301912+0000 b312 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b12580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000284:[<0x10000000257/test_names v90>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000284:[<0x10000000257/test_names v190>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.968 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.700+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000261 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdust auth v120 ap=1 s=839 n(v0 rc2024-09-19T06:08:33.231368+0000 b839 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b12b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000261:[<0x10000000257/dmdust v20>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000261:[<0x10000000257/dmdust v120>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.968 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.700+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000259 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/attr auth v104 ap=1 s=6649 n(v0 rc2024-09-19T06:08:33.216049+0000 b6649 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b13080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000259:[<0x10000000257/attr v4>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000259:[<0x10000000257/attr v104>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.968 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.700+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027d [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/quota auth v176 ap=1 s=13048 n(v0 rc2024-09-19T06:08:33.285968+0000 b13048 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b13600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027d:[<0x10000000257/quota v76>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000027d:[<0x10000000257/quota v176>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.968 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.700+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000266 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmthin auth v130 ap=1 s=7964 n(v0 rc2024-09-19T06:08:33.240312+0000 b7964 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b13b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000266:[<0x10000000257/dmthin v30>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000266:[<0x10000000257/dmthin v130>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.968 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.700+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000277 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/overlay auth v164 ap=1 s=13439 n(v0 rc2024-09-19T06:08:33.274434+0000 b13439 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b14100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000277:[<0x10000000257/overlay v64>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000277:[<0x10000000257/overlay v164>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.969 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.700+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000273 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/log auth v156 ap=1 s=16169 n(v0 rc2024-09-19T06:08:33.265824+0000 b16169 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b14680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000273:[<0x10000000257/log v56>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000273:[<0x10000000257/log v156>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.969 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.700+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000271 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/inject auth v152 ap=1 s=2962 n(v0 rc2024-09-19T06:08:33.262030+0000 b2962 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b14c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000271:[<0x10000000257/inject v52>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000271:[<0x10000000257/inject v152>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.969 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.701+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027a [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/populate auth v170 ap=1 s=34516 n(v0 rc2024-09-19T06:08:33.280514+0000 b34516 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b15180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027a:[<0x10000000257/populate v70>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000027a:[<0x10000000257/populate v170>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.969 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.701+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026a [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/f2fs auth v138 ap=1 s=812 n(v0 rc2024-09-19T06:08:33.248616+0000 b812 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b15700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026a:[<0x10000000257/f2fs v38>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000026a:[<0x10000000257/f2fs v138>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.969 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.701+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000285 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/tracing auth v192 ap=1 s=2061 n(v0 rc2024-09-19T06:08:33.304312+0000 b2061 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b1a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000285:[<0x10000000257/tracing v92>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000285:[<0x10000000257/tracing v192>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.969 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.701+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025f [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/defrag auth v116 ap=1 s=4123 n(v0 rc2024-09-19T06:08:33.227648+0000 b4123 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348b1a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025f:[<0x10000000257/defrag v16>,<0x10000000007/common v320>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000025f:[<0x10000000257/defrag v116>,<0x10000000007/common v961>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.969 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.701+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000204 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info/exclude auth v6 ap=1 s=240 n(v0 rc2024-09-19T06:08:29.799839+0000 b240 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348bac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000204:[<0x10000000203/exclude v6>,<0x10000000008/info v217>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000204:[<0x10000000203/exclude v6>,<0x10000000008/info v217>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.969 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.701+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000217 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/tags/ auth v4 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/AsLsXsFsx@2},l=15201 | importingcaps=0 dirfrag=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5573488f8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000217:[<0x10000000215/tags v4>,<0x10000000008/refs v170>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000217:[<0x10000000215/tags v4>,<0x10000000008/refs v272>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":0} 2024-09-19T06:08:53.969 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.702+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000216 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads/ auth v21 ap=1 f(v0 m2024-09-19T06:08:33.119074+0000 1=1+0) n(v0 rc2024-09-19T06:08:33.119074+0000 b41 2=1+1) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/-@1},l=15201 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5573488f8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000216:[<0x10000000215/heads v16>,<0x10000000008/refs v170>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000216:[<0x10000000215/heads v21>,<0x10000000008/refs v272>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:33.119074+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.119074+0000 b41 2=1+1)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:33.119074+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-09-19T06:08:33.119074+0000 b41 2=1+1)","error_str":""},"return_code":0} 2024-09-19T06:08:53.969 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.702+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022e [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/ auth v18 ap=1 f(v0 m2024-09-19T06:08:33.058745+0000 1=0+1) n(v1 rc2024-09-19T06:08:33.077744+0000 b32 3=1+2) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/AsLsXsFsx@1},l=15201 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5573488f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000022e:[<0x10000000215/remotes v8>,<0x10000000008/refs v170>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000022e:[<0x10000000215/remotes v18>,<0x10000000008/refs v272>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:33.058745+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.077744+0000 b32 3=1+2)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:33.058745+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-19T06:08:33.077744+0000 b32 3=1+2)","error_str":""},"return_code":0} 2024-09-19T06:08:53.970 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.702+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023a [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads/ auth v15 ap=1 f(v0 m2024-09-19T06:08:33.115891+0000 1=1+0) n(v0 rc2024-09-19T06:08:33.117249+0000 b196 2=1+1) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/AsLsXsFsx@1},l=15201 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348baab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000023a:[<0x10000000232/heads v8>,<0x10000000231/refs v8>,<0x10000000008/logs v187>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000023a:[<0x10000000232/heads v15>,<0x10000000231/refs v21>,<0x10000000008/logs v278>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:33.115891+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.117249+0000 b196 2=1+1)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:33.115891+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-09-19T06:08:33.117249+0000 b196 2=1+1)","error_str":""},"return_code":0} 2024-09-19T06:08:53.970 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.702+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000233 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/ auth v13 ap=1 f(v0 m2024-09-19T06:08:33.071601+0000 1=0+1) n(v1 rc2024-09-19T06:08:33.075045+0000 b196 3=1+2) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/AsLsXsFsx@1},l=15201 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348bab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000233:[<0x10000000232/remotes v4>,<0x10000000231/refs v8>,<0x10000000008/logs v187>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000233:[<0x10000000232/remotes v13>,<0x10000000231/refs v21>,<0x10000000008/logs v278>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:33.071601+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.075045+0000 b196 3=1+2)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:33.071601+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-19T06:08:33.075045+0000 b196 3=1+2)","error_str":""},"return_code":0} 2024-09-19T06:08:53.970 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.702+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000238 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads/master auth v10 ap=1 s=41 n(v0 rc2024-09-19T06:08:33.119074+0000 b41 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5573488f9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000238:[<0x10000000216/master v8>,<0x10000000215/heads v16>,<0x10000000008/refs v170>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000238:[<0x10000000216/master v10>,<0x10000000215/heads v21>,<0x10000000008/refs v272>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.970 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.703+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022f [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/ auth v10 ap=1 f(v0 m2024-09-19T06:08:33.077744+0000 1=1+0) n(v0 rc2024-09-19T06:08:33.077744+0000 b32 2=1+1) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/-@1},l=15201 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348948000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000022f:[<0x1000000022e/origin v10>,<0x10000000215/remotes v8>,<0x10000000008/refs v170>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000022f:[<0x1000000022e/origin v10>,<0x10000000215/remotes v18>,<0x10000000008/refs v272>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:33.077744+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.077744+0000 b32 2=1+1)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:33.077744+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-09-19T06:08:33.077744+0000 b32 2=1+1)","error_str":""},"return_code":0} 2024-09-19T06:08:53.970 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.703+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023b [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master auth v4 ap=1 s=196 n(v0 rc2024-09-19T06:08:33.117249+0000 b196 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348bab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023b:[<0x1000000023a/master v2>,<0x10000000232/heads v8>,<0x10000000231/refs v8>,<0x10000000008/logs v187>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000023b:[<0x1000000023a/master v4>,<0x10000000232/heads v15>,<0x10000000231/refs v21>,<0x10000000008/logs v278>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.970 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.703+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000234 [...3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/ auth v7 ap=1 f(v0 m2024-09-19T06:08:33.073398+0000 1=1+0) n(v0 rc2024-09-19T06:08:33.075045+0000 b196 2=1+1) (inest lock) (ifile excl) caps={15201=pAsLsXsFsx/AsLsXsFsx@1},l=15201 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348babb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000234:[<0x10000000233/origin v4>,<0x10000000232/remotes v4>,<0x10000000231/refs v8>,<0x10000000008/logs v187>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000234:[<0x10000000233/origin v7>,<0x10000000232/remotes v13>,<0x10000000231/refs v21>,<0x10000000008/logs v278>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:08:33.073398+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:08:33.075045+0000 b196 2=1+1)","memory_value.dirstat":"f(v0 m2024-09-19T06:08:33.073398+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-09-19T06:08:33.075045+0000 b196 2=1+1)","error_str":""},"return_code":0} 2024-09-19T06:08:53.970 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.703+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000230 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD auth v8 ap=1 s=32 n(v0 rc2024-09-19T06:08:33.077744+0000 b32 1=1+0) (ifile excl) cr={15201=0-4194304@2} caps={15201=pAsLsXsFsxcrwb/Fxcb@1},l=15201 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557348948580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000230:[<0x1000000022f/HEAD v8>,<0x1000000022e/origin v10>,<0x10000000215/remotes v8>,<0x10000000008/refs v170>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000230:[<0x1000000022f/HEAD v8>,<0x1000000022e/origin v10>,<0x10000000215/remotes v18>,<0x10000000008/refs v272>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:53.970 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:08:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:08:53.703+0000 7fb9a354e640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000235 [3,head] /volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD auth v4 ap=1 s=196 n(v0 rc2024-09-19T06:08:33.075045+0000 b196 1=1+0) caps={15201=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557348bac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000235:[<0x10000000234/HEAD v2>,<0x10000000233/origin v4>,<0x10000000232/remotes v4>,<0x10000000231/refs v8>,<0x10000000008/logs v187>,<0x10000000007/.git v787>,<0x10000000006/xfstests-dev v77>,<0x10000000005/tmp v15>,<0x10000000003/client.0 v16>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v32>,<0x10000000001/sv_0 v54>,<0x10000000000/qa v45>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000000235:[<0x10000000234/HEAD v4>,<0x10000000233/origin v7>,<0x10000000232/remotes v13>,<0x10000000231/refs v21>,<0x10000000008/logs v278>,<0x10000000007/.git v1463>,<0x10000000006/xfstests-dev v136>,<0x10000000005/tmp v33>,<0x10000000003/client.0 v32>,<0x10000000002/dc07b841-4793-4328-a037-1a9cabc3f071 v48>,<0x10000000001/sv_0 v68>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T06:08:54.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.641+0000 7f7d5c08f640 1 -- 172.21.15.103:0/3337662398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d541036e0 msgr2=0x7f7d54107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:54.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.641+0000 7f7d5c08f640 1 --2- 172.21.15.103:0/3337662398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d541036e0 0x7f7d54107b90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009930 tx=0x7f7d4402a420 comp rx=0 tx=0).stop 2024-09-19T06:08:54.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.641+0000 7f7d5c08f640 1 -- 172.21.15.103:0/3337662398 shutdown_connections 2024-09-19T06:08:54.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.641+0000 7f7d5c08f640 1 --2- 172.21.15.103:0/3337662398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d541082a0 0x7f7d5410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.641+0000 7f7d5c08f640 1 --2- 172.21.15.103:0/3337662398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d541036e0 0x7f7d54107b90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.641+0000 7f7d5c08f640 1 --2- 172.21.15.103:0/3337662398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d54102d30 0x7f7d54103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.641+0000 7f7d5c08f640 1 -- 172.21.15.103:0/3337662398 >> 172.21.15.103:0/3337662398 conn(0x7f7d540fc7d0 msgr2=0x7f7d540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:54.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.641+0000 7f7d5c08f640 1 -- 172.21.15.103:0/3337662398 shutdown_connections 2024-09-19T06:08:54.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.641+0000 7f7d5c08f640 1 -- 172.21.15.103:0/3337662398 wait complete. 2024-09-19T06:08:54.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d5c08f640 1 Processor -- start 2024-09-19T06:08:54.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d5c08f640 1 -- start start 2024-09-19T06:08:54.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d5c08f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d54102d30 0x7f7d54100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d5c08f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d541036e0 0x7f7d54100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d5c08f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d541082a0 0x7f7d54101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d5c08f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54111f10 con 0x7f7d541082a0 2024-09-19T06:08:54.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d5c08f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54111d90 con 0x7f7d54102d30 2024-09-19T06:08:54.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d5c08f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54112090 con 0x7f7d541036e0 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d59e2b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d54102d30 0x7f7d54100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d5a62c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d541082a0 0x7f7d54101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d59e2b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d54102d30 0x7f7d54100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:43808/0 (socket says 172.21.15.103:43808) 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d59e2b640 1 -- 172.21.15.103:0/2855723691 learned_addr learned my addr 172.21.15.103:0/2855723691 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.642+0000 7f7d5962a640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d541036e0 0x7f7d54100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d59e2b640 1 -- 172.21.15.103:0/2855723691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d541036e0 msgr2=0x7f7d54100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d541036e0 0x7f7d54100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d59e2b640 1 -- 172.21.15.103:0/2855723691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d541082a0 msgr2=0x7f7d54101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d541082a0 0x7f7d54101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d59e2b640 1 -- 172.21.15.103:0/2855723691 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d541a6990 con 0x7f7d54102d30 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d54102d30 0x7f7d54100990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000d950 tx=0x7f7d5000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d4affd640 1 -- 172.21.15.103:0/2855723691 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50017030 con 0x7f7d54102d30 2024-09-19T06:08:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d5c08f640 1 -- 172.21.15.103:0/2855723691 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d541a6c80 con 0x7f7d54102d30 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d4affd640 1 -- 172.21.15.103:0/2855723691 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d50004020 con 0x7f7d54102d30 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d4affd640 1 -- 172.21.15.103:0/2855723691 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d500047a0 con 0x7f7d54102d30 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.643+0000 7f7d5c08f640 1 -- 172.21.15.103:0/2855723691 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d541a7190 con 0x7f7d54102d30 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.645+0000 7f7d4affd640 1 -- 172.21.15.103:0/2855723691 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f7d500041d0 con 0x7f7d54102d30 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5e468740 1 Processor -- start 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5e468740 1 -- start start 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735db60 0x5629a735df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 0x5629a7368800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a736b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5e468740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5629a72c3280 con 0x5629a735db60 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5e468740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5629a726ab10 con 0x5629a735e480 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5e468740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5629a72bf240 con 0x5629a7368d40 2024-09-19T06:08:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d4affd640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7d400a33b0 0x7f7d400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5a62c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735db60 0x5629a735df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d59e2b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 0x5629a7368800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5a62c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735db60 0x5629a735df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45924/0 (socket says 172.21.15.103:45924) 2024-09-19T06:08:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5a62c640 1 -- 172.21.15.103:0/2545391841 learned_addr learned my addr 172.21.15.103:0/2545391841 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5a62c640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7d400a33b0 0x7f7d400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d4affd640 1 -- 172.21.15.103:0/2855723691 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f7d500cf6b0 con 0x7f7d54102d30 2024-09-19T06:08:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.646+0000 7f7d5962a640 1 --2- 172.21.15.103:0/2545391841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a736b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d59e2b640 1 -- 172.21.15.103:0/2545391841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 msgr2=0x5629a736b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/2545391841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a736b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d59e2b640 1 -- 172.21.15.103:0/2545391841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735db60 msgr2=0x5629a735df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/2545391841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735db60 0x5629a735df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d59e2b640 1 -- 172.21.15.103:0/2545391841 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a72771f0 con 0x5629a735e480 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d5a62c640 1 --2- 172.21.15.103:0/2545391841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735db60 0x5629a735df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/2545391841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 0x5629a7368800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7d500cce50 tx=0x7f7d50066870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d786164aea2e403e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d5a62c640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7d400a33b0 0x7f7d400a5870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0099e0 tx=0x7f7d4c009500 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d3ffff640 1 -- 172.21.15.103:0/2545391841 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5009c0e0 con 0x5629a735e480 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d3ffff640 1 -- 172.21.15.103:0/2545391841 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d5009b9e0 con 0x5629a735e480 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.647+0000 7f7d3ffff640 1 -- 172.21.15.103:0/2545391841 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d500981e0 con 0x5629a735e480 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 -- 172.21.15.103:0/2545391841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 msgr2=0x5629a7368800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 --2- 172.21.15.103:0/2545391841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 0x5629a7368800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7d500cce50 tx=0x7f7d50066870 comp rx=0 tx=0).stop 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 -- 172.21.15.103:0/2545391841 shutdown_connections 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 --2- 172.21.15.103:0/2545391841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a736b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 --2- 172.21.15.103:0/2545391841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 0x5629a7368800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 --2- 172.21.15.103:0/2545391841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735db60 0x5629a735df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 -- 172.21.15.103:0/2545391841 >> 172.21.15.103:0/2545391841 conn(0x5629a735a0f0 msgr2=0x5629a735a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 -- 172.21.15.103:0/2545391841 shutdown_connections 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 -- 172.21.15.103:0/2545391841 wait complete. 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 -- start start 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.648+0000 7f7d5e468740 1 Processor -- start 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 0x5629a7365c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a73661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a7366700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5e468740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5629a736b8b0 con 0x5629a735e480 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5e468740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5629a727df10 con 0x5629a735db60 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5e468740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5629a736ba30 con 0x5629a7368d40 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5e468740 10 client.0 _ll_register_callbacks cb 0x5629a7246a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5962a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a73661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5962a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a73661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45938/0 (socket says 172.21.15.103:45938) 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5962a640 1 -- 172.21.15.103:0/1235577420 learned_addr learned my addr 172.21.15.103:0/1235577420 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5a62c640 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a7366700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 0x5629a7365c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5962a640 1 -- 172.21.15.103:0/1235577420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 msgr2=0x5629a7366700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5962a640 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a7366700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5962a640 1 -- 172.21.15.103:0/1235577420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 msgr2=0x5629a7365c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5962a640 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 0x5629a7365c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5962a640 1 -- 172.21.15.103:0/1235577420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a70346a0 con 0x5629a735e480 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d5962a640 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a73661c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7d44033000 tx=0x7f7d44032ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ae59897e3a966e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.649+0000 7f7d3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/1235577420 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44035040 con 0x5629a735e480 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/1235577420 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f7d44004050 con 0x5629a735e480 2024-09-19T06:08:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d5e468740 1 -- 172.21.15.103:0/1235577420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d5009b9e0 con 0x5629a735e480 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/1235577420 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7d44004250 con 0x5629a735e480 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d5e468740 10 client.15687 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d5e468740 1 -- 172.21.15.103:0/1235577420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5629a7377510 con 0x5629a735e480 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/1235577420 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d5009b9e0 con 0x5629a735e480 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/1235577420 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f7d44004910 con 0x5629a735e480 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d5e468740 10 client.15687 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d5e468740 10 client.15687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d5e468740 20 client.15687 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d5e468740 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5629a7378990 0x5629a737add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d5e468740 4 client.15687 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.650+0000 7f7d5e468740 1 -- 172.21.15.103:0/1235577420 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629a72d07f0 con 0x5629a7378990 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.651+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5629a7378990 0x5629a737add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.651+0000 7f7d3d7fa640 10 client.15687 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:54.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.651+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5629a7378990 0x5629a737add0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d26e0b9323f86c server_cookie=b9fa17b43c6f03a2 in_seq=0 out_seq=0 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/1235577420 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629a72d07f0 con 0x5629a7378990 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d3d7fa640 10 client.15687 handle_command_reply: tid=0 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 client.15687 shutdown 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 -- 172.21.15.103:0/1235577420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 msgr2=0x5629a73661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a73661c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7d44033000 tx=0x7f7d44032ee0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 -- 172.21.15.103:0/1235577420 shutdown_connections 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5629a7378990 0x5629a737add0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a7366700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a73661c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 --2- 172.21.15.103:0/1235577420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 0x5629a7365c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d3d7fa640 0 client.15687 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 -- 172.21.15.103:0/1235577420 >> 172.21.15.103:0/1235577420 conn(0x5629a735a0f0 msgr2=0x5629a735fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:54.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 -- 172.21.15.103:0/1235577420 shutdown_connections 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.652+0000 7f7d5e468740 1 -- 172.21.15.103:0/1235577420 wait complete. 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.653+0000 7f7d5e468740 20 client.15687 trim_cache size 0 max 16384 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.670+0000 7f7d5e468740 1 Processor -- start 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.670+0000 7f7d5e468740 1 -- start start 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a735db60 0x5629a7366550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 0x5629a73806f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a7368d40 0x5629a7380c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5e468740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541b21b0 con 0x5629a7368d40 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5e468740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541afa80 con 0x5629a735e480 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5e468740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541ad8f0 con 0x5629a735db60 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5a62c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a7368d40 0x5629a7380c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5a62c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a7368d40 0x5629a7380c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45954/0 (socket says 172.21.15.103:45954) 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5a62c640 1 -- 172.21.15.103:0/433637207 learned_addr learned my addr 172.21.15.103:0/433637207 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/433637207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a735db60 0x5629a7366550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5962a640 1 --2- 172.21.15.103:0/433637207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 0x5629a73806f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5a62c640 1 -- 172.21.15.103:0/433637207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a735db60 msgr2=0x5629a7366550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5a62c640 1 --2- 172.21.15.103:0/433637207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a735db60 0x5629a7366550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5a62c640 1 -- 172.21.15.103:0/433637207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 msgr2=0x5629a73806f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5a62c640 1 --2- 172.21.15.103:0/433637207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 0x5629a73806f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5a62c640 1 -- 172.21.15.103:0/433637207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a7359b90 con 0x5629a7368d40 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d5a62c640 1 --2- 172.21.15.103:0/433637207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a7368d40 0x5629a7380c30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c011940 tx=0x7f7d4c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25a099280ef6f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.671+0000 7f7d3f7fe640 1 -- 172.21.15.103:0/433637207 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c00fcf0 con 0x5629a7368d40 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d3f7fe640 1 -- 172.21.15.103:0/433637207 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d4c00fe90 con 0x5629a7368d40 2024-09-19T06:08:54.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d3f7fe640 1 -- 172.21.15.103:0/433637207 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0055e0 con 0x5629a7368d40 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d5e468740 1 -- 172.21.15.103:0/433637207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a7368d40 msgr2=0x5629a7380c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d5e468740 1 --2- 172.21.15.103:0/433637207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a7368d40 0x5629a7380c30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c011940 tx=0x7f7d4c00e000 comp rx=0 tx=0).stop 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d5e468740 1 -- 172.21.15.103:0/433637207 shutdown_connections 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d5e468740 1 --2- 172.21.15.103:0/433637207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a7368d40 0x5629a7380c30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d5e468740 1 --2- 172.21.15.103:0/433637207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735e480 0x5629a73806f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d5e468740 1 --2- 172.21.15.103:0/433637207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a735db60 0x5629a7366550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d5e468740 1 -- 172.21.15.103:0/433637207 >> 172.21.15.103:0/433637207 conn(0x5629a735a0f0 msgr2=0x5629a7367bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d5e468740 1 -- 172.21.15.103:0/433637207 shutdown_connections 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.672+0000 7f7d5e468740 1 -- 172.21.15.103:0/433637207 wait complete. 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5e468740 1 -- start start 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5e468740 1 Processor -- start 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 0x5629a736d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a736dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5e468740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a73db680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5e468740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541adf40 con 0x5629a735e480 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5e468740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541af3b0 con 0x5629a735db60 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5e468740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541ae610 con 0x5629a7368d40 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5e468740 10 client.0 _ll_register_callbacks cb 0x7f7d44009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5962a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a736dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5962a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a736dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45970/0 (socket says 172.21.15.103:45970) 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5962a640 1 -- 172.21.15.103:0/2671841930 learned_addr learned my addr 172.21.15.103:0/2671841930 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 0x5629a736d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5a62c640 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a73db680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5962a640 1 -- 172.21.15.103:0/2671841930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 msgr2=0x5629a73db680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.673+0000 7f7d5962a640 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a73db680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5962a640 1 -- 172.21.15.103:0/2671841930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 msgr2=0x5629a736d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5962a640 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 0x5629a736d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5962a640 1 -- 172.21.15.103:0/2671841930 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a73dbeb0 con 0x5629a735e480 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 0x5629a736d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5962a640 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a736dad0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7d44004720 tx=0x7f7d44004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b951cd746dcfabd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/2671841930 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44035050 con 0x5629a735e480 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/2671841930 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f7d44004970 con 0x5629a735e480 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5e468740 1 -- 172.21.15.103:0/2671841930 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d4c00fe90 con 0x5629a735e480 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/2671841930 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7d44031a40 con 0x5629a735e480 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5e468740 10 client.15693 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5e468740 1 -- 172.21.15.103:0/2671841930 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5629a73e4290 con 0x5629a735e480 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/2671841930 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d4c00fe90 con 0x5629a735e480 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/2671841930 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f7d44003ba0 con 0x5629a735e480 2024-09-19T06:08:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5e468740 10 client.15693 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5e468740 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5e468740 20 client.15693 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5e468740 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5629a73e4a60 0x5629a73e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5e468740 4 client.15693 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.674+0000 7f7d5e468740 1 -- 172.21.15.103:0/2671841930 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5629a72cad00 con 0x5629a73e4a60 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.675+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5629a73e4a60 0x5629a73e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.675+0000 7f7d59e2b640 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5629a73e4a60 0x5629a73e6e80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=652ecb45b18d029f server_cookie=de5801da4e66cd38 in_seq=0 out_seq=0 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.675+0000 7f7d3d7fa640 10 client.15693 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.675+0000 7f7d3d7fa640 1 -- 172.21.15.103:0/2671841930 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5629a72cad00 con 0x5629a73e4a60 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.675+0000 7f7d3d7fa640 10 client.15693 handle_command_reply: tid=0 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.675+0000 7f7d5e468740 1 client.15693 shutdown 2024-09-19T06:08:54.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 1 -- 172.21.15.103:0/2671841930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 msgr2=0x5629a736dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:54.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a736dad0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7d44004720 tx=0x7f7d44004600 comp rx=0 tx=0).stop 2024-09-19T06:08:54.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 1 -- 172.21.15.103:0/2671841930 shutdown_connections 2024-09-19T06:08:54.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5629a73e4a60 0x5629a73e6e80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629a7368d40 0x5629a73db680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5629a735e480 0x5629a736dad0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d3d7fa640 0 client.15693 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:54.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 1 --2- 172.21.15.103:0/2671841930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a735db60 0x5629a736d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 1 -- 172.21.15.103:0/2671841930 >> 172.21.15.103:0/2671841930 conn(0x5629a735a0f0 msgr2=0x5629a735f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:54.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 1 -- 172.21.15.103:0/2671841930 shutdown_connections 2024-09-19T06:08:54.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 1 -- 172.21.15.103:0/2671841930 wait complete. 2024-09-19T06:08:54.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5e468740 20 client.15693 trim_cache size 0 max 16384 2024-09-19T06:08:54.535 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:08:54.535 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-09-19T06:08:54.535 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "5cb5ab81-20f2-47e0-806c-e988cbc58560", 2024-09-19T06:08:54.535 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-09-19T06:08:54.535 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5c08f640 1 -- 172.21.15.103:0/2855723691 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7d400a33b0 msgr2=0x7f7d400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5c08f640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7d400a33b0 0x7f7d400a5870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0099e0 tx=0x7f7d4c009500 comp rx=0 tx=0).stop 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5c08f640 1 -- 172.21.15.103:0/2855723691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d54102d30 msgr2=0x7f7d54100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5c08f640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d54102d30 0x7f7d54100990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000d950 tx=0x7f7d5000de10 comp rx=0 tx=0).stop 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5c08f640 1 -- 172.21.15.103:0/2855723691 shutdown_connections 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5c08f640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7d400a33b0 0x7f7d400a5870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5c08f640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d541082a0 0x7f7d54101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5c08f640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d541036e0 0x7f7d54100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5c08f640 1 --2- 172.21.15.103:0/2855723691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d54102d30 0x7f7d54100990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.676+0000 7f7d5c08f640 1 -- 172.21.15.103:0/2855723691 >> 172.21.15.103:0/2855723691 conn(0x7f7d540fc7d0 msgr2=0x7f7d54105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.677+0000 7f7d5c08f640 1 -- 172.21.15.103:0/2855723691 shutdown_connections 2024-09-19T06:08:54.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:53.677+0000 7f7d5c08f640 1 -- 172.21.15.103:0/2855723691 wait complete. 2024-09-19T06:08:54.905 INFO:tasks.workunit.client.0.smithi103.stderr:Updating files: 7% (322/4351) Updating files: 8% (349/4351) Updating files: 9% (392/4351) Updating files: 10% (436/4351) Updating files: 11% (479/4351) Updating files: 11% (493/4351) Updating files: 12% (523/4351) Updating files: 13% (566/4351) Updating files: 14% (610/4351) Updating files: 15% (653/4351) Updating files: 16% (697/4351) Updating files: 17% (740/4351) Updating files: 17% (777/4351) Updating files: 18% (784/4351) Updating files: 19% (827/4351) Updating files: 20% (871/4351) Updating files: 21% (914/4351) Updating files: 22% (958/4351) Updating files: 23% (1001/4351) Updating files: 24% (1045/4351) Updating files: 25% (1088/4351) Updating files: 26% (1132/4351) Updating files: 27% (1175/4351) Updating files: 28% (1219/4351) Updating files: 28% (1254/4351) Updating files: 29% (1262/4351) Updating files: 29% (1303/4351) Updating files: 30% (1306/4351) Updating files: 31% (1349/4351) Updating files: 32% (1393/4351) Updating files: 33% (1436/4351) Updating files: 34% (1480/4351) Updating files: 35% (1523/4351) Updating files: 35% (1534/4351) Updating files: 36% (1567/4351) Updating files: 37% (1610/4351) Updating files: 38% (1654/4351) Updating files: 39% (1697/4351) Updating files: 40% (1741/4351) Updating files: 41% (1784/4351) Updating files: 42% (1828/4351) Updating files: 43% (1871/4351) Updating files: 44% (1915/4351) Updating files: 44% (1937/4351) Updating files: 45% (1958/4351) Updating files: 46% (2002/4351) Updating files: 47% (2045/4351) Updating files: 48% (2089/4351) Updating files: 49% (2132/4351) Updating files: 50% (2176/4351) Updating files: 51% (2220/4351) Updating files: 52% (2263/4351) Updating files: 52% (2294/4351) Updating files: 53% (2307/4351) Updating files: 54% (2350/4351) Updating files: 55% (2394/4351) Updating files: 56% (2437/4351) Updating files: 57% (2481/4351) Updating files: 58% (2524/4351) Updating files: 59% (2568/4351) Updating files: 59% (2591/4351) Updating files: 60% (2611/4351) Updating files: 61% (2655/4351) Updating files: 62% (2698/4351) Updating files: 63% (2742/4351) Updating files: 64% (2785/4351) Updating files: 65% (2829/4351) Updating files: 65% (2835/4351) Updating files: 66% (2872/4351) Updating files: 67% (2916/4351) Updating files: 68% (2959/4351) Updating files: 69% (3003/4351) Updating files: 70% (3046/4351) Updating files: 71% (3090/4351) Updating files: 72% (3133/4351) Updating files: 73% (3177/4351) Updating files: 74% (3220/4351) Updating files: 74% (3227/4351) Updating files: 75% (3264/4351) Updating files: 76% (3307/4351) Updating files: 77% (3351/4351) Updating files: 78% (3394/4351) Updating files: 79% (3438/4351) Updating files: 80% (3481/4351) Updating files: 81% (3525/4351) Updating files: 82% (3568/4351) Updating files: 83% (3612/4351) Updating files: 83% (3640/4351) Updating files: 84% (3655/4351) Updating files: 85% (3699/4351) Updating files: 86% (3742/4351) Updating files: 87% (3786/4351) Updating files: 88% (3829/4351) Updating files: 89% (3873/4351) Updating files: 89% (3915/4351) Updating files: 90% (3916/4351) Updating files: 91% (3960/4351) Updating files: 92% (4003/4351) Updating files: 93% (4047/4351) Updating files: 94% (4090/4351) Updating files: 95% (4134/4351) Updating files: 95% (4142/4351) Updating files: 96% (4177/4351) Updating files: 97% (4221/4351) Updating files: 98% (4264/4351) Updating files: 99% (4308/4351) Updating files: 100% (4351/4351) Updating files: 100% (4351/4351), done. 2024-09-19T06:08:54.959 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd xfstests-dev 2024-09-19T06:08:54.959 INFO:tasks.workunit.client.0.smithi103.stderr:+ git checkout 0e5c12dfd008efc2848c98108c9237487e91ef35 2024-09-19T06:08:55.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub queued for path: / 2024-09-19T06:08:55.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub summary: active paths [/] 2024-09-19T06:08:55.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub summary: active paths [/] 2024-09-19T06:08:55.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub summary: active paths [/] 2024-09-19T06:08:55.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000023f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/index.lock) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000009 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/description) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/info) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000227 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.pack) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000220 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000236 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.rev) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000231 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.idx) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000242 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/LICENSES/GPL-2.0) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000022d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/packed-refs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/config) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000203 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000022b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/shallow) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000214 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/branches) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000020a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000020b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000213 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000209 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000212 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/update.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000020d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/sendemail-validate.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000210 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.158 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000211 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000239 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000232 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/repair) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000026e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter.btrfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000282 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/report) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000265 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmlogwrites) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/casefold) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/perf) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000026b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fail_make_request) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmerror) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000278 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/parent) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000021f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/scsi_debug) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/gcov) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000264 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000288 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/xfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000287 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/verity) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/locktest) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000026c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filestreams) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000269 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ext4) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.161 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/encrypt) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.161 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000027b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/preamble) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.161 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000025e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/config) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.161 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000027e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/rc) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.161 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dump) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.161 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000025d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/cgroup2) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.161 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/zoned) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.161 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/renameat2) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000274 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/metadump) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000258 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/Makefile) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000027c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/punch) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000025c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ceph) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000276 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/nfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ubifs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmflakey) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdelay) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/module) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.162 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000025a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/btrfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/reflink) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000026f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fuzzy) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000284 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/test_names) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdust) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000259 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/attr) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000027d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/quota) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000266 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmthin) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/overlay) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000273 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/log) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/inject) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000027a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/populate) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.163 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000026a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/f2fs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000285 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/tracing) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000025f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/defrag) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000204 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info/exclude) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000217 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/tags) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000216 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000023a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000233 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000238 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads/master) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000022f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x1000000023b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000234 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.164 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.165 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.165 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.165 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub summary: active paths [/] 2024-09-19T06:08:55.165 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub summary: active paths [/] 2024-09-19T06:08:55.165 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: pgmap v50: 97 pgs: 97 active+clean; 27 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.2 MiB/s wr, 511 op/s 2024-09-19T06:08:55.165 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.165 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:54 smithi103 ceph-mon[30925]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub queued for path: / 2024-09-19T06:08:55.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub summary: active paths [/] 2024-09-19T06:08:55.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub summary: active paths [/] 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub summary: active paths [/] 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000023f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/index.lock) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000009 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/description) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/info) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000227 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.pack) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000220 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000236 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.rev) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000231 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.idx) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000242 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/LICENSES/GPL-2.0) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.205 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000022d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/packed-refs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/config) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000203 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000022b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/shallow) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000214 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/branches) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000020a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000020b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000213 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000209 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000212 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/update.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.207 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000020d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/sendemail-validate.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000210 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000211 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000239 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000232 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/repair) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000026e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter.btrfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000282 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/report) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000265 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmlogwrites) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/casefold) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/perf) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000026b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fail_make_request) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmerror) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000278 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/parent) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000021f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/scsi_debug) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/gcov) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000264 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000288 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/xfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000287 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/verity) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/locktest) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000026c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filestreams) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000269 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ext4) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/encrypt) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.209 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000027b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/preamble) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000025e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/config) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000027e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/rc) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dump) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000025d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/cgroup2) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/zoned) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/renameat2) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000274 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/metadump) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000258 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/Makefile) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000027c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/punch) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000025c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ceph) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000276 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/nfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ubifs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.210 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmflakey) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdelay) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/module) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000025a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/btrfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/reflink) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000026f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fuzzy) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000284 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/test_names) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdust) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000259 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/attr) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000027d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/quota) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000266 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmthin) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/overlay) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.211 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000273 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/log) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/inject) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000027a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/populate) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000026a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/f2fs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000285 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/tracing) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000025f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/defrag) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000204 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info/exclude) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000217 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/tags) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000216 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000023a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000233 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000238 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads/master) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.212 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000022f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.213 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x1000000023b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.213 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000234 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.213 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.213 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.213 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.213 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub summary: active paths [/] 2024-09-19T06:08:55.213 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub summary: active paths [/] 2024-09-19T06:08:55.213 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: pgmap v50: 97 pgs: 97 active+clean; 27 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.2 MiB/s wr, 511 op/s 2024-09-19T06:08:55.213 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.213 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:54 smithi174 ceph-mon[34488]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub queued for path: / 2024-09-19T06:08:55.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub summary: active paths [/] 2024-09-19T06:08:55.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub summary: active paths [/] 2024-09-19T06:08:55.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub summary: active paths [/] 2024-09-19T06:08:55.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000023f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/index.lock) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000009 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/description) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/info) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000227 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.pack) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000220 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000236 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.rev) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000231 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.idx) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000242 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/LICENSES/GPL-2.0) see mds.i log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000022d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/packed-refs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/config) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000203 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000022b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/shallow) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000214 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/branches) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000020a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000020b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000213 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000209 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000212 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/update.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.280 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000020d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/sendemail-validate.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000210 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000211 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000239 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000232 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/repair) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000026e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter.btrfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000282 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/report) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000265 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmlogwrites) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.281 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/casefold) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/perf) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000026b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fail_make_request) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmerror) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000278 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/parent) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000021f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/scsi_debug) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/gcov) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000264 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000288 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/xfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000287 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/verity) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/locktest) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.282 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000026c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filestreams) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000269 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ext4) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/encrypt) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000027b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/preamble) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000025e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/config) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000027e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/rc) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dump) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000025d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/cgroup2) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/zoned) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/renameat2) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000274 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/metadump) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000258 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/Makefile) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000027c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/punch) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000025c (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ceph) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.283 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000276 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/nfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.284 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ubifs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.284 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmflakey) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.284 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.284 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdelay) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.284 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/module) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.284 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000025a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/btrfs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/reflink) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000026f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fuzzy) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000284 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/test_names) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdust) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000259 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/attr) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000027d (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/quota) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000266 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmthin) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/overlay) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000273 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/log) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/inject) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.285 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000027a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/populate) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000026a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/f2fs) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000285 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/tracing) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000025f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/defrag) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000204 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info/exclude) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000217 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/tags) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000216 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000023a (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000233 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000238 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads/master) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000022f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x1000000023b (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000234 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.286 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.287 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2024-09-19T06:08:55.287 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.287 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub summary: active paths [/] 2024-09-19T06:08:55.287 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub summary: active paths [/] 2024-09-19T06:08:55.287 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: pgmap v50: 97 pgs: 97 active+clean; 27 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.2 MiB/s wr, 511 op/s 2024-09-19T06:08:55.287 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.287 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:54 smithi169 ceph-mon[34350]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:55.531 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:08:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:56.165 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:55 smithi103 ceph-mon[30925]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:56.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:55 smithi174 ceph-mon[34488]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:56.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:55 smithi169 ceph-mon[34350]: scrub summary: idle+waiting paths [/] 2024-09-19T06:08:56.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.625+0000 7f1015212640 1 -- 172.21.15.103:0/3787359252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10101082a0 msgr2=0x7f101010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.625+0000 7f1015212640 1 --2- 172.21.15.103:0/3787359252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10101082a0 0x7f101010ec40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1008009cd0 tx=0x7f100802a910 comp rx=0 tx=0).stop 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.625+0000 7f1015212640 1 -- 172.21.15.103:0/3787359252 shutdown_connections 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.625+0000 7f1015212640 1 --2- 172.21.15.103:0/3787359252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10101082a0 0x7f101010ec40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.625+0000 7f1015212640 1 --2- 172.21.15.103:0/3787359252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10101036e0 0x7f1010107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.625+0000 7f1015212640 1 --2- 172.21.15.103:0/3787359252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010102d30 0x7f1010103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.625+0000 7f1015212640 1 -- 172.21.15.103:0/3787359252 >> 172.21.15.103:0/3787359252 conn(0x7f10100fc7d0 msgr2=0x7f10100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.625+0000 7f1015212640 1 -- 172.21.15.103:0/3787359252 shutdown_connections 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.625+0000 7f1015212640 1 -- 172.21.15.103:0/3787359252 wait complete. 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1015212640 1 Processor -- start 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1015212640 1 -- start start 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1015212640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010102d30 0x7f10101984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1015212640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10101036e0 0x7f1010198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1015212640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10101082a0 0x7f101019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1015212640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1010111f90 con 0x7f10101036e0 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1015212640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1010111e10 con 0x7f1010102d30 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1015212640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1010112110 con 0x7f10101082a0 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1007fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10101036e0 0x7f1010198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1007fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10101036e0 0x7f1010198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45990/0 (socket says 172.21.15.103:45990) 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f1007fff640 1 -- 172.21.15.103:0/1307783355 learned_addr learned my addr 172.21.15.103:0/1307783355 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.626+0000 7f100ed9d640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010102d30 0x7f10101984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f1007fff640 1 -- 172.21.15.103:0/1307783355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10101082a0 msgr2=0x7f101019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f1007fff640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10101082a0 0x7f101019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f1007fff640 1 -- 172.21.15.103:0/1307783355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010102d30 msgr2=0x7f10101984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f1007fff640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010102d30 0x7f10101984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f1007fff640 1 -- 172.21.15.103:0/1307783355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101019d470 con 0x7f10101036e0 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f100ed9d640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010102d30 0x7f10101984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f1007fff640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10101036e0 0x7f1010198a00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8006fd0 tx=0x7f0ff800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f100cd99640 1 -- 172.21.15.103:0/1307783355 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8011830 con 0x7f10101036e0 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f1015212640 1 -- 172.21.15.103:0/1307783355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101019d760 con 0x7f10101036e0 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f100cd99640 1 -- 172.21.15.103:0/1307783355 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0ff8016070 con 0x7f10101036e0 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f100cd99640 1 -- 172.21.15.103:0/1307783355 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8010df0 con 0x7f10101036e0 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.627+0000 7f1015212640 1 -- 172.21.15.103:0/1307783355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10101a5040 con 0x7f10101036e0 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.629+0000 7f100cd99640 1 -- 172.21.15.103:0/1307783355 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f0ff80119d0 con 0x7f10101036e0 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f10175eb740 1 Processor -- start 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f10175eb740 1 -- start start 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f10175eb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f40880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f10175eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f4b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f10175eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f4b680 0x55e460f4da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f100cd99640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ffc0a33b0 0x7f0ffc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f10175eb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e460ea62e0 con 0x55e460f404a0 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f10175eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e460e4dce0 con 0x55e460f4b680 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f10175eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e460ea22a0 con 0x55e460f40dc0 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f100f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f40880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f100f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f40880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45998/0 (socket says 172.21.15.103:45998) 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f100ed9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f4b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f100f59e640 1 -- 172.21.15.103:0/1226871973 learned_addr learned my addr 172.21.15.103:0/1226871973 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f100f59e640 1 --2- 172.21.15.103:0/1226871973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f4b680 0x55e460f4da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f100cd99640 1 -- 172.21.15.103:0/1307783355 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f0ff80cf210 con 0x7f10101036e0 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.630+0000 7f1007fff640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ffc0a33b0 0x7f0ffc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.631+0000 7f100f59e640 1 -- 172.21.15.103:0/1226871973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 msgr2=0x55e460f4b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.631+0000 7f100f59e640 1 --2- 172.21.15.103:0/1226871973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f4b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.631+0000 7f100f59e640 1 -- 172.21.15.103:0/1226871973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f4b680 msgr2=0x55e460f4da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.631+0000 7f100f59e640 1 --2- 172.21.15.103:0/1226871973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f4b680 0x55e460f4da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.631+0000 7f100f59e640 1 -- 172.21.15.103:0/1226871973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e460e32440 con 0x55e460f404a0 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.631+0000 7f1007fff640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ffc0a33b0 0x7f0ffc0a5870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80ccb70 tx=0x7f0ff800bf90 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.631+0000 7f100f59e640 1 --2- 172.21.15.103:0/1226871973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f40880 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1008009430 tx=0x7f1008005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720df43e9c0652cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.631+0000 7f10057fa640 1 -- 172.21.15.103:0/1226871973 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008031a50 con 0x55e460f404a0 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.631+0000 7f10057fa640 1 -- 172.21.15.103:0/1226871973 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1008036070 con 0x55e460f404a0 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.631+0000 7f10057fa640 1 -- 172.21.15.103:0/1226871973 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008004310 con 0x55e460f404a0 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.632+0000 7f10175eb740 1 -- 172.21.15.103:0/1226871973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 msgr2=0x55e460f40880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.632+0000 7f10175eb740 1 --2- 172.21.15.103:0/1226871973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f40880 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1008009430 tx=0x7f1008005df0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.632+0000 7f10175eb740 1 -- 172.21.15.103:0/1226871973 shutdown_connections 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.632+0000 7f10175eb740 1 --2- 172.21.15.103:0/1226871973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f4b680 0x55e460f4da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.632+0000 7f10175eb740 1 --2- 172.21.15.103:0/1226871973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f4b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.632+0000 7f10175eb740 1 --2- 172.21.15.103:0/1226871973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f40880 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.632+0000 7f10175eb740 1 -- 172.21.15.103:0/1226871973 >> 172.21.15.103:0/1226871973 conn(0x55e460f3ca30 msgr2=0x55e460f3ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.632+0000 7f10175eb740 1 -- 172.21.15.103:0/1226871973 shutdown_connections 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.632+0000 7f10175eb740 1 -- 172.21.15.103:0/1226871973 wait complete. 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.632+0000 7f10175eb740 1 -- start start 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f10175eb740 1 Processor -- start 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f10175eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f404a0 0x55e460f4b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f10175eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f10175eb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f488e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f10175eb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e460f4e250 con 0x55e460f4b680 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f10175eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e460e61050 con 0x55e460f404a0 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f10175eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e460f4e3d0 con 0x55e460f40dc0 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f10175eb740 10 client.0 _ll_register_callbacks cb 0x55e460ea1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:56.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100f59e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f404a0 0x55e460f4b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100ed9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46002/0 (socket says 172.21.15.103:46002) 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100ed9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:46874/0 (socket says 172.21.15.103:46874) 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100f59e640 1 -- 172.21.15.103:0/2254409610 learned_addr learned my addr 172.21.15.103:0/2254409610 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100f59e640 1 -- 172.21.15.103:0/2254409610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 msgr2=0x55e460f482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100f59e640 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100f59e640 1 -- 172.21.15.103:0/2254409610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f404a0 msgr2=0x55e460f4b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100f59e640 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f404a0 0x55e460f4b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.633+0000 7f100f59e640 1 -- 172.21.15.103:0/2254409610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e460c173c0 con 0x55e460f4b680 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f100f59e640 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f488e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1008009620 tx=0x7f1008031560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26abecb8a7d581cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f0ff67fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:08:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f0ff67fc640 1 -- 172.21.15.103:0/2254409610 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10080046b0 con 0x55e460f4b680 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f0ff67fc640 1 -- 172.21.15.103:0/2254409610 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f1008003970 con 0x55e460f4b680 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f10175eb740 1 -- 172.21.15.103:0/2254409610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1008036070 con 0x55e460f4b680 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f0ff67fc640 1 -- 172.21.15.103:0/2254409610 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1008004850 con 0x55e460f4b680 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f10175eb740 10 client.15705 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f10175eb740 1 -- 172.21.15.103:0/2254409610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e460f4e250 con 0x55e460f4b680 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f0ff67fc640 1 -- 172.21.15.103:0/2254409610 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1008036070 con 0x55e460f4b680 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f0ff67fc640 1 -- 172.21.15.103:0/2254409610 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1008030890 con 0x55e460f4b680 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f10175eb740 10 client.15705 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f10175eb740 10 client.15705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f10175eb740 20 client.15705 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f10175eb740 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e460f5adf0 0x55e460f5d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f10175eb740 4 client.15705 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:56.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.634+0000 7f10175eb740 1 -- 172.21.15.103:0/2254409610 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e460eb3850 con 0x55e460f5adf0 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.635+0000 7f100ed9d640 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e460f5adf0 0x55e460f5d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.635+0000 7f0ff67fc640 10 client.15705 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.635+0000 7f100ed9d640 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e460f5adf0 0x55e460f5d1e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d5506627cdaace6 server_cookie=e8a14fe74a880e87 in_seq=0 out_seq=0 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f0ff67fc640 1 -- 172.21.15.103:0/2254409610 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e460eb3850 con 0x55e460f5adf0 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f0ff67fc640 10 client.15705 handle_command_reply: tid=0 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 client.15705 shutdown 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 -- 172.21.15.103:0/2254409610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 msgr2=0x55e460f488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f488e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1008009620 tx=0x7f1008031560 comp rx=0 tx=0).stop 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 -- 172.21.15.103:0/2254409610 shutdown_connections 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e460f5adf0 0x55e460f5d1e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f488e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f0ff67fc640 0 client.15705 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 --2- 172.21.15.103:0/2254409610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f404a0 0x55e460f4b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 -- 172.21.15.103:0/2254409610 >> 172.21.15.103:0/2254409610 conn(0x55e460f3ca30 msgr2=0x55e460f42760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:56.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 -- 172.21.15.103:0/2254409610 shutdown_connections 2024-09-19T06:08:56.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 1 -- 172.21.15.103:0/2254409610 wait complete. 2024-09-19T06:08:56.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.636+0000 7f10175eb740 20 client.15705 trim_cache size 0 max 16384 2024-09-19T06:08:56.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.654+0000 7f10175eb740 1 Processor -- start 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.654+0000 7f10175eb740 1 -- start start 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.654+0000 7f10175eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f404a0 0x55e460f3c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.654+0000 7f10175eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.654+0000 7f10175eb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f62950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.654+0000 7f10175eb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f10101add90 con 0x55e460f4b680 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.654+0000 7f10175eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10101ab660 con 0x55e460f404a0 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.654+0000 7f10175eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10101a9520 con 0x55e460f40dc0 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f62950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100ed9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f62950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46012/0 (socket says 172.21.15.103:46012) 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100f59e640 1 -- 172.21.15.103:0/2555499688 learned_addr learned my addr 172.21.15.103:0/2555499688 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100ed9d640 1 --2- 172.21.15.103:0/2555499688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:46888/0 (socket says 172.21.15.103:46888) 2024-09-19T06:08:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100f59e640 1 --2- 172.21.15.103:0/2555499688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f404a0 0x55e460f3c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100f59e640 1 -- 172.21.15.103:0/2555499688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 msgr2=0x55e460f574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100f59e640 1 --2- 172.21.15.103:0/2555499688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100f59e640 1 -- 172.21.15.103:0/2555499688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f404a0 msgr2=0x55e460f3c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100f59e640 1 --2- 172.21.15.103:0/2555499688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f404a0 0x55e460f3c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100f59e640 1 -- 172.21.15.103:0/2555499688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e460f4dde0 con 0x55e460f4b680 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f100f59e640 1 --2- 172.21.15.103:0/2555499688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f62950 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1008031750 tx=0x7f1008000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab7e63513f87709 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f1004ff9640 1 -- 172.21.15.103:0/2555499688 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100805d070 con 0x55e460f4b680 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f1004ff9640 1 -- 172.21.15.103:0/2555499688 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1008036020 con 0x55e460f4b680 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.655+0000 7f1004ff9640 1 -- 172.21.15.103:0/2555499688 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008003c60 con 0x55e460f4b680 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.656+0000 7f10175eb740 1 -- 172.21.15.103:0/2555499688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 msgr2=0x55e460f62950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.656+0000 7f10175eb740 1 --2- 172.21.15.103:0/2555499688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f62950 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1008031750 tx=0x7f1008000f40 comp rx=0 tx=0).stop 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.656+0000 7f10175eb740 1 -- 172.21.15.103:0/2555499688 shutdown_connections 2024-09-19T06:08:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.656+0000 7f10175eb740 1 --2- 172.21.15.103:0/2555499688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f4b680 0x55e460f62950 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.656+0000 7f10175eb740 1 --2- 172.21.15.103:0/2555499688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.656+0000 7f10175eb740 1 --2- 172.21.15.103:0/2555499688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f404a0 0x55e460f3c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.656+0000 7f10175eb740 1 -- 172.21.15.103:0/2555499688 >> 172.21.15.103:0/2555499688 conn(0x55e460f3ca30 msgr2=0x55e460f43900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.656+0000 7f10175eb740 1 -- 172.21.15.103:0/2555499688 shutdown_connections 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.656+0000 7f10175eb740 1 -- 172.21.15.103:0/2555499688 wait complete. 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.656+0000 7f10175eb740 1 -- start start 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f10175eb740 1 Processor -- start 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f10175eb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f4f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f10175eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f4fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f10175eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f4b680 0x55e460fc4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f10175eb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f10101a9b70 con 0x55e460f404a0 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f10175eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10101aaf90 con 0x55e460f4b680 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f10175eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10101aa1f0 con 0x55e460f40dc0 2024-09-19T06:08:56.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f10175eb740 10 client.0 _ll_register_callbacks cb 0x7f1008031f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f4f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f4f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46028/0 (socket says 172.21.15.103:46028) 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100f59e640 1 -- 172.21.15.103:0/1164091566 learned_addr learned my addr 172.21.15.103:0/1164091566 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100ed9d640 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f4fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100f59e640 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f4b680 0x55e460fc4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100ed9d640 1 -- 172.21.15.103:0/1164091566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f4b680 msgr2=0x55e460fc4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100ed9d640 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f4b680 0x55e460fc4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100ed9d640 1 -- 172.21.15.103:0/1164091566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 msgr2=0x55e460f4f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100ed9d640 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f4f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100ed9d640 1 -- 172.21.15.103:0/1164091566 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e460fc4e60 con 0x55e460f40dc0 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.657+0000 7f100f59e640 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f4f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.658+0000 7f100ed9d640 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f4fd10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55e460f5d8f0 tx=0x7f1000013ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96bd7ba3890ccded server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:56.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.658+0000 7f0ff67fc640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.658+0000 7f0ff67fc640 1 -- 172.21.15.103:0/1164091566 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10000154f0 con 0x55e460f40dc0 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.658+0000 7f10175eb740 1 -- 172.21.15.103:0/1164091566 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1008036020 con 0x55e460f40dc0 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.658+0000 7f0ff67fc640 1 -- 172.21.15.103:0/1164091566 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f1000015690 con 0x55e460f40dc0 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.658+0000 7f0ff67fc640 1 -- 172.21.15.103:0/1164091566 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1000004020 con 0x55e460f40dc0 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.658+0000 7f10175eb740 10 client.25309 fetch_fsmap learned FSMap version 27 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.658+0000 7f10175eb740 1 -- 172.21.15.103:0/1164091566 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e460fc6070 con 0x55e460f40dc0 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.658+0000 7f0ff67fc640 1 -- 172.21.15.103:0/1164091566 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1008036020 con 0x55e460f40dc0 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f0ff67fc640 1 -- 172.21.15.103:0/1164091566 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1000003bc0 con 0x55e460f40dc0 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f10175eb740 10 client.25309 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f10175eb740 10 client.25309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f10175eb740 20 client.25309 populate_metadata read hostname 'smithi103' 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f10175eb740 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e460fc6800 0x55e460fc8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f10175eb740 4 client.25309 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f10175eb740 1 -- 172.21.15.103:0/1164091566 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e460eadd60 con 0x55e460fc6800 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f100f59e640 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e460fc6800 0x55e460fc8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f100f59e640 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e460fc6800 0x55e460fc8c20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e5704a82c8aa784 server_cookie=1445f22e2725e1be in_seq=0 out_seq=0 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f0ff67fc640 10 client.25309 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f0ff67fc640 1 -- 172.21.15.103:0/1164091566 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e460eadd60 con 0x55e460fc6800 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f0ff67fc640 10 client.25309 handle_command_reply: tid=0 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f10175eb740 1 client.25309 shutdown 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f10175eb740 1 -- 172.21.15.103:0/1164091566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 msgr2=0x55e460f4fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.659+0000 7f10175eb740 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f4fd10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55e460f5d8f0 tx=0x7f1000013ba0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f10175eb740 1 -- 172.21.15.103:0/1164091566 shutdown_connections 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f10175eb740 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e460fc6800 0x55e460fc8c20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f10175eb740 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e460f4b680 0x55e460fc4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f10175eb740 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e460f40dc0 0x55e460f4fd10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f0ff67fc640 0 client.25309 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:08:56.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f10175eb740 1 --2- 172.21.15.103:0/1164091566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e460f404a0 0x55e460f4f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f10175eb740 1 -- 172.21.15.103:0/1164091566 >> 172.21.15.103:0/1164091566 conn(0x55e460f3ca30 msgr2=0x55e460f3b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:56.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f10175eb740 1 -- 172.21.15.103:0/1164091566 shutdown_connections 2024-09-19T06:08:56.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f10175eb740 1 -- 172.21.15.103:0/1164091566 wait complete. 2024-09-19T06:08:56.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f10175eb740 20 client.25309 trim_cache size 0 max 16384 2024-09-19T06:08:56.671 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:08:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:08:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-19T06:08:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "5cb5ab81-20f2-47e0-806c-e988cbc58560": { 2024-09-19T06:08:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/", 2024-09-19T06:08:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "5cb5ab81-20f2-47e0-806c-e988cbc58560", 2024-09-19T06:08:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-19T06:08:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:08:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:08:56.672 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:08:56.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f1015212640 1 -- 172.21.15.103:0/1307783355 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ffc0a33b0 msgr2=0x7f0ffc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f1015212640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ffc0a33b0 0x7f0ffc0a5870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80ccb70 tx=0x7f0ff800bf90 comp rx=0 tx=0).stop 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f1015212640 1 -- 172.21.15.103:0/1307783355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10101036e0 msgr2=0x7f1010198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f1015212640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10101036e0 0x7f1010198a00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8006fd0 tx=0x7f0ff800b8e0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f1015212640 1 -- 172.21.15.103:0/1307783355 shutdown_connections 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f1015212640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ffc0a33b0 0x7f0ffc0a5870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f1015212640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10101082a0 0x7f101019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f1015212640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10101036e0 0x7f1010198a00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f1015212640 1 --2- 172.21.15.103:0/1307783355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010102d30 0x7f10101984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.660+0000 7f1015212640 1 -- 172.21.15.103:0/1307783355 >> 172.21.15.103:0/1307783355 conn(0x7f10100fc7d0 msgr2=0x7f1010105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.661+0000 7f1015212640 1 -- 172.21.15.103:0/1307783355 shutdown_connections 2024-09-19T06:08:56.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:08:56.661+0000 7f1015212640 1 -- 172.21.15.103:0/1307783355 wait complete. 2024-09-19T06:08:57.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:56 smithi174 ceph-mon[34488]: pgmap v51: 97 pgs: 97 active+clean; 35 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 795 op/s 2024-09-19T06:08:57.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:56 smithi103 ceph-mon[30925]: pgmap v51: 97 pgs: 97 active+clean; 35 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 795 op/s 2024-09-19T06:08:57.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:56 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a[30921]: 2024-09-19T06:08:56.901+0000 7f2e2393e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T06:08:57.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:56 smithi169 ceph-mon[34350]: pgmap v51: 97 pgs: 97 active+clean; 35 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 795 op/s 2024-09-19T06:08:57.385 INFO:tasks.cephfs.filesystem:scrub status for tag:5cb5ab81-20f2-47e0-806c-e988cbc58560 - {'path': '/', 'tag': '5cb5ab81-20f2-47e0-806c-e988cbc58560', 'options': 'recursive,force'} 2024-09-19T06:08:58.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:57 smithi174 ceph-mon[34488]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T06:08:58.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:57 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] up:active 2024-09-19T06:08:58.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:57 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:58.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:57 smithi103 ceph-mon[30925]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T06:08:58.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:57 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] up:active 2024-09-19T06:08:58.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:57 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:58.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:57 smithi169 ceph-mon[34350]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T06:08:58.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:57 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] up:active 2024-09-19T06:08:58.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:57 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:59.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:58 smithi174 ceph-mon[34488]: pgmap v52: 97 pgs: 97 active+clean; 35 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 725 op/s 2024-09-19T06:08:59.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:58 smithi174 ceph-mon[34488]: mds.? [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] up:active 2024-09-19T06:08:59.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:08:58 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:59.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:58 smithi103 ceph-mon[30925]: pgmap v52: 97 pgs: 97 active+clean; 35 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 725 op/s 2024-09-19T06:08:59.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:58 smithi103 ceph-mon[30925]: mds.? [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] up:active 2024-09-19T06:08:59.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:08:58 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:08:59.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:58 smithi169 ceph-mon[34350]: pgmap v52: 97 pgs: 97 active+clean; 35 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 725 op/s 2024-09-19T06:08:59.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:58 smithi169 ceph-mon[34350]: mds.? [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] up:active 2024-09-19T06:08:59.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:08:58 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:09:01.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:00 smithi174 ceph-mon[34488]: pgmap v53: 97 pgs: 97 active+clean; 35 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 725 op/s 2024-09-19T06:09:01.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:00 smithi103 ceph-mon[30925]: pgmap v53: 97 pgs: 97 active+clean; 35 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 725 op/s 2024-09-19T06:09:01.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:00 smithi169 ceph-mon[34350]: pgmap v53: 97 pgs: 97 active+clean; 35 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 725 op/s 2024-09-19T06:09:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.034+0000 7f480ba23640 1 -- 172.21.15.103:0/3705896506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48041069c0 msgr2=0x7f4804106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.034+0000 7f480ba23640 1 --2- 172.21.15.103:0/3705896506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48041069c0 0x7f4804106da0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4800009930 tx=0x7f480002a420 comp rx=0 tx=0).stop 2024-09-19T06:09:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.034+0000 7f480ba23640 1 -- 172.21.15.103:0/3705896506 shutdown_connections 2024-09-19T06:09:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.034+0000 7f480ba23640 1 --2- 172.21.15.103:0/3705896506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4804101350 0x7f480410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.034+0000 7f480ba23640 1 --2- 172.21.15.103:0/3705896506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48041009b0 0x7f4804100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.034+0000 7f480ba23640 1 --2- 172.21.15.103:0/3705896506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48041069c0 0x7f4804106da0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.034+0000 7f480ba23640 1 -- 172.21.15.103:0/3705896506 >> 172.21.15.103:0/3705896506 conn(0x7f4804077990 msgr2=0x7f48040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.034+0000 7f480ba23640 1 -- 172.21.15.103:0/3705896506 shutdown_connections 2024-09-19T06:09:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.034+0000 7f480ba23640 1 -- 172.21.15.103:0/3705896506 wait complete. 2024-09-19T06:09:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.034+0000 7f480ba23640 1 Processor -- start 2024-09-19T06:09:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f480ba23640 1 -- start start 2024-09-19T06:09:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f480ba23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48041009b0 0x7f4804198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f480ba23640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4804101350 0x7f48041987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f480ba23640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48041069c0 0x7f480419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f480ba23640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4804110cb0 con 0x7f48041009b0 2024-09-19T06:09:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f480ba23640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4804110b30 con 0x7f4804101350 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f480ba23640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4804110e30 con 0x7f48041069c0 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f48097bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48041009b0 0x7f4804198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f48097bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48041009b0 0x7f4804198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46136/0 (socket says 172.21.15.103:46136) 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f48097bf640 1 -- 172.21.15.103:0/318559084 learned_addr learned my addr 172.21.15.103:0/318559084 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f48097bf640 1 -- 172.21.15.103:0/318559084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48041069c0 msgr2=0x7f480419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f4808fbe640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4804101350 0x7f48041987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f48097bf640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48041069c0 0x7f480419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f48097bf640 1 -- 172.21.15.103:0/318559084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4804101350 msgr2=0x7f48041987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f48097bf640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4804101350 0x7f48041987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f48097bf640 1 -- 172.21.15.103:0/318559084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480419d270 con 0x7f48041009b0 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f4808fbe640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4804101350 0x7f48041987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.035+0000 7f48097bf640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48041009b0 0x7f4804198280 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4800005940 tx=0x7f48000040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.036+0000 7f47fa7fc640 1 -- 172.21.15.103:0/318559084 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480003f030 con 0x7f48041009b0 2024-09-19T06:09:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.036+0000 7f47fa7fc640 1 -- 172.21.15.103:0/318559084 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48000044c0 con 0x7f48041009b0 2024-09-19T06:09:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.036+0000 7f47fa7fc640 1 -- 172.21.15.103:0/318559084 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800035070 con 0x7f48041009b0 2024-09-19T06:09:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.036+0000 7f480ba23640 1 -- 172.21.15.103:0/318559084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f480419d500 con 0x7f48041009b0 2024-09-19T06:09:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.036+0000 7f480ba23640 1 -- 172.21.15.103:0/318559084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48041a4df0 con 0x7f48041009b0 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.038+0000 7f47fa7fc640 1 -- 172.21.15.103:0/318559084 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f4800042030 con 0x7f48041009b0 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.038+0000 7f480e7bd740 1 Processor -- start 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.038+0000 7f480e7bd740 1 -- start start 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f47fa7fc640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f47f00a34e0 0x7f47f00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5aaf0 0x55a746d5aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5b410 0x55a746d65770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 0x55a746d680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f480e7bd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a746cbf2f0 con 0x55a746d65cb0 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f480e7bd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a746c67270 con 0x55a746d5aaf0 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f480e7bd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a746cbb2b0 con 0x55a746d5b410 2024-09-19T06:09:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f48097bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5aaf0 0x55a746d5aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f4809fc0640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f47f00a34e0 0x7f47f00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f4808fbe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5b410 0x55a746d65770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f48097bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5aaf0 0x55a746d5aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:52444/0 (socket says 172.21.15.103:52444) 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f48097bf640 1 -- 172.21.15.103:0/2412612047 learned_addr learned my addr 172.21.15.103:0/2412612047 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f4809fc0640 1 --2- 172.21.15.103:0/2412612047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 0x55a746d680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f47fa7fc640 1 -- 172.21.15.103:0/318559084 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f48000f0070 con 0x7f48041009b0 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f48097bf640 1 -- 172.21.15.103:0/2412612047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5b410 msgr2=0x55a746d65770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f48097bf640 1 --2- 172.21.15.103:0/2412612047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5b410 0x55a746d65770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f48097bf640 1 -- 172.21.15.103:0/2412612047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 msgr2=0x55a746d680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f48097bf640 1 --2- 172.21.15.103:0/2412612047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 0x55a746d680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f48097bf640 1 -- 172.21.15.103:0/2412612047 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a746c66340 con 0x55a746d5aaf0 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f4809fc0640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f47f00a34e0 0x7f47f00a59a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009810 tx=0x7f47fc009db0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.039+0000 7f48097bf640 1 --2- 172.21.15.103:0/2412612047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5aaf0 0x55a746d5aed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48000bc0a0 tx=0x7f480002a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=957d8928737bc417 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f47ef7fe640 1 -- 172.21.15.103:0/2412612047 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800049070 con 0x55a746d5aaf0 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f47ef7fe640 1 -- 172.21.15.103:0/2412612047 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48000a56a0 con 0x55a746d5aaf0 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f47ef7fe640 1 -- 172.21.15.103:0/2412612047 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48000bc3a0 con 0x55a746d5aaf0 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f480e7bd740 1 -- 172.21.15.103:0/2412612047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5aaf0 msgr2=0x55a746d5aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f480e7bd740 1 --2- 172.21.15.103:0/2412612047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5aaf0 0x55a746d5aed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48000bc0a0 tx=0x7f480002a420 comp rx=0 tx=0).stop 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f480e7bd740 1 -- 172.21.15.103:0/2412612047 shutdown_connections 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f480e7bd740 1 --2- 172.21.15.103:0/2412612047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 0x55a746d680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f480e7bd740 1 --2- 172.21.15.103:0/2412612047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5b410 0x55a746d65770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f480e7bd740 1 --2- 172.21.15.103:0/2412612047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5aaf0 0x55a746d5aed0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f480e7bd740 1 -- 172.21.15.103:0/2412612047 >> 172.21.15.103:0/2412612047 conn(0x55a746d57060 msgr2=0x55a746d57440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f480e7bd740 1 -- 172.21.15.103:0/2412612047 shutdown_connections 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.040+0000 7f480e7bd740 1 -- 172.21.15.103:0/2412612047 wait complete. 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f480e7bd740 1 -- start start 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f480e7bd740 1 Processor -- start 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5aaf0 0x55a746d62bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 0x55a746d63110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d65cb0 0x55a746d63650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f480e7bd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a746d68640 con 0x55a746d5aaf0 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f480e7bd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a746c48290 con 0x55a746d5b410 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f480e7bd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a746d687c0 con 0x55a746d65cb0 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f480e7bd740 10 client.0 _ll_register_callbacks cb 0x55a746c79140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f48097bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5aaf0 0x55a746d62bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f48097bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5aaf0 0x55a746d62bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46148/0 (socket says 172.21.15.103:46148) 2024-09-19T06:09:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f48097bf640 1 -- 172.21.15.103:0/1275268152 learned_addr learned my addr 172.21.15.103:0/1275268152 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f4808fbe640 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 0x55a746d63110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.041+0000 7f4809fc0640 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d65cb0 0x55a746d63650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f48097bf640 1 -- 172.21.15.103:0/1275268152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d65cb0 msgr2=0x55a746d63650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f48097bf640 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d65cb0 0x55a746d63650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f48097bf640 1 -- 172.21.15.103:0/1275268152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 msgr2=0x55a746d63110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f48097bf640 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 0x55a746d63110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f48097bf640 1 -- 172.21.15.103:0/1275268152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7469d2210 con 0x55a746d5aaf0 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f48097bf640 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5aaf0 0x55a746d62bd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f48000b8d70 tx=0x7f48000bcaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a619c09f34a382 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f47ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f47ecff9640 1 -- 172.21.15.103:0/1275268152 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48000d4020 con 0x55a746d5aaf0 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f47ecff9640 1 -- 172.21.15.103:0/1275268152 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f48000eda90 con 0x55a746d5aaf0 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f480e7bd740 1 -- 172.21.15.103:0/1275268152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48000a56a0 con 0x55a746d5aaf0 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f47ecff9640 1 -- 172.21.15.103:0/1275268152 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4800049040 con 0x55a746d5aaf0 2024-09-19T06:09:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f480e7bd740 10 client.15723 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f480e7bd740 1 -- 172.21.15.103:0/1275268152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a746a9e620 con 0x55a746d5aaf0 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.042+0000 7f47ecff9640 1 -- 172.21.15.103:0/1275268152 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48000a56a0 con 0x55a746d5aaf0 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.043+0000 7f47ecff9640 1 -- 172.21.15.103:0/1275268152 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f48000b8a10 con 0x55a746d5aaf0 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.043+0000 7f480e7bd740 10 client.15723 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.043+0000 7f480e7bd740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.043+0000 7f480e7bd740 20 client.15723 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.043+0000 7f480e7bd740 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a746d75820 0x55a746d77c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.043+0000 7f480e7bd740 4 client.15723 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.043+0000 7f480e7bd740 1 -- 172.21.15.103:0/1275268152 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a746ccca20 con 0x55a746d75820 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.043+0000 7f4808fbe640 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a746d75820 0x55a746d77c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.043+0000 7f4808fbe640 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a746d75820 0x55a746d77c90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5eb0c133d496bc server_cookie=c90946d9dbf3eb1 in_seq=0 out_seq=0 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.043+0000 7f47ecff9640 10 client.15723 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f47ecff9640 1 -- 172.21.15.103:0/1275268152 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a746ccca20 con 0x55a746d75820 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f47ecff9640 10 client.15723 handle_command_reply: tid=0 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 client.15723 shutdown 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 -- 172.21.15.103:0/1275268152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5aaf0 msgr2=0x55a746d62bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5aaf0 0x55a746d62bd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f48000b8d70 tx=0x7f48000bcaa0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 -- 172.21.15.103:0/1275268152 shutdown_connections 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a746d75820 0x55a746d77c90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d65cb0 0x55a746d63650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 0x55a746d63110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 --2- 172.21.15.103:0/1275268152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5aaf0 0x55a746d62bd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 -- 172.21.15.103:0/1275268152 >> 172.21.15.103:0/1275268152 conn(0x55a746d57060 msgr2=0x55a746d5cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f47ecff9640 0 client.15723 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 -- 172.21.15.103:0/1275268152 shutdown_connections 2024-09-19T06:09:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 1 -- 172.21.15.103:0/1275268152 wait complete. 2024-09-19T06:09:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.044+0000 7f480e7bd740 20 client.15723 trim_cache size 0 max 16384 2024-09-19T06:09:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.059+0000 7f480e7bd740 1 Processor -- start 2024-09-19T06:09:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.059+0000 7f480e7bd740 1 -- start start 2024-09-19T06:09:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 0x55a746d63480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 0x55a746d64b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 0x55a746d7d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f480e7bd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48041aff10 con 0x55a746d65cb0 2024-09-19T06:09:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f480e7bd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f48041ad7e0 con 0x55a746d5b410 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f480e7bd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f48041ab630 con 0x55a746d5aaf0 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4809fc0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 0x55a746d7d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f48097bf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 0x55a746d63480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4809fc0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 0x55a746d7d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46162/0 (socket says 172.21.15.103:46162) 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f48097bf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 0x55a746d63480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:32974/0 (socket says 172.21.15.103:32974) 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4809fc0640 1 -- 172.21.15.103:0/1808226292 learned_addr learned my addr 172.21.15.103:0/1808226292 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4808fbe640 1 --2- 172.21.15.103:0/1808226292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 0x55a746d64b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4809fc0640 1 -- 172.21.15.103:0/1808226292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 msgr2=0x55a746d63480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4809fc0640 1 --2- 172.21.15.103:0/1808226292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 0x55a746d63480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4809fc0640 1 -- 172.21.15.103:0/1808226292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 msgr2=0x55a746d64b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4809fc0640 1 --2- 172.21.15.103:0/1808226292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 0x55a746d64b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4809fc0640 1 -- 172.21.15.103:0/1808226292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a746d58110 con 0x55a746d65cb0 2024-09-19T06:09:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4808fbe640 1 --2- 172.21.15.103:0/1808226292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 0x55a746d64b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f48097bf640 1 --2- 172.21.15.103:0/1808226292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 0x55a746d63480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f4809fc0640 1 --2- 172.21.15.103:0/1808226292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 0x55a746d7d5a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009ba0 tx=0x7f47fc009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01524cbb7f38721 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.060+0000 7f47eeffd640 1 -- 172.21.15.103:0/1808226292 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc004b20 con 0x55a746d65cb0 2024-09-19T06:09:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.061+0000 7f47eeffd640 1 -- 172.21.15.103:0/1808226292 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47fc026070 con 0x55a746d65cb0 2024-09-19T06:09:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.061+0000 7f47eeffd640 1 -- 172.21.15.103:0/1808226292 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc005280 con 0x55a746d65cb0 2024-09-19T06:09:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.061+0000 7f480e7bd740 1 -- 172.21.15.103:0/1808226292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 msgr2=0x55a746d7d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.061+0000 7f480e7bd740 1 --2- 172.21.15.103:0/1808226292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 0x55a746d7d5a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009ba0 tx=0x7f47fc009500 comp rx=0 tx=0).stop 2024-09-19T06:09:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.061+0000 7f480e7bd740 1 -- 172.21.15.103:0/1808226292 shutdown_connections 2024-09-19T06:09:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.061+0000 7f480e7bd740 1 --2- 172.21.15.103:0/1808226292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d65cb0 0x55a746d7d5a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.061+0000 7f480e7bd740 1 --2- 172.21.15.103:0/1808226292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d5b410 0x55a746d64b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.061+0000 7f480e7bd740 1 --2- 172.21.15.103:0/1808226292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 0x55a746d63480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.061+0000 7f480e7bd740 1 -- 172.21.15.103:0/1808226292 >> 172.21.15.103:0/1808226292 conn(0x55a746d57060 msgr2=0x55a746d64430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.061+0000 7f480e7bd740 1 -- 172.21.15.103:0/1808226292 shutdown_connections 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f480e7bd740 1 -- 172.21.15.103:0/1808226292 wait complete. 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f480e7bd740 1 -- start start 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f480e7bd740 1 Processor -- start 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 0x55a746d6dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5b410 0x55a746d6e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f480e7bd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d65cb0 0x55a746d69140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f480e7bd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48041abca0 con 0x55a746d5b410 2024-09-19T06:09:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f480e7bd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f48041ad110 con 0x55a746d65cb0 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f480e7bd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f48041ac370 con 0x55a746d5aaf0 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f480e7bd740 10 client.0 _ll_register_callbacks cb 0x7f47fc013600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f4808fbe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5b410 0x55a746d6e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f4808fbe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5b410 0x55a746d6e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46168/0 (socket says 172.21.15.103:46168) 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f4808fbe640 1 -- 172.21.15.103:0/933206845 learned_addr learned my addr 172.21.15.103:0/933206845 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f4809fc0640 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d65cb0 0x55a746d69140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.062+0000 7f48097bf640 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 0x55a746d6dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f4808fbe640 1 -- 172.21.15.103:0/933206845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 msgr2=0x55a746d6dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f4808fbe640 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 0x55a746d6dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f4808fbe640 1 -- 172.21.15.103:0/933206845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d65cb0 msgr2=0x55a746d69140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f4808fbe640 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d65cb0 0x55a746d69140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f4808fbe640 1 -- 172.21.15.103:0/933206845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a746d522d0 con 0x55a746d5b410 2024-09-19T06:09:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f4808fbe640 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5b410 0x55a746d6e290 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x55a746d57ec0 tx=0x7f47f4014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00bc9eb4bbe5049 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f47ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f47ecff9640 1 -- 172.21.15.103:0/933206845 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4004050 con 0x55a746d5b410 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f47ecff9640 1 -- 172.21.15.103:0/933206845 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f47f40041f0 con 0x55a746d5b410 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f480e7bd740 1 -- 172.21.15.103:0/933206845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47fc026070 con 0x55a746d5b410 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f47ecff9640 1 -- 172.21.15.103:0/933206845 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f47f402d050 con 0x55a746d5b410 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f480e7bd740 10 client.15729 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f480e7bd740 1 -- 172.21.15.103:0/933206845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a746de4440 con 0x55a746d5b410 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f47ecff9640 1 -- 172.21.15.103:0/933206845 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47fc026070 con 0x55a746d5b410 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.063+0000 7f47ecff9640 1 -- 172.21.15.103:0/933206845 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f47f400f040 con 0x55a746d5b410 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.064+0000 7f480e7bd740 10 client.15729 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.064+0000 7f480e7bd740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.064+0000 7f480e7bd740 20 client.15729 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.064+0000 7f480e7bd740 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a746de4c50 0x55a746de7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.064+0000 7f480e7bd740 4 client.15729 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:09:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.064+0000 7f480e7bd740 1 -- 172.21.15.103:0/933206845 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a746cc6d70 con 0x55a746de4c50 2024-09-19T06:09:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.064+0000 7f48097bf640 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a746de4c50 0x55a746de7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.064+0000 7f47ecff9640 10 client.15729 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.064+0000 7f48097bf640 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a746de4c50 0x55a746de7070 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b206b23be326fd25 server_cookie=2e68303b3accd4f4 in_seq=0 out_seq=0 2024-09-19T06:09:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f47ecff9640 1 -- 172.21.15.103:0/933206845 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a746cc6d70 con 0x55a746de4c50 2024-09-19T06:09:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f47ecff9640 10 client.15729 handle_command_reply: tid=0 2024-09-19T06:09:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 client.15729 shutdown 2024-09-19T06:09:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 -- 172.21.15.103:0/933206845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5b410 msgr2=0x55a746d6e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5b410 0x55a746d6e290 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x55a746d57ec0 tx=0x7f47f4014840 comp rx=0 tx=0).stop 2024-09-19T06:09:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 -- 172.21.15.103:0/933206845 shutdown_connections 2024-09-19T06:09:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a746de4c50 0x55a746de7070 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a746d65cb0 0x55a746d69140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a746d5b410 0x55a746d6e290 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f47ecff9640 0 client.15729 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 --2- 172.21.15.103:0/933206845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a746d5aaf0 0x55a746d6dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 -- 172.21.15.103:0/933206845 >> 172.21.15.103:0/933206845 conn(0x55a746d57060 msgr2=0x55a746d64430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 -- 172.21.15.103:0/933206845 shutdown_connections 2024-09-19T06:09:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 1 -- 172.21.15.103:0/933206845 wait complete. 2024-09-19T06:09:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.255+0000 7f480e7bd740 20 client.15729 trim_cache size 0 max 16384 2024-09-19T06:09:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:09:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:09:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:09:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 -- 172.21.15.103:0/318559084 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f47f00a34e0 msgr2=0x7f47f00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f47f00a34e0 0x7f47f00a59a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009810 tx=0x7f47fc009db0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 -- 172.21.15.103:0/318559084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48041009b0 msgr2=0x7f4804198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48041009b0 0x7f4804198280 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4800005940 tx=0x7f48000040c0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 -- 172.21.15.103:0/318559084 shutdown_connections 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f47f00a34e0 0x7f47f00a59a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48041069c0 0x7f480419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4804101350 0x7f48041987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 --2- 172.21.15.103:0/318559084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48041009b0 0x7f4804198280 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 -- 172.21.15.103:0/318559084 >> 172.21.15.103:0/318559084 conn(0x7f4804077990 msgr2=0x7f4804069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 -- 172.21.15.103:0/318559084 shutdown_connections 2024-09-19T06:09:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:02.256+0000 7f480ba23640 1 -- 172.21.15.103:0/318559084 wait complete. 2024-09-19T06:09:03.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:02 smithi174 ceph-mon[34488]: pgmap v54: 97 pgs: 97 active+clean; 43 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 841 op/s 2024-09-19T06:09:03.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:02 smithi103 ceph-mon[30925]: pgmap v54: 97 pgs: 97 active+clean; 43 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 841 op/s 2024-09-19T06:09:03.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:02 smithi169 ceph-mon[34350]: pgmap v54: 97 pgs: 97 active+clean; 43 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 841 op/s 2024-09-19T06:09:05.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:04 smithi174 ceph-mon[34488]: pgmap v55: 97 pgs: 97 active+clean; 43 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 400 op/s 2024-09-19T06:09:05.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:04 smithi103 ceph-mon[30925]: pgmap v55: 97 pgs: 97 active+clean; 43 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 400 op/s 2024-09-19T06:09:05.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:04 smithi169 ceph-mon[34350]: pgmap v55: 97 pgs: 97 active+clean; 43 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 400 op/s 2024-09-19T06:09:05.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:05 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a[30921]: 2024-09-19T06:09:05.328+0000 7f2e2393e640 -1 log_channel(cluster) log [ERR] : Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T06:09:06.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:05 smithi174 ceph-mon[34488]: scrub summary: idle 2024-09-19T06:09:06.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:05 smithi174 ceph-mon[34488]: scrub summary: idle 2024-09-19T06:09:06.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:05 smithi174 ceph-mon[34488]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T06:09:06.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:05 smithi103 ceph-mon[30925]: scrub summary: idle 2024-09-19T06:09:06.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:05 smithi103 ceph-mon[30925]: scrub summary: idle 2024-09-19T06:09:06.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:05 smithi103 ceph-mon[30925]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T06:09:06.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:05 smithi169 ceph-mon[34350]: scrub summary: idle 2024-09-19T06:09:06.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:05 smithi169 ceph-mon[34350]: scrub summary: idle 2024-09-19T06:09:06.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:05 smithi169 ceph-mon[34350]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T06:09:07.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:06 smithi174 ceph-mon[34488]: scrub summary: idle 2024-09-19T06:09:07.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:06 smithi174 ceph-mon[34488]: pgmap v56: 97 pgs: 97 active+clean; 38 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 703 op/s 2024-09-19T06:09:07.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:06 smithi103 ceph-mon[30925]: scrub summary: idle 2024-09-19T06:09:07.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:06 smithi103 ceph-mon[30925]: pgmap v56: 97 pgs: 97 active+clean; 38 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 703 op/s 2024-09-19T06:09:07.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:06 smithi169 ceph-mon[34350]: scrub summary: idle 2024-09-19T06:09:07.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:06 smithi169 ceph-mon[34350]: pgmap v56: 97 pgs: 97 active+clean; 38 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 703 op/s 2024-09-19T06:09:09.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:08 smithi174 ceph-mon[34488]: pgmap v57: 97 pgs: 97 active+clean; 38 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 418 op/s 2024-09-19T06:09:09.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:08 smithi103 ceph-mon[30925]: pgmap v57: 97 pgs: 97 active+clean; 38 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 418 op/s 2024-09-19T06:09:09.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:08 smithi169 ceph-mon[34350]: pgmap v57: 97 pgs: 97 active+clean; 38 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 418 op/s 2024-09-19T06:09:11.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:10 smithi174 ceph-mon[34488]: pgmap v58: 97 pgs: 97 active+clean; 38 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 419 op/s 2024-09-19T06:09:11.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:10 smithi103 ceph-mon[30925]: pgmap v58: 97 pgs: 97 active+clean; 38 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 419 op/s 2024-09-19T06:09:11.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:10 smithi169 ceph-mon[34350]: pgmap v58: 97 pgs: 97 active+clean; 38 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 419 op/s 2024-09-19T06:09:13.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:12 smithi174 ceph-mon[34488]: pgmap v59: 97 pgs: 97 active+clean; 49 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 613 op/s 2024-09-19T06:09:13.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:12 smithi103 ceph-mon[30925]: pgmap v59: 97 pgs: 97 active+clean; 49 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 613 op/s 2024-09-19T06:09:13.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:12 smithi169 ceph-mon[34350]: pgmap v59: 97 pgs: 97 active+clean; 49 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 613 op/s 2024-09-19T06:09:15.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:14 smithi174 ceph-mon[34488]: pgmap v60: 97 pgs: 97 active+clean; 49 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 496 op/s 2024-09-19T06:09:15.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:14 smithi103 ceph-mon[30925]: pgmap v60: 97 pgs: 97 active+clean; 49 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 496 op/s 2024-09-19T06:09:15.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:14 smithi169 ceph-mon[34350]: pgmap v60: 97 pgs: 97 active+clean; 49 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 496 op/s 2024-09-19T06:09:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.347+0000 7f17d2e1e640 1 -- 172.21.15.103:0/80148420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17cc1069e0 msgr2=0x7f17cc106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.347+0000 7f17d2e1e640 1 --2- 172.21.15.103:0/80148420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17cc1069e0 0x7f17cc106dc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009930 tx=0x7f17c002a420 comp rx=0 tx=0).stop 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.347+0000 7f17d2e1e640 1 -- 172.21.15.103:0/80148420 shutdown_connections 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.347+0000 7f17d2e1e640 1 --2- 172.21.15.103:0/80148420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17cc101370 0x7f17cc10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.347+0000 7f17d2e1e640 1 --2- 172.21.15.103:0/80148420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17cc1009d0 0x7f17cc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.347+0000 7f17d2e1e640 1 --2- 172.21.15.103:0/80148420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17cc1069e0 0x7f17cc106dc0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.347+0000 7f17d2e1e640 1 -- 172.21.15.103:0/80148420 >> 172.21.15.103:0/80148420 conn(0x7f17cc0fc6b0 msgr2=0x7f17cc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.347+0000 7f17d2e1e640 1 -- 172.21.15.103:0/80148420 shutdown_connections 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.347+0000 7f17d2e1e640 1 -- 172.21.15.103:0/80148420 wait complete. 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17d2e1e640 1 Processor -- start 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17d2e1e640 1 -- start start 2024-09-19T06:09:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17d2e1e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17cc1009d0 0x7f17cc1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17d2e1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17cc101370 0x7f17cc199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17d2e1e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17cc1069e0 0x7f17cc1a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17d2e1e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc110cd0 con 0x7f17cc101370 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17d2e1e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc110b50 con 0x7f17cc1069e0 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17d2e1e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc110e50 con 0x7f17cc1009d0 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17cbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17cc101370 0x7f17cc199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17cbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17cc101370 0x7f17cc199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52990/0 (socket says 172.21.15.103:52990) 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17d0bba640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17cc1009d0 0x7f17cc1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17cbfff640 1 -- 172.21.15.103:0/910263266 learned_addr learned my addr 172.21.15.103:0/910263266 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17d13bb640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17cc1069e0 0x7f17cc1a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17cbfff640 1 -- 172.21.15.103:0/910263266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17cc1009d0 msgr2=0x7f17cc1990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17cbfff640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17cc1009d0 0x7f17cc1990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17cbfff640 1 -- 172.21.15.103:0/910263266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17cc1069e0 msgr2=0x7f17cc1a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17cbfff640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17cc1069e0 0x7f17cc1a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.348+0000 7f17cbfff640 1 -- 172.21.15.103:0/910263266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc1a46b0 con 0x7f17cc101370 2024-09-19T06:09:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.349+0000 7f17cbfff640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17cc101370 0x7f17cc199630 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f17b800e9f0 tx=0x7f17b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.349+0000 7f17c9ffb640 1 -- 172.21.15.103:0/910263266 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b800cd80 con 0x7f17cc101370 2024-09-19T06:09:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.349+0000 7f17c9ffb640 1 -- 172.21.15.103:0/910263266 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17b80108e0 con 0x7f17cc101370 2024-09-19T06:09:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.349+0000 7f17c9ffb640 1 -- 172.21.15.103:0/910263266 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8018920 con 0x7f17cc101370 2024-09-19T06:09:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.349+0000 7f17d2e1e640 1 -- 172.21.15.103:0/910263266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17cc1a4880 con 0x7f17cc101370 2024-09-19T06:09:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.349+0000 7f17d2e1e640 1 -- 172.21.15.103:0/910263266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17cc1a4da0 con 0x7f17cc101370 2024-09-19T06:09:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.351+0000 7f17c9ffb640 1 -- 172.21.15.103:0/910263266 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f17b8010a90 con 0x7f17cc101370 2024-09-19T06:09:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.351+0000 7f17d5c8b740 1 Processor -- start 2024-09-19T06:09:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d5c8b740 1 -- start start 2024-09-19T06:09:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c72596bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c725976770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c725976cb0 0x55c7259790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c7258d02f0 con 0x55c72596baf0 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c725878270 con 0x55c725976cb0 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c7258cc2b0 con 0x55c72596c410 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d13bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c72596bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17c9ffb640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f17bc0a3460 0x7f17bc0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d0bba640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c725976770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d0bba640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c725976770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:48580/0 (socket says 172.21.15.103:48580) 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17cbfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c725976cb0 0x55c7259790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d0bba640 1 -- 172.21.15.103:0/130963974 learned_addr learned my addr 172.21.15.103:0/130963974 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d13bb640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f17bc0a3460 0x7f17bc0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d0bba640 1 -- 172.21.15.103:0/130963974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c725976cb0 msgr2=0x55c7259790a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17c9ffb640 1 -- 172.21.15.103:0/910263266 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f17b80cffa0 con 0x7f17cc101370 2024-09-19T06:09:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d0bba640 1 --2- 172.21.15.103:0/130963974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c725976cb0 0x55c7259790a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d0bba640 1 -- 172.21.15.103:0/130963974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 msgr2=0x55c72596bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d0bba640 1 --2- 172.21.15.103:0/130963974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c72596bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d0bba640 1 -- 172.21.15.103:0/130963974 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c725877340 con 0x55c72596c410 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.352+0000 7f17d0bba640 1 --2- 172.21.15.103:0/130963974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c725976770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f17c002a940 tx=0x7f17c0005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec9355aec772d4be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.353+0000 7f17d13bb640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f17bc0a3460 0x7f17bc0a5920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17c4005fd0 tx=0x7f17c4015040 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.353+0000 7f17b6ffd640 1 -- 172.21.15.103:0/130963974 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0040070 con 0x55c72596c410 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.353+0000 7f17b6ffd640 1 -- 172.21.15.103:0/130963974 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17c0004030 con 0x55c72596c410 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.353+0000 7f17b6ffd640 1 -- 172.21.15.103:0/130963974 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0035040 con 0x55c72596c410 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.353+0000 7f17d5c8b740 1 -- 172.21.15.103:0/130963974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 msgr2=0x55c725976770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.353+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/130963974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c725976770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f17c002a940 tx=0x7f17c0005be0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 -- 172.21.15.103:0/130963974 shutdown_connections 2024-09-19T06:09:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/130963974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c725976cb0 0x55c7259790a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/130963974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c725976770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/130963974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c72596bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 -- 172.21.15.103:0/130963974 >> 172.21.15.103:0/130963974 conn(0x55c725968060 msgr2=0x55c725968440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 -- 172.21.15.103:0/130963974 shutdown_connections 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 -- 172.21.15.103:0/130963974 wait complete. 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 -- start start 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 Processor -- start 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725973b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c7259740b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c725976cb0 0x55c7259745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c725979880 con 0x55c72596baf0 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c725859290 con 0x55c725976cb0 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c725979a00 con 0x55c72596c410 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d5c8b740 10 client.0 _ll_register_callbacks cb 0x55c72588a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.354+0000 7f17d0bba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725973b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d0bba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725973b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53012/0 (socket says 172.21.15.103:53012) 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d0bba640 1 -- 172.21.15.103:0/4181886748 learned_addr learned my addr 172.21.15.103:0/4181886748 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17cbfff640 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c7259740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d13bb640 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c725976cb0 0x55c7259745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d0bba640 1 -- 172.21.15.103:0/4181886748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 msgr2=0x55c7259740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d0bba640 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c7259740b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d0bba640 1 -- 172.21.15.103:0/4181886748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c725976cb0 msgr2=0x55c7259745f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d0bba640 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c725976cb0 0x55c7259745f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d0bba640 1 -- 172.21.15.103:0/4181886748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7255e3210 con 0x55c72596baf0 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17cbfff640 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c7259740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d0bba640 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725973b70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f17c002ab90 tx=0x7f17c0005090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01b229cca9220cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17abfff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17abfff640 1 -- 172.21.15.103:0/4181886748 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c004c020 con 0x55c72596baf0 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17abfff640 1 -- 172.21.15.103:0/4181886748 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f17c0005430 con 0x55c72596baf0 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d5c8b740 1 -- 172.21.15.103:0/4181886748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17c0004030 con 0x55c72596baf0 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17abfff640 1 -- 172.21.15.103:0/4181886748 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f17c0057050 con 0x55c72596baf0 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d5c8b740 10 client.15741 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.355+0000 7f17d5c8b740 1 -- 172.21.15.103:0/4181886748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c7256af620 con 0x55c72596baf0 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17abfff640 1 -- 172.21.15.103:0/4181886748 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17c0004030 con 0x55c72596baf0 2024-09-19T06:09:15.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17abfff640 1 -- 172.21.15.103:0/4181886748 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f17c0004bc0 con 0x55c72596baf0 2024-09-19T06:09:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17d5c8b740 10 client.15741 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17d5c8b740 10 client.15741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17d5c8b740 20 client.15741 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c725986a60 0x55c725988e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17d5c8b740 4 client.15741 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17d5c8b740 1 -- 172.21.15.103:0/4181886748 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7258dda20 con 0x55c725986a60 2024-09-19T06:09:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17cbfff640 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c725986a60 0x55c725988e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17abfff640 10 client.15741 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.356+0000 7f17cbfff640 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c725986a60 0x55c725988e50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e47f558f359aa4da server_cookie=b4adeea33b676c49 in_seq=0 out_seq=0 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17abfff640 1 -- 172.21.15.103:0/4181886748 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c7258dda20 con 0x55c725986a60 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17abfff640 10 client.15741 handle_command_reply: tid=0 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 client.15741 shutdown 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 -- 172.21.15.103:0/4181886748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 msgr2=0x55c725973b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725973b70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f17c002ab90 tx=0x7f17c0005090 comp rx=0 tx=0).stop 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 -- 172.21.15.103:0/4181886748 shutdown_connections 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c725986a60 0x55c725988e50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c725976cb0 0x55c7259745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c7259740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17abfff640 0 client.15741 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/4181886748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725973b70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 -- 172.21.15.103:0/4181886748 >> 172.21.15.103:0/4181886748 conn(0x55c725968060 msgr2=0x55c72596ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 -- 172.21.15.103:0/4181886748 shutdown_connections 2024-09-19T06:09:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 1 -- 172.21.15.103:0/4181886748 wait complete. 2024-09-19T06:09:15.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.357+0000 7f17d5c8b740 20 client.15741 trim_cache size 0 max 16384 2024-09-19T06:09:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.372+0000 7f17d5c8b740 1 Processor -- start 2024-09-19T06:09:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d5c8b740 1 -- start start 2024-09-19T06:09:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725974420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596c410 0x55c72598e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c725976cb0 0x55c72598ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc1afe70 con 0x55c72596baf0 2024-09-19T06:09:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc1ad740 con 0x55c72596c410 2024-09-19T06:09:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc1ab590 con 0x55c725976cb0 2024-09-19T06:09:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d0bba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725974420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d0bba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725974420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53018/0 (socket says 172.21.15.103:53018) 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d0bba640 1 -- 172.21.15.103:0/727704381 learned_addr learned my addr 172.21.15.103:0/727704381 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17cbfff640 1 --2- 172.21.15.103:0/727704381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596c410 0x55c72598e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d13bb640 1 --2- 172.21.15.103:0/727704381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c725976cb0 0x55c72598ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d0bba640 1 -- 172.21.15.103:0/727704381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c725976cb0 msgr2=0x55c72598ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d0bba640 1 --2- 172.21.15.103:0/727704381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c725976cb0 0x55c72598ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d0bba640 1 -- 172.21.15.103:0/727704381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596c410 msgr2=0x55c72598e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d0bba640 1 --2- 172.21.15.103:0/727704381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596c410 0x55c72598e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d0bba640 1 -- 172.21.15.103:0/727704381 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c725967e90 con 0x55c72596baf0 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17d0bba640 1 --2- 172.21.15.103:0/727704381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725974420 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f17c002a940 tx=0x7f17c0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb133b2d6ada30bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.373+0000 7f17b67fc640 1 -- 172.21.15.103:0/727704381 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c004c040 con 0x55c72596baf0 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17b67fc640 1 -- 172.21.15.103:0/727704381 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17c00055e0 con 0x55c72596baf0 2024-09-19T06:09:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17b67fc640 1 -- 172.21.15.103:0/727704381 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0040070 con 0x55c72596baf0 2024-09-19T06:09:15.380 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17d5c8b740 1 -- 172.21.15.103:0/727704381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 msgr2=0x55c725974420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:15.380 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/727704381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725974420 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f17c002a940 tx=0x7f17c0005fd0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.380 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17d5c8b740 1 -- 172.21.15.103:0/727704381 shutdown_connections 2024-09-19T06:09:15.380 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/727704381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c725976cb0 0x55c72598ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.380 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/727704381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596c410 0x55c72598e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.380 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/727704381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c72596baf0 0x55c725974420 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.380 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17d5c8b740 1 -- 172.21.15.103:0/727704381 >> 172.21.15.103:0/727704381 conn(0x55c725968060 msgr2=0x55c725975bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:15.380 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17d5c8b740 1 -- 172.21.15.103:0/727704381 shutdown_connections 2024-09-19T06:09:15.380 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.374+0000 7f17d5c8b740 1 -- 172.21.15.103:0/727704381 wait complete. 2024-09-19T06:09:15.380 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d5c8b740 1 -- start start 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d5c8b740 1 Processor -- start 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596baf0 0x55c72597f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c72597a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d5c8b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c725976cb0 0x55c72597abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc1abc00 con 0x55c725976cb0 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc1ad070 con 0x55c72596baf0 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d5c8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc1ac2d0 con 0x55c72596c410 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d5c8b740 10 client.0 _ll_register_callbacks cb 0x7f17c4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d13bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c725976cb0 0x55c72597abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d0bba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596baf0 0x55c72597f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d13bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c725976cb0 0x55c72597abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53026/0 (socket says 172.21.15.103:53026) 2024-09-19T06:09:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d13bb640 1 -- 172.21.15.103:0/3062853 learned_addr learned my addr 172.21.15.103:0/3062853 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17d0bba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596baf0 0x55c72597f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:39282/0 (socket says 172.21.15.103:39282) 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.375+0000 7f17cbfff640 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c72597a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17d0bba640 1 -- 172.21.15.103:0/3062853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 msgr2=0x55c72597a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17d0bba640 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c72597a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17d0bba640 1 -- 172.21.15.103:0/3062853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c725976cb0 msgr2=0x55c72597abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17d0bba640 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c725976cb0 0x55c72597abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17d0bba640 1 -- 172.21.15.103:0/3062853 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c72597b3c0 con 0x55c72596baf0 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17d13bb640 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c725976cb0 0x55c72597abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17d0bba640 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596baf0 0x55c72597f380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f17c002a940 tx=0x7f17c002a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd8d9f4143715d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17abfff640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17abfff640 1 -- 172.21.15.103:0/3062853 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0040030 con 0x55c72596baf0 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17abfff640 1 -- 172.21.15.103:0/3062853 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f17c00314a0 con 0x55c72596baf0 2024-09-19T06:09:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17d5c8b740 1 -- 172.21.15.103:0/3062853 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17c00055e0 con 0x55c72596baf0 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17abfff640 1 -- 172.21.15.103:0/3062853 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f17c004c070 con 0x55c72596baf0 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17d5c8b740 10 client.25292 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17d5c8b740 1 -- 172.21.15.103:0/3062853 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c7259f1470 con 0x55c72596baf0 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.376+0000 7f17abfff640 1 -- 172.21.15.103:0/3062853 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17c00055e0 con 0x55c72596baf0 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.377+0000 7f17abfff640 1 -- 172.21.15.103:0/3062853 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f17c0062030 con 0x55c72596baf0 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.377+0000 7f17d5c8b740 10 client.25292 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.377+0000 7f17d5c8b740 10 client.25292 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.377+0000 7f17d5c8b740 20 client.25292 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.377+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c7259f1a10 0x55c7259f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.377+0000 7f17d5c8b740 4 client.25292 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.377+0000 7f17d5c8b740 1 -- 172.21.15.103:0/3062853 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c7258d7d70 con 0x55c7259f1a10 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.377+0000 7f17cbfff640 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c7259f1a10 0x55c7259f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.377+0000 7f17abfff640 10 client.25292 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.377+0000 7f17cbfff640 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c7259f1a10 0x55c7259f3e30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e54f1131beab0a28 server_cookie=760a0d9dc3e18aff in_seq=0 out_seq=0 2024-09-19T06:09:15.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17abfff640 1 -- 172.21.15.103:0/3062853 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c7258d7d70 con 0x55c7259f1a10 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17abfff640 10 client.25292 handle_command_reply: tid=0 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17d5c8b740 1 client.25292 shutdown 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17d5c8b740 1 -- 172.21.15.103:0/3062853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596baf0 msgr2=0x55c72597f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596baf0 0x55c72597f380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f17c002a940 tx=0x7f17c002a420 comp rx=0 tx=0).stop 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17d5c8b740 1 -- 172.21.15.103:0/3062853 shutdown_connections 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c7259f1a10 0x55c7259f3e30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c725976cb0 0x55c72597abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c72596c410 0x55c72597a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17abfff640 0 client.25292 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.507+0000 7f17d5c8b740 1 --2- 172.21.15.103:0/3062853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c72596baf0 0x55c72597f380 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d5c8b740 1 -- 172.21.15.103:0/3062853 >> 172.21.15.103:0/3062853 conn(0x55c725968060 msgr2=0x55c725975bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d5c8b740 1 -- 172.21.15.103:0/3062853 shutdown_connections 2024-09-19T06:09:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d5c8b740 1 -- 172.21.15.103:0/3062853 wait complete. 2024-09-19T06:09:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d5c8b740 20 client.25292 trim_cache size 0 max 16384 2024-09-19T06:09:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:09:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:09:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:09:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:09:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d2e1e640 1 -- 172.21.15.103:0/910263266 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f17bc0a3460 msgr2=0x7f17bc0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d2e1e640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f17bc0a3460 0x7f17bc0a5920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17c4005fd0 tx=0x7f17c4015040 comp rx=0 tx=0).stop 2024-09-19T06:09:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d2e1e640 1 -- 172.21.15.103:0/910263266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17cc101370 msgr2=0x7f17cc199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d2e1e640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17cc101370 0x7f17cc199630 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f17b800e9f0 tx=0x7f17b800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d2e1e640 1 -- 172.21.15.103:0/910263266 shutdown_connections 2024-09-19T06:09:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d2e1e640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f17bc0a3460 0x7f17bc0a5920 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d2e1e640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17cc1069e0 0x7f17cc1a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d2e1e640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17cc101370 0x7f17cc199630 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d2e1e640 1 --2- 172.21.15.103:0/910263266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17cc1009d0 0x7f17cc1990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.508+0000 7f17d2e1e640 1 -- 172.21.15.103:0/910263266 >> 172.21.15.103:0/910263266 conn(0x7f17cc0fc6b0 msgr2=0x7f17cc0fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.509+0000 7f17d2e1e640 1 -- 172.21.15.103:0/910263266 shutdown_connections 2024-09-19T06:09:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:15.509+0000 7f17d2e1e640 1 -- 172.21.15.103:0/910263266 wait complete. 2024-09-19T06:09:17.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:16 smithi174 ceph-mon[34488]: pgmap v61: 97 pgs: 97 active+clean; 49 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 728 op/s 2024-09-19T06:09:17.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:16 smithi103 ceph-mon[30925]: pgmap v61: 97 pgs: 97 active+clean; 49 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 728 op/s 2024-09-19T06:09:17.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:16 smithi169 ceph-mon[34350]: pgmap v61: 97 pgs: 97 active+clean; 49 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 728 op/s 2024-09-19T06:09:19.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:18 smithi174 ceph-mon[34488]: pgmap v62: 97 pgs: 97 active+clean; 49 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 426 op/s 2024-09-19T06:09:19.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:18 smithi103 ceph-mon[30925]: pgmap v62: 97 pgs: 97 active+clean; 49 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 426 op/s 2024-09-19T06:09:19.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:18 smithi169 ceph-mon[34350]: pgmap v62: 97 pgs: 97 active+clean; 49 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 426 op/s 2024-09-19T06:09:21.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:20 smithi174 ceph-mon[34488]: pgmap v63: 97 pgs: 97 active+clean; 49 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 426 op/s 2024-09-19T06:09:21.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:20 smithi103 ceph-mon[30925]: pgmap v63: 97 pgs: 97 active+clean; 49 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 426 op/s 2024-09-19T06:09:21.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:20 smithi169 ceph-mon[34350]: pgmap v63: 97 pgs: 97 active+clean; 49 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 426 op/s 2024-09-19T06:09:23.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:22 smithi174 ceph-mon[34488]: pgmap v64: 97 pgs: 97 active+clean; 62 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 539 op/s 2024-09-19T06:09:23.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:22 smithi103 ceph-mon[30925]: pgmap v64: 97 pgs: 97 active+clean; 62 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 539 op/s 2024-09-19T06:09:23.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:22 smithi169 ceph-mon[34350]: pgmap v64: 97 pgs: 97 active+clean; 62 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 539 op/s 2024-09-19T06:09:25.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:24 smithi174 ceph-mon[34488]: pgmap v65: 97 pgs: 97 active+clean; 62 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 345 op/s 2024-09-19T06:09:25.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:24 smithi103 ceph-mon[30925]: pgmap v65: 97 pgs: 97 active+clean; 62 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 345 op/s 2024-09-19T06:09:25.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:24 smithi169 ceph-mon[34350]: pgmap v65: 97 pgs: 97 active+clean; 62 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 345 op/s 2024-09-19T06:09:27.068 INFO:tasks.workunit.client.0.smithi103.stderr:Note: switching to '0e5c12dfd008efc2848c98108c9237487e91ef35'. 2024-09-19T06:09:27.068 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:09:27.068 INFO:tasks.workunit.client.0.smithi103.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T06:09:27.068 INFO:tasks.workunit.client.0.smithi103.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T06:09:27.068 INFO:tasks.workunit.client.0.smithi103.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T06:09:27.068 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:09:27.068 INFO:tasks.workunit.client.0.smithi103.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T06:09:27.068 INFO:tasks.workunit.client.0.smithi103.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T06:09:27.068 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:09:27.068 INFO:tasks.workunit.client.0.smithi103.stderr: git switch -c 2024-09-19T06:09:27.069 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:09:27.069 INFO:tasks.workunit.client.0.smithi103.stderr:Or undo this operation with: 2024-09-19T06:09:27.069 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:09:27.069 INFO:tasks.workunit.client.0.smithi103.stderr: git switch - 2024-09-19T06:09:27.069 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:09:27.069 INFO:tasks.workunit.client.0.smithi103.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T06:09:27.069 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T06:09:27.069 INFO:tasks.workunit.client.0.smithi103.stderr:HEAD is now at 0e5c12df xfs/522: use reflink instead of crc as test feature 2024-09-19T06:09:27.078 INFO:tasks.workunit.client.0.smithi103.stderr:+ make -j4 2024-09-19T06:09:27.104 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize -cfi 2024-09-19T06:09:27.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:26 smithi174 ceph-mon[34488]: pgmap v66: 97 pgs: 97 active+clean; 74 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 455 op/s 2024-09-19T06:09:27.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:26 smithi103 ceph-mon[30925]: pgmap v66: 97 pgs: 97 active+clean; 74 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 455 op/s 2024-09-19T06:09:27.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:26 smithi169 ceph-mon[34350]: pgmap v66: 97 pgs: 97 active+clean; 74 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 455 op/s 2024-09-19T06:09:27.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:09:27.552 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-19T06:09:27.552 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: copying file './config.guess' 2024-09-19T06:09:27.564 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: copying file './config.sub' 2024-09-19T06:09:27.575 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: copying file './install-sh' 2024-09-19T06:09:27.586 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: copying file './ltmain.sh' 2024-09-19T06:09:27.652 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:27.658 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-19T06:09:27.658 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-19T06:09:27.688 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-19T06:09:27.709 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-19T06:09:27.731 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-19T06:09:27.753 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-19T06:09:27.761 INFO:tasks.workunit.client.0.smithi103.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-19T06:09:27.763 INFO:tasks.workunit.client.0.smithi103.stdout:cp include/install-sh . 2024-09-19T06:09:27.772 INFO:tasks.workunit.client.0.smithi103.stdout:aclocal -I m4 2024-09-19T06:09:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.597+0000 7f66f36af640 1 -- 172.21.15.103:0/1556854941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66ec1026f0 msgr2=0x7f66ec10d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.597+0000 7f66f36af640 1 --2- 172.21.15.103:0/1556854941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66ec1026f0 0x7f66ec10d110 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009cd0 tx=0x7f66e402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.597+0000 7f66f36af640 1 -- 172.21.15.103:0/1556854941 shutdown_connections 2024-09-19T06:09:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.597+0000 7f66f36af640 1 --2- 172.21.15.103:0/1556854941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66ec1026f0 0x7f66ec10d110 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.597+0000 7f66f36af640 1 --2- 172.21.15.103:0/1556854941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66ec101d70 0x7f66ec1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.597+0000 7f66f36af640 1 --2- 172.21.15.103:0/1556854941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66ec100490 0x7f66ec100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.597+0000 7f66f36af640 1 -- 172.21.15.103:0/1556854941 >> 172.21.15.103:0/1556854941 conn(0x7f66ec0770f0 msgr2=0x7f66ec0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.597+0000 7f66f36af640 1 -- 172.21.15.103:0/1556854941 shutdown_connections 2024-09-19T06:09:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.597+0000 7f66f36af640 1 -- 172.21.15.103:0/1556854941 wait complete. 2024-09-19T06:09:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f36af640 1 Processor -- start 2024-09-19T06:09:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f36af640 1 -- start start 2024-09-19T06:09:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f36af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66ec100490 0x7f66ec1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f36af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66ec101d70 0x7f66ec1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f36af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66ec1026f0 0x7f66ec19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f36af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec110d80 con 0x7f66ec100490 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f36af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec110c00 con 0x7f66ec101d70 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f36af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec110f00 con 0x7f66ec1026f0 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f144b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66ec100490 0x7f66ec1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f144b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66ec100490 0x7f66ec1982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53464/0 (socket says 172.21.15.103:53464) 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f144b640 1 -- 172.21.15.103:0/3852636786 learned_addr learned my addr 172.21.15.103:0/3852636786 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.598+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66ec101d70 0x7f66ec1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66f1c4c640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66ec1026f0 0x7f66ec19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66f144b640 1 -- 172.21.15.103:0/3852636786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66ec1026f0 msgr2=0x7f66ec19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66f144b640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66ec1026f0 0x7f66ec19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66f144b640 1 -- 172.21.15.103:0/3852636786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66ec101d70 msgr2=0x7f66ec1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66f144b640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66ec101d70 0x7f66ec1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66f144b640 1 -- 172.21.15.103:0/3852636786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec19d290 con 0x7f66ec100490 2024-09-19T06:09:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66f144b640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66ec100490 0x7f66ec1982a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f66e800d950 tx=0x7f66e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66e27fc640 1 -- 172.21.15.103:0/3852636786 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8017070 con 0x7f66ec100490 2024-09-19T06:09:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66e27fc640 1 -- 172.21.15.103:0/3852636786 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66e8009c30 con 0x7f66ec100490 2024-09-19T06:09:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66f36af640 1 -- 172.21.15.103:0/3852636786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ec19d580 con 0x7f66ec100490 2024-09-19T06:09:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66e27fc640 1 -- 172.21.15.103:0/3852636786 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e800f620 con 0x7f66ec100490 2024-09-19T06:09:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.599+0000 7f66f36af640 1 -- 172.21.15.103:0/3852636786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ec1a4e10 con 0x7f66ec100490 2024-09-19T06:09:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.602+0000 7f66e27fc640 1 -- 172.21.15.103:0/3852636786 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f66e80109a0 con 0x7f66ec100490 2024-09-19T06:09:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.602+0000 7f66f643f740 1 Processor -- start 2024-09-19T06:09:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.602+0000 7f66f643f740 1 -- start start 2024-09-19T06:09:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.602+0000 7f66f643f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f03bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.602+0000 7f66f643f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f046770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f643f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 0x55608f0490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f643f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55608efa02f0 con 0x55608f03baf0 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f643f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55608ef48270 con 0x55608f03c410 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f643f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55608ef9c2b0 con 0x55608f046cb0 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f1c4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f03bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f1c4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f03bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53472/0 (socket says 172.21.15.103:53472) 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f1c4c640 1 -- 172.21.15.103:0/2160984585 learned_addr learned my addr 172.21.15.103:0/2160984585 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66e27fc640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66d80a3460 0x7f66d80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f144b640 1 --2- 172.21.15.103:0/2160984585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f046770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/2160984585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 0x55608f0490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f1c4c640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66d80a3460 0x7f66d80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f0c4a640 1 -- 172.21.15.103:0/2160984585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 msgr2=0x55608f046770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66e27fc640 1 -- 172.21.15.103:0/3852636786 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f66e80cf850 con 0x7f66ec100490 2024-09-19T06:09:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/2160984585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f046770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f0c4a640 1 -- 172.21.15.103:0/2160984585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 msgr2=0x55608f03bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/2160984585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f03bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f0c4a640 1 -- 172.21.15.103:0/2160984585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55608ef47340 con 0x55608f046cb0 2024-09-19T06:09:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f1c4c640 1 --2- 172.21.15.103:0/2160984585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f03bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.603+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/2160984585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 0x55608f0490a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00bbc0 tx=0x7f66dc0103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b04567917812268f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66f1c4c640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66d80a3460 0x7f66d80a5920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009a60 tx=0x7f66e402a8e0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66d77fe640 1 -- 172.21.15.103:0/2160984585 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc004030 con 0x55608f046cb0 2024-09-19T06:09:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66d77fe640 1 -- 172.21.15.103:0/2160984585 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66dc0035f0 con 0x55608f046cb0 2024-09-19T06:09:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66d77fe640 1 -- 172.21.15.103:0/2160984585 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc0116a0 con 0x55608f046cb0 2024-09-19T06:09:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66f643f740 1 -- 172.21.15.103:0/2160984585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 msgr2=0x55608f0490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66f643f740 1 --2- 172.21.15.103:0/2160984585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 0x55608f0490a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00bbc0 tx=0x7f66dc0103d0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66f643f740 1 -- 172.21.15.103:0/2160984585 shutdown_connections 2024-09-19T06:09:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66f643f740 1 --2- 172.21.15.103:0/2160984585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 0x55608f0490a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66f643f740 1 --2- 172.21.15.103:0/2160984585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f046770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66f643f740 1 --2- 172.21.15.103:0/2160984585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f03bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66f643f740 1 -- 172.21.15.103:0/2160984585 >> 172.21.15.103:0/2160984585 conn(0x55608f038060 msgr2=0x55608f038440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.604+0000 7f66f643f740 1 -- 172.21.15.103:0/2160984585 shutdown_connections 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.605+0000 7f66f643f740 1 -- 172.21.15.103:0/2160984585 wait complete. 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.605+0000 7f66f643f740 1 -- start start 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.605+0000 7f66f643f740 1 Processor -- start 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.605+0000 7f66f643f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f043b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.605+0000 7f66f643f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f044090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.605+0000 7f66f643f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 0x55608f0445d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.605+0000 7f66f144b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f043b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f643f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55608f049880 con 0x55608f03baf0 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f643f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55608ef29290 con 0x55608f03c410 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f643f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55608f049a00 con 0x55608f046cb0 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f144b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f043b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53488/0 (socket says 172.21.15.103:53488) 2024-09-19T06:09:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f144b640 1 -- 172.21.15.103:0/587004651 learned_addr learned my addr 172.21.15.103:0/587004651 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f643f740 10 client.0 _ll_register_callbacks cb 0x55608ef5a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f044090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f1c4c640 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 0x55608f0445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f144b640 1 -- 172.21.15.103:0/587004651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 msgr2=0x55608f0445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f144b640 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 0x55608f0445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f144b640 1 -- 172.21.15.103:0/587004651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 msgr2=0x55608f044090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f144b640 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f044090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f144b640 1 -- 172.21.15.103:0/587004651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55608ecb3210 con 0x55608f03baf0 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f144b640 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f043b50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f66e809b930 tx=0x7f66e809b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2598ce7a10099ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66d4ff9640 1 -- 172.21.15.103:0/587004651 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8020040 con 0x55608f03baf0 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66d4ff9640 1 -- 172.21.15.103:0/587004651 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f66e80860d0 con 0x55608f03baf0 2024-09-19T06:09:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66f643f740 1 -- 172.21.15.103:0/587004651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66dc0035f0 con 0x55608f03baf0 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.606+0000 7f66d4ff9640 1 -- 172.21.15.103:0/587004651 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f66e80a47f0 con 0x55608f03baf0 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66f643f740 10 client.15759 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66f643f740 1 -- 172.21.15.103:0/587004651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55608ed7f620 con 0x55608f03baf0 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66d4ff9640 1 -- 172.21.15.103:0/587004651 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66dc0035f0 con 0x55608f03baf0 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66d4ff9640 1 -- 172.21.15.103:0/587004651 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f66e80104f0 con 0x55608f03baf0 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66f643f740 10 client.15759 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66f643f740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66f643f740 20 client.15759 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66f643f740 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55608f056bc0 0x55608f058ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66f643f740 4 client.15759 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66f643f740 1 -- 172.21.15.103:0/587004651 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55608efada20 con 0x55608f056bc0 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.607+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55608f056bc0 0x55608f058ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.608+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55608f056bc0 0x55608f058ff0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e87dafd98560add server_cookie=9699cf05bd684fc2 in_seq=0 out_seq=0 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.608+0000 7f66d4ff9640 10 client.15759 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66d4ff9640 1 -- 172.21.15.103:0/587004651 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55608efada20 con 0x55608f056bc0 2024-09-19T06:09:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66d4ff9640 10 client.15759 handle_command_reply: tid=0 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 client.15759 shutdown 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 -- 172.21.15.103:0/587004651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 msgr2=0x55608f043b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f043b50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f66e809b930 tx=0x7f66e809b650 comp rx=0 tx=0).stop 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 -- 172.21.15.103:0/587004651 shutdown_connections 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55608f056bc0 0x55608f058ff0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f046cb0 0x55608f0445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f044090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66d4ff9640 0 client.15759 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 --2- 172.21.15.103:0/587004651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f03baf0 0x55608f043b50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 -- 172.21.15.103:0/587004651 >> 172.21.15.103:0/587004651 conn(0x55608f038060 msgr2=0x55608f03ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 -- 172.21.15.103:0/587004651 shutdown_connections 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 1 -- 172.21.15.103:0/587004651 wait complete. 2024-09-19T06:09:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.609+0000 7f66f643f740 20 client.15759 trim_cache size 0 max 16384 2024-09-19T06:09:28.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.623+0000 7f66f643f740 1 Processor -- start 2024-09-19T06:09:28.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.623+0000 7f66f643f740 1 -- start start 2024-09-19T06:09:28.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f643f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f03baf0 0x55608f044400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f643f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f045ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f643f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f05e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f643f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec1afeb0 con 0x55608f046cb0 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f643f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec1ad780 con 0x55608f03c410 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f643f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec1ab5d0 con 0x55608f03baf0 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f1c4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f05e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f1c4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f05e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53494/0 (socket says 172.21.15.103:53494) 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f1c4c640 1 -- 172.21.15.103:0/2393925012 learned_addr learned my addr 172.21.15.103:0/2393925012 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f1c4c640 1 -- 172.21.15.103:0/2393925012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f03baf0 msgr2=0x55608f044400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f1c4c640 1 --2- 172.21.15.103:0/2393925012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f03baf0 0x55608f044400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f1c4c640 1 -- 172.21.15.103:0/2393925012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 msgr2=0x55608f045ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f1c4c640 1 --2- 172.21.15.103:0/2393925012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f045ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f1c4c640 1 -- 172.21.15.103:0/2393925012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55608f037e90 con 0x55608f046cb0 2024-09-19T06:09:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.624+0000 7f66f1c4c640 1 --2- 172.21.15.103:0/2393925012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f05e900 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009430 tx=0x7f66e4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4c9ddd80efc559 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:28.627 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66d6ffd640 1 -- 172.21.15.103:0/2393925012 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4004510 con 0x55608f046cb0 2024-09-19T06:09:28.627 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66d6ffd640 1 -- 172.21.15.103:0/2393925012 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66e4036040 con 0x55608f046cb0 2024-09-19T06:09:28.627 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66d6ffd640 1 -- 172.21.15.103:0/2393925012 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4056480 con 0x55608f046cb0 2024-09-19T06:09:28.627 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66f643f740 1 -- 172.21.15.103:0/2393925012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 msgr2=0x55608f05e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66f643f740 1 --2- 172.21.15.103:0/2393925012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f05e900 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009430 tx=0x7f66e4009360 comp rx=0 tx=0).stop 2024-09-19T06:09:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66f643f740 1 -- 172.21.15.103:0/2393925012 shutdown_connections 2024-09-19T06:09:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66f643f740 1 --2- 172.21.15.103:0/2393925012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f05e900 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66f643f740 1 --2- 172.21.15.103:0/2393925012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03c410 0x55608f045ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66f643f740 1 --2- 172.21.15.103:0/2393925012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f03baf0 0x55608f044400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66f643f740 1 -- 172.21.15.103:0/2393925012 >> 172.21.15.103:0/2393925012 conn(0x55608f038060 msgr2=0x55608f0453b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66f643f740 1 -- 172.21.15.103:0/2393925012 shutdown_connections 2024-09-19T06:09:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.625+0000 7f66f643f740 1 -- 172.21.15.103:0/2393925012 wait complete. 2024-09-19T06:09:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.626+0000 7f66f643f740 1 -- start start 2024-09-19T06:09:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.626+0000 7f66f643f740 1 Processor -- start 2024-09-19T06:09:28.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.626+0000 7f66f643f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03baf0 0x55608f04f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.626+0000 7f66f643f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f03c410 0x55608f04a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f643f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f04ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f643f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec1abc40 con 0x55608f046cb0 2024-09-19T06:09:28.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f643f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec1ad0b0 con 0x55608f03baf0 2024-09-19T06:09:28.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f643f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec1ac310 con 0x55608f03c410 2024-09-19T06:09:28.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f643f740 10 client.0 _ll_register_callbacks cb 0x7f66e800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:28.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f1c4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f04ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f144b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03baf0 0x55608f04f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f1c4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f04ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53498/0 (socket says 172.21.15.103:53498) 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f1c4c640 1 -- 172.21.15.103:0/39794222 learned_addr learned my addr 172.21.15.103:0/39794222 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f03c410 0x55608f04a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f144b640 1 -- 172.21.15.103:0/39794222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f03c410 msgr2=0x55608f04a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f144b640 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f03c410 0x55608f04a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f144b640 1 -- 172.21.15.103:0/39794222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 msgr2=0x55608f04ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f144b640 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f04ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f144b640 1 -- 172.21.15.103:0/39794222 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55608f04b450 con 0x55608f03baf0 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f03c410 0x55608f04a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f1c4c640 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f04ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66f144b640 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03baf0 0x55608f04f3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f66e80a49b0 tx=0x7f66e8010690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71915850b4367581 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.627+0000 7f66d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66d4ff9640 1 -- 172.21.15.103:0/39794222 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8020050 con 0x55608f03baf0 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66d4ff9640 1 -- 172.21.15.103:0/39794222 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f66e809b080 con 0x55608f03baf0 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66f643f740 1 -- 172.21.15.103:0/39794222 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66e4036040 con 0x55608f03baf0 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66d4ff9640 1 -- 172.21.15.103:0/39794222 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f66e809b770 con 0x55608f03baf0 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66f643f740 10 client.25307 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66f643f740 1 -- 172.21.15.103:0/39794222 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55608f0c18d0 con 0x55608f03baf0 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66d4ff9640 1 -- 172.21.15.103:0/39794222 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66e4036040 con 0x55608f03baf0 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66d4ff9640 1 -- 172.21.15.103:0/39794222 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f66e809aaf0 con 0x55608f03baf0 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66f643f740 10 client.25307 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66f643f740 10 client.25307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66f643f740 20 client.25307 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66f643f740 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55608f0c1ee0 0x55608f0c4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66f643f740 4 client.25307 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:09:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66f643f740 1 -- 172.21.15.103:0/39794222 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55608efa7d70 con 0x55608f0c1ee0 2024-09-19T06:09:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.628+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55608f0c1ee0 0x55608f0c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.629+0000 7f66d4ff9640 10 client.25307 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.629+0000 7f66f0c4a640 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55608f0c1ee0 0x55608f0c4300 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de4b4e584adf6397 server_cookie=8110d7956d31e000 in_seq=0 out_seq=0 2024-09-19T06:09:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.696+0000 7f66d4ff9640 1 -- 172.21.15.103:0/39794222 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55608efa7d70 con 0x55608f0c1ee0 2024-09-19T06:09:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.696+0000 7f66d4ff9640 10 client.25307 handle_command_reply: tid=0 2024-09-19T06:09:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.696+0000 7f66f643f740 1 client.25307 shutdown 2024-09-19T06:09:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.696+0000 7f66f643f740 1 -- 172.21.15.103:0/39794222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03baf0 msgr2=0x55608f04f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.696+0000 7f66f643f740 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03baf0 0x55608f04f3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f66e80a49b0 tx=0x7f66e8010690 comp rx=0 tx=0).stop 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f643f740 1 -- 172.21.15.103:0/39794222 shutdown_connections 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f643f740 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55608f0c1ee0 0x55608f0c4300 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f643f740 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55608f046cb0 0x55608f04ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f643f740 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55608f03c410 0x55608f04a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f643f740 1 --2- 172.21.15.103:0/39794222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608f03baf0 0x55608f04f3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66d4ff9640 0 client.25307 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f643f740 1 -- 172.21.15.103:0/39794222 >> 172.21.15.103:0/39794222 conn(0x55608f038060 msgr2=0x55608f03d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f643f740 1 -- 172.21.15.103:0/39794222 shutdown_connections 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f643f740 1 -- 172.21.15.103:0/39794222 wait complete. 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f643f740 20 client.25307 trim_cache size 0 max 16384 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:09:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:09:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:09:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:09:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f36af640 1 -- 172.21.15.103:0/3852636786 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66d80a3460 msgr2=0x7f66d80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f36af640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66d80a3460 0x7f66d80a5920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009a60 tx=0x7f66e402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f36af640 1 -- 172.21.15.103:0/3852636786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66ec100490 msgr2=0x7f66ec1982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.697+0000 7f66f36af640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66ec100490 0x7f66ec1982a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f66e800d950 tx=0x7f66e800de10 comp rx=0 tx=0).stop 2024-09-19T06:09:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.698+0000 7f66f36af640 1 -- 172.21.15.103:0/3852636786 shutdown_connections 2024-09-19T06:09:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.698+0000 7f66f36af640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f66d80a3460 0x7f66d80a5920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.698+0000 7f66f36af640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66ec1026f0 0x7f66ec19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.698+0000 7f66f36af640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66ec101d70 0x7f66ec1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.698+0000 7f66f36af640 1 --2- 172.21.15.103:0/3852636786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66ec100490 0x7f66ec1982a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.698+0000 7f66f36af640 1 -- 172.21.15.103:0/3852636786 >> 172.21.15.103:0/3852636786 conn(0x7f66ec0770f0 msgr2=0x7f66ec10dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.698+0000 7f66f36af640 1 -- 172.21.15.103:0/3852636786 shutdown_connections 2024-09-19T06:09:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:28.698+0000 7f66f36af640 1 -- 172.21.15.103:0/3852636786 wait complete. 2024-09-19T06:09:29.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:28 smithi103 ceph-mon[30925]: pgmap v67: 97 pgs: 97 active+clean; 74 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-19T06:09:29.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:29.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:28 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:28 smithi169 ceph-mon[34350]: pgmap v67: 97 pgs: 97 active+clean; 74 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-19T06:09:29.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:29.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:28 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:28 smithi174 ceph-mon[34488]: pgmap v67: 97 pgs: 97 active+clean; 74 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-19T06:09:29.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:29.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:28 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:29.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.935+0000 7f3440c73640 1 -- 172.21.15.103:0/1093229993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f343c102570 msgr2=0x7f343c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.935+0000 7f3440c73640 1 --2- 172.21.15.103:0/1093229993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f343c102570 0x7f343c1029b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3424009900 tx=0x7f342402a480 comp rx=0 tx=0).stop 2024-09-19T06:09:29.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.935+0000 7f3440c73640 1 -- 172.21.15.103:0/1093229993 shutdown_connections 2024-09-19T06:09:29.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.935+0000 7f3440c73640 1 --2- 172.21.15.103:0/1093229993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f343c102ef0 0x7f343c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.935+0000 7f3440c73640 1 --2- 172.21.15.103:0/1093229993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f343c102570 0x7f343c1029b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.935+0000 7f3440c73640 1 --2- 172.21.15.103:0/1093229993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f343c100e20 0x7f343c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.935+0000 7f3440c73640 1 -- 172.21.15.103:0/1093229993 >> 172.21.15.103:0/1093229993 conn(0x7f343c0fc7d0 msgr2=0x7f343c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.935+0000 7f3440c73640 1 -- 172.21.15.103:0/1093229993 shutdown_connections 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.935+0000 7f3440c73640 1 -- 172.21.15.103:0/1093229993 wait complete. 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.936+0000 7f3440c73640 1 Processor -- start 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f3440c73640 1 -- start start 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f3440c73640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f343c100e20 0x7f343c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f3440c73640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f343c102570 0x7f343c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f3440c73640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f343c102ef0 0x7f343c1a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f3440c73640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f343c110e80 con 0x7f343c102570 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f3440c73640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f343c110d00 con 0x7f343c102ef0 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f3440c73640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f343c111000 con 0x7f343c100e20 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f343a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f343c100e20 0x7f343c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f343a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f343c100e20 0x7f343c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:40410/0 (socket says 172.21.15.103:40410) 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f3433fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f343c102570 0x7f343c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f343a59c640 1 -- 172.21.15.103:0/2793363010 learned_addr learned my addr 172.21.15.103:0/2793363010 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f343ad9d640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f343c102ef0 0x7f343c1a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f343a59c640 1 -- 172.21.15.103:0/2793363010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f343c102ef0 msgr2=0x7f343c1a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f343a59c640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f343c102ef0 0x7f343c1a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f343a59c640 1 -- 172.21.15.103:0/2793363010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f343c102570 msgr2=0x7f343c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f343a59c640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f343c102570 0x7f343c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f343a59c640 1 -- 172.21.15.103:0/2793363010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c1a48a0 con 0x7f343c100e20 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.937+0000 7f343ad9d640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f343c102ef0 0x7f343c1a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.938+0000 7f343a59c640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f343c100e20 0x7f343c1992e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f342c00e9f0 tx=0x7f342c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.938+0000 7f34337fe640 1 -- 172.21.15.103:0/2793363010 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c00cd80 con 0x7f343c100e20 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.938+0000 7f34337fe640 1 -- 172.21.15.103:0/2793363010 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f342c0054d0 con 0x7f343c100e20 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.938+0000 7f3440c73640 1 -- 172.21.15.103:0/2793363010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c1a4a70 con 0x7f343c100e20 2024-09-19T06:09:29.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.938+0000 7f34337fe640 1 -- 172.21.15.103:0/2793363010 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c010490 con 0x7f343c100e20 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.938+0000 7f3440c73640 1 -- 172.21.15.103:0/2793363010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c1a4f30 con 0x7f343c100e20 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.940+0000 7f34337fe640 1 -- 172.21.15.103:0/2793363010 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f342c005020 con 0x7f343c100e20 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.941+0000 7f34337fe640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34280a3430 0x7f34280a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.941+0000 7f3433fff640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34280a3430 0x7f34280a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.941+0000 7f34337fe640 1 -- 172.21.15.103:0/2793363010 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f342c0cff60 con 0x7f343c100e20 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.942+0000 7f3433fff640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34280a3430 0x7f34280a58f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3424000c00 tx=0x7f3424005e80 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.942+0000 7f344304c740 1 Processor -- start 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.942+0000 7f344304c740 1 -- start start 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.942+0000 7f344304c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd60880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f344304c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 0x5596cfd6b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f344304c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f344304c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5596cfcc62e0 con 0x5596cfd6b680 2024-09-19T06:09:29.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f344304c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5596cfc6dce0 con 0x5596cfd604a0 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f344304c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5596cfcc22a0 con 0x5596cfd60dc0 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343a59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd60880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343a59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd60880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:46162/0 (socket says 172.21.15.103:46162) 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343a59c640 1 -- 172.21.15.103:0/592475986 learned_addr learned my addr 172.21.15.103:0/592475986 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f3433fff640 1 --2- 172.21.15.103:0/592475986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 0x5596cfd6b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343ad9d640 1 --2- 172.21.15.103:0/592475986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343a59c640 1 -- 172.21.15.103:0/592475986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 msgr2=0x5596cfd6b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343a59c640 1 --2- 172.21.15.103:0/592475986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 0x5596cfd6b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343a59c640 1 -- 172.21.15.103:0/592475986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 msgr2=0x5596cfd6da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343a59c640 1 --2- 172.21.15.103:0/592475986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343a59c640 1 -- 172.21.15.103:0/592475986 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596cfc52440 con 0x5596cfd604a0 2024-09-19T06:09:29.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343ad9d640 1 --2- 172.21.15.103:0/592475986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f343a59c640 1 --2- 172.21.15.103:0/592475986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd60880 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f342c09c220 tx=0x7f342c0053d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c100c0e52e553f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f3430ff9640 1 -- 172.21.15.103:0/592475986 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c09c290 con 0x5596cfd604a0 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f3430ff9640 1 -- 172.21.15.103:0/592475986 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f342c0cde50 con 0x5596cfd604a0 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.943+0000 7f3430ff9640 1 -- 172.21.15.103:0/592475986 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0a4a70 con 0x5596cfd604a0 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.944+0000 7f344304c740 1 -- 172.21.15.103:0/592475986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 msgr2=0x5596cfd60880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.944+0000 7f344304c740 1 --2- 172.21.15.103:0/592475986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd60880 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f342c09c220 tx=0x7f342c0053d0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.945+0000 7f344304c740 1 -- 172.21.15.103:0/592475986 shutdown_connections 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.945+0000 7f344304c740 1 --2- 172.21.15.103:0/592475986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.945+0000 7f344304c740 1 --2- 172.21.15.103:0/592475986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 0x5596cfd6b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.945+0000 7f344304c740 1 --2- 172.21.15.103:0/592475986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd60880 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.945+0000 7f344304c740 1 -- 172.21.15.103:0/592475986 >> 172.21.15.103:0/592475986 conn(0x5596cfd5ca30 msgr2=0x5596cfd5ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.945+0000 7f344304c740 1 -- 172.21.15.103:0/592475986 shutdown_connections 2024-09-19T06:09:29.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.945+0000 7f344304c740 1 -- 172.21.15.103:0/592475986 wait complete. 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.945+0000 7f344304c740 1 -- start start 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.945+0000 7f344304c740 1 Processor -- start 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f344304c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd6afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f344304c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd60dc0 0x5596cfd68250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f344304c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd6b680 0x5596cfd68790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f344304c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5596cfd6e250 con 0x5596cfd60dc0 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f344304c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5596cfc81050 con 0x5596cfd604a0 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f344304c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5596cfd6e3d0 con 0x5596cfd6b680 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f344304c740 10 client.0 _ll_register_callbacks cb 0x5596cfcc1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f3433fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd60dc0 0x5596cfd68250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f343a59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd6afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f3433fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd60dc0 0x5596cfd68250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53534/0 (socket says 172.21.15.103:53534) 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f3433fff640 1 -- 172.21.15.103:0/3208130332 learned_addr learned my addr 172.21.15.103:0/3208130332 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f343ad9d640 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd6b680 0x5596cfd68790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f343a59c640 1 -- 172.21.15.103:0/3208130332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd6b680 msgr2=0x5596cfd68790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f343a59c640 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd6b680 0x5596cfd68790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f343a59c640 1 -- 172.21.15.103:0/3208130332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd60dc0 msgr2=0x5596cfd68250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f343a59c640 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd60dc0 0x5596cfd68250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f343a59c640 1 -- 172.21.15.103:0/3208130332 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596cfa373c0 con 0x5596cfd604a0 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f3433fff640 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd60dc0 0x5596cfd68250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.946+0000 7f343ad9d640 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd6b680 0x5596cfd68790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f343a59c640 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd6afa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f342c009810 tx=0x7f342c09a600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63e73f48363bd188 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f3421ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:09:29.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f3421ffb640 1 -- 172.21.15.103:0/3208130332 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c09c290 con 0x5596cfd604a0 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f3421ffb640 1 -- 172.21.15.103:0/3208130332 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f342c096e00 con 0x5596cfd604a0 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f344304c740 1 -- 172.21.15.103:0/3208130332 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f342c0cde50 con 0x5596cfd604a0 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f3421ffb640 1 -- 172.21.15.103:0/3208130332 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f342c0a9020 con 0x5596cfd604a0 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f344304c740 10 client.25319 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f344304c740 1 -- 172.21.15.103:0/3208130332 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596cfd7df80 con 0x5596cfd604a0 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f3421ffb640 1 -- 172.21.15.103:0/3208130332 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f342c0a0640 con 0x5596cfd604a0 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f3421ffb640 1 -- 172.21.15.103:0/3208130332 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f342c0a0170 con 0x5596cfd604a0 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f344304c740 10 client.25319 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f344304c740 10 client.25319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f344304c740 20 client.25319 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:29.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f344304c740 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5596cfd7f2d0 0x5596cfd816c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f344304c740 4 client.25319 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.947+0000 7f344304c740 1 -- 172.21.15.103:0/3208130332 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f342c0cde50 con 0x5596cfd7f2d0 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.948+0000 7f3433fff640 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5596cfd7f2d0 0x5596cfd816c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.948+0000 7f3421ffb640 10 client.25319 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.948+0000 7f3433fff640 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5596cfd7f2d0 0x5596cfd816c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d919ffcf8f6e8fa9 server_cookie=a7aa8c503d1c384c in_seq=0 out_seq=0 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f3421ffb640 1 -- 172.21.15.103:0/3208130332 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f342c0cde50 con 0x5596cfd7f2d0 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f3421ffb640 10 client.25319 handle_command_reply: tid=0 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 client.25319 shutdown 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 -- 172.21.15.103:0/3208130332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 msgr2=0x5596cfd6afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd6afa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f342c009810 tx=0x7f342c09a600 comp rx=0 tx=0).stop 2024-09-19T06:09:29.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 -- 172.21.15.103:0/3208130332 shutdown_connections 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5596cfd7f2d0 0x5596cfd816c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd6b680 0x5596cfd68790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd60dc0 0x5596cfd68250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f3421ffb640 0 client.25319 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 --2- 172.21.15.103:0/3208130332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd6afa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 -- 172.21.15.103:0/3208130332 >> 172.21.15.103:0/3208130332 conn(0x5596cfd5ca30 msgr2=0x5596cfd5bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 -- 172.21.15.103:0/3208130332 shutdown_connections 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 1 -- 172.21.15.103:0/3208130332 wait complete. 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.949+0000 7f344304c740 20 client.25319 trim_cache size 0 max 16384 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f344304c740 1 Processor -- start 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f344304c740 1 -- start start 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f344304c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd604a0 0x5596cfd86cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f344304c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd60dc0 0x5596cfd87200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f344304c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd5b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f344304c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f341c010ec0 con 0x5596cfd6b680 2024-09-19T06:09:29.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f344304c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f341c00e790 con 0x5596cfd60dc0 2024-09-19T06:09:29.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f344304c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f341c00c5e0 con 0x5596cfd604a0 2024-09-19T06:09:29.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f343ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd5b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f3433fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd60dc0 0x5596cfd87200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f343ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd5b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53544/0 (socket says 172.21.15.103:53544) 2024-09-19T06:09:29.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f343a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd604a0 0x5596cfd86cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.985+0000 7f343ad9d640 1 -- 172.21.15.103:0/3957512518 learned_addr learned my addr 172.21.15.103:0/3957512518 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:29.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.986+0000 7f343ad9d640 1 -- 172.21.15.103:0/3957512518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd604a0 msgr2=0x5596cfd86cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.986+0000 7f343ad9d640 1 --2- 172.21.15.103:0/3957512518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd604a0 0x5596cfd86cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.986+0000 7f343ad9d640 1 -- 172.21.15.103:0/3957512518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd60dc0 msgr2=0x5596cfd87200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.986+0000 7f343ad9d640 1 --2- 172.21.15.103:0/3957512518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd60dc0 0x5596cfd87200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.986+0000 7f343ad9d640 1 -- 172.21.15.103:0/3957512518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596cfd67200 con 0x5596cfd6b680 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.986+0000 7f343ad9d640 1 --2- 172.21.15.103:0/3957512518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd5b370 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f34340124d0 tx=0x7f3434012990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb34ba8c98bab9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.986+0000 7f3423fff640 1 -- 172.21.15.103:0/3957512518 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434004b20 con 0x5596cfd6b680 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.986+0000 7f3423fff640 1 -- 172.21.15.103:0/3957512518 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3434004cc0 con 0x5596cfd6b680 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.986+0000 7f3423fff640 1 -- 172.21.15.103:0/3957512518 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34340053e0 con 0x5596cfd6b680 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 -- 172.21.15.103:0/3957512518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 msgr2=0x5596cfd5b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 --2- 172.21.15.103:0/3957512518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd5b370 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f34340124d0 tx=0x7f3434012990 comp rx=0 tx=0).stop 2024-09-19T06:09:29.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 -- 172.21.15.103:0/3957512518 shutdown_connections 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 --2- 172.21.15.103:0/3957512518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd5b370 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 --2- 172.21.15.103:0/3957512518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd60dc0 0x5596cfd87200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 --2- 172.21.15.103:0/3957512518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd604a0 0x5596cfd86cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 -- 172.21.15.103:0/3957512518 >> 172.21.15.103:0/3957512518 conn(0x5596cfd5ca30 msgr2=0x5596cfd62710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 -- 172.21.15.103:0/3957512518 shutdown_connections 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 -- 172.21.15.103:0/3957512518 wait complete. 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 -- start start 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.987+0000 7f344304c740 1 Processor -- start 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f344304c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd73bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f344304c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 0x5596cfd6ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f344304c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f344304c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f341c00cc50 con 0x5596cfd6b680 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f344304c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f341c00e0c0 con 0x5596cfd604a0 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f344304c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f341c00d320 con 0x5596cfd60dc0 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f344304c740 10 client.0 _ll_register_callbacks cb 0x7f3424040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343a59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd73bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f3433fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 0x5596cfd6ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343a59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd73bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:46190/0 (socket says 172.21.15.103:46190) 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343a59c640 1 -- 172.21.15.103:0/2238395633 learned_addr learned my addr 172.21.15.103:0/2238395633 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53554/0 (socket says 172.21.15.103:53554) 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f3433fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 0x5596cfd6ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:40448/0 (socket says 172.21.15.103:40448) 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343a59c640 1 -- 172.21.15.103:0/2238395633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 msgr2=0x5596cfd6ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343a59c640 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 0x5596cfd6ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343a59c640 1 -- 172.21.15.103:0/2238395633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 msgr2=0x5596cfd6f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:29.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343a59c640 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343a59c640 1 -- 172.21.15.103:0/2238395633 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596cfd6fa80 con 0x5596cfd604a0 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.988+0000 7f343ad9d640 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f343a59c640 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd73bd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f342c0858b0 tx=0x7f342c00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8b8ea640568be2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f3421ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f3421ffb640 1 -- 172.21.15.103:0/2238395633 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c09bbf0 con 0x5596cfd604a0 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f3421ffb640 1 -- 172.21.15.103:0/2238395633 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f342c096e00 con 0x5596cfd604a0 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f344304c740 1 -- 172.21.15.103:0/2238395633 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3434004cc0 con 0x5596cfd604a0 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f3421ffb640 1 -- 172.21.15.103:0/2238395633 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f342c0a0640 con 0x5596cfd604a0 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f344304c740 10 client.25325 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f344304c740 1 -- 172.21.15.103:0/2238395633 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596cfde9ad0 con 0x5596cfd604a0 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f3421ffb640 1 -- 172.21.15.103:0/2238395633 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3434004cc0 con 0x5596cfd604a0 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f3421ffb640 1 -- 172.21.15.103:0/2238395633 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f342c004710 con 0x5596cfd604a0 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f344304c740 10 client.25325 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:29.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f344304c740 10 client.25325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.989+0000 7f344304c740 20 client.25325 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.990+0000 7f344304c740 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5596cfdea000 0x5596cfdec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.990+0000 7f344304c740 4 client.25325 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.990+0000 7f344304c740 1 -- 172.21.15.103:0/2238395633 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5596cfcd3850 con 0x5596cfdea000 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.990+0000 7f3433fff640 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5596cfdea000 0x5596cfdec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.990+0000 7f3433fff640 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5596cfdea000 0x5596cfdec3f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4f5678142e9a4af server_cookie=8495e4ad875b3632 in_seq=0 out_seq=0 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.990+0000 7f3421ffb640 10 client.25325 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.990+0000 7f3421ffb640 1 -- 172.21.15.103:0/2238395633 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5596cfcd3850 con 0x5596cfdea000 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.990+0000 7f3421ffb640 10 client.25325 handle_command_reply: tid=0 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.990+0000 7f344304c740 1 client.25325 shutdown 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.991+0000 7f344304c740 1 -- 172.21.15.103:0/2238395633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 msgr2=0x5596cfd73bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.991+0000 7f344304c740 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd73bd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f342c0858b0 tx=0x7f342c00cf90 comp rx=0 tx=0).stop 2024-09-19T06:09:29.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.992+0000 7f344304c740 1 -- 172.21.15.103:0/2238395633 shutdown_connections 2024-09-19T06:09:29.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.992+0000 7f344304c740 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5596cfdea000 0x5596cfdec3f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.992+0000 7f3421ffb640 0 client.25325 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:29.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.992+0000 7f344304c740 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5596cfd6b680 0x5596cfd6f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.992+0000 7f344304c740 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5596cfd60dc0 0x5596cfd6ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.478 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:09:29.478 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-19T06:09:29.478 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-09-19T06:09:29.478 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.992+0000 7f344304c740 1 --2- 172.21.15.103:0/2238395633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596cfd604a0 0x5596cfd73bd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.992+0000 7f344304c740 1 -- 172.21.15.103:0/2238395633 >> 172.21.15.103:0/2238395633 conn(0x5596cfd5ca30 msgr2=0x5596cfd62f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.993+0000 7f344304c740 1 -- 172.21.15.103:0/2238395633 shutdown_connections 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.993+0000 7f344304c740 1 -- 172.21.15.103:0/2238395633 wait complete. 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.993+0000 7f344304c740 20 client.25325 trim_cache size 0 max 16384 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.994+0000 7f3440c73640 1 -- 172.21.15.103:0/2793363010 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34280a3430 msgr2=0x7f34280a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.994+0000 7f3440c73640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34280a3430 0x7f34280a58f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3424000c00 tx=0x7f3424005e80 comp rx=0 tx=0).stop 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.995+0000 7f3440c73640 1 -- 172.21.15.103:0/2793363010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f343c100e20 msgr2=0x7f343c1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.995+0000 7f3440c73640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f343c100e20 0x7f343c1992e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f342c00e9f0 tx=0x7f342c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.995+0000 7f3440c73640 1 -- 172.21.15.103:0/2793363010 shutdown_connections 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.995+0000 7f3440c73640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f34280a3430 0x7f34280a58f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.995+0000 7f3440c73640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f343c102ef0 0x7f343c1a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.995+0000 7f3440c73640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f343c102570 0x7f343c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.995+0000 7f3440c73640 1 --2- 172.21.15.103:0/2793363010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f343c100e20 0x7f343c1992e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.995+0000 7f3440c73640 1 -- 172.21.15.103:0/2793363010 >> 172.21.15.103:0/2793363010 conn(0x7f343c0fc7d0 msgr2=0x7f343c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:29.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.995+0000 7f3440c73640 1 -- 172.21.15.103:0/2793363010 shutdown_connections 2024-09-19T06:09:29.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:28.995+0000 7f3440c73640 1 -- 172.21.15.103:0/2793363010 wait complete. 2024-09-19T06:09:30.637 INFO:tasks.workunit.client.0.smithi103.stdout:autoheader 2024-09-19T06:09:31.113 INFO:tasks.workunit.client.0.smithi103.stdout:autoconf 2024-09-19T06:09:31.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:30 smithi103 ceph-mon[30925]: pgmap v68: 97 pgs: 97 active+clean; 74 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-19T06:09:31.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:30 smithi169 ceph-mon[34350]: pgmap v68: 97 pgs: 97 active+clean; 74 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-19T06:09:31.335 INFO:tasks.workunit.client.0.smithi103.stdout:./configure \ 2024-09-19T06:09:31.335 INFO:tasks.workunit.client.0.smithi103.stdout: --libexecdir=/usr/lib \ 2024-09-19T06:09:31.335 INFO:tasks.workunit.client.0.smithi103.stdout: --exec_prefix=/var/lib 2024-09-19T06:09:31.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:30 smithi174 ceph-mon[34488]: pgmap v68: 97 pgs: 97 active+clean; 74 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-19T06:09:31.471 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:09:31.471 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:31.617 INFO:tasks.workunit.client.0.smithi103.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-19T06:09:31.617 INFO:tasks.workunit.client.0.smithi103.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-19T06:09:31.619 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to print strings... printf 2024-09-19T06:09:31.620 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc... gcc 2024-09-19T06:09:31.751 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:31.757 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether the C compiler works... yes 2024-09-19T06:09:31.757 INFO:tasks.workunit.client.0.smithi103.stdout:checking for C compiler default output file name... a.out 2024-09-19T06:09:31.828 INFO:tasks.workunit.client.0.smithi103.stdout:checking for suffix of executables... 2024-09-19T06:09:31.893 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are cross compiling... no 2024-09-19T06:09:31.951 INFO:tasks.workunit.client.0.smithi103.stdout:checking for suffix of object files... o 2024-09-19T06:09:31.988 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T06:09:32.021 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc accepts -g... yes 2024-09-19T06:09:32.119 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T06:09:32.124 INFO:tasks.workunit.client.0.smithi103.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-09-19T06:09:32.128 INFO:tasks.workunit.client.0.smithi103.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T06:09:32.130 INFO:tasks.workunit.client.0.smithi103.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T06:09:32.131 INFO:tasks.workunit.client.0.smithi103.stdout:checking for fgrep... /usr/bin/grep -F 2024-09-19T06:09:32.135 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ld used by gcc... /usr/bin/ld 2024-09-19T06:09:32.137 INFO:tasks.workunit.client.0.smithi103.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-09-19T06:09:32.150 INFO:tasks.workunit.client.0.smithi103.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-09-19T06:09:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 -- 172.21.15.103:0/2988639094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7704102570 msgr2=0x7f77041029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 --2- 172.21.15.103:0/2988639094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7704102570 0x7f77041029b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009900 tx=0x7f76f802a480 comp rx=0 tx=0).stop 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 -- 172.21.15.103:0/2988639094 shutdown_connections 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 --2- 172.21.15.103:0/2988639094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7704102ef0 0x7f770410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 --2- 172.21.15.103:0/2988639094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7704102570 0x7f77041029b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 --2- 172.21.15.103:0/2988639094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7704100e20 0x7f7704101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 -- 172.21.15.103:0/2988639094 >> 172.21.15.103:0/2988639094 conn(0x7f77040fc7d0 msgr2=0x7f77040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 -- 172.21.15.103:0/2988639094 shutdown_connections 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 -- 172.21.15.103:0/2988639094 wait complete. 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 Processor -- start 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 -- start start 2024-09-19T06:09:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7704100e20 0x7f7704199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7704102570 0x7f7704199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7704102ef0 0x7f77041a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7704110e00 con 0x7f7704100e20 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7704110c80 con 0x7f7704102570 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.313+0000 7f770ad87640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7704110f80 con 0x7f7704102ef0 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7708b23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7704100e20 0x7f7704199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7708b23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7704100e20 0x7f7704199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58470/0 (socket says 172.21.15.103:58470) 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7708b23640 1 -- 172.21.15.103:0/2435432456 learned_addr learned my addr 172.21.15.103:0/2435432456 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7709324640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7704102ef0 0x7f77041a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7703fff640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7704102570 0x7f7704199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7708b23640 1 -- 172.21.15.103:0/2435432456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7704102ef0 msgr2=0x7f77041a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7708b23640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7704102ef0 0x7f77041a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7708b23640 1 -- 172.21.15.103:0/2435432456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7704102570 msgr2=0x7f7704199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7708b23640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7704102570 0x7f7704199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7708b23640 1 -- 172.21.15.103:0/2435432456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77041a4810 con 0x7f7704100e20 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7708b23640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7704100e20 0x7f7704199250 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c920 tx=0x7f76f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7701ffb640 1 -- 172.21.15.103:0/2435432456 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f4007c70 con 0x7f7704100e20 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f770ad87640 1 -- 172.21.15.103:0/2435432456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77041a49e0 con 0x7f7704100e20 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7701ffb640 1 -- 172.21.15.103:0/2435432456 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f76f4007e10 con 0x7f7704100e20 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.314+0000 7f7701ffb640 1 -- 172.21.15.103:0/2435432456 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f4018820 con 0x7f7704100e20 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.315+0000 7f770ad87640 1 -- 172.21.15.103:0/2435432456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77041a4ef0 con 0x7f7704100e20 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.316+0000 7f770ad87640 1 -- 172.21.15.103:0/2435432456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7704101200 con 0x7f7704100e20 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.317+0000 7f7701ffb640 1 -- 172.21.15.103:0/2435432456 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f76f40189c0 con 0x7f7704100e20 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.317+0000 7f7701ffb640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76ec0a33b0 0x7f76ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.317+0000 7f7703fff640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76ec0a33b0 0x7f76ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.317+0000 7f7701ffb640 1 -- 172.21.15.103:0/2435432456 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f76f40cfd50 con 0x7f7704100e20 2024-09-19T06:09:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.318+0000 7f7703fff640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76ec0a33b0 0x7f76ec0a5870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009230 tx=0x7f76f80058d0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:32.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.321+0000 7f7701ffb640 1 -- 172.21.15.103:0/2435432456 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f76f40d3030 con 0x7f7704100e20 2024-09-19T06:09:32.493 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:32 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:32.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:32 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:32.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:32 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:32.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:32 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:32.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:32 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.530+0000 7f770ad87640 1 -- 172.21.15.103:0/2435432456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7704109090 con 0x7f7704100e20 2024-09-19T06:09:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.531+0000 7f7701ffb640 1 -- 172.21.15.103:0/2435432456 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11937 (secure 0 0 0) 0x7f76f4014030 con 0x7f7704100e20 2024-09-19T06:09:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:09:32.533 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":29,"btime":"2024-09-19T06:08:57:907491+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1313035056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1313035056},{"type":"v1","addr":"172.21.15.103:6835","nonce":1313035056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1090426593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1090426593},{"type":"v1","addr":"172.21.15.103:6837","nonce":1090426593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/208937195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":208937195},{"type":"v1","addr":"172.21.15.103:6839","nonce":208937195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/3658112833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":3658112833},{"type":"v1","addr":"172.21.15.103:6841","nonce":3658112833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4189079406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4189079406},{"type":"v1","addr":"172.21.15.169:6833","nonce":4189079406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1347140059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1347140059},{"type":"v1","addr":"172.21.15.174:6833","nonce":1347140059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:05:25.242328+0000","modified":"2024-09-19T06:08:57.894244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24488,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/3808769732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":3808769732},{"type":"v1","addr":"172.21.15.169:6835","nonce":3808769732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/588815565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588815565},{"type":"v1","addr":"172.21.15.174:6835","nonce":588815565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2782103866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2782103866},{"type":"v1","addr":"172.21.15.169:6837","nonce":2782103866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":61,"addr":"172.21.15.174:6837/2575162107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2575162107},{"type":"v1","addr":"172.21.15.174:6837","nonce":2575162107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":59,"addr":"172.21.15.174:6839/1070224661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":1070224661},{"type":"v1","addr":"172.21.15.174:6839","nonce":1070224661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/3987841064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3987841064},{"type":"v1","addr":"172.21.15.169:6839","nonce":3987841064}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24488,24475,24463]},"id":1}]} 2024-09-19T06:09:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 29 2024-09-19T06:09:32.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.533+0000 7f770ad87640 1 -- 172.21.15.103:0/2435432456 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76ec0a33b0 msgr2=0x7f76ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:32.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.533+0000 7f770ad87640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76ec0a33b0 0x7f76ec0a5870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009230 tx=0x7f76f80058d0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.533+0000 7f770ad87640 1 -- 172.21.15.103:0/2435432456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7704100e20 msgr2=0x7f7704199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:32.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.533+0000 7f770ad87640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7704100e20 0x7f7704199250 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c920 tx=0x7f76f400cde0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.533+0000 7f770ad87640 1 -- 172.21.15.103:0/2435432456 shutdown_connections 2024-09-19T06:09:32.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.533+0000 7f770ad87640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76ec0a33b0 0x7f76ec0a5870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.533+0000 7f770ad87640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7704102ef0 0x7f77041a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.533+0000 7f770ad87640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7704102570 0x7f7704199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.533+0000 7f770ad87640 1 --2- 172.21.15.103:0/2435432456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7704100e20 0x7f7704199250 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:32.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.533+0000 7f770ad87640 1 -- 172.21.15.103:0/2435432456 >> 172.21.15.103:0/2435432456 conn(0x7f77040fc7d0 msgr2=0x7f77040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:32.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.534+0000 7f770ad87640 1 -- 172.21.15.103:0/2435432456 shutdown_connections 2024-09-19T06:09:32.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:32.534+0000 7f770ad87640 1 -- 172.21.15.103:0/2435432456 wait complete. 2024-09-19T06:09:32.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:32 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:32.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:32 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:32.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:32 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:32.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:32 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:32.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:32 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:32 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:32 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:32 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:32 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:32 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:09:33.322 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:09:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:33.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:33 smithi103 ceph-mon[30925]: pgmap v69: 97 pgs: 97 active+clean; 67 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 316 op/s 2024-09-19T06:09:33.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:33 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2435432456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:33 smithi174 ceph-mon[34488]: pgmap v69: 97 pgs: 97 active+clean; 67 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 316 op/s 2024-09-19T06:09:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:33 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2435432456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:33.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:33 smithi169 ceph-mon[34350]: pgmap v69: 97 pgs: 97 active+clean; 67 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 316 op/s 2024-09-19T06:09:33.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:33 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2435432456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:34.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.091+0000 7f392d2a0640 1 -- 172.21.15.103:0/1103084853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3928106f10 msgr2=0x7f392810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:34.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.091+0000 7f392d2a0640 1 --2- 172.21.15.103:0/1103084853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3928106f10 0x7f392810ea90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3920009ca0 tx=0x7f392002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.091+0000 7f392d2a0640 1 -- 172.21.15.103:0/1103084853 shutdown_connections 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.091+0000 7f392d2a0640 1 --2- 172.21.15.103:0/1103084853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3928106f10 0x7f392810ea90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.091+0000 7f392d2a0640 1 --2- 172.21.15.103:0/1103084853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3928102790 0x7f39281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.091+0000 7f392d2a0640 1 --2- 172.21.15.103:0/1103084853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928101de0 0x7f39281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.091+0000 7f392d2a0640 1 -- 172.21.15.103:0/1103084853 >> 172.21.15.103:0/1103084853 conn(0x7f39280fd8c0 msgr2=0x7f39280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.091+0000 7f392d2a0640 1 -- 172.21.15.103:0/1103084853 shutdown_connections 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.091+0000 7f392d2a0640 1 -- 172.21.15.103:0/1103084853 wait complete. 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f392d2a0640 1 Processor -- start 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f392d2a0640 1 -- start start 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f392d2a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3928101de0 0x7f3928198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f392d2a0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3928102790 0x7f3928198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f392d2a0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928106f10 0x7f392819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f392d2a0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3928111e20 con 0x7f3928101de0 2024-09-19T06:09:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f392d2a0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3928111ca0 con 0x7f3928102790 2024-09-19T06:09:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f392d2a0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3928111fa0 con 0x7f3928106f10 2024-09-19T06:09:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f3926ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3928101de0 0x7f3928198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f3926ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3928101de0 0x7f3928198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58478/0 (socket says 172.21.15.103:58478) 2024-09-19T06:09:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.092+0000 7f3926ffd640 1 -- 172.21.15.103:0/2584437830 learned_addr learned my addr 172.21.15.103:0/2584437830 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f39267fc640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3928102790 0x7f3928198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f39277fe640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928106f10 0x7f392819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f3926ffd640 1 -- 172.21.15.103:0/2584437830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928106f10 msgr2=0x7f392819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f3926ffd640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928106f10 0x7f392819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f3926ffd640 1 -- 172.21.15.103:0/2584437830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3928102790 msgr2=0x7f3928198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f3926ffd640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3928102790 0x7f3928198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f3926ffd640 1 -- 172.21.15.103:0/2584437830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392819d2f0 con 0x7f3928101de0 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f39277fe640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928106f10 0x7f392819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f3926ffd640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3928101de0 0x7f3928198340 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f391800d770 tx=0x7f391800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f390ffff640 1 -- 172.21.15.103:0/2584437830 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918017070 con 0x7f3928101de0 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f392d2a0640 1 -- 172.21.15.103:0/2584437830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392819d5e0 con 0x7f3928101de0 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f390ffff640 1 -- 172.21.15.103:0/2584437830 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39180054d0 con 0x7f3928101de0 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f390ffff640 1 -- 172.21.15.103:0/2584437830 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918004cf0 con 0x7f3928101de0 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.093+0000 7f392d2a0640 1 -- 172.21.15.103:0/2584437830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39281a4ec0 con 0x7f3928101de0 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.095+0000 7f390ffff640 1 -- 172.21.15.103:0/2584437830 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f3918004e90 con 0x7f3928101de0 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.095+0000 7f392f679740 1 Processor -- start 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.095+0000 7f392f679740 1 -- start start 2024-09-19T06:09:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f392f679740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb537b40 0x55cebb536090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f392f679740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb5365d0 0x55cebb536a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f392f679740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb543760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f392f679740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cebb49c2f0 con 0x55cebb541370 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f392f679740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cebb443cf0 con 0x55cebb537b40 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f392f679740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cebb4982b0 con 0x55cebb5365d0 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39267fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb543760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39277fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb537b40 0x55cebb536090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39267fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb543760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58492/0 (socket says 172.21.15.103:58492) 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39267fc640 1 -- 172.21.15.103:0/3195049909 learned_addr learned my addr 172.21.15.103:0/3195049909 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f390ffff640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f39100a33b0 0x7f39100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f3926ffd640 1 --2- 172.21.15.103:0/3195049909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb5365d0 0x55cebb536a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39277fe640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f39100a33b0 0x7f39100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39267fc640 1 -- 172.21.15.103:0/3195049909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb5365d0 msgr2=0x55cebb536a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39267fc640 1 --2- 172.21.15.103:0/3195049909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb5365d0 0x55cebb536a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39267fc640 1 -- 172.21.15.103:0/3195049909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb537b40 msgr2=0x55cebb536090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39267fc640 1 --2- 172.21.15.103:0/3195049909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb537b40 0x55cebb536090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39267fc640 1 -- 172.21.15.103:0/3195049909 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cebb4283a0 con 0x55cebb541370 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f390ffff640 1 -- 172.21.15.103:0/2584437830 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f39180cf7f0 con 0x7f3928101de0 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.096+0000 7f39267fc640 1 --2- 172.21.15.103:0/3195049909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb543760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f391c00cb40 tx=0x7f391c00e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c043f7dddb7f543b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f39277fe640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f39100a33b0 0x7f39100a5870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3920009a60 tx=0x7f392002a8c0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f390d7fa640 1 -- 172.21.15.103:0/3195049909 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c010430 con 0x55cebb541370 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f390d7fa640 1 -- 172.21.15.103:0/3195049909 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f391c010a80 con 0x55cebb541370 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f390d7fa640 1 -- 172.21.15.103:0/3195049909 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c01ab60 con 0x55cebb541370 2024-09-19T06:09:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f392f679740 1 -- 172.21.15.103:0/3195049909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 msgr2=0x55cebb543760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f392f679740 1 --2- 172.21.15.103:0/3195049909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb543760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f391c00cb40 tx=0x7f391c00e350 comp rx=0 tx=0).stop 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f392f679740 1 -- 172.21.15.103:0/3195049909 shutdown_connections 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f392f679740 1 --2- 172.21.15.103:0/3195049909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb543760 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f392f679740 1 --2- 172.21.15.103:0/3195049909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb5365d0 0x55cebb536a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f392f679740 1 --2- 172.21.15.103:0/3195049909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb537b40 0x55cebb536090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f392f679740 1 -- 172.21.15.103:0/3195049909 >> 172.21.15.103:0/3195049909 conn(0x55cebb4ff310 msgr2=0x55cebb532c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f392f679740 1 -- 172.21.15.103:0/3195049909 shutdown_connections 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.097+0000 7f392f679740 1 -- 172.21.15.103:0/3195049909 wait complete. 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f392f679740 1 -- start start 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f392f679740 1 Processor -- start 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f392f679740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb540d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f392f679740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb53dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f392f679740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb541370 0x55cebb53e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f392f679740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cebb544070 con 0x55cebb537b40 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f392f679740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cebb457060 con 0x55cebb5365d0 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f392f679740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cebb5441f0 con 0x55cebb541370 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f392f679740 10 client.0 _ll_register_callbacks cb 0x55cebb1aa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f39267fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb53dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f39267fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb53dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58496/0 (socket says 172.21.15.103:58496) 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f39267fc640 1 -- 172.21.15.103:0/1352741483 learned_addr learned my addr 172.21.15.103:0/1352741483 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f3926ffd640 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb540d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f39277fe640 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb541370 0x55cebb53e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f39267fc640 1 -- 172.21.15.103:0/1352741483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb541370 msgr2=0x55cebb53e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f39267fc640 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb541370 0x55cebb53e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f39267fc640 1 -- 172.21.15.103:0/1352741483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 msgr2=0x55cebb540d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f39267fc640 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb540d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.098+0000 7f39267fc640 1 -- 172.21.15.103:0/1352741483 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cebb20d3c0 con 0x55cebb537b40 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f39267fc640 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb53dfe0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f391c00e850 tx=0x7f391c00efc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be491c5e6aa95f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f390aff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f390aff5640 1 -- 172.21.15.103:0/1352741483 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c02a060 con 0x55cebb537b40 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f390aff5640 1 -- 172.21.15.103:0/1352741483 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f391c010430 con 0x55cebb537b40 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f392f679740 1 -- 172.21.15.103:0/1352741483 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f391c010a80 con 0x55cebb537b40 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f390aff5640 1 -- 172.21.15.103:0/1352741483 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f391c00c710 con 0x55cebb537b40 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f392f679740 10 client.15798 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f392f679740 1 -- 172.21.15.103:0/1352741483 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cebb54fad0 con 0x55cebb537b40 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f390aff5640 1 -- 172.21.15.103:0/1352741483 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f391c010a80 con 0x55cebb537b40 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f390aff5640 1 -- 172.21.15.103:0/1352741483 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f391c0051d0 con 0x55cebb537b40 2024-09-19T06:09:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f392f679740 10 client.15798 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f392f679740 10 client.15798 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f392f679740 20 client.15798 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f392f679740 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55cebb550ed0 0x55cebb5532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f392f679740 4 client.15798 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.099+0000 7f392f679740 1 -- 172.21.15.103:0/1352741483 --> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cebb4a9860 con 0x55cebb550ed0 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.100+0000 7f3926ffd640 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55cebb550ed0 0x55cebb5532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.100+0000 7f390aff5640 10 client.15798 ms_handle_connect on v2:172.21.15.174:6836/2575162107 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.100+0000 7f3926ffd640 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55cebb550ed0 0x55cebb5532c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0a745a369003247 server_cookie=f0be9b7b20acaba2 in_seq=0 out_seq=0 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f390aff5640 1 -- 172.21.15.103:0/1352741483 <== mds.2 v2:172.21.15.174:6836/2575162107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cebb4a9860 con 0x55cebb550ed0 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f390aff5640 10 client.15798 handle_command_reply: tid=0 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 client.15798 shutdown 2024-09-19T06:09:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 -- 172.21.15.103:0/1352741483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 msgr2=0x55cebb53dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb53dfe0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f391c00e850 tx=0x7f391c00efc0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 -- 172.21.15.103:0/1352741483 shutdown_connections 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb541370 0x55cebb53e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55cebb550ed0 0x55cebb5532c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb53dfe0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 --2- 172.21.15.103:0/1352741483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb540d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f390aff5640 0 client.15798 ms_handle_reset on v2:172.21.15.174:6836/2575162107 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 -- 172.21.15.103:0/1352741483 >> 172.21.15.103:0/1352741483 conn(0x55cebb4ff310 msgr2=0x55cebb538960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 -- 172.21.15.103:0/1352741483 shutdown_connections 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 1 -- 172.21.15.103:0/1352741483 wait complete. 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.101+0000 7f392f679740 20 client.15798 trim_cache size 0 max 16384 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f392f679740 1 Processor -- start 2024-09-19T06:09:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f392f679740 1 -- start start 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f392f679740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb53ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f392f679740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb542760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f392f679740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb541370 0x55cebb542ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f392f679740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39281b0050 con 0x55cebb537b40 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f392f679740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39281ad920 con 0x55cebb5365d0 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f392f679740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f39281ab770 con 0x55cebb541370 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f39267fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb542760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f39267fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb542760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58510/0 (socket says 172.21.15.103:58510) 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.114+0000 7f39267fc640 1 -- 172.21.15.103:0/1760002028 learned_addr learned my addr 172.21.15.103:0/1760002028 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f39277fe640 1 --2- 172.21.15.103:0/1760002028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb541370 0x55cebb542ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f3926ffd640 1 --2- 172.21.15.103:0/1760002028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb53ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f39267fc640 1 -- 172.21.15.103:0/1760002028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb541370 msgr2=0x55cebb542ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f39267fc640 1 --2- 172.21.15.103:0/1760002028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb541370 0x55cebb542ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f39267fc640 1 -- 172.21.15.103:0/1760002028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 msgr2=0x55cebb53ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f39267fc640 1 --2- 172.21.15.103:0/1760002028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb53ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f39267fc640 1 -- 172.21.15.103:0/1760002028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cebb532ed0 con 0x55cebb537b40 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f39267fc640 1 --2- 172.21.15.103:0/1760002028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb542760 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f391c00ca60 tx=0x7f391c005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85433cd06d909a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f390cff9640 1 -- 172.21.15.103:0/1760002028 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c02a040 con 0x55cebb537b40 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f390cff9640 1 -- 172.21.15.103:0/1760002028 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f391c004790 con 0x55cebb537b40 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.115+0000 7f390cff9640 1 -- 172.21.15.103:0/1760002028 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c010950 con 0x55cebb537b40 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 -- 172.21.15.103:0/1760002028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 msgr2=0x55cebb542760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 --2- 172.21.15.103:0/1760002028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb542760 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f391c00ca60 tx=0x7f391c005ce0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 -- 172.21.15.103:0/1760002028 shutdown_connections 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 --2- 172.21.15.103:0/1760002028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb541370 0x55cebb542ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 --2- 172.21.15.103:0/1760002028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb537b40 0x55cebb542760 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 --2- 172.21.15.103:0/1760002028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb53ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 -- 172.21.15.103:0/1760002028 >> 172.21.15.103:0/1760002028 conn(0x55cebb4ff310 msgr2=0x55cebb53f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 -- 172.21.15.103:0/1760002028 shutdown_connections 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 -- 172.21.15.103:0/1760002028 wait complete. 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 -- start start 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 Processor -- start 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb549490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb537b40 0x55cebb5499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb544440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39281abde0 con 0x55cebb541370 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39281ad250 con 0x55cebb5365d0 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f39281ac4b0 con 0x55cebb537b40 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.116+0000 7f392f679740 10 client.0 _ll_register_callbacks cb 0x7f391c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f39277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb544440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f39277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb544440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58512/0 (socket says 172.21.15.103:58512) 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f39277fe640 1 -- 172.21.15.103:0/4074248851 learned_addr learned my addr 172.21.15.103:0/4074248851 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f39267fc640 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb537b40 0x55cebb5499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f3926ffd640 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb549490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f39277fe640 1 -- 172.21.15.103:0/4074248851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb537b40 msgr2=0x55cebb5499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f39277fe640 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb537b40 0x55cebb5499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f39277fe640 1 -- 172.21.15.103:0/4074248851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 msgr2=0x55cebb549490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f39277fe640 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb549490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f39277fe640 1 -- 172.21.15.103:0/4074248851 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cebb54a040 con 0x55cebb541370 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f3926ffd640 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb549490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f39277fe640 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb544440 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3920009ca0 tx=0x7f39200095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c578b377d8e1074 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f390aff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f390aff5640 1 -- 172.21.15.103:0/4074248851 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920004240 con 0x55cebb541370 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f390aff5640 1 -- 172.21.15.103:0/4074248851 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f39200043e0 con 0x55cebb541370 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f392f679740 1 -- 172.21.15.103:0/4074248851 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f391c004790 con 0x55cebb541370 2024-09-19T06:09:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f390aff5640 1 -- 172.21.15.103:0/4074248851 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39200045e0 con 0x55cebb541370 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f392f679740 10 client.15804 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.117+0000 7f392f679740 1 -- 172.21.15.103:0/4074248851 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cebb5bbdd0 con 0x55cebb541370 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f390aff5640 1 -- 172.21.15.103:0/4074248851 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f391c004790 con 0x55cebb541370 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f390aff5640 1 -- 172.21.15.103:0/4074248851 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f392002f4c0 con 0x55cebb541370 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f392f679740 10 client.15804 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f392f679740 10 client.15804 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f392f679740 20 client.15804 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f392f679740 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55cebb5bc530 0x55cebb5be950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f392f679740 4 client.15804 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f392f679740 1 -- 172.21.15.103:0/4074248851 --> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cebb4a3d70 con 0x55cebb5bc530 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f3926ffd640 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55cebb5bc530 0x55cebb5be950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f390aff5640 10 client.15804 ms_handle_connect on v2:172.21.15.174:6836/2575162107 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.118+0000 7f3926ffd640 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55cebb5bc530 0x55cebb5be950 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9b39ef558470343 server_cookie=e7cf17737ae0a1cd in_seq=0 out_seq=0 2024-09-19T06:09:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f390aff5640 1 -- 172.21.15.103:0/4074248851 <== mds.2 v2:172.21.15.174:6836/2575162107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+19890 (crc 0 0 0) 0x55cebb4a3d70 con 0x55cebb5bc530 2024-09-19T06:09:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f390aff5640 10 client.15804 handle_command_reply: tid=0 2024-09-19T06:09:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 client.15804 shutdown 2024-09-19T06:09:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 -- 172.21.15.103:0/4074248851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 msgr2=0x55cebb544440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb544440 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3920009ca0 tx=0x7f39200095c0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 -- 172.21.15.103:0/4074248851 shutdown_connections 2024-09-19T06:09:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.174:6836/2575162107,v1:172.21.15.174:6837/2575162107] conn(0x55cebb5bc530 0x55cebb5be950 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cebb541370 0x55cebb544440 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cebb537b40 0x55cebb5499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.144 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 26954374, 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628415, 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/reflink" 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 67541233, 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628380, 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ceph" 2024-09-19T06:09:34.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 113371225, 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511627785, 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/description" 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 136586525, 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628346, 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads" 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 141596033, 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628305, 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample" 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 212702769, 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628303, 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample" 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 262432302, 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628300, 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample" 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 262928759, 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628309, 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs" 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 325490625, 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628302, 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample" 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 328001271, 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628420, 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/test_names" 2024-09-19T06:09:34.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.150 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.150 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 413560776, 2024-09-19T06:09:34.150 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628403, 2024-09-19T06:09:34.150 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/log" 2024-09-19T06:09:34.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.150 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.150 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 440931478, 2024-09-19T06:09:34.150 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628378, 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/btrfs" 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 453710586, 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628396, 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filestreams" 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 492156454, 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628347, 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master" 2024-09-19T06:09:34.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 540003260, 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628409, 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/perf" 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 600201803, 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628338, 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs" 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.152 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 659533073, 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628293, 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks" 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 707958821, 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628379, 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/casefold" 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.153 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 710482957, 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628333, 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/packed-refs" 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 755600170, 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628308, 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/branches" 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 899676218, 2024-09-19T06:09:34.154 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628383, 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/defrag" 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 964071864, 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628304, 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample" 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1035179068, 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628382, 2024-09-19T06:09:34.155 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/config" 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1118802668, 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628301, 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/sendemail-validate.sample" 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1140500354, 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628345, 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/HEAD" 2024-09-19T06:09:34.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1144050549, 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628311, 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/tags" 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1145547548, 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628344, 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads/master" 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1164015390, 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628395, 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fail_make_request" 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1191308161, 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628299, 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample" 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1193798637, 2024-09-19T06:09:34.158 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628337, 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs" 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1251157505, 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628393, 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ext4" 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1255622966, 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628414, 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/rc" 2024-09-19T06:09:34.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1280631593, 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628339, 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes" 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1366856081, 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628418, 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/report" 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1395143080, 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628399, 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fuzzy" 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1412625153, 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628423, 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/verity" 2024-09-19T06:09:34.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1522124755, 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628334, 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes" 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1574443024, 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628295, 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample" 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.162 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1580364069, 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628390, 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmthin" 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1617738625, 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628424, 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/xfs" 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.163 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1687808312, 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628394, 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/f2fs" 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1713595521, 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628413, 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/quota" 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1776022760, 2024-09-19T06:09:34.164 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628385, 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdust" 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1904246637, 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628419, 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/scsi_debug" 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1916128437, 2024-09-19T06:09:34.165 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628292, 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info/exclude" 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1925740535, 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628386, 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmerror" 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1986209229, 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628319, 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects" 2024-09-19T06:09:34.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1995901777, 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628401, 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/inject" 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2057203963, 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628392, 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/encrypt" 2024-09-19T06:09:34.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2159025420, 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628298, 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample" 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2223951676, 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628336, 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD" 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2384629731, 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628412, 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/punch" 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2384846817, 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628296, 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample" 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2542435508, 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628411, 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/preamble" 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2553750268, 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628381, 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/cgroup2" 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2586302678, 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628404, 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/metadump" 2024-09-19T06:09:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2606912399, 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628294, 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample" 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2638681757, 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628407, 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/overlay" 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2639542632, 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628410, 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/populate" 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2652237299, 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628416, 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/renameat2" 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.172 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2663916666, 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628402, 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/locktest" 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2795312498, 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628421, 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/tracing" 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.173 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3040971015, 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628291, 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info" 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3136333155, 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628331, 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/shallow" 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.174 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3136749498, 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628391, 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dump" 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3175034291, 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628340, 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin" 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.175 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3283115983, 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628406, 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/nfs" 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3320658366, 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628342, 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/HEAD" 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.176 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3404389185, 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628398, 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter.btrfs" 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3442152334, 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628397, 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter" 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3492626103, 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628307, 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample" 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3504046152, 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628377, 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/attr" 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3522378162, 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628422, 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ubifs" 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3528477559, 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628408, 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/parent" 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f390aff5640 0 client.15804 ms_handle_reset on v2:172.21.15.174:6836/2575162107 2024-09-19T06:09:34.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 --2- 172.21.15.103:0/4074248851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cebb5365d0 0x55cebb549490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 -- 172.21.15.103:0/4074248851 >> 172.21.15.103:0/4074248851 conn(0x55cebb4ff310 msgr2=0x55cebb540060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:34.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 -- 172.21.15.103:0/4074248851 shutdown_connections 2024-09-19T06:09:34.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 1 -- 172.21.15.103:0/4074248851 wait complete. 2024-09-19T06:09:34.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.119+0000 7f392f679740 20 client.15804 trim_cache size 0 max 16384 2024-09-19T06:09:34.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 -- 172.21.15.103:0/2584437830 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f39100a33b0 msgr2=0x7f39100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:34.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f39100a33b0 0x7f39100a5870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3920009a60 tx=0x7f392002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 -- 172.21.15.103:0/2584437830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3928101de0 msgr2=0x7f3928198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3928101de0 0x7f3928198340 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f391800d770 tx=0x7f391800dc30 comp rx=0 tx=0).stop 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 -- 172.21.15.103:0/2584437830 shutdown_connections 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f39100a33b0 0x7f39100a5870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928106f10 0x7f392819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3928102790 0x7f3928198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 --2- 172.21.15.103:0/2584437830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3928101de0 0x7f3928198340 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 -- 172.21.15.103:0/2584437830 >> 172.21.15.103:0/2584437830 conn(0x7f39280fd8c0 msgr2=0x7f39280fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 -- 172.21.15.103:0/2584437830 shutdown_connections 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:34.120+0000 7f392d2a0640 1 -- 172.21.15.103:0/2584437830 wait complete. 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3567835919, 2024-09-19T06:09:34.181 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628341, 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD" 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3570796926, 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628297, 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample" 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3617639600, 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628310, 2024-09-19T06:09:34.182 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads" 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3642877177, 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628387, 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmflakey" 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3713585021, 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628384, 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdelay" 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3722630212, 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628388, 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmhugedisk" 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3728706488, 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628389, 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmlogwrites" 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.184 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3731678442, 2024-09-19T06:09:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628417, 2024-09-19T06:09:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/repair" 2024-09-19T06:09:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3883263216, 2024-09-19T06:09:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628335, 2024-09-19T06:09:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin" 2024-09-19T06:09:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3884226855, 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628350, 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/config" 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3895654602, 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628351, 2024-09-19T06:09:34.186 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/index.lock" 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3903122054, 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628306, 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/update.sample" 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3954764177, 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628400, 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/gcov" 2024-09-19T06:09:34.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4264502208, 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628425, 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/zoned" 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4286255114, 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628376, 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/Makefile" 2024-09-19T06:09:34.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:34.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:34.189 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:34.189 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4286941463, 2024-09-19T06:09:34.189 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628405, 2024-09-19T06:09:34.189 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/module" 2024-09-19T06:09:34.189 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:09:34.189 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-19T06:09:34.380 INFO:tasks.workunit.client.0.smithi103.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-09-19T06:09:34.380 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether ln -s works... yes 2024-09-19T06:09:34.397 INFO:tasks.workunit.client.0.smithi103.stdout:checking the maximum length of command line arguments... 1572864 2024-09-19T06:09:34.399 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-19T06:09:34.400 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-19T06:09:34.400 INFO:tasks.workunit.client.0.smithi103.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-09-19T06:09:34.401 INFO:tasks.workunit.client.0.smithi103.stdout:checking for objdump... objdump 2024-09-19T06:09:34.402 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to recognize dependent libraries... pass_all 2024-09-19T06:09:34.402 INFO:tasks.workunit.client.0.smithi103.stdout:checking for dlltool... no 2024-09-19T06:09:34.403 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-19T06:09:34.403 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ar... ar 2024-09-19T06:09:34.515 INFO:tasks.workunit.client.0.smithi103.stdout:checking for archiver @FILE support... @ 2024-09-19T06:09:34.515 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strip... strip 2024-09-19T06:09:34.516 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ranlib... ranlib 2024-09-19T06:09:34.517 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gawk... gawk 2024-09-19T06:09:34.675 INFO:tasks.workunit.client.0.smithi103.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-09-19T06:09:34.676 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sysroot... no 2024-09-19T06:09:34.697 INFO:tasks.workunit.client.0.smithi103.stdout:checking for a working dd... /usr/bin/dd 2024-09-19T06:09:34.714 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-09-19T06:09:34.761 INFO:tasks.workunit.client.0.smithi103.stdout:checking for mt... no 2024-09-19T06:09:34.780 INFO:tasks.workunit.client.0.smithi103.stdout:checking if : is a manifest tool... no 2024-09-19T06:09:34.987 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T06:09:35.435 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ANSI C header files... yes 2024-09-19T06:09:35.486 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:09:35.605 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/types.h... yes 2024-09-19T06:09:35.671 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/stat.h... yes 2024-09-19T06:09:35.703 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:35 smithi174 ceph-mon[34488]: pgmap v70: 97 pgs: 97 active+clean; 67 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-19T06:09:35.735 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdlib.h... yes 2024-09-19T06:09:35.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:35 smithi103 ceph-mon[30925]: pgmap v70: 97 pgs: 97 active+clean; 67 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-19T06:09:35.750 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:35 smithi169 ceph-mon[34350]: pgmap v70: 97 pgs: 97 active+clean; 67 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-19T06:09:35.800 INFO:tasks.workunit.client.0.smithi103.stdout:checking for string.h... yes 2024-09-19T06:09:35.873 INFO:tasks.workunit.client.0.smithi103.stdout:checking for memory.h... yes 2024-09-19T06:09:35.934 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strings.h... yes 2024-09-19T06:09:35.997 INFO:tasks.workunit.client.0.smithi103.stdout:checking for inttypes.h... yes 2024-09-19T06:09:36.070 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdint.h... yes 2024-09-19T06:09:36.134 INFO:tasks.workunit.client.0.smithi103.stdout:checking for unistd.h... yes 2024-09-19T06:09:36.211 INFO:tasks.workunit.client.0.smithi103.stdout:checking for dlfcn.h... yes 2024-09-19T06:09:36.223 INFO:tasks.workunit.client.0.smithi103.stdout:checking for objdir... .libs 2024-09-19T06:09:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.263+0000 7f98ffedc640 1 -- 172.21.15.103:0/1416602848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f81027a0 msgr2=0x7f98f81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.263+0000 7f98ffedc640 1 --2- 172.21.15.103:0/1416602848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f81027a0 0x7f98f81067f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009900 tx=0x7f98e802a410 comp rx=0 tx=0).stop 2024-09-19T06:09:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.263+0000 7f98ffedc640 1 -- 172.21.15.103:0/1416602848 shutdown_connections 2024-09-19T06:09:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.263+0000 7f98ffedc640 1 --2- 172.21.15.103:0/1416602848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f8106f20 0x7f98f810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.263+0000 7f98ffedc640 1 --2- 172.21.15.103:0/1416602848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f81027a0 0x7f98f81067f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.263+0000 7f98ffedc640 1 --2- 172.21.15.103:0/1416602848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98f8101df0 0x7f98f81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.263+0000 7f98ffedc640 1 -- 172.21.15.103:0/1416602848 >> 172.21.15.103:0/1416602848 conn(0x7f98f80fd8f0 msgr2=0x7f98f80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.263+0000 7f98ffedc640 1 -- 172.21.15.103:0/1416602848 shutdown_connections 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.263+0000 7f98ffedc640 1 -- 172.21.15.103:0/1416602848 wait complete. 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98ffedc640 1 Processor -- start 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98ffedc640 1 -- start start 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98ffedc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98f8101df0 0x7f98f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98ffedc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f81027a0 0x7f98f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98ffedc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f8106f20 0x7f98f8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98ffedc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f98f8111e80 con 0x7f98f8106f20 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98ffedc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f98f8111d00 con 0x7f98f81027a0 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98ffedc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f98f8112000 con 0x7f98f8101df0 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98fe479640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f8106f20 0x7f98f8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98fd477640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f81027a0 0x7f98f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98fd477640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f81027a0 0x7f98f8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:44996/0 (socket says 172.21.15.103:44996) 2024-09-19T06:09:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98fd477640 1 -- 172.21.15.103:0/1732948805 learned_addr learned my addr 172.21.15.103:0/1732948805 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.264+0000 7f98fe479640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f8106f20 0x7f98f8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58536/0 (socket says 172.21.15.103:58536) 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98fdc78640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98f8101df0 0x7f98f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98fd477640 1 -- 172.21.15.103:0/1732948805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98f8101df0 msgr2=0x7f98f80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98fd477640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98f8101df0 0x7f98f80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98fd477640 1 -- 172.21.15.103:0/1732948805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f8106f20 msgr2=0x7f98f8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98fd477640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f8106f20 0x7f98f8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98fd477640 1 -- 172.21.15.103:0/1732948805 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f81a68c0 con 0x7f98f81027a0 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98fe479640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f8106f20 0x7f98f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98fd477640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f81027a0 0x7f98f8074a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98e8005ab0 tx=0x7f98e8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98eeffd640 1 -- 172.21.15.103:0/1732948805 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e803f070 con 0x7f98f81027a0 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98ffedc640 1 -- 172.21.15.103:0/1732948805 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f81a6b50 con 0x7f98f81027a0 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98eeffd640 1 -- 172.21.15.103:0/1732948805 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98e8031b60 con 0x7f98f81027a0 2024-09-19T06:09:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98ffedc640 1 -- 172.21.15.103:0/1732948805 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f81a7080 con 0x7f98f81027a0 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.265+0000 7f98eeffd640 1 -- 172.21.15.103:0/1732948805 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8035030 con 0x7f98f81027a0 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f99022b5740 1 Processor -- start 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f99022b5740 1 -- start start 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f98eeffd640 1 -- 172.21.15.103:0/1732948805 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f98e8042070 con 0x7f98f81027a0 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f99022b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a955090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f99022b5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a9555d0 0x55a77a955a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f99022b5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 0x55a77a962760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f99022b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a77a8bb2f0 con 0x55a77a956b40 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f99022b5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a77a862cf0 con 0x55a77a960370 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f99022b5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a77a8b72b0 con 0x55a77a9555d0 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f98fe479640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a955090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f98fe479640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a955090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58552/0 (socket says 172.21.15.103:58552) 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.268+0000 7f98fe479640 1 -- 172.21.15.103:0/4107348765 learned_addr learned my addr 172.21.15.103:0/4107348765 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98fd477640 1 --2- 172.21.15.103:0/4107348765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 0x55a77a962760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98fdc78640 1 --2- 172.21.15.103:0/4107348765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a9555d0 0x55a77a955a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98fe479640 1 -- 172.21.15.103:0/4107348765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a9555d0 msgr2=0x55a77a955a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98fe479640 1 --2- 172.21.15.103:0/4107348765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a9555d0 0x55a77a955a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98fe479640 1 -- 172.21.15.103:0/4107348765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 msgr2=0x55a77a962760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98fe479640 1 --2- 172.21.15.103:0/4107348765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 0x55a77a962760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98fe479640 1 -- 172.21.15.103:0/4107348765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a77a8473a0 con 0x55a77a956b40 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98fd477640 1 --2- 172.21.15.103:0/4107348765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 0x55a77a962760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98fe479640 1 --2- 172.21.15.103:0/4107348765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a955090 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f98f0011790 tx=0x7f98f0011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe52a581ced0da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98eeffd640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f98e40a33b0 0x7f98e40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98e3fff640 1 -- 172.21.15.103:0/4107348765 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0004d20 con 0x55a77a956b40 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98e3fff640 1 -- 172.21.15.103:0/4107348765 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98f0003970 con 0x55a77a956b40 2024-09-19T06:09:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98e3fff640 1 -- 172.21.15.103:0/4107348765 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0004470 con 0x55a77a956b40 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98fdc78640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f98e40a33b0 0x7f98e40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.269+0000 7f98eeffd640 1 -- 172.21.15.103:0/1732948805 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f98e80f03b0 con 0x7f98f81027a0 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.270+0000 7f98fdc78640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f98e40a33b0 0x7f98e40a5870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55a77a952ac0 tx=0x7f98f4005f90 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.270+0000 7f99022b5740 1 -- 172.21.15.103:0/4107348765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 msgr2=0x55a77a955090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.270+0000 7f99022b5740 1 --2- 172.21.15.103:0/4107348765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a955090 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f98f0011790 tx=0x7f98f0011c50 comp rx=0 tx=0).stop 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.270+0000 7f99022b5740 1 -- 172.21.15.103:0/4107348765 shutdown_connections 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.270+0000 7f99022b5740 1 --2- 172.21.15.103:0/4107348765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 0x55a77a962760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.270+0000 7f99022b5740 1 --2- 172.21.15.103:0/4107348765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a9555d0 0x55a77a955a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.270+0000 7f99022b5740 1 --2- 172.21.15.103:0/4107348765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a955090 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.270+0000 7f99022b5740 1 -- 172.21.15.103:0/4107348765 >> 172.21.15.103:0/4107348765 conn(0x55a77a91e310 msgr2=0x55a77a951c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.270+0000 7f99022b5740 1 -- 172.21.15.103:0/4107348765 shutdown_connections 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.270+0000 7f99022b5740 1 -- 172.21.15.103:0/4107348765 wait complete. 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f99022b5740 1 -- start start 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f99022b5740 1 Processor -- start 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f99022b5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 0x55a77a95fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f99022b5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 0x55a77a95cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f99022b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a960370 0x55a77a95d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f99022b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a77a963070 con 0x55a77a960370 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f99022b5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a77a876060 con 0x55a77a9555d0 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f99022b5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a77a9631f0 con 0x55a77a956b40 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f99022b5740 10 client.0 _ll_register_callbacks cb 0x55a77a5c98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f98fe479640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a960370 0x55a77a95d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f98fe479640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a960370 0x55a77a95d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58568/0 (socket says 172.21.15.103:58568) 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f98fe479640 1 -- 172.21.15.103:0/3984680957 learned_addr learned my addr 172.21.15.103:0/3984680957 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f98fdc78640 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 0x55a77a95fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.271+0000 7f98fd477640 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 0x55a77a95cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f98fe479640 1 -- 172.21.15.103:0/3984680957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 msgr2=0x55a77a95cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f98fe479640 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 0x55a77a95cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f98fe479640 1 -- 172.21.15.103:0/3984680957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 msgr2=0x55a77a95fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f98fe479640 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 0x55a77a95fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f98fe479640 1 -- 172.21.15.103:0/3984680957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a77a62c3c0 con 0x55a77a960370 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f98fe479640 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a960370 0x55a77a95d570 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f98f0000f80 tx=0x7f98f0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd4b214369dc0be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f98e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f98e17fa640 1 -- 172.21.15.103:0/3984680957 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0028030 con 0x55a77a960370 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f98e17fa640 1 -- 172.21.15.103:0/3984680957 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f98f000fc70 con 0x55a77a960370 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f99022b5740 1 -- 172.21.15.103:0/3984680957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98f0003970 con 0x55a77a960370 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f98e17fa640 1 -- 172.21.15.103:0/3984680957 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f98f0032050 con 0x55a77a960370 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f99022b5740 10 client.15816 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.272+0000 7f99022b5740 1 -- 172.21.15.103:0/3984680957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a77a96eac0 con 0x55a77a960370 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.273+0000 7f98e17fa640 1 -- 172.21.15.103:0/3984680957 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98f0003970 con 0x55a77a960370 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.273+0000 7f98e17fa640 1 -- 172.21.15.103:0/3984680957 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f98f0005240 con 0x55a77a960370 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.273+0000 7f99022b5740 10 client.15816 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.273+0000 7f99022b5740 10 client.15816 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:09:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.273+0000 7f99022b5740 20 client.15816 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.273+0000 7f99022b5740 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55a77a96ff20 0x55a77a972310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.273+0000 7f99022b5740 4 client.15816 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.273+0000 7f99022b5740 1 -- 172.21.15.103:0/3984680957 --> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a77a8c8860 con 0x55a77a96ff20 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.273+0000 7f98fdc78640 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55a77a96ff20 0x55a77a972310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.274+0000 7f98fdc78640 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55a77a96ff20 0x55a77a972310 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37c526420194222 server_cookie=795a64295563f538 in_seq=0 out_seq=0 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.274+0000 7f98e17fa640 10 client.15816 ms_handle_connect on v2:172.21.15.174:6838/1070224661 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.274+0000 7f98e17fa640 1 -- 172.21.15.103:0/3984680957 <== mds.1 v2:172.21.15.174:6838/1070224661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a77a8c8860 con 0x55a77a96ff20 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.274+0000 7f98e17fa640 10 client.15816 handle_command_reply: tid=0 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.274+0000 7f99022b5740 1 client.15816 shutdown 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.274+0000 7f99022b5740 1 -- 172.21.15.103:0/3984680957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a960370 msgr2=0x55a77a95d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.274+0000 7f99022b5740 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a960370 0x55a77a95d570 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f98f0000f80 tx=0x7f98f0003d50 comp rx=0 tx=0).stop 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.275+0000 7f99022b5740 1 -- 172.21.15.103:0/3984680957 shutdown_connections 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.275+0000 7f99022b5740 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a960370 0x55a77a95d570 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.275+0000 7f99022b5740 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 0x55a77a95cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.275+0000 7f99022b5740 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55a77a96ff20 0x55a77a972310 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.275+0000 7f99022b5740 1 --2- 172.21.15.103:0/3984680957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 0x55a77a95fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.275+0000 7f98e17fa640 0 client.15816 ms_handle_reset on v2:172.21.15.174:6838/1070224661 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.275+0000 7f99022b5740 1 -- 172.21.15.103:0/3984680957 >> 172.21.15.103:0/3984680957 conn(0x55a77a91e310 msgr2=0x55a77a957960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.275+0000 7f99022b5740 1 -- 172.21.15.103:0/3984680957 shutdown_connections 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.275+0000 7f99022b5740 1 -- 172.21.15.103:0/3984680957 wait complete. 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.275+0000 7f99022b5740 20 client.15816 trim_cache size 0 max 16384 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.288+0000 7f99022b5740 1 Processor -- start 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.288+0000 7f99022b5740 1 -- start start 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f99022b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a9555d0 0x55a77a96c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f99022b5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 0x55a77a958120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f99022b5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 0x55a77a958660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f99022b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81b21b0 con 0x55a77a9555d0 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f99022b5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81afa80 con 0x55a77a960370 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f99022b5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81ad8d0 con 0x55a77a956b40 2024-09-19T06:09:36.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fdc78640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a9555d0 0x55a77a96c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fdc78640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a9555d0 0x55a77a96c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58572/0 (socket says 172.21.15.103:58572) 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fdc78640 1 -- 172.21.15.103:0/2247856597 learned_addr learned my addr 172.21.15.103:0/2247856597 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fe479640 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 0x55a77a958660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fd477640 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 0x55a77a958120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fe479640 1 -- 172.21.15.103:0/2247856597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 msgr2=0x55a77a958120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fe479640 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 0x55a77a958120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fe479640 1 -- 172.21.15.103:0/2247856597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a9555d0 msgr2=0x55a77a96c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fe479640 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a9555d0 0x55a77a96c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fe479640 1 -- 172.21.15.103:0/2247856597 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a77a958ba0 con 0x55a77a960370 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fdc78640 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a9555d0 0x55a77a96c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fd477640 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 0x55a77a958120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.289+0000 7f98fe479640 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 0x55a77a958660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98f0005850 tx=0x7f98f0009fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e9fbf0f992f926 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.290+0000 7f98e37fe640 1 -- 172.21.15.103:0/2247856597 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0028040 con 0x55a77a960370 2024-09-19T06:09:36.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.290+0000 7f98e37fe640 1 -- 172.21.15.103:0/2247856597 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98f001e040 con 0x55a77a960370 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.290+0000 7f98e37fe640 1 -- 172.21.15.103:0/2247856597 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f001d070 con 0x55a77a960370 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 -- 172.21.15.103:0/2247856597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 msgr2=0x55a77a958660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 0x55a77a958660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98f0005850 tx=0x7f98f0009fc0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 -- 172.21.15.103:0/2247856597 shutdown_connections 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a960370 0x55a77a958660 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a956b40 0x55a77a958120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 --2- 172.21.15.103:0/2247856597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a9555d0 0x55a77a96c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 -- 172.21.15.103:0/2247856597 >> 172.21.15.103:0/2247856597 conn(0x55a77a91e310 msgr2=0x55a77a95c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 -- 172.21.15.103:0/2247856597 shutdown_connections 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 -- 172.21.15.103:0/2247856597 wait complete. 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 -- start start 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.291+0000 7f99022b5740 1 Processor -- start 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f99022b5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 0x55a77a9641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f99022b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a9646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f99022b5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a960370 0x55a77a964c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f99022b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81adf40 con 0x55a77a956b40 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f99022b5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81af3b0 con 0x55a77a9555d0 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f99022b5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81ae610 con 0x55a77a960370 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fd477640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a9646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fd477640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a9646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58574/0 (socket says 172.21.15.103:58574) 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f99022b5740 10 client.0 _ll_register_callbacks cb 0x7f98e80f3dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fdc78640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 0x55a77a9641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fd477640 1 -- 172.21.15.103:0/1531596766 learned_addr learned my addr 172.21.15.103:0/1531596766 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fe479640 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a960370 0x55a77a964c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fd477640 1 -- 172.21.15.103:0/1531596766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a960370 msgr2=0x55a77a964c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fd477640 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a960370 0x55a77a964c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fd477640 1 -- 172.21.15.103:0/1531596766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 msgr2=0x55a77a9641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fd477640 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 0x55a77a9641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fd477640 1 -- 172.21.15.103:0/1531596766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a77a9d9a50 con 0x55a77a956b40 2024-09-19T06:09:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fdc78640 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 0x55a77a9641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98fd477640 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a9646e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f98e80bc670 tx=0x7f98e80f3ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfed37b3de528d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98e17fa640 1 -- 172.21.15.103:0/1531596766 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8049040 con 0x55a77a956b40 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f98e17fa640 1 -- 172.21.15.103:0/1531596766 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f98e80eddd0 con 0x55a77a956b40 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.292+0000 7f99022b5740 1 -- 172.21.15.103:0/1531596766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98f001e040 con 0x55a77a956b40 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f98e17fa640 1 -- 172.21.15.103:0/1531596766 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f98e80da050 con 0x55a77a956b40 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f99022b5740 10 client.15822 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f99022b5740 1 -- 172.21.15.103:0/1531596766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a77a9dad60 con 0x55a77a956b40 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f98e17fa640 1 -- 172.21.15.103:0/1531596766 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98f001e040 con 0x55a77a956b40 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f98e17fa640 1 -- 172.21.15.103:0/1531596766 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f98e80b8d50 con 0x55a77a956b40 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f99022b5740 10 client.15822 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f99022b5740 10 client.15822 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1975359568, 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628320, 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack" 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2304325334, 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628354, 2024-09-19T06:09:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/LICENSES/GPL-2.0" 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3265255724, 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628327, 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.pack" 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3808012466, 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628321, 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/info" 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4119083925, 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628329, 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.rev" 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4152475832, 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628328, 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.idx" 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:09:36.329 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-19T06:09:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f99022b5740 20 client.15822 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f99022b5740 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55a77a9db510 0x55a77a9dd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f99022b5740 4 client.15822 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:09:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f99022b5740 1 -- 172.21.15.103:0/1531596766 --> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a77a8c2d70 con 0x55a77a9db510 2024-09-19T06:09:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f98fdc78640 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55a77a9db510 0x55a77a9dd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.293+0000 7f98e17fa640 10 client.15822 ms_handle_connect on v2:172.21.15.174:6838/1070224661 2024-09-19T06:09:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f98fdc78640 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55a77a9db510 0x55a77a9dd930 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=776daa7323ee22a3 server_cookie=10126787904c95ce in_seq=0 out_seq=0 2024-09-19T06:09:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f98e17fa640 1 -- 172.21.15.103:0/1531596766 <== mds.1 v2:172.21.15.174:6838/1070224661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1479 (crc 0 0 0) 0x55a77a8c2d70 con 0x55a77a9db510 2024-09-19T06:09:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f98e17fa640 10 client.15822 handle_command_reply: tid=0 2024-09-19T06:09:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 client.15822 shutdown 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 -- 172.21.15.103:0/1531596766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 msgr2=0x55a77a9646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a9646e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f98e80bc670 tx=0x7f98e80f3ad0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 -- 172.21.15.103:0/1531596766 shutdown_connections 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a77a960370 0x55a77a964c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a77a956b40 0x55a77a9646e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.174:6838/1070224661,v1:172.21.15.174:6839/1070224661] conn(0x55a77a9db510 0x55a77a9dd930 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 --2- 172.21.15.103:0/1531596766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a77a9555d0 0x55a77a9641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f98e17fa640 0 client.15822 ms_handle_reset on v2:172.21.15.174:6838/1070224661 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 -- 172.21.15.103:0/1531596766 >> 172.21.15.103:0/1531596766 conn(0x55a77a91e310 msgr2=0x55a77a95e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 -- 172.21.15.103:0/1531596766 shutdown_connections 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 1 -- 172.21.15.103:0/1531596766 wait complete. 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.294+0000 7f99022b5740 20 client.15822 trim_cache size 0 max 16384 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 -- 172.21.15.103:0/1732948805 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f98e40a33b0 msgr2=0x7f98e40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f98e40a33b0 0x7f98e40a5870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55a77a952ac0 tx=0x7f98f4005f90 comp rx=0 tx=0).stop 2024-09-19T06:09:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 -- 172.21.15.103:0/1732948805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f81027a0 msgr2=0x7f98f8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:36.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f81027a0 0x7f98f8074a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98e8005ab0 tx=0x7f98e8003c10 comp rx=0 tx=0).stop 2024-09-19T06:09:36.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 -- 172.21.15.103:0/1732948805 shutdown_connections 2024-09-19T06:09:36.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f98e40a33b0 0x7f98e40a5870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f8106f20 0x7f98f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f81027a0 0x7f98f8074a30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 --2- 172.21.15.103:0/1732948805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98f8101df0 0x7f98f80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:36.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 -- 172.21.15.103:0/1732948805 >> 172.21.15.103:0/1732948805 conn(0x7f98f80fd8f0 msgr2=0x7f98f80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:36.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 -- 172.21.15.103:0/1732948805 shutdown_connections 2024-09-19T06:09:36.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:36.295+0000 7f98ffedc640 1 -- 172.21.15.103:0/1732948805 wait complete. 2024-09-19T06:09:36.401 INFO:tasks.workunit.client.0.smithi103.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-19T06:09:36.401 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-19T06:09:36.458 INFO:tasks.workunit.client.0.smithi103.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-19T06:09:36.613 INFO:tasks.workunit.client.0.smithi103.stdout:checking if gcc static flag -static works... no 2024-09-19T06:09:36.698 INFO:tasks.workunit.client.0.smithi103.stdout:checking if gcc supports -c -o file.o... yes 2024-09-19T06:09:36.698 INFO:tasks.workunit.client.0.smithi103.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-19T06:09:36.705 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-19T06:09:36.817 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether -lc should be explicitly linked in... no 2024-09-19T06:09:36.907 INFO:tasks.workunit.client.0.smithi103.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-19T06:09:36.908 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to hardcode library paths into programs... immediate 2024-09-19T06:09:36.910 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether stripping libraries is possible... yes 2024-09-19T06:09:36.910 INFO:tasks.workunit.client.0.smithi103.stdout:checking if libtool supports shared libraries... yes 2024-09-19T06:09:36.911 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether to build shared libraries... yes 2024-09-19T06:09:36.911 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether to build static libraries... yes 2024-09-19T06:09:36.919 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc... (cached) gcc 2024-09-19T06:09:36.969 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T06:09:36.969 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T06:09:36.970 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T06:09:36.970 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gmake... /usr/bin/gmake 2024-09-19T06:09:36.971 INFO:tasks.workunit.client.0.smithi103.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-19T06:09:36.971 INFO:tasks.workunit.client.0.smithi103.stdout:checking for tar... /bin/tar 2024-09-19T06:09:36.972 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gzip... /bin/gzip 2024-09-19T06:09:36.995 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc -MM is supported... yes 2024-09-19T06:09:36.996 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sort... /bin/sort 2024-09-19T06:09:36.997 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether ln -s works... yes 2024-09-19T06:09:36.997 INFO:tasks.workunit.client.0.smithi103.stdout:checking for rpm... /bin/rpm 2024-09-19T06:09:37.001 INFO:tasks.workunit.client.0.smithi103.stdout:checking for rpmbuild... no 2024-09-19T06:09:37.091 INFO:tasks.workunit.client.0.smithi103.stdout:checking assert.h usability... yes 2024-09-19T06:09:37.112 INFO:tasks.workunit.client.0.smithi103.stdout:checking assert.h presence... yes 2024-09-19T06:09:37.113 INFO:tasks.workunit.client.0.smithi103.stdout:checking for assert.h... yes 2024-09-19T06:09:37.200 INFO:tasks.workunit.client.0.smithi103.stdout:checking bstring.h usability... no 2024-09-19T06:09:37.241 INFO:tasks.workunit.client.0.smithi103.stdout:checking bstring.h presence... no 2024-09-19T06:09:37.241 INFO:tasks.workunit.client.0.smithi103.stdout:checking for bstring.h... no 2024-09-19T06:09:37.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:09:37.298 INFO:tasks.workunit.client.0.smithi103.stdout:checking libgen.h usability... yes 2024-09-19T06:09:37.320 INFO:tasks.workunit.client.0.smithi103.stdout:checking libgen.h presence... yes 2024-09-19T06:09:37.320 INFO:tasks.workunit.client.0.smithi103.stdout:checking for libgen.h... yes 2024-09-19T06:09:37.394 INFO:tasks.workunit.client.0.smithi103.stdout:checking dirent.h usability... yes 2024-09-19T06:09:37.417 INFO:tasks.workunit.client.0.smithi103.stdout:checking dirent.h presence... yes 2024-09-19T06:09:37.417 INFO:tasks.workunit.client.0.smithi103.stdout:checking for dirent.h... yes 2024-09-19T06:09:37.486 INFO:tasks.workunit.client.0.smithi103.stdout:checking errno.h usability... yes 2024-09-19T06:09:37.494 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:37 smithi103 ceph-mon[30925]: pgmap v71: 97 pgs: 97 active+clean; 70 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 233 op/s 2024-09-19T06:09:37.510 INFO:tasks.workunit.client.0.smithi103.stdout:checking errno.h presence... yes 2024-09-19T06:09:37.510 INFO:tasks.workunit.client.0.smithi103.stdout:checking for errno.h... yes 2024-09-19T06:09:37.532 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:37.582 INFO:tasks.workunit.client.0.smithi103.stdout:checking malloc.h usability... yes 2024-09-19T06:09:37.608 INFO:tasks.workunit.client.0.smithi103.stdout:checking malloc.h presence... yes 2024-09-19T06:09:37.608 INFO:tasks.workunit.client.0.smithi103.stdout:checking for malloc.h... yes 2024-09-19T06:09:37.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:37 smithi174 ceph-mon[34488]: pgmap v71: 97 pgs: 97 active+clean; 70 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 233 op/s 2024-09-19T06:09:37.706 INFO:tasks.workunit.client.0.smithi103.stdout:checking uuid.h usability... no 2024-09-19T06:09:37.750 INFO:tasks.workunit.client.0.smithi103.stdout:checking uuid.h presence... no 2024-09-19T06:09:37.750 INFO:tasks.workunit.client.0.smithi103.stdout:checking for uuid.h... no 2024-09-19T06:09:37.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:37 smithi169 ceph-mon[34350]: pgmap v71: 97 pgs: 97 active+clean; 70 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 233 op/s 2024-09-19T06:09:37.819 INFO:tasks.workunit.client.0.smithi103.stdout:checking uuid/uuid.h usability... yes 2024-09-19T06:09:37.844 INFO:tasks.workunit.client.0.smithi103.stdout:checking uuid/uuid.h presence... yes 2024-09-19T06:09:37.845 INFO:tasks.workunit.client.0.smithi103.stdout:checking for uuid/uuid.h... yes 2024-09-19T06:09:37.939 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/uuid.h usability... no 2024-09-19T06:09:37.983 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/uuid.h presence... no 2024-09-19T06:09:37.984 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/uuid.h... no 2024-09-19T06:09:38.056 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/file.h usability... yes 2024-09-19T06:09:38.080 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/file.h presence... yes 2024-09-19T06:09:38.081 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/file.h... yes 2024-09-19T06:09:38.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.048+0000 7fd963333640 1 -- 172.21.15.103:0/1329950945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c101e10 msgr2=0x7fd95c1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.048+0000 7fd963333640 1 --2- 172.21.15.103:0/1329950945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c101e10 0x7fd95c1021f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd958009900 tx=0x7fd95802a410 comp rx=0 tx=0).stop 2024-09-19T06:09:38.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.048+0000 7fd963333640 1 -- 172.21.15.103:0/1329950945 shutdown_connections 2024-09-19T06:09:38.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.048+0000 7fd963333640 1 --2- 172.21.15.103:0/1329950945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95c106f40 0x7fd95c10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.049+0000 7fd963333640 1 --2- 172.21.15.103:0/1329950945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd95c1027c0 0x7fd95c106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.049+0000 7fd963333640 1 --2- 172.21.15.103:0/1329950945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c101e10 0x7fd95c1021f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.049+0000 7fd963333640 1 -- 172.21.15.103:0/1329950945 >> 172.21.15.103:0/1329950945 conn(0x7fd95c0fd8d0 msgr2=0x7fd95c0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:38.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.049+0000 7fd963333640 1 -- 172.21.15.103:0/1329950945 shutdown_connections 2024-09-19T06:09:38.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.049+0000 7fd963333640 1 -- 172.21.15.103:0/1329950945 wait complete. 2024-09-19T06:09:38.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.049+0000 7fd963333640 1 Processor -- start 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.049+0000 7fd963333640 1 -- start start 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd963333640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c101e10 0x7fd95c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd963333640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd95c1027c0 0x7fd95c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd963333640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95c106f40 0x7fd95c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd963333640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c111e50 con 0x7fd95c101e10 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd963333640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c111cd0 con 0x7fd95c106f40 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd963333640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c111fd0 con 0x7fd95c1027c0 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9610cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c101e10 0x7fd95c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9608ce640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd95c1027c0 0x7fd95c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9610cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c101e10 0x7fd95c198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58590/0 (socket says 172.21.15.103:58590) 2024-09-19T06:09:38.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9610cf640 1 -- 172.21.15.103:0/4222455549 learned_addr learned my addr 172.21.15.103:0/4222455549 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9618d0640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95c106f40 0x7fd95c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9608ce640 1 -- 172.21.15.103:0/4222455549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95c106f40 msgr2=0x7fd95c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9608ce640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95c106f40 0x7fd95c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9608ce640 1 -- 172.21.15.103:0/4222455549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c101e10 msgr2=0x7fd95c198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9608ce640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c101e10 0x7fd95c198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9608ce640 1 -- 172.21.15.103:0/4222455549 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c19d320 con 0x7fd95c1027c0 2024-09-19T06:09:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9610cf640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c101e10 0x7fd95c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.050+0000 7fd9608ce640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd95c1027c0 0x7fd95c1988b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00e9f0 tx=0x7fd94c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.051+0000 7fd9527fc640 1 -- 172.21.15.103:0/4222455549 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00ccc0 con 0x7fd95c1027c0 2024-09-19T06:09:38.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.051+0000 7fd963333640 1 -- 172.21.15.103:0/4222455549 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95c19d610 con 0x7fd95c1027c0 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.051+0000 7fd9527fc640 1 -- 172.21.15.103:0/4222455549 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd94c005020 con 0x7fd95c1027c0 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.051+0000 7fd9527fc640 1 -- 172.21.15.103:0/4222455549 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00ce60 con 0x7fd95c1027c0 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.051+0000 7fd963333640 1 -- 172.21.15.103:0/4222455549 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95c1a4ef0 con 0x7fd95c1027c0 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.053+0000 7fd9527fc640 1 -- 172.21.15.103:0/4222455549 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7fd94c0051d0 con 0x7fd95c1027c0 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.053+0000 7fd96570c740 1 Processor -- start 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd96570c740 1 -- start start 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd96570c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824fb40 0x55856824e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd96570c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x55856824ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd96570c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558568259370 0x55856825b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd96570c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5585681b42f0 con 0x558568259370 2024-09-19T06:09:38.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd96570c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55856815bcf0 con 0x55856824e5d0 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd96570c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5585681b02b0 con 0x55856824fb40 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9527fc640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9480a3430 0x7fd9480a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9608ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558568259370 0x55856825b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9610cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x55856824ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9618d0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824fb40 0x55856824e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9610cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x55856824ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:45056/0 (socket says 172.21.15.103:45056) 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9618d0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824fb40 0x55856824e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:51208/0 (socket says 172.21.15.103:51208) 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9610cf640 1 -- 172.21.15.103:0/2906231000 learned_addr learned my addr 172.21.15.103:0/2906231000 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9618d0640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9480a3430 0x7fd9480a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9610cf640 1 -- 172.21.15.103:0/2906231000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824fb40 msgr2=0x55856824e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9610cf640 1 --2- 172.21.15.103:0/2906231000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824fb40 0x55856824e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9610cf640 1 -- 172.21.15.103:0/2906231000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558568259370 msgr2=0x55856825b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9610cf640 1 --2- 172.21.15.103:0/2906231000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558568259370 0x55856825b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9610cf640 1 -- 172.21.15.103:0/2906231000 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585681403a0 con 0x55856824e5d0 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.054+0000 7fd9527fc640 1 -- 172.21.15.103:0/4222455549 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fd94c0cfb90 con 0x7fd95c1027c0 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.055+0000 7fd9610cf640 1 --2- 172.21.15.103:0/2906231000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x55856824ea10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd958000c00 tx=0x7fd958032eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=235608e93d6e75e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.055+0000 7fd9618d0640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9480a3430 0x7fd9480a58f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd954005fd0 tx=0x7fd954009500 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.055+0000 7fd9477fe640 1 -- 172.21.15.103:0/2906231000 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958035040 con 0x55856824e5d0 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.055+0000 7fd9477fe640 1 -- 172.21.15.103:0/2906231000 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9580317a0 con 0x55856824e5d0 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.055+0000 7fd9477fe640 1 -- 172.21.15.103:0/2906231000 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958004a00 con 0x55856824e5d0 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 -- 172.21.15.103:0/2906231000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 msgr2=0x55856824ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 --2- 172.21.15.103:0/2906231000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x55856824ea10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd958000c00 tx=0x7fd958032eb0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 -- 172.21.15.103:0/2906231000 shutdown_connections 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 --2- 172.21.15.103:0/2906231000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558568259370 0x55856825b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 --2- 172.21.15.103:0/2906231000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x55856824ea10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 --2- 172.21.15.103:0/2906231000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824fb40 0x55856824e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 -- 172.21.15.103:0/2906231000 >> 172.21.15.103:0/2906231000 conn(0x558568217310 msgr2=0x55856824ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 -- 172.21.15.103:0/2906231000 shutdown_connections 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 -- 172.21.15.103:0/2906231000 wait complete. 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 -- start start 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.056+0000 7fd96570c740 1 Processor -- start 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd96570c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 0x558568258d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd96570c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568255fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd96570c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 0x558568256570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd96570c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55856825c010 con 0x55856824fb40 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd96570c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55856816f060 con 0x558568259370 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd96570c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55856825c190 con 0x55856824e5d0 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd96570c740 10 client.0 _ll_register_callbacks cb 0x558567ec28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9608ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568255fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9608ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568255fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58620/0 (socket says 172.21.15.103:58620) 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9608ce640 1 -- 172.21.15.103:0/3472444484 learned_addr learned my addr 172.21.15.103:0/3472444484 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9618d0640 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 0x558568256570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9610cf640 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 0x558568258d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9608ce640 1 -- 172.21.15.103:0/3472444484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 msgr2=0x558568258d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9608ce640 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 0x558568258d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9608ce640 1 -- 172.21.15.103:0/3472444484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 msgr2=0x558568256570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9608ce640 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 0x558568256570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9608ce640 1 -- 172.21.15.103:0/3472444484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558567f253c0 con 0x55856824fb40 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9618d0640 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 0x558568256570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd9608ce640 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568255fd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd94c004610 tx=0x7fd94c09bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3134adb02e1bfaa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.057+0000 7fd944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd944ff9640 1 -- 172.21.15.103:0/3472444484 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c01c040 con 0x55856824fb40 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd96570c740 1 -- 172.21.15.103:0/3472444484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9580317a0 con 0x55856824fb40 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd944ff9640 1 -- 172.21.15.103:0/3472444484 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fd94c0a48a0 con 0x55856824fb40 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd944ff9640 1 -- 172.21.15.103:0/3472444484 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd94c09c5c0 con 0x55856824fb40 2024-09-19T06:09:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd96570c740 10 client.15834 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd96570c740 1 -- 172.21.15.103:0/3472444484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558568267ac0 con 0x55856824fb40 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd944ff9640 1 -- 172.21.15.103:0/3472444484 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9580317a0 con 0x55856824fb40 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd944ff9640 1 -- 172.21.15.103:0/3472444484 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd94c0bac90 con 0x55856824fb40 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd96570c740 10 client.15834 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd96570c740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd96570c740 20 client.15834 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd96570c740 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558568268f80 0x55856826b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd96570c740 4 client.15834 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.058+0000 7fd96570c740 1 -- 172.21.15.103:0/3472444484 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585681c1860 con 0x558568268f80 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.059+0000 7fd9610cf640 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558568268f80 0x55856826b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.059+0000 7fd9610cf640 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558568268f80 0x55856826b3c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b406f12c176e0092 server_cookie=576b72e2c0dabee3 in_seq=0 out_seq=0 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.059+0000 7fd944ff9640 10 client.15834 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd944ff9640 1 -- 172.21.15.103:0/3472444484 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585681c1860 con 0x558568268f80 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd944ff9640 10 client.15834 handle_command_reply: tid=0 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 client.15834 shutdown 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 -- 172.21.15.103:0/3472444484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 msgr2=0x558568255fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568255fd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd94c004610 tx=0x7fd94c09bd90 comp rx=0 tx=0).stop 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 -- 172.21.15.103:0/3472444484 shutdown_connections 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558568268f80 0x55856826b3c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 0x558568256570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568255fd0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd944ff9640 0 client.15834 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 --2- 172.21.15.103:0/3472444484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 0x558568258d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 -- 172.21.15.103:0/3472444484 >> 172.21.15.103:0/3472444484 conn(0x558568217310 msgr2=0x558568250960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 -- 172.21.15.103:0/3472444484 shutdown_connections 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.060+0000 7fd96570c740 1 -- 172.21.15.103:0/3472444484 wait complete. 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.061+0000 7fd96570c740 20 client.15834 trim_cache size 0 max 16384 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd96570c740 1 Processor -- start 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd96570c740 1 -- start start 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd96570c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 0x55856824ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd96570c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x5585682652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd96570c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 0x558568270c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd96570c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1add60 con 0x55856824fb40 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd96570c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1ab630 con 0x558568259370 2024-09-19T06:09:38.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd96570c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1a9460 con 0x55856824e5d0 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9608ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x5585682652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9610cf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 0x55856824ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9608ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x5585682652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58626/0 (socket says 172.21.15.103:58626) 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9610cf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 0x55856824ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:51226/0 (socket says 172.21.15.103:51226) 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9608ce640 1 -- 172.21.15.103:0/1312546356 learned_addr learned my addr 172.21.15.103:0/1312546356 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9618d0640 1 --2- 172.21.15.103:0/1312546356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 0x558568270c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9610cf640 1 -- 172.21.15.103:0/1312546356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 msgr2=0x558568270c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9610cf640 1 --2- 172.21.15.103:0/1312546356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 0x558568270c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9610cf640 1 -- 172.21.15.103:0/1312546356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 msgr2=0x5585682652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9610cf640 1 --2- 172.21.15.103:0/1312546356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x5585682652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.075+0000 7fd9610cf640 1 -- 172.21.15.103:0/1312546356 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558568251120 con 0x55856824e5d0 2024-09-19T06:09:38.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.076+0000 7fd9610cf640 1 --2- 172.21.15.103:0/1312546356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 0x55856824ae10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd958009a20 tx=0x7fd958049040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd5a764446aeb0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.076+0000 7fd946ffd640 1 -- 172.21.15.103:0/1312546356 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958057070 con 0x55856824e5d0 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.076+0000 7fd946ffd640 1 -- 172.21.15.103:0/1312546356 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd958031820 con 0x55856824e5d0 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.076+0000 7fd946ffd640 1 -- 172.21.15.103:0/1312546356 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958035040 con 0x55856824e5d0 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 -- 172.21.15.103:0/1312546356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 msgr2=0x55856824ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 --2- 172.21.15.103:0/1312546356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 0x55856824ae10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd958009a20 tx=0x7fd958049040 comp rx=0 tx=0).stop 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 -- 172.21.15.103:0/1312546356 shutdown_connections 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 --2- 172.21.15.103:0/1312546356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558568259370 0x558568270c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 --2- 172.21.15.103:0/1312546356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x5585682652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 --2- 172.21.15.103:0/1312546356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55856824e5d0 0x55856824ae10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 -- 172.21.15.103:0/1312546356 >> 172.21.15.103:0/1312546356 conn(0x558568217310 msgr2=0x55856824a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:38.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 -- 172.21.15.103:0/1312546356 shutdown_connections 2024-09-19T06:09:38.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 -- 172.21.15.103:0/1312546356 wait complete. 2024-09-19T06:09:38.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 -- start start 2024-09-19T06:09:38.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.077+0000 7fd96570c740 1 Processor -- start 2024-09-19T06:09:38.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd96570c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x558568261420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd96570c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568261960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd96570c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558568259370 0x55856825e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd96570c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1a9af0 con 0x55856824fb40 2024-09-19T06:09:38.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd96570c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1aaf60 con 0x55856824e5d0 2024-09-19T06:09:38.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd96570c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1aa1c0 con 0x558568259370 2024-09-19T06:09:38.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd96570c740 10 client.0 _ll_register_callbacks cb 0x7fd94c098250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9608ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568261960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9608ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568261960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58628/0 (socket says 172.21.15.103:58628) 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9608ce640 1 -- 172.21.15.103:0/855616755 learned_addr learned my addr 172.21.15.103:0/855616755 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9610cf640 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x558568261420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9618d0640 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558568259370 0x55856825e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9608ce640 1 -- 172.21.15.103:0/855616755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558568259370 msgr2=0x55856825e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9608ce640 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558568259370 0x55856825e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9608ce640 1 -- 172.21.15.103:0/855616755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 msgr2=0x558568261420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9608ce640 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x558568261420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9608ce640 1 -- 172.21.15.103:0/855616755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558568253f30 con 0x55856824fb40 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9610cf640 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x558568261420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:38.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd9608ce640 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568261960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd94c09a170 tx=0x7fd94c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831cd52ea76ebcf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd944ff9640 1 -- 172.21.15.103:0/855616755 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c0a8070 con 0x55856824fb40 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd944ff9640 1 -- 172.21.15.103:0/855616755 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fd94c0a48a0 con 0x55856824fb40 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.078+0000 7fd96570c740 1 -- 172.21.15.103:0/855616755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd958031820 con 0x55856824fb40 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd944ff9640 1 -- 172.21.15.103:0/855616755 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd94c01c040 con 0x55856824fb40 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd96570c740 10 client.15840 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd96570c740 1 -- 172.21.15.103:0/855616755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5585682d4150 con 0x55856824fb40 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd944ff9640 1 -- 172.21.15.103:0/855616755 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd94c0a0270 con 0x55856824fb40 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd944ff9640 1 -- 172.21.15.103:0/855616755 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd94c0ab030 con 0x55856824fb40 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd96570c740 10 client.15840 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:38.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd96570c740 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd96570c740 20 client.15840 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd96570c740 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5585682d4740 0x5585682d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd96570c740 4 client.15840 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd96570c740 1 -- 172.21.15.103:0/855616755 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd958031820 con 0x5585682d4740 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.079+0000 7fd9610cf640 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5585682d4740 0x5585682d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd944ff9640 10 client.15840 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd9610cf640 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5585682d4740 0x5585682d6b60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21b661a792b196cc server_cookie=f0747f391ecb7f4 in_seq=0 out_seq=0 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd944ff9640 1 -- 172.21.15.103:0/855616755 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd958031820 con 0x5585682d4740 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd944ff9640 10 client.15840 handle_command_reply: tid=0 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 client.15840 shutdown 2024-09-19T06:09:38.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 -- 172.21.15.103:0/855616755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 msgr2=0x558568261960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568261960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd94c09a170 tx=0x7fd94c00c7d0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 -- 172.21.15.103:0/855616755 shutdown_connections 2024-09-19T06:09:38.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5585682d4740 0x5585682d6b60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd944ff9640 0 client.15840 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:38.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558568259370 0x55856825e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55856824fb40 0x558568261960 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 --2- 172.21.15.103:0/855616755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55856824e5d0 0x558568261420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 -- 172.21.15.103:0/855616755 >> 172.21.15.103:0/855616755 conn(0x558568217310 msgr2=0x558568257830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:38.103 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-09-19T06:09:38.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 -- 172.21.15.103:0/855616755 shutdown_connections 2024-09-19T06:09:38.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 1 -- 172.21.15.103:0/855616755 wait complete. 2024-09-19T06:09:38.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.080+0000 7fd96570c740 20 client.15840 trim_cache size 0 max 16384 2024-09-19T06:09:38.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 -- 172.21.15.103:0/4222455549 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9480a3430 msgr2=0x7fd9480a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9480a3430 0x7fd9480a58f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd954005fd0 tx=0x7fd954009500 comp rx=0 tx=0).stop 2024-09-19T06:09:38.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 -- 172.21.15.103:0/4222455549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd95c1027c0 msgr2=0x7fd95c1988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd95c1027c0 0x7fd95c1988b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00e9f0 tx=0x7fd94c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 -- 172.21.15.103:0/4222455549 shutdown_connections 2024-09-19T06:09:38.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fd9480a3430 0x7fd9480a58f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95c106f40 0x7fd95c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd95c1027c0 0x7fd95c1988b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 --2- 172.21.15.103:0/4222455549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c101e10 0x7fd95c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 -- 172.21.15.103:0/4222455549 >> 172.21.15.103:0/4222455549 conn(0x7fd95c0fd8d0 msgr2=0x7fd95c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:38.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.081+0000 7fd963333640 1 -- 172.21.15.103:0/4222455549 shutdown_connections 2024-09-19T06:09:38.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:09:38.082+0000 7fd963333640 1 -- 172.21.15.103:0/4222455549 wait complete. 2024-09-19T06:09:38.166 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/fcntl.h usability... yes 2024-09-19T06:09:38.188 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/fcntl.h presence... yes 2024-09-19T06:09:38.189 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/fcntl.h... yes 2024-09-19T06:09:38.279 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/syssgi.h usability... no 2024-09-19T06:09:38.324 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/syssgi.h presence... no 2024-09-19T06:09:38.324 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/syssgi.h... no 2024-09-19T06:09:38.611 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/param.h usability... yes 2024-09-19T06:09:38.637 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/param.h presence... yes 2024-09-19T06:09:38.638 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/param.h... yes 2024-09-19T06:09:38.662 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/stat.h... (cached) yes 2024-09-19T06:09:38.747 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/statvfs.h usability... yes 2024-09-19T06:09:38.770 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/statvfs.h presence... yes 2024-09-19T06:09:38.770 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/statvfs.h... yes 2024-09-19T06:09:38.838 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/time.h usability... yes 2024-09-19T06:09:38.861 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/time.h presence... yes 2024-09-19T06:09:38.861 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/time.h... yes 2024-09-19T06:09:38.938 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/ioctl.h usability... yes 2024-09-19T06:09:38.954 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 26954374, 'ino': 1099511628415, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/reflink'}, {'damage_type': 'backtrace', 'id': 67541233, 'ino': 1099511628380, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ceph'}, {'damage_type': 'backtrace', 'id': 113371225, 'ino': 1099511627785, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/description'}, {'damage_type': 'backtrace', 'id': 136586525, 'ino': 1099511628346, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads'}, {'damage_type': 'backtrace', 'id': 141596033, 'ino': 1099511628305, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample'}, {'damage_type': 'backtrace', 'id': 212702769, 'ino': 1099511628303, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample'}, {'damage_type': 'backtrace', 'id': 262432302, 'ino': 1099511628300, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample'}, {'damage_type': 'backtrace', 'id': 262928759, 'ino': 1099511628309, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs'}, {'damage_type': 'backtrace', 'id': 325490625, 'ino': 1099511628302, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample'}, {'damage_type': 'backtrace', 'id': 328001271, 'ino': 1099511628420, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/test_names'}, {'damage_type': 'backtrace', 'id': 413560776, 'ino': 1099511628403, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/log'}, {'damage_type': 'backtrace', 'id': 440931478, 'ino': 1099511628378, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/btrfs'}, {'damage_type': 'backtrace', 'id': 453710586, 'ino': 1099511628396, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filestreams'}, {'damage_type': 'backtrace', 'id': 492156454, 'ino': 1099511628347, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master'}, {'damage_type': 'backtrace', 'id': 540003260, 'ino': 1099511628409, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/perf'}, {'damage_type': 'backtrace', 'id': 600201803, 'ino': 1099511628338, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs'}, {'damage_type': 'backtrace', 'id': 659533073, 'ino': 1099511628293, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks'}, {'damage_type': 'backtrace', 'id': 707958821, 'ino': 1099511628379, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/casefold'}, {'damage_type': 'backtrace', 'id': 710482957, 'ino': 1099511628333, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/packed-refs'}, {'damage_type': 'backtrace', 'id': 755600170, 'ino': 1099511628308, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/branches'}, {'damage_type': 'backtrace', 'id': 899676218, 'ino': 1099511628383, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/defrag'}, {'damage_type': 'backtrace', 'id': 964071864, 'ino': 1099511628304, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample'}, {'damage_type': 'backtrace', 'id': 1035179068, 'ino': 1099511628382, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/config'}, {'damage_type': 'backtrace', 'id': 1118802668, 'ino': 1099511628301, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/sendemail-validate.sample'}, {'damage_type': 'backtrace', 'id': 1140500354, 'ino': 1099511628345, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/HEAD'}, {'damage_type': 'backtrace', 'id': 1144050549, 'ino': 1099511628311, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/tags'}, {'damage_type': 'backtrace', 'id': 1145547548, 'ino': 1099511628344, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads/master'}, {'damage_type': 'backtrace', 'id': 1164015390, 'ino': 1099511628395, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fail_make_request'}, {'damage_type': 'backtrace', 'id': 1191308161, 'ino': 1099511628299, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample'}, {'damage_type': 'backtrace', 'id': 1193798637, 'ino': 1099511628337, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs'}, {'damage_type': 'backtrace', 'id': 1251157505, 'ino': 1099511628393, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ext4'}, {'damage_type': 'backtrace', 'id': 1255622966, 'ino': 1099511628414, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/rc'}, {'damage_type': 'backtrace', 'id': 1280631593, 'ino': 1099511628339, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes'}, {'damage_type': 'backtrace', 'id': 1366856081, 'ino': 1099511628418, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/report'}, {'damage_type': 'backtrace', 'id': 1395143080, 'ino': 1099511628399, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/fuzzy'}, {'damage_type': 'backtrace', 'id': 1412625153, 'ino': 1099511628423, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/verity'}, {'damage_type': 'backtrace', 'id': 1522124755, 'ino': 1099511628334, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes'}, {'damage_type': 'backtrace', 'id': 1574443024, 'ino': 1099511628295, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample'}, {'damage_type': 'backtrace', 'id': 1580364069, 'ino': 1099511628390, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmthin'}, {'damage_type': 'backtrace', 'id': 1617738625, 'ino': 1099511628424, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/xfs'}, {'damage_type': 'backtrace', 'id': 1687808312, 'ino': 1099511628394, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/f2fs'}, {'damage_type': 'backtrace', 'id': 1713595521, 'ino': 1099511628413, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/quota'}, {'damage_type': 'backtrace', 'id': 1776022760, 'ino': 1099511628385, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdust'}, {'damage_type': 'backtrace', 'id': 1904246637, 'ino': 1099511628419, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/scsi_debug'}, {'damage_type': 'backtrace', 'id': 1916128437, 'ino': 1099511628292, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info/exclude'}, {'damage_type': 'backtrace', 'id': 1925740535, 'ino': 1099511628386, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmerror'}, {'damage_type': 'backtrace', 'id': 1986209229, 'ino': 1099511628319, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects'}, {'damage_type': 'backtrace', 'id': 1995901777, 'ino': 1099511628401, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/inject'}, {'damage_type': 'backtrace', 'id': 2057203963, 'ino': 1099511628392, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/encrypt'}, {'damage_type': 'backtrace', 'id': 2159025420, 'ino': 1099511628298, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample'}, {'damage_type': 'backtrace', 'id': 2223951676, 'ino': 1099511628336, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD'}, {'damage_type': 'backtrace', 'id': 2384629731, 'ino': 1099511628412, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/punch'}, {'damage_type': 'backtrace', 'id': 2384846817, 'ino': 1099511628296, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample'}, {'damage_type': 'backtrace', 'id': 2542435508, 'ino': 1099511628411, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/preamble'}, {'damage_type': 'backtrace', 'id': 2553750268, 'ino': 1099511628381, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/cgroup2'}, {'damage_type': 'backtrace', 'id': 2586302678, 'ino': 1099511628404, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/metadump'}, {'damage_type': 'backtrace', 'id': 2606912399, 'ino': 1099511628294, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample'}, {'damage_type': 'backtrace', 'id': 2638681757, 'ino': 1099511628407, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/overlay'}, {'damage_type': 'backtrace', 'id': 2639542632, 'ino': 1099511628410, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/populate'}, {'damage_type': 'backtrace', 'id': 2652237299, 'ino': 1099511628416, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/renameat2'}, {'damage_type': 'backtrace', 'id': 2663916666, 'ino': 1099511628402, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/locktest'}, {'damage_type': 'backtrace', 'id': 2795312498, 'ino': 1099511628421, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/tracing'}, {'damage_type': 'backtrace', 'id': 3040971015, 'ino': 1099511628291, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/info'}, {'damage_type': 'backtrace', 'id': 3136333155, 'ino': 1099511628331, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/shallow'}, {'damage_type': 'backtrace', 'id': 3136749498, 'ino': 1099511628391, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dump'}, {'damage_type': 'backtrace', 'id': 3175034291, 'ino': 1099511628340, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin'}, {'damage_type': 'backtrace', 'id': 3283115983, 'ino': 1099511628406, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/nfs'}, {'damage_type': 'backtrace', 'id': 3320658366, 'ino': 1099511628342, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/HEAD'}, {'damage_type': 'backtrace', 'id': 3404389185, 'ino': 1099511628398, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter.btrfs'}, {'damage_type': 'backtrace', 'id': 3442152334, 'ino': 1099511628397, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/filter'}, {'damage_type': 'backtrace', 'id': 3492626103, 'ino': 1099511628307, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample'}, {'damage_type': 'backtrace', 'id': 3504046152, 'ino': 1099511628377, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/attr'}, {'damage_type': 'backtrace', 'id': 3522378162, 'ino': 1099511628422, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/ubifs'}, {'damage_type': 'backtrace', 'id': 3528477559, 'ino': 1099511628408, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/parent'}, {'damage_type': 'backtrace', 'id': 3567835919, 'ino': 1099511628341, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD'}, {'damage_type': 'backtrace', 'id': 3570796926, 'ino': 1099511628297, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample'}, {'damage_type': 'backtrace', 'id': 3617639600, 'ino': 1099511628310, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/heads'}, {'damage_type': 'backtrace', 'id': 3642877177, 'ino': 1099511628387, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmflakey'}, {'damage_type': 'backtrace', 'id': 3713585021, 'ino': 1099511628384, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmdelay'}, {'damage_type': 'backtrace', 'id': 3722630212, 'ino': 1099511628388, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmhugedisk'}, {'damage_type': 'backtrace', 'id': 3728706488, 'ino': 1099511628389, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/dmlogwrites'}, {'damage_type': 'backtrace', 'id': 3731678442, 'ino': 1099511628417, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/repair'}, {'damage_type': 'backtrace', 'id': 3883263216, 'ino': 1099511628335, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/refs/remotes/origin'}, {'damage_type': 'backtrace', 'id': 3884226855, 'ino': 1099511628350, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/config'}, {'damage_type': 'backtrace', 'id': 3895654602, 'ino': 1099511628351, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/index.lock'}, {'damage_type': 'backtrace', 'id': 3903122054, 'ino': 1099511628306, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/hooks/update.sample'}, {'damage_type': 'backtrace', 'id': 3954764177, 'ino': 1099511628400, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/gcov'}, {'damage_type': 'backtrace', 'id': 4264502208, 'ino': 1099511628425, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/zoned'}, {'damage_type': 'backtrace', 'id': 4286255114, 'ino': 1099511628376, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/Makefile'}, {'damage_type': 'backtrace', 'id': 4286941463, 'ino': 1099511628405, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/common/module'}] 2024-09-19T06:09:38.954 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 1975359568, 'ino': 1099511628320, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack'}, {'damage_type': 'backtrace', 'id': 2304325334, 'ino': 1099511628354, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/LICENSES/GPL-2.0'}, {'damage_type': 'backtrace', 'id': 3265255724, 'ino': 1099511628327, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.pack'}, {'damage_type': 'backtrace', 'id': 3808012466, 'ino': 1099511628321, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/info'}, {'damage_type': 'backtrace', 'id': 4119083925, 'ino': 1099511628329, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.rev'}, {'damage_type': 'backtrace', 'id': 4152475832, 'ino': 1099511628328, 'path': '/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/objects/pack/pack-9baf72361dc7e7c84b64cd09cbfd32d41bef8f67.idx'}] 2024-09-19T06:09:38.954 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-09-19T06:09:38.961 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/ioctl.h presence... yes 2024-09-19T06:09:38.961 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/ioctl.h... yes 2024-09-19T06:09:39.047 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/wait.h usability... yes 2024-09-19T06:09:39.074 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/wait.h presence... yes 2024-09-19T06:09:39.074 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/wait.h... yes 2024-09-19T06:09:39.100 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/types.h... (cached) yes 2024-09-19T06:09:39.121 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strings.h... (cached) yes 2024-09-19T06:09:39.187 INFO:tasks.workunit.client.0.smithi103.stdout:checking err.h usability... yes 2024-09-19T06:09:39.211 INFO:tasks.workunit.client.0.smithi103.stdout:checking err.h presence... yes 2024-09-19T06:09:39.211 INFO:tasks.workunit.client.0.smithi103.stdout:checking for err.h... yes 2024-09-19T06:09:39.281 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/falloc.h usability... yes 2024-09-19T06:09:39.301 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/falloc.h presence... yes 2024-09-19T06:09:39.302 INFO:tasks.workunit.client.0.smithi103.stdout:checking for linux/falloc.h... yes 2024-09-19T06:09:39.376 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-19T06:09:39.420 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-19T06:09:39.421 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-19T06:09:39.482 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-19T06:09:39.520 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-19T06:09:39.521 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-19T06:09:39.582 INFO:tasks.workunit.client.0.smithi103.stdout:checking xfs/platform_defs.h usability... no 2024-09-19T06:09:39.625 INFO:tasks.workunit.client.0.smithi103.stdout:checking xfs/platform_defs.h presence... no 2024-09-19T06:09:39.626 INFO:tasks.workunit.client.0.smithi103.stdout:checking for xfs/platform_defs.h... no 2024-09-19T06:09:39.686 INFO:tasks.workunit.client.0.smithi103.stdout:checking btrfs/ioctl.h usability... no 2024-09-19T06:09:39.703 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:39 smithi174 ceph-mon[34488]: pgmap v72: 97 pgs: 97 active+clean; 70 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 836 KiB/s wr, 123 op/s 2024-09-19T06:09:39.723 INFO:tasks.workunit.client.0.smithi103.stdout:checking btrfs/ioctl.h presence... no 2024-09-19T06:09:39.723 INFO:tasks.workunit.client.0.smithi103.stdout:checking for btrfs/ioctl.h... no 2024-09-19T06:09:39.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:39 smithi103 ceph-mon[30925]: pgmap v72: 97 pgs: 97 active+clean; 70 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 836 KiB/s wr, 123 op/s 2024-09-19T06:09:39.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:39 smithi169 ceph-mon[34350]: pgmap v72: 97 pgs: 97 active+clean; 70 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 836 KiB/s wr, 123 op/s 2024-09-19T06:09:39.783 INFO:tasks.workunit.client.0.smithi103.stdout:checking cifs/ioctl.h usability... no 2024-09-19T06:09:39.822 INFO:tasks.workunit.client.0.smithi103.stdout:checking cifs/ioctl.h presence... no 2024-09-19T06:09:39.822 INFO:tasks.workunit.client.0.smithi103.stdout:checking for cifs/ioctl.h... no 2024-09-19T06:09:39.889 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/mman.h usability... yes 2024-09-19T06:09:39.911 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/mman.h presence... yes 2024-09-19T06:09:39.911 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/mman.h... yes 2024-09-19T06:09:39.989 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/ext4.h usability... no 2024-09-19T06:09:40.030 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/ext4.h presence... no 2024-09-19T06:09:40.030 INFO:tasks.workunit.client.0.smithi103.stdout:checking for linux/ext4.h... no 2024-09-19T06:09:40.072 INFO:tasks.workunit.client.0.smithi103.stdout:checking for xfs/xfs_log_format.h... no 2024-09-19T06:09:40.158 INFO:tasks.workunit.client.0.smithi103.stdout:checking for uuid_compare... no 2024-09-19T06:09:40.218 INFO:tasks.workunit.client.0.smithi103.stdout:checking for uuid_compare in -luuid... yes 2024-09-19T06:09:40.318 INFO:tasks.workunit.client.0.smithi103.stdout:checking for xfs/xfs.h... yes 2024-09-19T06:09:40.360 INFO:tasks.workunit.client.0.smithi103.stdout:checking for xfs/libxfs.h... no 2024-09-19T06:09:40.404 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-19T06:09:40.451 INFO:tasks.workunit.client.0.smithi103.stdout:checking for xfs/xqm.h... yes 2024-09-19T06:09:40.528 INFO:tasks.workunit.client.0.smithi103.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-19T06:09:40.575 INFO:tasks.workunit.client.0.smithi103.stdout:checking xfs/handle.h usability... yes 2024-09-19T06:09:40.596 INFO:tasks.workunit.client.0.smithi103.stdout:checking xfs/handle.h presence... yes 2024-09-19T06:09:40.596 INFO:tasks.workunit.client.0.smithi103.stdout:checking for xfs/handle.h... yes 2024-09-19T06:09:40.677 INFO:tasks.workunit.client.0.smithi103.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-19T06:09:40.727 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/acl.h usability... yes 2024-09-19T06:09:40.750 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/acl.h presence... yes 2024-09-19T06:09:40.750 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/acl.h... yes 2024-09-19T06:09:40.803 INFO:tasks.workunit.client.0.smithi103.stdout:checking acl/libacl.h usability... yes 2024-09-19T06:09:40.824 INFO:tasks.workunit.client.0.smithi103.stdout:checking acl/libacl.h presence... yes 2024-09-19T06:09:40.825 INFO:tasks.workunit.client.0.smithi103.stdout:checking for acl/libacl.h... yes 2024-09-19T06:09:40.893 INFO:tasks.workunit.client.0.smithi103.stdout:checking for acl_init in -lacl... yes 2024-09-19T06:09:40.950 INFO:tasks.workunit.client.0.smithi103.stdout:checking gdbm-ndbm.h usability... no 2024-09-19T06:09:40.989 INFO:tasks.workunit.client.0.smithi103.stdout:checking gdbm-ndbm.h presence... no 2024-09-19T06:09:40.989 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gdbm-ndbm.h... no 2024-09-19T06:09:41.041 INFO:tasks.workunit.client.0.smithi103.stdout:checking gdbm/ndbm.h usability... no 2024-09-19T06:09:41.079 INFO:tasks.workunit.client.0.smithi103.stdout:checking gdbm/ndbm.h presence... no 2024-09-19T06:09:41.079 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gdbm/ndbm.h... no 2024-09-19T06:09:41.127 INFO:tasks.workunit.client.0.smithi103.stdout:checking ndbm.h usability... no 2024-09-19T06:09:41.169 INFO:tasks.workunit.client.0.smithi103.stdout:checking ndbm.h presence... no 2024-09-19T06:09:41.169 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ndbm.h... no 2024-09-19T06:09:41.211 INFO:tasks.workunit.client.0.smithi103.stdout:checking libaio.h usability... yes 2024-09-19T06:09:41.234 INFO:tasks.workunit.client.0.smithi103.stdout:checking libaio.h presence... yes 2024-09-19T06:09:41.234 INFO:tasks.workunit.client.0.smithi103.stdout:checking for libaio.h... yes 2024-09-19T06:09:41.294 INFO:tasks.workunit.client.0.smithi103.stdout:checking liburing.h usability... no 2024-09-19T06:09:41.332 INFO:tasks.workunit.client.0.smithi103.stdout:checking liburing.h presence... no 2024-09-19T06:09:41.332 INFO:tasks.workunit.client.0.smithi103.stdout:checking for liburing.h... no 2024-09-19T06:09:41.381 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/capability.h usability... no 2024-09-19T06:09:41.420 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/capability.h presence... no 2024-09-19T06:09:41.420 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/capability.h... no 2024-09-19T06:09:41.462 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/fiemap.h usability... yes 2024-09-19T06:09:41.483 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/fiemap.h presence... yes 2024-09-19T06:09:41.483 INFO:tasks.workunit.client.0.smithi103.stdout:checking for linux/fiemap.h... yes 2024-09-19T06:09:41.555 INFO:tasks.workunit.client.0.smithi103.stdout:checking for fallocate... yes 2024-09-19T06:09:41.626 INFO:tasks.workunit.client.0.smithi103.stdout:checking for open_by_handle_at... yes 2024-09-19T06:09:41.674 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/fs.h usability... yes 2024-09-19T06:09:41.695 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/fs.h presence... yes 2024-09-19T06:09:41.695 INFO:tasks.workunit.client.0.smithi103.stdout:checking for linux/fs.h... yes 2024-09-19T06:09:41.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:41 smithi174 ceph-mon[34488]: pgmap v73: 97 pgs: 97 active+clean; 70 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 836 KiB/s wr, 123 op/s 2024-09-19T06:09:41.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:41 smithi103 ceph-mon[30925]: pgmap v73: 97 pgs: 97 active+clean; 70 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 836 KiB/s wr, 123 op/s 2024-09-19T06:09:41.751 INFO:tasks.workunit.client.0.smithi103.stdout:checking btrfsutil.h usability... no 2024-09-19T06:09:41.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:41 smithi169 ceph-mon[34350]: pgmap v73: 97 pgs: 97 active+clean; 70 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 836 KiB/s wr, 123 op/s 2024-09-19T06:09:41.791 INFO:tasks.workunit.client.0.smithi103.stdout:checking btrfsutil.h presence... no 2024-09-19T06:09:41.791 INFO:tasks.workunit.client.0.smithi103.stdout:checking for btrfsutil.h... no 2024-09-19T06:09:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.790+0000 7ffb567d6640 1 -- 172.21.15.103:0/1194581947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb50101210 msgr2=0x7ffb5010ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.790+0000 7ffb567d6640 1 --2- 172.21.15.103:0/1194581947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb50101210 0x7ffb5010ded0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009900 tx=0x7ffb4402a410 comp rx=0 tx=0).stop 2024-09-19T06:09:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.790+0000 7ffb567d6640 1 -- 172.21.15.103:0/1194581947 shutdown_connections 2024-09-19T06:09:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.790+0000 7ffb567d6640 1 --2- 172.21.15.103:0/1194581947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb5010e410 0x7ffb50110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.790+0000 7ffb567d6640 1 --2- 172.21.15.103:0/1194581947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb50101210 0x7ffb5010ded0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.790+0000 7ffb567d6640 1 --2- 172.21.15.103:0/1194581947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb50100860 0x7ffb50100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.790+0000 7ffb567d6640 1 -- 172.21.15.103:0/1194581947 >> 172.21.15.103:0/1194581947 conn(0x7ffb50077990 msgr2=0x7ffb500fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.790+0000 7ffb567d6640 1 -- 172.21.15.103:0/1194581947 shutdown_connections 2024-09-19T06:09:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.790+0000 7ffb567d6640 1 -- 172.21.15.103:0/1194581947 wait complete. 2024-09-19T06:09:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb567d6640 1 Processor -- start 2024-09-19T06:09:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb567d6640 1 -- start start 2024-09-19T06:09:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb567d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb50100860 0x7ffb5019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb567d6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb50101210 0x7ffb5019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb567d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb5010e410 0x7ffb5019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb567d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50113f90 con 0x7ffb5010e410 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb567d6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50113e10 con 0x7ffb50100860 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb567d6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50114110 con 0x7ffb50101210 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb54d73640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb5010e410 0x7ffb5019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb54d73640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb5010e410 0x7ffb5019ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50364/0 (socket says 172.21.15.103:50364) 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb54d73640 1 -- 172.21.15.103:0/2519596397 learned_addr learned my addr 172.21.15.103:0/2519596397 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.791+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb50100860 0x7ffb5019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb50101210 0x7ffb5019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb54d73640 1 -- 172.21.15.103:0/2519596397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb50101210 msgr2=0x7ffb5019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb54d73640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb50101210 0x7ffb5019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb54d73640 1 -- 172.21.15.103:0/2519596397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb50100860 msgr2=0x7ffb5019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb54d73640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb50100860 0x7ffb5019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb54d73640 1 -- 172.21.15.103:0/2519596397 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5019f490 con 0x7ffb5010e410 2024-09-19T06:09:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb50100860 0x7ffb5019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb54d73640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb5010e410 0x7ffb5019ed60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800eb10 tx=0x7ffb4800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb4d7fa640 1 -- 172.21.15.103:0/2519596397 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48004b20 con 0x7ffb5010e410 2024-09-19T06:09:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb567d6640 1 -- 172.21.15.103:0/2519596397 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5019f780 con 0x7ffb5010e410 2024-09-19T06:09:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb4d7fa640 1 -- 172.21.15.103:0/2519596397 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb48004cc0 con 0x7ffb5010e410 2024-09-19T06:09:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb4d7fa640 1 -- 172.21.15.103:0/2519596397 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48010690 con 0x7ffb5010e410 2024-09-19T06:09:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.792+0000 7ffb567d6640 1 -- 172.21.15.103:0/2519596397 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb501a7010 con 0x7ffb5010e410 2024-09-19T06:09:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.795+0000 7ffb4d7fa640 1 -- 172.21.15.103:0/2519596397 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7ffb48005020 con 0x7ffb5010e410 2024-09-19T06:09:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.795+0000 7ffb5964a740 1 Processor -- start 2024-09-19T06:09:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.795+0000 7ffb5964a740 1 -- start start 2024-09-19T06:09:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c233caf0 0x55e2c233ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233d410 0x55e2c2347770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c2347cb0 0x55e2c234a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb5964a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e2c22a12f0 con 0x55e2c233caf0 2024-09-19T06:09:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb5964a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e2c2249270 con 0x55e2c233d410 2024-09-19T06:09:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb5964a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e2c229d2b0 con 0x55e2c2347cb0 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4d7fa640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffb380a3460 0x7ffb380a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c233caf0 0x55e2c233ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233d410 0x55e2c2347770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c233caf0 0x55e2c233ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50366/0 (socket says 172.21.15.103:50366) 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/566885495 learned_addr learned my addr 172.21.15.103:0/566885495 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4d7fa640 1 -- 172.21.15.103:0/2519596397 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7ffb480d0290 con 0x7ffb5010e410 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/566885495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c2347cb0 0x55e2c234a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb54d73640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffb380a3460 0x7ffb380a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4ffff640 1 -- 172.21.15.103:0/566885495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c2347cb0 msgr2=0x55e2c234a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/566885495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c2347cb0 0x55e2c234a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4ffff640 1 -- 172.21.15.103:0/566885495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c233caf0 msgr2=0x55e2c233ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/566885495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c233caf0 0x55e2c233ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4ffff640 1 -- 172.21.15.103:0/566885495 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c2248340 con 0x55e2c233d410 2024-09-19T06:09:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/566885495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c2347cb0 0x55e2c234a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/566885495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233d410 0x55e2c2347770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb400103d0 tx=0x7ffb40010890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fe39ebc7208236a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb54d73640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffb380a3460 0x7ffb380a5920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb480cdae0 tx=0x7ffb4800a440 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.796+0000 7ffb367fc640 1 -- 172.21.15.103:0/566885495 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40011700 con 0x55e2c233d410 2024-09-19T06:09:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb367fc640 1 -- 172.21.15.103:0/566885495 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb40011d50 con 0x55e2c233d410 2024-09-19T06:09:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb367fc640 1 -- 172.21.15.103:0/566885495 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4001ce60 con 0x55e2c233d410 2024-09-19T06:09:41.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb5964a740 1 -- 172.21.15.103:0/566885495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233d410 msgr2=0x55e2c2347770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:41.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb5964a740 1 --2- 172.21.15.103:0/566885495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233d410 0x55e2c2347770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb400103d0 tx=0x7ffb40010890 comp rx=0 tx=0).stop 2024-09-19T06:09:41.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb5964a740 1 -- 172.21.15.103:0/566885495 shutdown_connections 2024-09-19T06:09:41.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb5964a740 1 --2- 172.21.15.103:0/566885495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c2347cb0 0x55e2c234a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb5964a740 1 --2- 172.21.15.103:0/566885495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233d410 0x55e2c2347770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb5964a740 1 --2- 172.21.15.103:0/566885495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c233caf0 0x55e2c233ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb5964a740 1 -- 172.21.15.103:0/566885495 >> 172.21.15.103:0/566885495 conn(0x55e2c2339060 msgr2=0x55e2c2339440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:41.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb5964a740 1 -- 172.21.15.103:0/566885495 shutdown_connections 2024-09-19T06:09:41.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.797+0000 7ffb5964a740 1 -- 172.21.15.103:0/566885495 wait complete. 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb5964a740 1 -- start start 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb5964a740 1 Processor -- start 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c2344b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c2345060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c23455a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb5964a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e2c234a880 con 0x55e2c2347cb0 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb5964a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e2c222a290 con 0x55e2c233caf0 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb5964a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e2c234aa00 con 0x55e2c233d410 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb5964a740 10 client.0 _ll_register_callbacks cb 0x55e2c225b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c23455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c23455a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50380/0 (socket says 172.21.15.103:50380) 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/685346409 learned_addr learned my addr 172.21.15.103:0/685346409 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.798+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c2344b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c2345060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/685346409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 msgr2=0x55e2c2345060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c2345060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/685346409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 msgr2=0x55e2c2344b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c2344b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/685346409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c1fb4210 con 0x55e2c2347cb0 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c2345060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c23455a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009900 tx=0x7ffb44031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ead2bdcdb821c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/685346409 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44035070 con 0x55e2c2347cb0 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/685346409 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7ffb44003cc0 con 0x55e2c2347cb0 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb5964a740 1 -- 172.21.15.103:0/685346409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb40011d50 con 0x55e2c2347cb0 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/685346409 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb440314a0 con 0x55e2c2347cb0 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb5964a740 10 client.15852 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb5964a740 1 -- 172.21.15.103:0/685346409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e2c2080620 con 0x55e2c2347cb0 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.799+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/685346409 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb40011d50 con 0x55e2c2347cb0 2024-09-19T06:09:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.800+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/685346409 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ffb4403a040 con 0x55e2c2347cb0 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.800+0000 7ffb5964a740 10 client.15852 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.800+0000 7ffb5964a740 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.800+0000 7ffb5964a740 20 client.15852 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.800+0000 7ffb5964a740 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e2c2357bb0 0x55e2c2359ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.800+0000 7ffb5964a740 4 client.15852 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.800+0000 7ffb5964a740 1 -- 172.21.15.103:0/685346409 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2c22aea20 con 0x55e2c2357bb0 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.800+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e2c2357bb0 0x55e2c2359ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.800+0000 7ffb2f7fe640 10 client.15852 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.800+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e2c2357bb0 0x55e2c2359ff0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1c51f1001e39249 server_cookie=58870c4ab2555016 in_seq=0 out_seq=0 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/685346409 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e2c22aea20 con 0x55e2c2357bb0 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb2f7fe640 10 client.15852 handle_command_reply: tid=0 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 client.15852 shutdown 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 -- 172.21.15.103:0/685346409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 msgr2=0x55e2c23455a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c23455a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009900 tx=0x7ffb44031400 comp rx=0 tx=0).stop 2024-09-19T06:09:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 -- 172.21.15.103:0/685346409 shutdown_connections 2024-09-19T06:09:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e2c2357bb0 0x55e2c2359ff0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c23455a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c2345060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 --2- 172.21.15.103:0/685346409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c2344b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 -- 172.21.15.103:0/685346409 >> 172.21.15.103:0/685346409 conn(0x55e2c2339060 msgr2=0x55e2c233edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb2f7fe640 0 client.15852 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 -- 172.21.15.103:0/685346409 shutdown_connections 2024-09-19T06:09:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 1 -- 172.21.15.103:0/685346409 wait complete. 2024-09-19T06:09:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.801+0000 7ffb5964a740 20 client.15852 trim_cache size 0 max 16384 2024-09-19T06:09:41.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb5964a740 1 Processor -- start 2024-09-19T06:09:41.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb5964a740 1 -- start start 2024-09-19T06:09:41.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c233f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c23453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c235f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb5964a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b2100 con 0x55e2c2347cb0 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb5964a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501af9d0 con 0x55e2c233caf0 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb5964a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501ad820 con 0x55e2c233d410 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c235f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c235f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50382/0 (socket says 172.21.15.103:50382) 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/1356352400 learned_addr learned my addr 172.21.15.103:0/1356352400 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/1356352400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c233f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/1356352400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c23453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/1356352400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 msgr2=0x55e2c23453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/1356352400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c23453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/1356352400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 msgr2=0x55e2c233f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/1356352400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c233f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/1356352400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c2343ad0 con 0x55e2c2347cb0 2024-09-19T06:09:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.816+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/1356352400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c23453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:09:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.817+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/1356352400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c235f900 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffb44001eb0 tx=0x7ffb4402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2d497bc7b47f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.817+0000 7ffb35ffb640 1 -- 172.21.15.103:0/1356352400 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44035070 con 0x55e2c2347cb0 2024-09-19T06:09:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.817+0000 7ffb35ffb640 1 -- 172.21.15.103:0/1356352400 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb44003cc0 con 0x55e2c2347cb0 2024-09-19T06:09:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.817+0000 7ffb35ffb640 1 -- 172.21.15.103:0/1356352400 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44031d50 con 0x55e2c2347cb0 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 -- 172.21.15.103:0/1356352400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 msgr2=0x55e2c235f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 --2- 172.21.15.103:0/1356352400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c235f900 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffb44001eb0 tx=0x7ffb4402a410 comp rx=0 tx=0).stop 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 -- 172.21.15.103:0/1356352400 shutdown_connections 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 --2- 172.21.15.103:0/1356352400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c235f900 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 --2- 172.21.15.103:0/1356352400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c23453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 --2- 172.21.15.103:0/1356352400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c233f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 -- 172.21.15.103:0/1356352400 >> 172.21.15.103:0/1356352400 conn(0x55e2c2339060 msgr2=0x55e2c2346ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 -- 172.21.15.103:0/1356352400 shutdown_connections 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 -- 172.21.15.103:0/1356352400 wait complete. 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 -- start start 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 Processor -- start 2024-09-19T06:09:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c234ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c23504c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c2341590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501ade90 con 0x55e2c2347cb0 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501af300 con 0x55e2c233caf0 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.818+0000 7ffb5964a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501ae560 con 0x55e2c233d410 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb5964a740 10 client.0 _ll_register_callbacks cb 0x7ffb44003680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c2341590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c2341590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50384/0 (socket says 172.21.15.103:50384) 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/1885333351 learned_addr learned my addr 172.21.15.103:0/1885333351 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c234ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c23504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/1885333351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 msgr2=0x55e2c23504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c23504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/1885333351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 msgr2=0x55e2c234ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c234ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4f7fe640 1 -- 172.21.15.103:0/1885333351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c2341d90 con 0x55e2c2347cb0 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb4f7fe640 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c2341590 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffb44005c40 tx=0x7ffb4403d930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf45a1bd2c11fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/1885333351 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44035060 con 0x55e2c2347cb0 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/1885333351 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7ffb44055820 con 0x55e2c2347cb0 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.819+0000 7ffb5964a740 1 -- 172.21.15.103:0/1885333351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb44003cc0 con 0x55e2c2347cb0 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/1885333351 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb4403d9d0 con 0x55e2c2347cb0 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb5964a740 10 client.15858 fetch_fsmap learned FSMap version 29 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb5964a740 1 -- 172.21.15.103:0/1885333351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e2c23c2470 con 0x55e2c2347cb0 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/1885333351 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb44003cc0 con 0x55e2c2347cb0 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/1885333351 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ffb44061700 con 0x55e2c2347cb0 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb5964a740 10 client.15858 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb5964a740 10 client.15858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb5964a740 20 client.15858 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:41.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb5964a740 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e2c23c2c00 0x55e2c23c5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:41.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb5964a740 4 client.15858 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:09:41.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb5964a740 1 -- 172.21.15.103:0/1885333351 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e2c22a8d70 con 0x55e2c23c2c00 2024-09-19T06:09:41.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.820+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e2c23c2c00 0x55e2c23c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:41.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.821+0000 7ffb2f7fe640 10 client.15858 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:41.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.821+0000 7ffb4ffff640 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e2c23c2c00 0x55e2c23c5020 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=377d4f3329c0fb9b server_cookie=74ac7b1afcdc26ba in_seq=0 out_seq=0 2024-09-19T06:09:41.852 INFO:tasks.workunit.client.0.smithi103.stdout:checking for copy_file_range... yes 2024-09-19T06:09:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.895+0000 7ffb2f7fe640 1 -- 172.21.15.103:0/1885333351 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e2c22a8d70 con 0x55e2c23c2c00 2024-09-19T06:09:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.895+0000 7ffb2f7fe640 10 client.15858 handle_command_reply: tid=0 2024-09-19T06:09:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.895+0000 7ffb5964a740 1 client.15858 shutdown 2024-09-19T06:09:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.895+0000 7ffb5964a740 1 -- 172.21.15.103:0/1885333351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 msgr2=0x55e2c2341590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.895+0000 7ffb5964a740 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c2341590 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffb44005c40 tx=0x7ffb4403d930 comp rx=0 tx=0).stop 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb5964a740 1 -- 172.21.15.103:0/1885333351 shutdown_connections 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb5964a740 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e2c23c2c00 0x55e2c23c5020 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb5964a740 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e2c2347cb0 0x55e2c2341590 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb5964a740 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2c233d410 0x55e2c23504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb5964a740 1 --2- 172.21.15.103:0/1885333351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c233caf0 0x55e2c234ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb5964a740 1 -- 172.21.15.103:0/1885333351 >> 172.21.15.103:0/1885333351 conn(0x55e2c2339060 msgr2=0x55e2c2352b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb2f7fe640 0 client.15858 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb5964a740 1 -- 172.21.15.103:0/1885333351 shutdown_connections 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb5964a740 1 -- 172.21.15.103:0/1885333351 wait complete. 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb5964a740 20 client.15858 trim_cache size 0 max 16384 2024-09-19T06:09:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:09:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:09:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:09:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:09:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb567d6640 1 -- 172.21.15.103:0/2519596397 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffb380a3460 msgr2=0x7ffb380a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb567d6640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffb380a3460 0x7ffb380a5920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb480cdae0 tx=0x7ffb4800a440 comp rx=0 tx=0).stop 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb567d6640 1 -- 172.21.15.103:0/2519596397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb5010e410 msgr2=0x7ffb5019ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.896+0000 7ffb567d6640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb5010e410 0x7ffb5019ed60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800eb10 tx=0x7ffb4800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.897+0000 7ffb567d6640 1 -- 172.21.15.103:0/2519596397 shutdown_connections 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.897+0000 7ffb567d6640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffb380a3460 0x7ffb380a5920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.897+0000 7ffb567d6640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb5010e410 0x7ffb5019ed60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.897+0000 7ffb567d6640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb50101210 0x7ffb5019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.897+0000 7ffb567d6640 1 --2- 172.21.15.103:0/2519596397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb50100860 0x7ffb5019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.897+0000 7ffb567d6640 1 -- 172.21.15.103:0/2519596397 >> 172.21.15.103:0/2519596397 conn(0x7ffb50077990 msgr2=0x7ffb500ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.897+0000 7ffb567d6640 1 -- 172.21.15.103:0/2519596397 shutdown_connections 2024-09-19T06:09:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:41.897+0000 7ffb567d6640 1 -- 172.21.15.103:0/2519596397 wait complete. 2024-09-19T06:09:41.947 INFO:tasks.workunit.client.0.smithi103.stdout:checking for SEEK_DATA... yes 2024-09-19T06:09:42.025 INFO:tasks.workunit.client.0.smithi103.stdout:checking for BMV_OF_SHARED... yes 2024-09-19T06:09:42.092 INFO:tasks.workunit.client.0.smithi103.stdout:checking for nftw... yes 2024-09-19T06:09:42.160 INFO:tasks.workunit.client.0.smithi103.stdout:checking for RLIMIT_NOFILE... yes 2024-09-19T06:09:42.218 INFO:tasks.workunit.client.0.smithi103.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-09-19T06:09:42.283 INFO:tasks.workunit.client.0.smithi103.stdout:checking for FICLONE... yes 2024-09-19T06:09:42.352 INFO:tasks.workunit.client.0.smithi103.stdout:checking for renameat2... yes 2024-09-19T06:09:42.417 INFO:tasks.workunit.client.0.smithi103.stdout:checking for reallocarray... yes 2024-09-19T06:09:42.498 INFO:tasks.workunit.client.0.smithi103.stdout:checking for struct mount_attr... yes 2024-09-19T06:09:42.587 INFO:tasks.workunit.client.0.smithi103.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-19T06:09:42.666 INFO:tasks.workunit.client.0.smithi103.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-19T06:09:42.750 INFO:tasks.workunit.client.0.smithi103.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-19T06:09:42.840 INFO:tasks.workunit.client.0.smithi103.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-19T06:09:42.941 INFO:tasks.workunit.client.0.smithi103.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-19T06:09:43.023 INFO:tasks.workunit.client.0.smithi103.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-19T06:09:43.103 INFO:tasks.workunit.client.0.smithi103.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-19T06:09:43.160 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/btrfs.h usability... yes 2024-09-19T06:09:43.181 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/btrfs.h presence... yes 2024-09-19T06:09:43.181 INFO:tasks.workunit.client.0.smithi103.stdout:checking for linux/btrfs.h... yes 2024-09-19T06:09:43.249 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-19T06:09:43.272 INFO:tasks.workunit.client.0.smithi103.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-19T06:09:43.273 INFO:tasks.workunit.client.0.smithi103.stdout:checking for linux/btrfs_tree.h... yes 2024-09-19T06:09:43.325 INFO:tasks.workunit.client.0.smithi103.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-19T06:09:43.365 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-19T06:09:43.389 INFO:tasks.workunit.client.0.smithi103.stdout:configure: creating ./config.status 2024-09-19T06:09:43.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:43 smithi174 ceph-mon[34488]: pgmap v74: 97 pgs: 97 active+clean; 73 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 1.1 MiB/s wr, 185 op/s 2024-09-19T06:09:43.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:43 smithi103 ceph-mon[30925]: pgmap v74: 97 pgs: 97 active+clean; 73 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 1.1 MiB/s wr, 185 op/s 2024-09-19T06:09:43.777 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating include/builddefs 2024-09-19T06:09:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:43 smithi169 ceph-mon[34350]: pgmap v74: 97 pgs: 97 active+clean; 73 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 1.1 MiB/s wr, 185 op/s 2024-09-19T06:09:43.817 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating include/config.h 2024-09-19T06:09:45.344 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: executing libtool commands 2024-09-19T06:09:45.540 INFO:tasks.workunit.client.0.smithi103.stdout:Building lib 2024-09-19T06:09:45.540 INFO:tasks.workunit.client.0.smithi103.stdout:Building include 2024-09-19T06:09:45.540 INFO:tasks.workunit.client.0.smithi103.stdout:Building tests 2024-09-19T06:09:45.560 INFO:tasks.workunit.client.0.smithi103.stdout: [LTDEP] 2024-09-19T06:09:45.605 INFO:tasks.workunit.client.0.smithi103.stdout:Building ceph 2024-09-19T06:09:45.606 INFO:tasks.workunit.client.0.smithi103.stdout:Building btrfs 2024-09-19T06:09:45.606 INFO:tasks.workunit.client.0.smithi103.stdout:Building cifs 2024-09-19T06:09:45.652 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ceph/group.list 2024-09-19T06:09:45.653 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/cifs/group.list 2024-09-19T06:09:45.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:45 smithi174 ceph-mon[34488]: pgmap v75: 97 pgs: 97 active+clean; 73 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 630 KiB/s wr, 92 op/s 2024-09-19T06:09:45.730 INFO:tasks.workunit.client.0.smithi103.stdout:Building ext4 2024-09-19T06:09:45.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:45 smithi103 ceph-mon[30925]: pgmap v75: 97 pgs: 97 active+clean; 73 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 630 KiB/s wr, 92 op/s 2024-09-19T06:09:45.772 INFO:tasks.workunit.client.0.smithi103.stdout:Building f2fs 2024-09-19T06:09:45.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:45 smithi169 ceph-mon[34350]: pgmap v75: 97 pgs: 97 active+clean; 73 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 630 KiB/s wr, 92 op/s 2024-09-19T06:09:45.798 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ext4/group.list 2024-09-19T06:09:45.814 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/f2fs/group.list 2024-09-19T06:09:45.817 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/btrfs/group.list 2024-09-19T06:09:45.913 INFO:tasks.workunit.client.0.smithi103.stdout:Building generic 2024-09-19T06:09:46.089 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/generic/group.list 2024-09-19T06:09:46.292 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] dataascii.lo 2024-09-19T06:09:46.528 INFO:tasks.workunit.client.0.smithi103.stdout:Building nfs 2024-09-19T06:09:46.566 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] databin.lo 2024-09-19T06:09:46.568 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/nfs/group.list 2024-09-19T06:09:46.640 INFO:tasks.workunit.client.0.smithi103.stdout:Building ocfs2 2024-09-19T06:09:46.680 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ocfs2/group.list 2024-09-19T06:09:46.746 INFO:tasks.workunit.client.0.smithi103.stdout:Building overlay 2024-09-19T06:09:46.807 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/overlay/group.list 2024-09-19T06:09:46.910 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] datapid.lo 2024-09-19T06:09:47.181 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] file_lock.lo 2024-09-19T06:09:47.546 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] forker.lo 2024-09-19T06:09:47.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:47 smithi174 ceph-mon[34488]: pgmap v76: 97 pgs: 97 active+clean; 72 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 937 KiB/s wr, 194 op/s 2024-09-19T06:09:47.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:47 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:09:47.726 INFO:tasks.workunit.client.0.smithi103.stdout:Building perf 2024-09-19T06:09:47.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:47 smithi103 ceph-mon[30925]: pgmap v76: 97 pgs: 97 active+clean; 72 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 937 KiB/s wr, 194 op/s 2024-09-19T06:09:47.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:47 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:09:47.767 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/perf/group.list 2024-09-19T06:09:47.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:47 smithi169 ceph-mon[34350]: pgmap v76: 97 pgs: 97 active+clean; 72 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 937 KiB/s wr, 194 op/s 2024-09-19T06:09:47.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:47 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:09:47.832 INFO:tasks.workunit.client.0.smithi103.stdout:Building selftest 2024-09-19T06:09:47.839 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] pattern.lo 2024-09-19T06:09:47.872 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/selftest/group.list 2024-09-19T06:09:47.976 INFO:tasks.workunit.client.0.smithi103.stdout:Building shared 2024-09-19T06:09:48.018 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/shared/group.list 2024-09-19T06:09:48.078 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] open_flags.lo 2024-09-19T06:09:48.110 INFO:tasks.workunit.client.0.smithi103.stdout:Building tmpfs 2024-09-19T06:09:48.149 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/tmpfs/group.list 2024-09-19T06:09:48.219 INFO:tasks.workunit.client.0.smithi103.stdout:Building udf 2024-09-19T06:09:48.259 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/group.list 2024-09-19T06:09:48.290 INFO:tasks.workunit.client.0.smithi103.stderr:grep: /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/102: Bad file descriptor 2024-09-19T06:09:48.323 INFO:tasks.workunit.client.0.smithi103.stdout:Building xfs 2024-09-19T06:09:48.412 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] random_range.lo 2024-09-19T06:09:48.515 INFO:tasks.workunit.client.0.smithi103.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/xfs/group.list 2024-09-19T06:09:48.570 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] string_to_tokens.lo 2024-09-19T06:09:48.795 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] str_to_bytes.lo 2024-09-19T06:09:48.832 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] tlibio.lo 2024-09-19T06:09:49.120 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] write_log.lo 2024-09-19T06:09:49.316 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] random.lo 2024-09-19T06:09:49.583 INFO:tasks.workunit.client.0.smithi103.stdout: [LD] 2024-09-19T06:09:49.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:49 smithi174 ceph-mon[34488]: pgmap v77: 97 pgs: 97 active+clean; 72 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 618 KiB/s wr, 164 op/s 2024-09-19T06:09:49.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:49 smithi103 ceph-mon[30925]: pgmap v77: 97 pgs: 97 active+clean; 72 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 618 KiB/s wr, 164 op/s 2024-09-19T06:09:49.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:49 smithi169 ceph-mon[34350]: pgmap v77: 97 pgs: 97 active+clean; 72 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 618 KiB/s wr, 164 op/s 2024-09-19T06:09:49.866 INFO:tasks.workunit.client.0.smithi103.stdout:Building ltp 2024-09-19T06:09:49.867 INFO:tasks.workunit.client.0.smithi103.stdout:Building src 2024-09-19T06:09:49.895 INFO:tasks.workunit.client.0.smithi103.stdout: [DEP] 2024-09-19T06:09:49.949 INFO:tasks.workunit.client.0.smithi103.stdout: [DEP] 2024-09-19T06:09:51.459 INFO:tasks.workunit.client.0.smithi103.stdout:Building m4 2024-09-19T06:09:51.482 INFO:tasks.workunit.client.0.smithi103.stdout:Building common 2024-09-19T06:09:51.698 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] doio 2024-09-19T06:09:51.698 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fsstress 2024-09-19T06:09:51.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:51 smithi174 ceph-mon[34488]: pgmap v78: 97 pgs: 97 active+clean; 72 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 618 KiB/s wr, 164 op/s 2024-09-19T06:09:51.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:51 smithi103 ceph-mon[30925]: pgmap v78: 97 pgs: 97 active+clean; 72 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 618 KiB/s wr, 164 op/s 2024-09-19T06:09:51.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:51 smithi169 ceph-mon[34350]: pgmap v78: 97 pgs: 97 active+clean; 72 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 618 KiB/s wr, 164 op/s 2024-09-19T06:09:52.865 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fsx 2024-09-19T06:09:52.941 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] growfiles 2024-09-19T06:09:53.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:53 smithi174 ceph-mon[34488]: pgmap v79: 97 pgs: 97 active+clean; 77 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.1 MiB/s wr, 195 op/s 2024-09-19T06:09:53.724 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] iogen 2024-09-19T06:09:53.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:53 smithi103 ceph-mon[30925]: pgmap v79: 97 pgs: 97 active+clean; 77 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.1 MiB/s wr, 195 op/s 2024-09-19T06:09:53.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:53 smithi169 ceph-mon[34350]: pgmap v79: 97 pgs: 97 active+clean; 77 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.1 MiB/s wr, 195 op/s 2024-09-19T06:09:53.872 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-stress 2024-09-19T06:09:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.994+0000 7f5b4f25e640 1 -- 172.21.15.103:0/2263838561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b48101ad0 msgr2=0x7f5b48101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.994+0000 7f5b4f25e640 1 --2- 172.21.15.103:0/2263838561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b48101ad0 0x7f5b48101f30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009930 tx=0x7f5b3402a420 comp rx=0 tx=0).stop 2024-09-19T06:09:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.994+0000 7f5b4f25e640 1 -- 172.21.15.103:0/2263838561 shutdown_connections 2024-09-19T06:09:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.994+0000 7f5b4f25e640 1 --2- 172.21.15.103:0/2263838561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b48102470 0x7f5b4810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.994+0000 7f5b4f25e640 1 --2- 172.21.15.103:0/2263838561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b48101ad0 0x7f5b48101f30 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.994+0000 7f5b4f25e640 1 --2- 172.21.15.103:0/2263838561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b48107b70 0x7f5b48107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.994+0000 7f5b4f25e640 1 -- 172.21.15.103:0/2263838561 >> 172.21.15.103:0/2263838561 conn(0x7f5b480fd7d0 msgr2=0x7f5b480ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.994+0000 7f5b4f25e640 1 -- 172.21.15.103:0/2263838561 shutdown_connections 2024-09-19T06:09:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.994+0000 7f5b4f25e640 1 -- 172.21.15.103:0/2263838561 wait complete. 2024-09-19T06:09:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b4f25e640 1 Processor -- start 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b4f25e640 1 -- start start 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b4f25e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b48101ad0 0x7f5b481982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b4f25e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b48102470 0x7f5b48198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b4f25e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b48107b70 0x7f5b4819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b4f25e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48111d90 con 0x7f5b48102470 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b4f25e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48111c10 con 0x7f5b48107b70 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b4f25e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48111f10 con 0x7f5b48101ad0 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b48102470 0x7f5b48198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b48102470 0x7f5b48198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51928/0 (socket says 172.21.15.103:51928) 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.995+0000 7f5b47fff640 1 -- 172.21.15.103:0/4279308124 learned_addr learned my addr 172.21.15.103:0/4279308124 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b4cffa640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b48101ad0 0x7f5b481982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b4d7fb640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b48107b70 0x7f5b4819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b47fff640 1 -- 172.21.15.103:0/4279308124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b48101ad0 msgr2=0x7f5b481982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b47fff640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b48101ad0 0x7f5b481982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b47fff640 1 -- 172.21.15.103:0/4279308124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b48107b70 msgr2=0x7f5b4819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b47fff640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b48107b70 0x7f5b4819cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b47fff640 1 -- 172.21.15.103:0/4279308124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4819d2b0 con 0x7f5b48102470 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b4cffa640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b48101ad0 0x7f5b481982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b47fff640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b48102470 0x7f5b48198800 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5b34004770 tx=0x7f5b340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b45ffb640 1 -- 172.21.15.103:0/4279308124 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3403f070 con 0x7f5b48102470 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b45ffb640 1 -- 172.21.15.103:0/4279308124 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b3403b460 con 0x7f5b48102470 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b4f25e640 1 -- 172.21.15.103:0/4279308124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b4819d540 con 0x7f5b48102470 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b45ffb640 1 -- 172.21.15.103:0/4279308124 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34035070 con 0x7f5b48102470 2024-09-19T06:09:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.996+0000 7f5b4f25e640 1 -- 172.21.15.103:0/4279308124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b481a4e30 con 0x7f5b48102470 2024-09-19T06:09:55.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.999+0000 7f5b45ffb640 1 -- 172.21.15.103:0/4279308124 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f5b3403b610 con 0x7f5b48102470 2024-09-19T06:09:55.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.999+0000 7f5b51ffa740 1 Processor -- start 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.999+0000 7f5b51ffa740 1 -- start start 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.999+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef616ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.999+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef617410 0x563eef621770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.999+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 0x563eef6240a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.999+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563eef57b2f0 con 0x563eef616af0 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.999+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563eef523270 con 0x563eef621cb0 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:54.999+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563eef5772b0 con 0x563eef617410 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4d7fb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef616ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b45ffb640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5b380a34e0 0x7f5b380a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4d7fb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef616ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51930/0 (socket says 172.21.15.103:51930) 2024-09-19T06:09:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4d7fb640 1 -- 172.21.15.103:0/157237243 learned_addr learned my addr 172.21.15.103:0/157237243 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b47fff640 1 --2- 172.21.15.103:0/157237243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 0x563eef6240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4d7fb640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5b380a34e0 0x7f5b380a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4cffa640 1 --2- 172.21.15.103:0/157237243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef617410 0x563eef621770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4d7fb640 1 -- 172.21.15.103:0/157237243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef617410 msgr2=0x563eef621770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4d7fb640 1 --2- 172.21.15.103:0/157237243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef617410 0x563eef621770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4d7fb640 1 -- 172.21.15.103:0/157237243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 msgr2=0x563eef6240a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4d7fb640 1 --2- 172.21.15.103:0/157237243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 0x563eef6240a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4d7fb640 1 -- 172.21.15.103:0/157237243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eef522340 con 0x563eef616af0 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b45ffb640 1 -- 172.21.15.103:0/4279308124 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f5b340f0070 con 0x7f5b48102470 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b4d7fb640 1 --2- 172.21.15.103:0/157237243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef616ed0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5b40013a70 tx=0x7f5b40013f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4bb022b503e447 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.000+0000 7f5b32ffd640 1 -- 172.21.15.103:0/157237243 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40013540 con 0x563eef616af0 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b32ffd640 1 -- 172.21.15.103:0/157237243 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b40022070 con 0x563eef616af0 2024-09-19T06:09:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b32ffd640 1 -- 172.21.15.103:0/157237243 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4001cc20 con 0x563eef616af0 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b4d7fb640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5b380a34e0 0x7f5b380a59a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b40021000 tx=0x7f5b4001f000 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b51ffa740 1 -- 172.21.15.103:0/157237243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 msgr2=0x563eef616ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/157237243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef616ed0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5b40013a70 tx=0x7f5b40013f30 comp rx=0 tx=0).stop 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b51ffa740 1 -- 172.21.15.103:0/157237243 shutdown_connections 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/157237243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 0x563eef6240a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/157237243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef617410 0x563eef621770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/157237243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef616ed0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b51ffa740 1 -- 172.21.15.103:0/157237243 >> 172.21.15.103:0/157237243 conn(0x563eef613060 msgr2=0x563eef613440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b51ffa740 1 -- 172.21.15.103:0/157237243 shutdown_connections 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.001+0000 7f5b51ffa740 1 -- 172.21.15.103:0/157237243 wait complete. 2024-09-19T06:09:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b51ffa740 1 -- start start 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b51ffa740 1 Processor -- start 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef61eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef617410 0x563eef61f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef621cb0 0x563eef61f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563eef624880 con 0x563eef616af0 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563eef504290 con 0x563eef617410 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563eef624a00 con 0x563eef621cb0 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b51ffa740 10 client.0 _ll_register_callbacks cb 0x563eef535140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b4cffa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef61eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b4cffa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef61eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51932/0 (socket says 172.21.15.103:51932) 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.002+0000 7f5b4cffa640 1 -- 172.21.15.103:0/3533559490 learned_addr learned my addr 172.21.15.103:0/3533559490 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b4d7fb640 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef621cb0 0x563eef61f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b47fff640 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef617410 0x563eef61f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b4cffa640 1 -- 172.21.15.103:0/3533559490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef621cb0 msgr2=0x563eef61f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b4cffa640 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef621cb0 0x563eef61f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b4cffa640 1 -- 172.21.15.103:0/3533559490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef617410 msgr2=0x563eef61f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b4cffa640 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef617410 0x563eef61f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b4cffa640 1 -- 172.21.15.103:0/3533559490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eef28e210 con 0x563eef616af0 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b47fff640 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef617410 0x563eef61f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b4cffa640 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef61eb90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c003c10 tx=0x7f5b3c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f5647497575fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b27fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b27fff640 1 -- 172.21.15.103:0/3533559490 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c005020 con 0x563eef616af0 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b27fff640 1 -- 172.21.15.103:0/3533559490 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f5b3c0051c0 con 0x563eef616af0 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b51ffa740 1 -- 172.21.15.103:0/3533559490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b40022070 con 0x563eef616af0 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b27fff640 1 -- 172.21.15.103:0/3533559490 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5b3c0053c0 con 0x563eef616af0 2024-09-19T06:09:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b51ffa740 10 client.15870 fetch_fsmap learned FSMap version 30 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b51ffa740 1 -- 172.21.15.103:0/3533559490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563eef35a620 con 0x563eef616af0 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.003+0000 7f5b27fff640 1 -- 172.21.15.103:0/3533559490 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b40022070 con 0x563eef616af0 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.004+0000 7f5b27fff640 1 -- 172.21.15.103:0/3533559490 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f5b3c01b750 con 0x563eef616af0 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.004+0000 7f5b51ffa740 10 client.15870 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.004+0000 7f5b51ffa740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.004+0000 7f5b51ffa740 20 client.15870 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.004+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563eef636010 0x563eef638440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.004+0000 7f5b51ffa740 4 client.15870 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.004+0000 7f5b51ffa740 1 -- 172.21.15.103:0/3533559490 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563eef588a20 con 0x563eef636010 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.004+0000 7f5b47fff640 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563eef636010 0x563eef638440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.004+0000 7f5b27fff640 10 client.15870 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.004+0000 7f5b47fff640 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563eef636010 0x563eef638440 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e3af9824abb3e11 server_cookie=f0670e283a0c584a in_seq=0 out_seq=0 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b27fff640 1 -- 172.21.15.103:0/3533559490 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563eef588a20 con 0x563eef636010 2024-09-19T06:09:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b27fff640 10 client.15870 handle_command_reply: tid=0 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b51ffa740 1 client.15870 shutdown 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b51ffa740 1 -- 172.21.15.103:0/3533559490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 msgr2=0x563eef61eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef61eb90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c003c10 tx=0x7f5b3c0117b0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b51ffa740 1 -- 172.21.15.103:0/3533559490 shutdown_connections 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563eef636010 0x563eef638440 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef621cb0 0x563eef61f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef617410 0x563eef61f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b27fff640 0 client.15870 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/3533559490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef616af0 0x563eef61eb90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.005+0000 7f5b51ffa740 1 -- 172.21.15.103:0/3533559490 >> 172.21.15.103:0/3533559490 conn(0x563eef613060 msgr2=0x563eef6121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.006+0000 7f5b51ffa740 1 -- 172.21.15.103:0/3533559490 shutdown_connections 2024-09-19T06:09:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.006+0000 7f5b51ffa740 1 -- 172.21.15.103:0/3533559490 wait complete. 2024-09-19T06:09:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.006+0000 7f5b51ffa740 20 client.15870 trim_cache size 0 max 16384 2024-09-19T06:09:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.022+0000 7f5b51ffa740 1 Processor -- start 2024-09-19T06:09:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b51ffa740 1 -- start start 2024-09-19T06:09:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef616af0 0x563eef619560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef620b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef621cb0 0x563eef63dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481adc90 con 0x563eef617410 2024-09-19T06:09:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481ab530 con 0x563eef616af0 2024-09-19T06:09:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481a93a0 con 0x563eef621cb0 2024-09-19T06:09:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef620b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef620b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51944/0 (socket says 172.21.15.103:51944) 2024-09-19T06:09:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b47fff640 1 -- 172.21.15.103:0/1342410825 learned_addr learned my addr 172.21.15.103:0/1342410825 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b4d7fb640 1 --2- 172.21.15.103:0/1342410825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef621cb0 0x563eef63dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b4cffa640 1 --2- 172.21.15.103:0/1342410825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef616af0 0x563eef619560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b47fff640 1 -- 172.21.15.103:0/1342410825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef621cb0 msgr2=0x563eef63dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b47fff640 1 --2- 172.21.15.103:0/1342410825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef621cb0 0x563eef63dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b47fff640 1 -- 172.21.15.103:0/1342410825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef616af0 msgr2=0x563eef619560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b47fff640 1 --2- 172.21.15.103:0/1342410825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef616af0 0x563eef619560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b47fff640 1 -- 172.21.15.103:0/1342410825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eef614110 con 0x563eef617410 2024-09-19T06:09:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.023+0000 7f5b47fff640 1 --2- 172.21.15.103:0/1342410825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef620b00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5b340bc0a0 tx=0x7f5b34005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec9db91f1b5f1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b327fc640 1 -- 172.21.15.103:0/1342410825 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34048040 con 0x563eef617410 2024-09-19T06:09:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b327fc640 1 -- 172.21.15.103:0/1342410825 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b340c0750 con 0x563eef617410 2024-09-19T06:09:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b327fc640 1 -- 172.21.15.103:0/1342410825 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b340b8a10 con 0x563eef617410 2024-09-19T06:09:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b51ffa740 1 -- 172.21.15.103:0/1342410825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 msgr2=0x563eef620b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/1342410825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef620b00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5b340bc0a0 tx=0x7f5b34005b70 comp rx=0 tx=0).stop 2024-09-19T06:09:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b51ffa740 1 -- 172.21.15.103:0/1342410825 shutdown_connections 2024-09-19T06:09:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/1342410825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef621cb0 0x563eef63dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/1342410825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef620b00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/1342410825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef616af0 0x563eef619560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b51ffa740 1 -- 172.21.15.103:0/1342410825 >> 172.21.15.103:0/1342410825 conn(0x563eef613060 msgr2=0x563eef6203f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b51ffa740 1 -- 172.21.15.103:0/1342410825 shutdown_connections 2024-09-19T06:09:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.024+0000 7f5b51ffa740 1 -- 172.21.15.103:0/1342410825 wait complete. 2024-09-19T06:09:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.025+0000 7f5b51ffa740 1 -- start start 2024-09-19T06:09:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.025+0000 7f5b51ffa740 1 Processor -- start 2024-09-19T06:09:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.025+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef616af0 0x563eef62e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.025+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef629910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.025+0000 7f5b51ffa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 0x563eef629e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.025+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481a99f0 con 0x563eef617410 2024-09-19T06:09:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.025+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481aae60 con 0x563eef621cb0 2024-09-19T06:09:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.025+0000 7f5b51ffa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481aa0c0 con 0x563eef616af0 2024-09-19T06:09:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.025+0000 7f5b51ffa740 10 client.0 _ll_register_callbacks cb 0x7f5b3c004180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef629910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef629910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51958/0 (socket says 172.21.15.103:51958) 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b47fff640 1 -- 172.21.15.103:0/2928632674 learned_addr learned my addr 172.21.15.103:0/2928632674 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b4d7fb640 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 0x563eef629e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b4cffa640 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef616af0 0x563eef62e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b47fff640 1 -- 172.21.15.103:0/2928632674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef616af0 msgr2=0x563eef62e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b47fff640 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef616af0 0x563eef62e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b47fff640 1 -- 172.21.15.103:0/2928632674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 msgr2=0x563eef629e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b47fff640 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 0x563eef629e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b47fff640 1 -- 172.21.15.103:0/2928632674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eef62a410 con 0x563eef617410 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b4d7fb640 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 0x563eef629e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b47fff640 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef629910 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009900 tx=0x7f5b34005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e03da2fa5f05f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b27fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b27fff640 1 -- 172.21.15.103:0/2928632674 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34048050 con 0x563eef617410 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b27fff640 1 -- 172.21.15.103:0/2928632674 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f5b340b8a10 con 0x563eef617410 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b51ffa740 1 -- 172.21.15.103:0/2928632674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b340c0750 con 0x563eef617410 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b27fff640 1 -- 172.21.15.103:0/2928632674 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5b3403b940 con 0x563eef617410 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b51ffa740 10 client.15876 fetch_fsmap learned FSMap version 30 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b51ffa740 1 -- 172.21.15.103:0/2928632674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563eef6a0aa0 con 0x563eef617410 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.026+0000 7f5b27fff640 1 -- 172.21.15.103:0/2928632674 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b340c0750 con 0x563eef617410 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.027+0000 7f5b27fff640 1 -- 172.21.15.103:0/2928632674 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f5b3404b060 con 0x563eef617410 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.027+0000 7f5b51ffa740 10 client.15876 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.027+0000 7f5b51ffa740 10 client.15876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.027+0000 7f5b51ffa740 20 client.15876 populate_metadata read hostname 'smithi103' 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.027+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563eef6a11a0 0x563eef6a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.027+0000 7f5b51ffa740 4 client.15876 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:09:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.027+0000 7f5b51ffa740 1 -- 172.21.15.103:0/2928632674 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563eef582d70 con 0x563eef6a11a0 2024-09-19T06:09:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.027+0000 7f5b4cffa640 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563eef6a11a0 0x563eef6a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.027+0000 7f5b27fff640 10 client.15876 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.027+0000 7f5b4cffa640 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563eef6a11a0 0x563eef6a35c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1c233ebc2b789bf server_cookie=c41593e7b8f15ca in_seq=0 out_seq=0 2024-09-19T06:09:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b27fff640 1 -- 172.21.15.103:0/2928632674 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563eef582d70 con 0x563eef6a11a0 2024-09-19T06:09:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b27fff640 10 client.15876 handle_command_reply: tid=0 2024-09-19T06:09:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 client.15876 shutdown 2024-09-19T06:09:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 -- 172.21.15.103:0/2928632674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 msgr2=0x563eef629910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef629910 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009900 tx=0x7f5b34005be0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 -- 172.21.15.103:0/2928632674 shutdown_connections 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x563eef6a11a0 0x563eef6a35c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563eef621cb0 0x563eef629e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b27fff640 0 client.15876 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563eef617410 0x563eef629910 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 --2- 172.21.15.103:0/2928632674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563eef616af0 0x563eef62e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 -- 172.21.15.103:0/2928632674 >> 172.21.15.103:0/2928632674 conn(0x563eef613060 msgr2=0x563eef6121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 -- 172.21.15.103:0/2928632674 shutdown_connections 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 1 -- 172.21.15.103:0/2928632674 wait complete. 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.046+0000 7f5b51ffa740 20 client.15876 trim_cache size 0 max 16384 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:09:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:09:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:09:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:09:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 -- 172.21.15.103:0/4279308124 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5b380a34e0 msgr2=0x7f5b380a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5b380a34e0 0x7f5b380a59a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b40021000 tx=0x7f5b4001f000 comp rx=0 tx=0).stop 2024-09-19T06:09:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 -- 172.21.15.103:0/4279308124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b48102470 msgr2=0x7f5b48198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b48102470 0x7f5b48198800 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5b34004770 tx=0x7f5b340042f0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 -- 172.21.15.103:0/4279308124 shutdown_connections 2024-09-19T06:09:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5b380a34e0 0x7f5b380a59a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b48107b70 0x7f5b4819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b48102470 0x7f5b48198800 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 --2- 172.21.15.103:0/4279308124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b48101ad0 0x7f5b481982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 -- 172.21.15.103:0/4279308124 >> 172.21.15.103:0/4279308124 conn(0x7f5b480fd7d0 msgr2=0x7f5b480fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 -- 172.21.15.103:0/4279308124 shutdown_connections 2024-09-19T06:09:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:09:55.047+0000 7f5b4f25e640 1 -- 172.21.15.103:0/4279308124 wait complete. 2024-09-19T06:09:55.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:55 smithi174 ceph-mon[34488]: pgmap v80: 97 pgs: 97 active+clean; 77 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 795 KiB/s wr, 133 op/s 2024-09-19T06:09:55.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:55 smithi103 ceph-mon[30925]: pgmap v80: 97 pgs: 97 active+clean; 77 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 795 KiB/s wr, 133 op/s 2024-09-19T06:09:55.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:55 smithi169 ceph-mon[34350]: pgmap v80: 97 pgs: 97 active+clean; 77 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 795 KiB/s wr, 133 op/s 2024-09-19T06:09:55.892 INFO:tasks.workunit.client.0.smithi103.stdout: [DEP] 2024-09-19T06:09:55.893 INFO:tasks.workunit.client.0.smithi103.stdout: [DEP] 2024-09-19T06:09:55.897 INFO:tasks.workunit.client.0.smithi103.stdout: [DEP] 2024-09-19T06:09:55.900 INFO:tasks.workunit.client.0.smithi103.stdout: [DEP] 2024-09-19T06:09:56.494 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] dirstress 2024-09-19T06:09:56.495 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fill 2024-09-19T06:09:56.495 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fill2 2024-09-19T06:09:56.497 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] getpagesize 2024-09-19T06:09:56.820 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] holes 2024-09-19T06:09:56.859 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] lstat64 2024-09-19T06:09:56.983 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] nametest 2024-09-19T06:09:56.988 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] permname 2024-09-19T06:09:57.222 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] randholes 2024-09-19T06:09:57.225 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] runas 2024-09-19T06:09:57.384 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] truncfile 2024-09-19T06:09:57.454 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] usemem 2024-09-19T06:09:57.599 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] mmapcat 2024-09-19T06:09:57.688 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] append_reader 2024-09-19T06:09:57.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:57 smithi174 ceph-mon[34488]: pgmap v81: 97 pgs: 97 active+clean; 81 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 1.1 MiB/s wr, 153 op/s 2024-09-19T06:09:57.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:57 smithi103 ceph-mon[30925]: pgmap v81: 97 pgs: 97 active+clean; 81 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 1.1 MiB/s wr, 153 op/s 2024-09-19T06:09:57.754 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] append_writer 2024-09-19T06:09:57.776 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] dirperf 2024-09-19T06:09:57.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:57 smithi169 ceph-mon[34350]: pgmap v81: 97 pgs: 97 active+clean; 81 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 1.1 MiB/s wr, 153 op/s 2024-09-19T06:09:57.914 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] metaperf 2024-09-19T06:09:58.016 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] devzero 2024-09-19T06:09:58.081 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] feature 2024-09-19T06:09:58.211 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] alloc 2024-09-19T06:09:58.396 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fault 2024-09-19T06:09:58.410 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fstest 2024-09-19T06:09:58.504 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_access_root 2024-09-19T06:09:58.618 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] godown 2024-09-19T06:09:58.762 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] resvtest 2024-09-19T06:09:58.814 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] writemod 2024-09-19T06:09:58.846 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] writev_on_pagefault 2024-09-19T06:09:58.977 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] makeextents 2024-09-19T06:09:59.127 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] itrash 2024-09-19T06:09:59.139 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] rename 2024-09-19T06:09:59.180 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] multi_open_unlink 2024-09-19T06:09:59.365 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] unwritten_sync 2024-09-19T06:09:59.442 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] genhashnames 2024-09-19T06:09:59.445 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_holes 2024-09-19T06:09:59.533 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_mmap_writev 2024-09-19T06:09:59.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:09:59 smithi174 ceph-mon[34488]: pgmap v82: 97 pgs: 97 active+clean; 81 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 793 KiB/s wr, 50 op/s 2024-09-19T06:09:59.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:09:59 smithi103 ceph-mon[30925]: pgmap v82: 97 pgs: 97 active+clean; 81 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 793 KiB/s wr, 50 op/s 2024-09-19T06:09:59.753 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_truncate_cmtime 2024-09-19T06:09:59.763 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] dirhash_collide 2024-09-19T06:09:59.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:09:59 smithi169 ceph-mon[34350]: pgmap v82: 97 pgs: 97 active+clean; 81 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 793 KiB/s wr, 50 op/s 2024-09-19T06:09:59.802 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_rename_overwrite 2024-09-19T06:09:59.848 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] holetest 2024-09-19T06:10:00.087 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_truncate_self 2024-09-19T06:10:00.100 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] af_unix 2024-09-19T06:10:00.128 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_mmap_stale_pmd 2024-09-19T06:10:00.278 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_mmap_cow_race 2024-09-19T06:10:00.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a[30921]: 2024-09-19T06:09:59.998+0000 7f2e2393e640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T06:10:00.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a[30921]: 2024-09-19T06:09:59.998+0000 7f2e2393e640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T06:10:00.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a[30921]: 2024-09-19T06:09:59.998+0000 7f2e2393e640 -1 log_channel(cluster) log [ERR] : mds.c(mds.2): Metadata damage detected 2024-09-19T06:10:00.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a[30921]: 2024-09-19T06:09:59.998+0000 7f2e2393e640 -1 log_channel(cluster) log [ERR] : mds.i(mds.1): Metadata damage detected 2024-09-19T06:10:00.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:00 smithi103 ceph-mon[30925]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T06:10:00.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:00 smithi103 ceph-mon[30925]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T06:10:00.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:00 smithi103 ceph-mon[30925]: mds.c(mds.2): Metadata damage detected 2024-09-19T06:10:00.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:00 smithi103 ceph-mon[30925]: mds.i(mds.1): Metadata damage detected 2024-09-19T06:10:00.466 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_mmap_fallocate 2024-09-19T06:10:00.494 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fsync-err 2024-09-19T06:10:00.507 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_mmap_write_ro 2024-09-19T06:10:00.622 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-19T06:10:00.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:00 smithi174 ceph-mon[34488]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T06:10:00.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:00 smithi174 ceph-mon[34488]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T06:10:00.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:00 smithi174 ceph-mon[34488]: mds.c(mds.2): Metadata damage detected 2024-09-19T06:10:00.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:00 smithi174 ceph-mon[34488]: mds.i(mds.1): Metadata damage detected 2024-09-19T06:10:00.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:00 smithi169 ceph-mon[34350]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T06:10:00.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:00 smithi169 ceph-mon[34350]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T06:10:00.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:00 smithi169 ceph-mon[34350]: mds.c(mds.2): Metadata damage detected 2024-09-19T06:10:00.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:00 smithi169 ceph-mon[34350]: mds.i(mds.1): Metadata damage detected 2024-09-19T06:10:00.785 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-19T06:10:00.828 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_ofd_locks 2024-09-19T06:10:00.857 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_mmap_collision 2024-09-19T06:10:00.955 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] mmap-write-concurrent 2024-09-19T06:10:01.112 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_get_file_time 2024-09-19T06:10:01.214 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_create_short_dirs 2024-09-19T06:10:01.234 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_create_long_dirs 2024-09-19T06:10:01.285 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_enospc 2024-09-19T06:10:01.425 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_mmap_writev_overlap 2024-09-19T06:10:01.548 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] checkpoint_journal 2024-09-19T06:10:01.576 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] mmap-rw-fault 2024-09-19T06:10:01.655 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] allocstale 2024-09-19T06:10:01.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:01 smithi174 ceph-mon[34488]: pgmap v83: 97 pgs: 97 active+clean; 81 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 793 KiB/s wr, 50 op/s 2024-09-19T06:10:01.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:01 smithi103 ceph-mon[30925]: pgmap v83: 97 pgs: 97 active+clean; 81 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 793 KiB/s wr, 50 op/s 2024-09-19T06:10:01.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:01 smithi169 ceph-mon[34350]: pgmap v83: 97 pgs: 97 active+clean; 81 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 793 KiB/s wr, 50 op/s 2024-09-19T06:10:01.812 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_mmap_cow_memory_failure 2024-09-19T06:10:01.955 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fake-dump-rootino 2024-09-19T06:10:01.957 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] dio-buf-fault 2024-09-19T06:10:02.044 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] rewinddir-test 2024-09-19T06:10:02.178 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] readdir-while-renames 2024-09-19T06:10:02.293 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] xfsctl 2024-09-19T06:10:02.311 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] bstat 2024-09-19T06:10:02.441 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_mtab 2024-09-19T06:10:02.556 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] getdevicesize 2024-09-19T06:10:02.761 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] preallo_rw_pattern_reader 2024-09-19T06:10:02.815 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] preallo_rw_pattern_writer 2024-09-19T06:10:02.851 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] ftrunc 2024-09-19T06:10:02.938 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] trunc 2024-09-19T06:10:03.170 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fs_perms 2024-09-19T06:10:03.262 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] testx 2024-09-19T06:10:03.272 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] looptest 2024-09-19T06:10:03.298 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] locktest 2024-09-19T06:10:03.584 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] unwritten_mmap 2024-09-19T06:10:03.594 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] bulkstat_unlink_test 2024-09-19T06:10:03.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:03 smithi174 ceph-mon[34488]: pgmap v84: 97 pgs: 97 active+clean; 83 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 1014 KiB/s wr, 123 op/s 2024-09-19T06:10:03.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:03 smithi103 ceph-mon[30925]: pgmap v84: 97 pgs: 97 active+clean; 83 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 1014 KiB/s wr, 123 op/s 2024-09-19T06:10:03.763 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] deduperace 2024-09-19T06:10:03.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:03 smithi169 ceph-mon[34350]: pgmap v84: 97 pgs: 97 active+clean; 83 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 1014 KiB/s wr, 123 op/s 2024-09-19T06:10:03.955 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] bulkstat_unlink_test_modified 2024-09-19T06:10:04.322 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_futimens 2024-09-19T06:10:04.322 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_dir_offset 2024-09-19T06:10:04.408 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_immutable 2024-09-19T06:10:04.409 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] stale_handle 2024-09-19T06:10:04.699 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_dir_offset2 2024-09-19T06:10:04.699 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] pwrite_mmap_blocked 2024-09-19T06:10:04.823 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] seek_sanity_test 2024-09-19T06:10:05.095 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] seek_copy_test 2024-09-19T06:10:05.192 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_readdir_1 2024-09-19T06:10:05.337 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_readdir_2 2024-09-19T06:10:05.450 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fsync-tester 2024-09-19T06:10:05.561 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] nsexec 2024-09-19T06:10:05.593 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] cloner 2024-09-19T06:10:05.654 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] renameat2 2024-09-19T06:10:05.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:05 smithi174 ceph-mon[34488]: pgmap v85: 97 pgs: 97 active+clean; 83 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 525 KiB/s wr, 92 op/s 2024-09-19T06:10:05.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:05 smithi103 ceph-mon[30925]: pgmap v85: 97 pgs: 97 active+clean; 83 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 525 KiB/s wr, 92 op/s 2024-09-19T06:10:05.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:05 smithi169 ceph-mon[34350]: pgmap v85: 97 pgs: 97 active+clean; 83 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 525 KiB/s wr, 92 op/s 2024-09-19T06:10:05.994 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] e4compact 2024-09-19T06:10:05.994 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_getcwd 2024-09-19T06:10:05.995 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] test-nextquota 2024-09-19T06:10:06.012 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] punch-alternating 2024-09-19T06:10:06.527 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-19T06:10:06.539 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] listxattr 2024-09-19T06:10:06.548 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] dio-interleaved 2024-09-19T06:10:06.661 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_dir_type 2024-09-19T06:10:06.943 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] dio-invalidate-cache 2024-09-19T06:10:06.965 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] stat_test 2024-09-19T06:10:06.983 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_encrypted_d_revalidate 2024-09-19T06:10:07.007 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] attr_replace_test 2024-09-19T06:10:07.364 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] mkswap 2024-09-19T06:10:07.364 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] swapon 2024-09-19T06:10:07.364 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_attr_corruption 2024-09-19T06:10:07.493 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:07 smithi103 ceph-mon[30925]: pgmap v86: 97 pgs: 97 active+clean; 85 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 692 KiB/s wr, 153 op/s 2024-09-19T06:10:07.509 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_open_tmpfiles 2024-09-19T06:10:07.692 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fscrypt-crypt-util 2024-09-19T06:10:07.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:07 smithi174 ceph-mon[34488]: pgmap v86: 97 pgs: 97 active+clean; 85 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 692 KiB/s wr, 153 op/s 2024-09-19T06:10:07.709 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] bulkstat_null_ocount 2024-09-19T06:10:07.713 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] splice-test 2024-09-19T06:10:07.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:07 smithi169 ceph-mon[34350]: pgmap v86: 97 pgs: 97 active+clean; 85 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 692 KiB/s wr, 153 op/s 2024-09-19T06:10:07.889 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] chprojid_fail 2024-09-19T06:10:08.079 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] detached_mounts_propagation 2024-09-19T06:10:08.091 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] ext4_resize 2024-09-19T06:10:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.160+0000 7f4d68eba640 1 -- 172.21.15.103:0/929953568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d64101350 msgr2=0x7f4d6410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.160+0000 7f4d68eba640 1 --2- 172.21.15.103:0/929953568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d64101350 0x7f4d6410d880 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009cd0 tx=0x7f4d5c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.160+0000 7f4d68eba640 1 -- 172.21.15.103:0/929953568 shutdown_connections 2024-09-19T06:10:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.160+0000 7f4d68eba640 1 --2- 172.21.15.103:0/929953568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d64101350 0x7f4d6410d880 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.160+0000 7f4d68eba640 1 --2- 172.21.15.103:0/929953568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d641009b0 0x7f4d64100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.160+0000 7f4d68eba640 1 --2- 172.21.15.103:0/929953568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d641069c0 0x7f4d64106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.160+0000 7f4d68eba640 1 -- 172.21.15.103:0/929953568 >> 172.21.15.103:0/929953568 conn(0x7f4d64077990 msgr2=0x7f4d640fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.160+0000 7f4d68eba640 1 -- 172.21.15.103:0/929953568 shutdown_connections 2024-09-19T06:10:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.160+0000 7f4d68eba640 1 -- 172.21.15.103:0/929953568 wait complete. 2024-09-19T06:10:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.161+0000 7f4d68eba640 1 Processor -- start 2024-09-19T06:10:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.161+0000 7f4d68eba640 1 -- start start 2024-09-19T06:10:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.161+0000 7f4d68eba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d641009b0 0x7f4d64197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.161+0000 7f4d68eba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d64101350 0x7f4d64197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.161+0000 7f4d68eba640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d641069c0 0x7f4d6419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.161+0000 7f4d68eba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64110cb0 con 0x7f4d641009b0 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.161+0000 7f4d68eba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64110b30 con 0x7f4d64101350 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.161+0000 7f4d68eba640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64110e30 con 0x7f4d641069c0 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d6259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d641009b0 0x7f4d64197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d6259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d641009b0 0x7f4d64197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47106/0 (socket says 172.21.15.103:47106) 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d6259c640 1 -- 172.21.15.103:0/1233971695 learned_addr learned my addr 172.21.15.103:0/1233971695 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d641069c0 0x7f4d6419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d64101350 0x7f4d64197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d6259c640 1 -- 172.21.15.103:0/1233971695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d641069c0 msgr2=0x7f4d6419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d6259c640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d641069c0 0x7f4d6419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d6259c640 1 -- 172.21.15.103:0/1233971695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d64101350 msgr2=0x7f4d64197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d6259c640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d64101350 0x7f4d64197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d6259c640 1 -- 172.21.15.103:0/1233971695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6419c130 con 0x7f4d641009b0 2024-09-19T06:10:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.162+0000 7f4d6259c640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d641009b0 0x7f4d64197140 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400d770 tx=0x7f4d5400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.163+0000 7f4d537fe640 1 -- 172.21.15.103:0/1233971695 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54017070 con 0x7f4d641009b0 2024-09-19T06:10:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.163+0000 7f4d537fe640 1 -- 172.21.15.103:0/1233971695 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d540054d0 con 0x7f4d641009b0 2024-09-19T06:10:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.163+0000 7f4d68eba640 1 -- 172.21.15.103:0/1233971695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6419c420 con 0x7f4d641009b0 2024-09-19T06:10:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.163+0000 7f4d537fe640 1 -- 172.21.15.103:0/1233971695 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54004cf0 con 0x7f4d641009b0 2024-09-19T06:10:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.163+0000 7f4d68eba640 1 -- 172.21.15.103:0/1233971695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d640698a0 con 0x7f4d641009b0 2024-09-19T06:10:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.166+0000 7f4d537fe640 1 -- 172.21.15.103:0/1233971695 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f4d54004e90 con 0x7f4d641009b0 2024-09-19T06:10:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.166+0000 7f4d6bc5a740 1 Processor -- start 2024-09-19T06:10:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d6bc5a740 1 -- start start 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 0x5569ec53bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec546770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec546cb0 0x5569ec5490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5569ec4a02f0 con 0x5569ec53c410 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5569ec448270 con 0x5569ec546cb0 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5569ec49c2b0 con 0x5569ec53baf0 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d62d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 0x5569ec53bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d62d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 0x5569ec53bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:57480/0 (socket says 172.21.15.103:57480) 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d62d9d640 1 -- 172.21.15.103:0/1527634521 learned_addr learned my addr 172.21.15.103:0/1527634521 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d6259c640 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec546770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.167+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec546cb0 0x5569ec5490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d62d9d640 1 -- 172.21.15.103:0/1527634521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec546cb0 msgr2=0x5569ec5490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec546cb0 0x5569ec5490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d62d9d640 1 -- 172.21.15.103:0/1527634521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 msgr2=0x5569ec546770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec546770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d62d9d640 1 -- 172.21.15.103:0/1527634521 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ec447340 con 0x5569ec53baf0 2024-09-19T06:10:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec546cb0 0x5569ec5490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d6259c640 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec546770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d537fe640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f4d4c0a3460 0x7f4d4c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 0x5569ec53bed0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009cd0 tx=0x7f4d5c009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=480d08eb7f566714 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d50ff9640 1 -- 172.21.15.103:0/1527634521 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c049070 con 0x5569ec53baf0 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d537fe640 1 -- 172.21.15.103:0/1233971695 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f4d540cf5f0 con 0x7f4d641009b0 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d6259c640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f4d4c0a3460 0x7f4d4c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d50ff9640 1 -- 172.21.15.103:0/1527634521 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d5c036040 con 0x5569ec53baf0 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.168+0000 7f4d50ff9640 1 -- 172.21.15.103:0/1527634521 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0042a0 con 0x5569ec53baf0 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.169+0000 7f4d6259c640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f4d4c0a3460 0x7f4d4c0a5920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d540cce40 tx=0x7f4d5400de80 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.169+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/1527634521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 msgr2=0x5569ec53bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.169+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 0x5569ec53bed0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009cd0 tx=0x7f4d5c009a20 comp rx=0 tx=0).stop 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.169+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/1527634521 shutdown_connections 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.169+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec546cb0 0x5569ec5490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.169+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec546770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.169+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/1527634521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 0x5569ec53bed0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.169+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/1527634521 >> 172.21.15.103:0/1527634521 conn(0x5569ec538060 msgr2=0x5569ec538440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/1527634521 shutdown_connections 2024-09-19T06:10:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/1527634521 wait complete. 2024-09-19T06:10:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 1 -- start start 2024-09-19T06:10:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 1 Processor -- start 2024-09-19T06:10:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 0x5569ec543bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53c410 0x5569ec544130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 0x5569ec544670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5569ec549880 con 0x5569ec546cb0 2024-09-19T06:10:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5569ec429290 con 0x5569ec53c410 2024-09-19T06:10:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5569ec549a00 con 0x5569ec53baf0 2024-09-19T06:10:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.170+0000 7f4d6bc5a740 10 client.0 _ll_register_callbacks cb 0x5569ec45a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:10:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d62d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 0x5569ec544670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d62d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 0x5569ec544670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47112/0 (socket says 172.21.15.103:47112) 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d62d9d640 1 -- 172.21.15.103:0/4086292707 learned_addr learned my addr 172.21.15.103:0/4086292707 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 0x5569ec543bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53c410 0x5569ec544130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d62d9d640 1 -- 172.21.15.103:0/4086292707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 msgr2=0x5569ec543bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 0x5569ec543bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d62d9d640 1 -- 172.21.15.103:0/4086292707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53c410 msgr2=0x5569ec544130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53c410 0x5569ec544130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d62d9d640 1 -- 172.21.15.103:0/4086292707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ec1b3210 con 0x5569ec546cb0 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 0x5569ec544670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009620 tx=0x7f4d5c003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36f15fa365f55c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.171+0000 7f4d49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d49ffb640 1 -- 172.21.15.103:0/4086292707 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c049040 con 0x5569ec546cb0 2024-09-19T06:10:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d49ffb640 1 -- 172.21.15.103:0/4086292707 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f4d5c004b40 con 0x5569ec546cb0 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/4086292707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d5c036040 con 0x5569ec546cb0 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d49ffb640 1 -- 172.21.15.103:0/4086292707 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4d5c004250 con 0x5569ec546cb0 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d6bc5a740 10 client.15888 fetch_fsmap learned FSMap version 30 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/4086292707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5569ec27f620 con 0x5569ec546cb0 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d49ffb640 1 -- 172.21.15.103:0/4086292707 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d5c036040 con 0x5569ec546cb0 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d49ffb640 1 -- 172.21.15.103:0/4086292707 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f4d5c04f070 con 0x5569ec546cb0 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d6bc5a740 10 client.15888 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d6bc5a740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.172+0000 7f4d6bc5a740 20 client.15888 populate_metadata read hostname 'smithi103' 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.173+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5569ec55aed0 0x5569ec55d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.173+0000 7f4d6bc5a740 4 client.15888 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:10:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.173+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/4086292707 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569ec4ada20 con 0x5569ec55aed0 2024-09-19T06:10:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.173+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5569ec55aed0 0x5569ec55d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.173+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5569ec55aed0 0x5569ec55d2c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef7c6b5de515346 server_cookie=80a6934c6d88c779 in_seq=0 out_seq=0 2024-09-19T06:10:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.173+0000 7f4d49ffb640 10 client.15888 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.174+0000 7f4d49ffb640 1 -- 172.21.15.103:0/4086292707 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569ec4ada20 con 0x5569ec55aed0 2024-09-19T06:10:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.174+0000 7f4d49ffb640 10 client.15888 handle_command_reply: tid=0 2024-09-19T06:10:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.174+0000 7f4d6bc5a740 1 client.15888 shutdown 2024-09-19T06:10:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/4086292707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 msgr2=0x5569ec544670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 0x5569ec544670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009620 tx=0x7f4d5c003ca0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/4086292707 shutdown_connections 2024-09-19T06:10:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5569ec55aed0 0x5569ec55d2c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 0x5569ec544670 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53c410 0x5569ec544130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/4086292707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53baf0 0x5569ec543bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/4086292707 >> 172.21.15.103:0/4086292707 conn(0x5569ec538060 msgr2=0x5569ec53ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d49ffb640 0 client.15888 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/4086292707 shutdown_connections 2024-09-19T06:10:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/4086292707 wait complete. 2024-09-19T06:10:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.175+0000 7f4d6bc5a740 20 client.15888 trim_cache size 0 max 16384 2024-09-19T06:10:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d6bc5a740 1 Processor -- start 2024-09-19T06:10:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d6bc5a740 1 -- start start 2024-09-19T06:10:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53baf0 0x5569ec5444a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53c410 0x5569ec545b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 0x5569ec562890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4d641adbf0 con 0x5569ec546cb0 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d641ab490 con 0x5569ec53baf0 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d641a92e0 con 0x5569ec53c410 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d61d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53c410 0x5569ec545b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d62d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 0x5569ec562890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d61d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53c410 0x5569ec545b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:57498/0 (socket says 172.21.15.103:57498) 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d62d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53baf0 0x5569ec5444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.194+0000 7f4d61d9b640 1 -- 172.21.15.103:0/3030329068 learned_addr learned my addr 172.21.15.103:0/3030329068 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.195+0000 7f4d61d9b640 1 -- 172.21.15.103:0/3030329068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53baf0 msgr2=0x5569ec5444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.195+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/3030329068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53baf0 0x5569ec5444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.195+0000 7f4d61d9b640 1 -- 172.21.15.103:0/3030329068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 msgr2=0x5569ec562890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.195+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/3030329068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 0x5569ec562890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.195+0000 7f4d61d9b640 1 -- 172.21.15.103:0/3030329068 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ec537e90 con 0x5569ec53c410 2024-09-19T06:10:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.195+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/3030329068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53c410 0x5569ec545b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d64105f40 tx=0x7f4d58005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17793774d06b408d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.195+0000 7f4d4bfff640 1 -- 172.21.15.103:0/3030329068 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58010430 con 0x5569ec53c410 2024-09-19T06:10:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.195+0000 7f4d4bfff640 1 -- 172.21.15.103:0/3030329068 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d58010a80 con 0x5569ec53c410 2024-09-19T06:10:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.195+0000 7f4d4bfff640 1 -- 172.21.15.103:0/3030329068 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5801e9c0 con 0x5569ec53c410 2024-09-19T06:10:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.196+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3030329068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53c410 msgr2=0x5569ec545b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.196+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/3030329068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53c410 0x5569ec545b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d64105f40 tx=0x7f4d58005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.196+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3030329068 shutdown_connections 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.196+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/3030329068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec546cb0 0x5569ec562890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.196+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/3030329068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec53c410 0x5569ec545b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.196+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/3030329068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53baf0 0x5569ec5444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.196+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3030329068 >> 172.21.15.103:0/3030329068 conn(0x5569ec538060 msgr2=0x5569ec545450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.196+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3030329068 shutdown_connections 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.196+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3030329068 wait complete. 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d6bc5a740 1 -- start start 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d6bc5a740 1 Processor -- start 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53baf0 0x5569ec54a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec54a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d6bc5a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec546cb0 0x5569ec5bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4d641a9950 con 0x5569ec53c410 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d641aadc0 con 0x5569ec53baf0 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d6bc5a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d641aa020 con 0x5569ec546cb0 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d6bc5a740 10 client.0 _ll_register_callbacks cb 0x7f4d5c047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d61d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec54a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d62d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec546cb0 0x5569ec5bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d61d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec54a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47126/0 (socket says 172.21.15.103:47126) 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d61d9b640 1 -- 172.21.15.103:0/3159928154 learned_addr learned my addr 172.21.15.103:0/3159928154 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53baf0 0x5569ec54a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d62d9d640 1 -- 172.21.15.103:0/3159928154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53baf0 msgr2=0x5569ec54a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53baf0 0x5569ec54a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d62d9d640 1 -- 172.21.15.103:0/3159928154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 msgr2=0x5569ec54a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec54a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d62d9d640 1 -- 172.21.15.103:0/3159928154 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ec5bdf00 con 0x5569ec546cb0 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.197+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec54a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d62d9d640 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec546cb0 0x5569ec5bd890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009960 tx=0x7f4d5c003c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cfa622220997bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d49ffb640 1 -- 172.21.15.103:0/3159928154 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c003e20 con 0x5569ec546cb0 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3159928154 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d58010a80 con 0x5569ec546cb0 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d49ffb640 1 -- 172.21.15.103:0/3159928154 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f4d5c02e040 con 0x5569ec546cb0 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d49ffb640 1 -- 172.21.15.103:0/3159928154 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4d5c06b050 con 0x5569ec546cb0 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d6bc5a740 10 client.25468 fetch_fsmap learned FSMap version 30 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3159928154 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5569ec5c52b0 con 0x5569ec546cb0 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d49ffb640 1 -- 172.21.15.103:0/3159928154 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d58010a80 con 0x5569ec546cb0 2024-09-19T06:10:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d49ffb640 1 -- 172.21.15.103:0/3159928154 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f4d5c04f040 con 0x5569ec546cb0 2024-09-19T06:10:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d6bc5a740 10 client.25468 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:10:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d6bc5a740 10 client.25468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:10:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d6bc5a740 20 client.25468 populate_metadata read hostname 'smithi103' 2024-09-19T06:10:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5569ec5c59b0 0x5569ec5c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d6bc5a740 4 client.25468 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:10:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.198+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3159928154 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5569ec4a7d70 con 0x5569ec5c59b0 2024-09-19T06:10:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.199+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5569ec5c59b0 0x5569ec5c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.199+0000 7f4d49ffb640 10 client.25468 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.199+0000 7f4d61d9b640 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5569ec5c59b0 0x5569ec5c7dd0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbd228b3d597b479 server_cookie=373652bec20c6425 in_seq=0 out_seq=0 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d49ffb640 1 -- 172.21.15.103:0/3159928154 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5569ec4a7d70 con 0x5569ec5c59b0 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d49ffb640 10 client.25468 handle_command_reply: tid=0 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 client.25468 shutdown 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3159928154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec546cb0 msgr2=0x5569ec5bd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec546cb0 0x5569ec5bd890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009960 tx=0x7f4d5c003c00 comp rx=0 tx=0).stop 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3159928154 shutdown_connections 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5569ec5c59b0 0x5569ec5c7dd0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5569ec546cb0 0x5569ec5bd890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ec53c410 0x5569ec54a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d49ffb640 0 client.25468 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 --2- 172.21.15.103:0/3159928154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569ec53baf0 0x5569ec54a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3159928154 >> 172.21.15.103:0/3159928154 conn(0x5569ec538060 msgr2=0x5569ec5371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3159928154 shutdown_connections 2024-09-19T06:10:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 1 -- 172.21.15.103:0/3159928154 wait complete. 2024-09-19T06:10:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.216+0000 7f4d6bc5a740 20 client.25468 trim_cache size 0 max 16384 2024-09-19T06:10:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:10:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:10:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:10:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:10:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 -- 172.21.15.103:0/1233971695 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f4d4c0a3460 msgr2=0x7f4d4c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f4d4c0a3460 0x7f4d4c0a5920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d540cce40 tx=0x7f4d5400de80 comp rx=0 tx=0).stop 2024-09-19T06:10:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 -- 172.21.15.103:0/1233971695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d641009b0 msgr2=0x7f4d64197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d641009b0 0x7f4d64197140 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400d770 tx=0x7f4d5400dc30 comp rx=0 tx=0).stop 2024-09-19T06:10:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 -- 172.21.15.103:0/1233971695 shutdown_connections 2024-09-19T06:10:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f4d4c0a3460 0x7f4d4c0a5920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d641069c0 0x7f4d6419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d64101350 0x7f4d64197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 --2- 172.21.15.103:0/1233971695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d641009b0 0x7f4d64197140 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 -- 172.21.15.103:0/1233971695 >> 172.21.15.103:0/1233971695 conn(0x7f4d64077990 msgr2=0x7f4d640ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 -- 172.21.15.103:0/1233971695 shutdown_connections 2024-09-19T06:10:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:08.217+0000 7f4d68eba640 1 -- 172.21.15.103:0/1233971695 wait complete. 2024-09-19T06:10:08.240 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_readdir_3 2024-09-19T06:10:08.415 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] splice2pipe 2024-09-19T06:10:08.474 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] uuid_ioctl 2024-09-19T06:10:08.608 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-19T06:10:08.720 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fiemap-fault 2024-09-19T06:10:08.737 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fiemap-tester 2024-09-19T06:10:08.798 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_stripealign 2024-09-19T06:10:08.985 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] open_by_handle 2024-09-19T06:10:09.043 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_mmap_dio 2024-09-19T06:10:09.121 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] xfsfind 2024-09-19T06:10:09.197 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] t_reflink_read_race 2024-09-19T06:10:09.350 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] fssum 2024-09-19T06:10:09.423 INFO:tasks.workunit.client.0.smithi103.stdout:Building log-writes 2024-09-19T06:10:09.456 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] replay-log 2024-09-19T06:10:09.505 INFO:tasks.workunit.client.0.smithi103.stdout:Building perf 2024-09-19T06:10:09.524 INFO:tasks.workunit.client.0.smithi103.stdout:Building aio-dio-regress 2024-09-19T06:10:09.577 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aiocp 2024-09-19T06:10:09.584 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-19T06:10:09.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:09 smithi174 ceph-mon[34488]: pgmap v87: 97 pgs: 97 active+clean; 85 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 388 KiB/s wr, 133 op/s 2024-09-19T06:10:09.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:09 smithi103 ceph-mon[30925]: pgmap v87: 97 pgs: 97 active+clean; 85 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 388 KiB/s wr, 133 op/s 2024-09-19T06:10:09.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:09 smithi169 ceph-mon[34350]: pgmap v87: 97 pgs: 97 active+clean; 85 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 388 KiB/s wr, 133 op/s 2024-09-19T06:10:09.881 INFO:tasks.workunit.client.0.smithi103.stdout:Building vfs 2024-09-19T06:10:09.915 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] vfstest 2024-09-19T06:10:09.925 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-append-write-read-race 2024-09-19T06:10:09.961 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-cow-race 2024-09-19T06:10:10.038 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] mount-idmapped 2024-09-19T06:10:10.230 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-cycle-write 2024-09-19T06:10:10.244 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-eof-race 2024-09-19T06:10:10.529 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-extend-stat 2024-09-19T06:10:10.537 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-fcntl-race 2024-09-19T06:10:10.664 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-hole-filling-race 2024-09-19T06:10:10.822 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-invalidate-failure 2024-09-19T06:10:10.830 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-invalidate-readahead 2024-09-19T06:10:10.930 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aiodio_sparse2 2024-09-19T06:10:11.101 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-subblock-eof-read 2024-09-19T06:10:11.122 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-dio-write-verify 2024-09-19T06:10:11.281 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-19T06:10:11.345 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-19T06:10:11.437 INFO:tasks.workunit.client.0.smithi103.stdout: [CC] aio-last-ref-held-by-io 2024-09-19T06:10:11.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:11 smithi174 ceph-mon[34488]: pgmap v88: 97 pgs: 97 active+clean; 85 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 388 KiB/s wr, 133 op/s 2024-09-19T06:10:11.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:11 smithi103 ceph-mon[30925]: pgmap v88: 97 pgs: 97 active+clean; 85 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 388 KiB/s wr, 133 op/s 2024-09-19T06:10:11.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:11 smithi169 ceph-mon[34350]: pgmap v88: 97 pgs: 97 active+clean; 85 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 388 KiB/s wr, 133 op/s 2024-09-19T06:10:12.419 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd .. 2024-09-19T06:10:12.420 INFO:tasks.workunit.client.0.smithi103.stderr:+ cp xfstests-dev/ltp/fsx . 2024-09-19T06:10:12.427 INFO:tasks.workunit.client.0.smithi103.stderr:+ OPTIONS=-z 2024-09-19T06:10:12.427 INFO:tasks.workunit.client.0.smithi103.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2024-09-19T06:10:12.428 INFO:tasks.workunit.client.0.smithi103.stdout:Seed set to 1 2024-09-19T06:10:12.461 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T06:10:12.462 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T06:10:12.462 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T06:10:12.462 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T06:10:12.466 INFO:tasks.workunit.client.0.smithi103.stdout:skipping zero size read 2024-09-19T06:10:12.466 INFO:tasks.workunit.client.0.smithi103.stdout:skipping zero size read 2024-09-19T06:10:12.467 INFO:tasks.workunit.client.0.smithi103.stdout:fallocating to largest ever: 0x9abd6 2024-09-19T06:10:12.503 INFO:tasks.workunit.client.0.smithi103.stdout:truncating to largest ever: 0xaeaec 2024-09-19T06:10:12.533 INFO:tasks.workunit.client.0.smithi103.stdout:truncating to largest ever: 0xf3194 2024-09-19T06:10:12.567 INFO:tasks.workunit.client.0.smithi103.stdout:copying to largest ever: 0xf3ceb 2024-09-19T06:10:12.700 INFO:tasks.workunit.client.0.smithi103.stdout:copying to largest ever: 0xfaccc 2024-09-19T06:10:12.708 INFO:tasks.workunit.client.0.smithi103.stdout:fallocating to largest ever: 0xfbb6d 2024-09-19T06:10:12.999 INFO:tasks.workunit.client.0.smithi103.stdout:fallocating to largest ever: 0xffee7 2024-09-19T06:10:13.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:13 smithi174 ceph-mon[34488]: pgmap v89: 97 pgs: 97 active+clean; 87 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 565 KiB/s wr, 193 op/s 2024-09-19T06:10:13.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:13 smithi103 ceph-mon[30925]: pgmap v89: 97 pgs: 97 active+clean; 87 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 565 KiB/s wr, 193 op/s 2024-09-19T06:10:13.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:13 smithi169 ceph-mon[34350]: pgmap v89: 97 pgs: 97 active+clean; 87 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 565 KiB/s wr, 193 op/s 2024-09-19T06:10:15.001 INFO:tasks.workunit.client.0.smithi103.stdout:fallocating to largest ever: 0x100000 2024-09-19T06:10:15.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:15 smithi174 ceph-mon[34488]: pgmap v90: 97 pgs: 97 active+clean; 87 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 343 KiB/s wr, 121 op/s 2024-09-19T06:10:15.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:15 smithi103 ceph-mon[30925]: pgmap v90: 97 pgs: 97 active+clean; 87 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 343 KiB/s wr, 121 op/s 2024-09-19T06:10:15.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:15 smithi169 ceph-mon[34350]: pgmap v90: 97 pgs: 97 active+clean; 87 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 343 KiB/s wr, 121 op/s 2024-09-19T06:10:17.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:17 smithi174 ceph-mon[34488]: pgmap v91: 97 pgs: 97 active+clean; 90 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 383 op/s 2024-09-19T06:10:17.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:17 smithi103 ceph-mon[30925]: pgmap v91: 97 pgs: 97 active+clean; 90 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 383 op/s 2024-09-19T06:10:17.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:17 smithi169 ceph-mon[34350]: pgmap v91: 97 pgs: 97 active+clean; 90 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 383 op/s 2024-09-19T06:10:19.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:19 smithi174 ceph-mon[34488]: pgmap v92: 97 pgs: 97 active+clean; 90 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 322 op/s 2024-09-19T06:10:19.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:19 smithi103 ceph-mon[30925]: pgmap v92: 97 pgs: 97 active+clean; 90 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 322 op/s 2024-09-19T06:10:19.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:19 smithi169 ceph-mon[34350]: pgmap v92: 97 pgs: 97 active+clean; 90 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 322 op/s 2024-09-19T06:10:20.539 INFO:tasks.workunit.client.0.smithi103.stdout:10000 punch from 0x713e to 0x9907, (0x27c9 bytes) 2024-09-19T06:10:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 -- 172.21.15.103:0/912132318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c101350 msgr2=0x7fe41c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 --2- 172.21.15.103:0/912132318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c101350 0x7fe41c10d880 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe414009cd0 tx=0x7fe41402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 -- 172.21.15.103:0/912132318 shutdown_connections 2024-09-19T06:10:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 --2- 172.21.15.103:0/912132318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c101350 0x7fe41c10d880 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 --2- 172.21.15.103:0/912132318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe41c1009b0 0x7fe41c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 --2- 172.21.15.103:0/912132318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe41c1069c0 0x7fe41c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 -- 172.21.15.103:0/912132318 >> 172.21.15.103:0/912132318 conn(0x7fe41c077990 msgr2=0x7fe41c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 -- 172.21.15.103:0/912132318 shutdown_connections 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 -- 172.21.15.103:0/912132318 wait complete. 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 Processor -- start 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.312+0000 7fe424417640 1 -- start start 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe424417640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe41c1009b0 0x7fe41c196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe424417640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c101350 0x7fe41c1973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe424417640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe41c1069c0 0x7fe41c1978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe424417640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c110cb0 con 0x7fe41c101350 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe424417640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c110b30 con 0x7fe41c1069c0 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe424417640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c110e30 con 0x7fe41c1009b0 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4219b2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c101350 0x7fe41c1973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4219b2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c101350 0x7fe41c1973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48468/0 (socket says 172.21.15.103:48468) 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4219b2640 1 -- 172.21.15.103:0/962970317 learned_addr learned my addr 172.21.15.103:0/962970317 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4229b4640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe41c1069c0 0x7fe41c1978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4221b3640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe41c1009b0 0x7fe41c196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4219b2640 1 -- 172.21.15.103:0/962970317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe41c1009b0 msgr2=0x7fe41c196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4219b2640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe41c1009b0 0x7fe41c196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4219b2640 1 -- 172.21.15.103:0/962970317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe41c1069c0 msgr2=0x7fe41c1978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4219b2640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe41c1069c0 0x7fe41c1978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4219b2640 1 -- 172.21.15.103:0/962970317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41c1a66e0 con 0x7fe41c101350 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4229b4640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe41c1069c0 0x7fe41c1978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4219b2640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c101350 0x7fe41c1973b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00d770 tx=0x7fe40c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.313+0000 7fe4137fe640 1 -- 172.21.15.103:0/962970317 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c017070 con 0x7fe41c101350 2024-09-19T06:10:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.314+0000 7fe424417640 1 -- 172.21.15.103:0/962970317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41c1a69d0 con 0x7fe41c101350 2024-09-19T06:10:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.314+0000 7fe4137fe640 1 -- 172.21.15.103:0/962970317 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe40c0054d0 con 0x7fe41c101350 2024-09-19T06:10:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.314+0000 7fe4137fe640 1 -- 172.21.15.103:0/962970317 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c004cf0 con 0x7fe41c101350 2024-09-19T06:10:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.314+0000 7fe424417640 1 -- 172.21.15.103:0/962970317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe41c1a6ed0 con 0x7fe41c101350 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.316+0000 7fe4137fe640 1 -- 172.21.15.103:0/962970317 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7fe40c004e90 con 0x7fe41c101350 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.316+0000 7fe427288740 1 Processor -- start 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe427288740 1 -- start start 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe427288740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a20ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe427288740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a2b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe427288740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a2e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe427288740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5622c89852f0 con 0x5622c8a20af0 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe427288740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5622c892d270 con 0x5622c8a2bcb0 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe427288740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5622c89812b0 con 0x5622c8a21410 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4137fe640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe4080a3460 0x7fe4080a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4229b4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a20ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4221b3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a2b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4221b3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a2b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:39416/0 (socket says 172.21.15.103:39416) 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4221b3640 1 -- 172.21.15.103:0/3926663690 learned_addr learned my addr 172.21.15.103:0/3926663690 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4219b2640 1 --2- 172.21.15.103:0/3926663690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a2e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4229b4640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe4080a3460 0x7fe4080a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4137fe640 1 -- 172.21.15.103:0/962970317 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fe40c0cf690 con 0x7fe41c101350 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4221b3640 1 -- 172.21.15.103:0/3926663690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 msgr2=0x5622c8a2e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4221b3640 1 --2- 172.21.15.103:0/3926663690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a2e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4221b3640 1 -- 172.21.15.103:0/3926663690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 msgr2=0x5622c8a20ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4221b3640 1 --2- 172.21.15.103:0/3926663690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a20ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4221b3640 1 -- 172.21.15.103:0/3926663690 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622c892c340 con 0x5622c8a21410 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.317+0000 7fe4229b4640 1 --2- 172.21.15.103:0/3926663690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a20ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.318+0000 7fe4221b3640 1 --2- 172.21.15.103:0/3926663690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a2b770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe418009c70 tx=0x7fe418011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d778ce6e9a91a4f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.318+0000 7fe4229b4640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe4080a3460 0x7fe4080a5920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe414006010 tx=0x7fe414004a60 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.318+0000 7fe410bfe640 1 -- 172.21.15.103:0/3926663690 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418004230 con 0x5622c8a21410 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.318+0000 7fe410bfe640 1 -- 172.21.15.103:0/3926663690 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4180043d0 con 0x5622c8a21410 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.318+0000 7fe410bfe640 1 -- 172.21.15.103:0/3926663690 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4180196d0 con 0x5622c8a21410 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 -- 172.21.15.103:0/3926663690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 msgr2=0x5622c8a2b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 --2- 172.21.15.103:0/3926663690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a2b770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe418009c70 tx=0x7fe418011810 comp rx=0 tx=0).stop 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 -- 172.21.15.103:0/3926663690 shutdown_connections 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 --2- 172.21.15.103:0/3926663690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a2e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 --2- 172.21.15.103:0/3926663690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a2b770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 --2- 172.21.15.103:0/3926663690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a20ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 -- 172.21.15.103:0/3926663690 >> 172.21.15.103:0/3926663690 conn(0x5622c8a1d060 msgr2=0x5622c8a1d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 -- 172.21.15.103:0/3926663690 shutdown_connections 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 -- 172.21.15.103:0/3926663690 wait complete. 2024-09-19T06:10:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 -- start start 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 Processor -- start 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a28b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a29070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a295b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5622c8a2e880 con 0x5622c8a20af0 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5622c890e290 con 0x5622c8a2bcb0 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5622c8a2ea00 con 0x5622c8a21410 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe427288740 10 client.0 _ll_register_callbacks cb 0x5622c893f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe4221b3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a28b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.319+0000 7fe4221b3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a28b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48486/0 (socket says 172.21.15.103:48486) 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe4221b3640 1 -- 172.21.15.103:0/644048052 learned_addr learned my addr 172.21.15.103:0/644048052 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe4229b4640 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a295b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe4219b2640 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a29070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe4221b3640 1 -- 172.21.15.103:0/644048052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 msgr2=0x5622c8a29070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe4221b3640 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a29070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe4221b3640 1 -- 172.21.15.103:0/644048052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 msgr2=0x5622c8a295b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe4221b3640 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a295b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe4221b3640 1 -- 172.21.15.103:0/644048052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622c8698210 con 0x5622c8a20af0 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe4221b3640 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a28b30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe418005bc0 tx=0x7fe418003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de129c52b7631d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe405ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe405ffb640 1 -- 172.21.15.103:0/644048052 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418027070 con 0x5622c8a20af0 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe405ffb640 1 -- 172.21.15.103:0/644048052 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fe418003800 con 0x5622c8a20af0 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe427288740 1 -- 172.21.15.103:0/644048052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4180043d0 con 0x5622c8a20af0 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe405ffb640 1 -- 172.21.15.103:0/644048052 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe418033050 con 0x5622c8a20af0 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe427288740 10 client.15906 fetch_fsmap learned FSMap version 30 2024-09-19T06:10:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.320+0000 7fe427288740 1 -- 172.21.15.103:0/644048052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5622c8764620 con 0x5622c8a20af0 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe405ffb640 1 -- 172.21.15.103:0/644048052 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4180043d0 con 0x5622c8a20af0 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe405ffb640 1 -- 172.21.15.103:0/644048052 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fe418018070 con 0x5622c8a20af0 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe427288740 10 client.15906 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe427288740 10 client.15906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe427288740 20 client.15906 populate_metadata read hostname 'smithi103' 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe427288740 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5622c8a3bb30 0x5622c8a3df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe427288740 4 client.15906 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe427288740 1 -- 172.21.15.103:0/644048052 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622c8992a20 con 0x5622c8a3bb30 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe4219b2640 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5622c8a3bb30 0x5622c8a3df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe405ffb640 10 client.15906 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.321+0000 7fe4219b2640 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5622c8a3bb30 0x5622c8a3df20 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=877861f342edffbe server_cookie=98154398d7bf3cc5 in_seq=0 out_seq=0 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe405ffb640 1 -- 172.21.15.103:0/644048052 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622c8992a20 con 0x5622c8a3bb30 2024-09-19T06:10:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe405ffb640 10 client.15906 handle_command_reply: tid=0 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 client.15906 shutdown 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 -- 172.21.15.103:0/644048052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 msgr2=0x5622c8a28b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a28b30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe418005bc0 tx=0x7fe418003d70 comp rx=0 tx=0).stop 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 -- 172.21.15.103:0/644048052 shutdown_connections 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5622c8a3bb30 0x5622c8a3df20 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe405ffb640 0 client.15906 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a295b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a29070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 --2- 172.21.15.103:0/644048052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a28b30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 -- 172.21.15.103:0/644048052 >> 172.21.15.103:0/644048052 conn(0x5622c8a1d060 msgr2=0x5622c8a1c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 -- 172.21.15.103:0/644048052 shutdown_connections 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 1 -- 172.21.15.103:0/644048052 wait complete. 2024-09-19T06:10:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.322+0000 7fe427288740 20 client.15906 trim_cache size 0 max 16384 2024-09-19T06:10:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe427288740 1 Processor -- start 2024-09-19T06:10:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe427288740 1 -- start start 2024-09-19T06:10:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe427288740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a29060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe427288740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a295a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe427288740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a436f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe427288740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c1b2140 con 0x5622c8a20af0 2024-09-19T06:10:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe427288740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c1af9e0 con 0x5622c8a2bcb0 2024-09-19T06:10:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe427288740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c1ad830 con 0x5622c8a21410 2024-09-19T06:10:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe4221b3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a29060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe4221b3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a29060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48500/0 (socket says 172.21.15.103:48500) 2024-09-19T06:10:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe4221b3640 1 -- 172.21.15.103:0/562788908 learned_addr learned my addr 172.21.15.103:0/562788908 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe4219b2640 1 --2- 172.21.15.103:0/562788908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a295a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe4229b4640 1 --2- 172.21.15.103:0/562788908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe4221b3640 1 -- 172.21.15.103:0/562788908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 msgr2=0x5622c8a295a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe4221b3640 1 --2- 172.21.15.103:0/562788908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a295a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe4221b3640 1 -- 172.21.15.103:0/562788908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 msgr2=0x5622c8a436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.337+0000 7fe4221b3640 1 --2- 172.21.15.103:0/562788908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.338+0000 7fe4221b3640 1 -- 172.21.15.103:0/562788908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622c8a2b680 con 0x5622c8a20af0 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.338+0000 7fe4219b2640 1 --2- 172.21.15.103:0/562788908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a295a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.338+0000 7fe4221b3640 1 --2- 172.21.15.103:0/562788908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a29060 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe4180059b0 tx=0x7fe418001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525d0b62ebba4eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.338+0000 7fe407fff640 1 -- 172.21.15.103:0/562788908 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418027070 con 0x5622c8a20af0 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.338+0000 7fe407fff640 1 -- 172.21.15.103:0/562788908 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe418015030 con 0x5622c8a20af0 2024-09-19T06:10:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.338+0000 7fe407fff640 1 -- 172.21.15.103:0/562788908 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4180097c0 con 0x5622c8a20af0 2024-09-19T06:10:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 -- 172.21.15.103:0/562788908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 msgr2=0x5622c8a29060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 --2- 172.21.15.103:0/562788908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a29060 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe4180059b0 tx=0x7fe418001e50 comp rx=0 tx=0).stop 2024-09-19T06:10:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 -- 172.21.15.103:0/562788908 shutdown_connections 2024-09-19T06:10:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 --2- 172.21.15.103:0/562788908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a2bcb0 0x5622c8a436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 --2- 172.21.15.103:0/562788908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a21410 0x5622c8a295a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 --2- 172.21.15.103:0/562788908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a29060 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 -- 172.21.15.103:0/562788908 >> 172.21.15.103:0/562788908 conn(0x5622c8a1d060 msgr2=0x5622c8a2abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 -- 172.21.15.103:0/562788908 shutdown_connections 2024-09-19T06:10:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 -- 172.21.15.103:0/562788908 wait complete. 2024-09-19T06:10:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 -- start start 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 Processor -- start 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a2f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a21410 0x5622c8a2fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a2bcb0 0x5622c8a33ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c1adea0 con 0x5622c8a20af0 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c1af310 con 0x5622c8a21410 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c1ae570 con 0x5622c8a2bcb0 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe427288740 10 client.0 _ll_register_callbacks cb 0x7fe40c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe4221b3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a2f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe4219b2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a21410 0x5622c8a2fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.339+0000 7fe4221b3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a2f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48504/0 (socket says 172.21.15.103:48504) 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe4221b3640 1 -- 172.21.15.103:0/765970940 learned_addr learned my addr 172.21.15.103:0/765970940 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe4229b4640 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a2bcb0 0x5622c8a33ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe4219b2640 1 -- 172.21.15.103:0/765970940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a2bcb0 msgr2=0x5622c8a33ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe4219b2640 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a2bcb0 0x5622c8a33ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe4219b2640 1 -- 172.21.15.103:0/765970940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 msgr2=0x5622c8a2f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe4219b2640 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a2f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe4219b2640 1 -- 172.21.15.103:0/765970940 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622c8a34120 con 0x5622c8a21410 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe4221b3640 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a2f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe4219b2640 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a21410 0x5622c8a2fa20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0cce30 tx=0x7fe40c06a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f67fa75d938f0882 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe405ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe405ffb640 1 -- 172.21.15.103:0/765970940 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c020040 con 0x5622c8a21410 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe405ffb640 1 -- 172.21.15.103:0/765970940 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fe40c0cd0b0 con 0x5622c8a21410 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe427288740 1 -- 172.21.15.103:0/765970940 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe418015030 con 0x5622c8a21410 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe405ffb640 1 -- 172.21.15.103:0/765970940 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe40c09ba70 con 0x5622c8a21410 2024-09-19T06:10:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe427288740 10 client.25445 fetch_fsmap learned FSMap version 30 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.340+0000 7fe427288740 1 -- 172.21.15.103:0/765970940 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5622c8aa6270 con 0x5622c8a21410 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe405ffb640 1 -- 172.21.15.103:0/765970940 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe418015030 con 0x5622c8a21410 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe405ffb640 1 -- 172.21.15.103:0/765970940 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fe40c0a41a0 con 0x5622c8a21410 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe427288740 10 client.25445 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe427288740 10 client.25445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe427288740 20 client.25445 populate_metadata read hostname 'smithi103' 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe427288740 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5622c8a3bb30 0x5622c8aa8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe427288740 4 client.25445 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe427288740 1 -- 172.21.15.103:0/765970940 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5622c898cd70 con 0x5622c8a3bb30 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe4221b3640 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5622c8a3bb30 0x5622c8aa8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe4221b3640 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5622c8a3bb30 0x5622c8aa8a90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61445f5b9a910ef7 server_cookie=ab3d241ec92ac927 in_seq=0 out_seq=0 2024-09-19T06:10:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.341+0000 7fe405ffb640 10 client.25445 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe405ffb640 1 -- 172.21.15.103:0/765970940 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5622c898cd70 con 0x5622c8a3bb30 2024-09-19T06:10:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe405ffb640 10 client.25445 handle_command_reply: tid=0 2024-09-19T06:10:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 client.25445 shutdown 2024-09-19T06:10:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 -- 172.21.15.103:0/765970940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a21410 msgr2=0x5622c8a2fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a21410 0x5622c8a2fa20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0cce30 tx=0x7fe40c06a760 comp rx=0 tx=0).stop 2024-09-19T06:10:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 -- 172.21.15.103:0/765970940 shutdown_connections 2024-09-19T06:10:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5622c8a3bb30 0x5622c8aa8a90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622c8a2bcb0 0x5622c8a33ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe405ffb640 0 client.25445 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622c8a21410 0x5622c8a2fa20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 --2- 172.21.15.103:0/765970940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622c8a20af0 0x5622c8a2f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 -- 172.21.15.103:0/765970940 >> 172.21.15.103:0/765970940 conn(0x5622c8a1d060 msgr2=0x5622c8a1b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:21.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 -- 172.21.15.103:0/765970940 shutdown_connections 2024-09-19T06:10:21.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 1 -- 172.21.15.103:0/765970940 wait complete. 2024-09-19T06:10:21.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.355+0000 7fe427288740 20 client.25445 trim_cache size 0 max 16384 2024-09-19T06:10:21.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:10:21.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:10:21.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:10:21.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 -- 172.21.15.103:0/962970317 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe4080a3460 msgr2=0x7fe4080a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe4080a3460 0x7fe4080a5920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe414006010 tx=0x7fe414004a60 comp rx=0 tx=0).stop 2024-09-19T06:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 -- 172.21.15.103:0/962970317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c101350 msgr2=0x7fe41c1973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c101350 0x7fe41c1973b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00d770 tx=0x7fe40c00dc30 comp rx=0 tx=0).stop 2024-09-19T06:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 -- 172.21.15.103:0/962970317 shutdown_connections 2024-09-19T06:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe4080a3460 0x7fe4080a5920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe41c1069c0 0x7fe41c1978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c101350 0x7fe41c1973b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 --2- 172.21.15.103:0/962970317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe41c1009b0 0x7fe41c196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 -- 172.21.15.103:0/962970317 >> 172.21.15.103:0/962970317 conn(0x7fe41c077990 msgr2=0x7fe41c103800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 -- 172.21.15.103:0/962970317 shutdown_connections 2024-09-19T06:10:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:21.356+0000 7fe424417640 1 -- 172.21.15.103:0/962970317 wait complete. 2024-09-19T06:10:21.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:21 smithi174 ceph-mon[34488]: pgmap v93: 97 pgs: 97 active+clean; 90 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 322 op/s 2024-09-19T06:10:21.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:21 smithi103 ceph-mon[30925]: pgmap v93: 97 pgs: 97 active+clean; 90 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 322 op/s 2024-09-19T06:10:21.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:21 smithi169 ceph-mon[34350]: pgmap v93: 97 pgs: 97 active+clean; 90 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 322 op/s 2024-09-19T06:10:23.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:23 smithi174 ceph-mon[34488]: pgmap v94: 97 pgs: 97 active+clean; 94 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.1 MiB/s wr, 679 op/s 2024-09-19T06:10:23.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:23 smithi103 ceph-mon[30925]: pgmap v94: 97 pgs: 97 active+clean; 94 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.1 MiB/s wr, 679 op/s 2024-09-19T06:10:23.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:23 smithi169 ceph-mon[34350]: pgmap v94: 97 pgs: 97 active+clean; 94 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.1 MiB/s wr, 679 op/s 2024-09-19T06:10:25.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:25 smithi174 ceph-mon[34488]: pgmap v95: 97 pgs: 97 active+clean; 94 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 4.9 MiB/s wr, 619 op/s 2024-09-19T06:10:25.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:25 smithi103 ceph-mon[30925]: pgmap v95: 97 pgs: 97 active+clean; 94 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 4.9 MiB/s wr, 619 op/s 2024-09-19T06:10:25.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:25 smithi169 ceph-mon[34350]: pgmap v95: 97 pgs: 97 active+clean; 94 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 4.9 MiB/s wr, 619 op/s 2024-09-19T06:10:27.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:27 smithi174 ceph-mon[34488]: pgmap v96: 97 pgs: 97 active+clean; 89 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 7.6 MiB/s wr, 960 op/s 2024-09-19T06:10:27.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:27 smithi103 ceph-mon[30925]: pgmap v96: 97 pgs: 97 active+clean; 89 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 7.6 MiB/s wr, 960 op/s 2024-09-19T06:10:27.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:27 smithi169 ceph-mon[34350]: pgmap v96: 97 pgs: 97 active+clean; 89 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 7.6 MiB/s wr, 960 op/s 2024-09-19T06:10:29.382 INFO:tasks.workunit.client.0.smithi103.stdout:20000 punch from 0x9116f to 0x978af, (0x6740 bytes) 2024-09-19T06:10:29.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:29 smithi174 ceph-mon[34488]: pgmap v97: 97 pgs: 97 active+clean; 89 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.5 MiB/s wr, 698 op/s 2024-09-19T06:10:29.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:29 smithi103 ceph-mon[30925]: pgmap v97: 97 pgs: 97 active+clean; 89 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.5 MiB/s wr, 698 op/s 2024-09-19T06:10:29.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:29 smithi169 ceph-mon[34350]: pgmap v97: 97 pgs: 97 active+clean; 89 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.5 MiB/s wr, 698 op/s 2024-09-19T06:10:31.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:31 smithi174 ceph-mon[34488]: pgmap v98: 97 pgs: 97 active+clean; 89 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.5 MiB/s wr, 698 op/s 2024-09-19T06:10:31.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:31 smithi103 ceph-mon[30925]: pgmap v98: 97 pgs: 97 active+clean; 89 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.5 MiB/s wr, 698 op/s 2024-09-19T06:10:31.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:31 smithi169 ceph-mon[34350]: pgmap v98: 97 pgs: 97 active+clean; 89 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.5 MiB/s wr, 698 op/s 2024-09-19T06:10:32.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:32 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:32.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:32 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:32.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:32 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:32.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:32 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:10:32.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:32 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:32.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:32 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:32.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:32 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:32.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:32 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:10:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:32 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:32 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:32 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:32.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:32 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:10:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:33 smithi174 ceph-mon[34488]: pgmap v99: 97 pgs: 97 active+clean; 91 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 8.0 MiB/s wr, 1.02k op/s 2024-09-19T06:10:33.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:33 smithi103 ceph-mon[30925]: pgmap v99: 97 pgs: 97 active+clean; 91 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 8.0 MiB/s wr, 1.02k op/s 2024-09-19T06:10:33.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:33 smithi169 ceph-mon[34350]: pgmap v99: 97 pgs: 97 active+clean; 91 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 8.0 MiB/s wr, 1.02k op/s 2024-09-19T06:10:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.447+0000 7f5f89531640 1 -- 172.21.15.103:0/2222239874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f841069e0 msgr2=0x7f5f84106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.447+0000 7f5f89531640 1 --2- 172.21.15.103:0/2222239874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f841069e0 0x7f5f84106dc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009930 tx=0x7f5f7402a420 comp rx=0 tx=0).stop 2024-09-19T06:10:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.447+0000 7f5f89531640 1 -- 172.21.15.103:0/2222239874 shutdown_connections 2024-09-19T06:10:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.447+0000 7f5f89531640 1 --2- 172.21.15.103:0/2222239874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f84101370 0x7f5f8410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.447+0000 7f5f89531640 1 --2- 172.21.15.103:0/2222239874 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f841009d0 0x7f5f84100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.447+0000 7f5f89531640 1 --2- 172.21.15.103:0/2222239874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f841069e0 0x7f5f84106dc0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.447+0000 7f5f89531640 1 -- 172.21.15.103:0/2222239874 >> 172.21.15.103:0/2222239874 conn(0x7f5f840fc6b0 msgr2=0x7f5f840fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.447+0000 7f5f89531640 1 -- 172.21.15.103:0/2222239874 shutdown_connections 2024-09-19T06:10:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.447+0000 7f5f89531640 1 -- 172.21.15.103:0/2222239874 wait complete. 2024-09-19T06:10:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f89531640 1 Processor -- start 2024-09-19T06:10:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f89531640 1 -- start start 2024-09-19T06:10:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f89531640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f841009d0 0x7f5f8419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f89531640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f84101370 0x7f5f8419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f89531640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f841069e0 0x7f5f8419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f89531640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84110cd0 con 0x7f5f841009d0 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f89531640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84110b50 con 0x7f5f841069e0 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f89531640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84110e50 con 0x7f5f84101370 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f82ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f841009d0 0x7f5f8419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f837fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f841069e0 0x7f5f8419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f82ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f841009d0 0x7f5f8419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35112/0 (socket says 172.21.15.103:35112) 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f82ffd640 1 -- 172.21.15.103:0/2599474510 learned_addr learned my addr 172.21.15.103:0/2599474510 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.448+0000 7f5f827fc640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f84101370 0x7f5f8419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.449+0000 7f5f82ffd640 1 -- 172.21.15.103:0/2599474510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f84101370 msgr2=0x7f5f8419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.449+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f84101370 0x7f5f8419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.449+0000 7f5f82ffd640 1 -- 172.21.15.103:0/2599474510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f841069e0 msgr2=0x7f5f8419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.449+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f841069e0 0x7f5f8419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.449+0000 7f5f82ffd640 1 -- 172.21.15.103:0/2599474510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8419f450 con 0x7f5f841009d0 2024-09-19T06:10:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.449+0000 7f5f837fe640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f841069e0 0x7f5f8419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.449+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f841009d0 0x7f5f8419a460 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5f74005940 tx=0x7f5f740040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.449+0000 7f5f6bfff640 1 -- 172.21.15.103:0/2599474510 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7403f030 con 0x7f5f841009d0 2024-09-19T06:10:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.450+0000 7f5f6bfff640 1 -- 172.21.15.103:0/2599474510 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f740044c0 con 0x7f5f841009d0 2024-09-19T06:10:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.450+0000 7f5f89531640 1 -- 172.21.15.103:0/2599474510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f8419f6e0 con 0x7f5f841009d0 2024-09-19T06:10:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.450+0000 7f5f6bfff640 1 -- 172.21.15.103:0/2599474510 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f74035070 con 0x7f5f841009d0 2024-09-19T06:10:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.450+0000 7f5f89531640 1 -- 172.21.15.103:0/2599474510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f841a6fd0 con 0x7f5f841009d0 2024-09-19T06:10:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.452+0000 7f5f6bfff640 1 -- 172.21.15.103:0/2599474510 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f5f74042030 con 0x7f5f841009d0 2024-09-19T06:10:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.452+0000 7f5f8c2cc740 1 Processor -- start 2024-09-19T06:10:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.452+0000 7f5f8c2cc740 1 -- start start 2024-09-19T06:10:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.452+0000 7f5f6bfff640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5f6c0a3460 0x7f5f6c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316161af0 0x55c316161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316162410 0x55c31616c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c31616f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c3160c62f0 con 0x55c316161af0 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c31606e270 con 0x55c316162410 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c3160c22b0 con 0x55c31616ccb0 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f6bfff640 1 -- 172.21.15.103:0/2599474510 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f5f740efc10 con 0x7f5f841009d0 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f837fe640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5f6c0a3460 0x7f5f6c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f827fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316162410 0x55c31616c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f827fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316162410 0x55c31616c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:49366/0 (socket says 172.21.15.103:49366) 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f827fc640 1 -- 172.21.15.103:0/879117514 learned_addr learned my addr 172.21.15.103:0/879117514 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f837fe640 1 --2- 172.21.15.103:0/879117514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c31616f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/879117514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316161af0 0x55c316161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f827fc640 1 -- 172.21.15.103:0/879117514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 msgr2=0x55c31616f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f827fc640 1 --2- 172.21.15.103:0/879117514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c31616f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f827fc640 1 -- 172.21.15.103:0/879117514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316161af0 msgr2=0x55c316161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f827fc640 1 --2- 172.21.15.103:0/879117514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316161af0 0x55c316161ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f827fc640 1 -- 172.21.15.103:0/879117514 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31606d340 con 0x55c316162410 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/879117514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316161af0 0x55c316161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f837fe640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5f6c0a3460 0x7f5f6c0a5920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0099e0 tx=0x7f5f7c00fe70 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f827fc640 1 --2- 172.21.15.103:0/879117514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316162410 0x55c31616c770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009ca0 tx=0x7f5f78011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7583ed3c7bbe88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f697fa640 1 -- 172.21.15.103:0/879117514 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7801e070 con 0x55c316162410 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f697fa640 1 -- 172.21.15.103:0/879117514 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f78009e50 con 0x55c316162410 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.453+0000 7f5f697fa640 1 -- 172.21.15.103:0/879117514 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78018730 con 0x55c316162410 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.454+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/879117514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316162410 msgr2=0x55c31616c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.454+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/879117514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316162410 0x55c31616c770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009ca0 tx=0x7f5f78011810 comp rx=0 tx=0).stop 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.454+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/879117514 shutdown_connections 2024-09-19T06:10:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.454+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/879117514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c31616f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.454+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/879117514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316162410 0x55c31616c770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.454+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/879117514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316161af0 0x55c316161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.454+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/879117514 >> 172.21.15.103:0/879117514 conn(0x55c31615e060 msgr2=0x55c31615e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.454+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/879117514 shutdown_connections 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.454+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/879117514 wait complete. 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f8c2cc740 1 -- start start 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f8c2cc740 1 Processor -- start 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c316169b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c31616a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c31616a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c31616f880 con 0x55c316162410 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c31604f290 con 0x55c316161af0 2024-09-19T06:10:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c31616fa00 con 0x55c31616ccb0 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f8c2cc740 10 client.0 _ll_register_callbacks cb 0x55c316080140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f827fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c31616a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f827fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c31616a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35132/0 (socket says 172.21.15.103:35132) 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c316169b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f827fc640 1 -- 172.21.15.103:0/3511651214 learned_addr learned my addr 172.21.15.103:0/3511651214 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f837fe640 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c31616a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f827fc640 1 -- 172.21.15.103:0/3511651214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 msgr2=0x55c31616a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f827fc640 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c31616a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f827fc640 1 -- 172.21.15.103:0/3511651214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 msgr2=0x55c316169b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f827fc640 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c316169b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f827fc640 1 -- 172.21.15.103:0/3511651214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c315dd9210 con 0x55c316162410 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.455+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c316169b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f827fc640 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c31616a080 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009c70 tx=0x7f5f780098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ef12f89bd2f521 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f66ff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f66ff5640 1 -- 172.21.15.103:0/3511651214 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78028070 con 0x55c316162410 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f66ff5640 1 -- 172.21.15.103:0/3511651214 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f5f78004020 con 0x55c316162410 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/3511651214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f78009e50 con 0x55c316162410 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f66ff5640 1 -- 172.21.15.103:0/3511651214 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5f78031050 con 0x55c316162410 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f8c2cc740 10 client.15924 fetch_fsmap learned FSMap version 30 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/3511651214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c315ea5620 con 0x55c316162410 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f66ff5640 1 -- 172.21.15.103:0/3511651214 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f78009e50 con 0x55c316162410 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f66ff5640 1 -- 172.21.15.103:0/3511651214 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f5f7802b020 con 0x55c316162410 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f8c2cc740 10 client.15924 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f8c2cc740 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f8c2cc740 20 client.15924 populate_metadata read hostname 'smithi103' 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c31617cb70 0x55c31617ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f8c2cc740 4 client.15924 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/3511651214 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3160d3a20 con 0x55c31617cb70 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.456+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c31617cb70 0x55c31617ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.457+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c31617cb70 0x55c31617ef60 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acc6e5fdb931f231 server_cookie=127e2ff3eb05d8c in_seq=0 out_seq=0 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.457+0000 7f5f66ff5640 10 client.15924 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.457+0000 7f5f66ff5640 1 -- 172.21.15.103:0/3511651214 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3160d3a20 con 0x55c31617cb70 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.457+0000 7f5f66ff5640 10 client.15924 handle_command_reply: tid=0 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.457+0000 7f5f8c2cc740 1 client.15924 shutdown 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/3511651214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 msgr2=0x55c31616a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c31616a080 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009c70 tx=0x7f5f780098d0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/3511651214 shutdown_connections 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c31617cb70 0x55c31617ef60 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c31616a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f66ff5640 0 client.15924 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c31616a080 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/3511651214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c316169b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/3511651214 >> 172.21.15.103:0/3511651214 conn(0x55c31615e060 msgr2=0x55c316163dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/3511651214 shutdown_connections 2024-09-19T06:10:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/3511651214 wait complete. 2024-09-19T06:10:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.458+0000 7f5f8c2cc740 20 client.15924 trim_cache size 0 max 16384 2024-09-19T06:10:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f8c2cc740 1 Processor -- start 2024-09-19T06:10:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f8c2cc740 1 -- start start 2024-09-19T06:10:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c31616a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c316184730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c316184c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841b20f0 con 0x55c316162410 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841af990 con 0x55c316161af0 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841ad7e0 con 0x55c31616ccb0 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f827fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c316184730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f827fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c316184730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35136/0 (socket says 172.21.15.103:35136) 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f827fc640 1 -- 172.21.15.103:0/982296912 learned_addr learned my addr 172.21.15.103:0/982296912 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/982296912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c31616a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f837fe640 1 --2- 172.21.15.103:0/982296912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c316184c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f827fc640 1 -- 172.21.15.103:0/982296912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 msgr2=0x55c316184c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f827fc640 1 --2- 172.21.15.103:0/982296912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c316184c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f827fc640 1 -- 172.21.15.103:0/982296912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 msgr2=0x55c31616a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f827fc640 1 --2- 172.21.15.103:0/982296912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c31616a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f827fc640 1 -- 172.21.15.103:0/982296912 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c316164940 con 0x55c316162410 2024-09-19T06:10:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/982296912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c31616a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.473+0000 7f5f827fc640 1 --2- 172.21.15.103:0/982296912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c316184730 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009ca0 tx=0x7f5f78009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca282011f805db0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f68ff9640 1 -- 172.21.15.103:0/982296912 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78028040 con 0x55c316162410 2024-09-19T06:10:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f68ff9640 1 -- 172.21.15.103:0/982296912 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f78003bd0 con 0x55c316162410 2024-09-19T06:10:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f68ff9640 1 -- 172.21.15.103:0/982296912 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7801e040 con 0x55c316162410 2024-09-19T06:10:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/982296912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 msgr2=0x55c316184730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/982296912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c316184730 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009ca0 tx=0x7f5f78009b70 comp rx=0 tx=0).stop 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/982296912 shutdown_connections 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/982296912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c31616ccb0 0x55c316184c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/982296912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c316162410 0x55c316184730 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/982296912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c31616a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/982296912 >> 172.21.15.103:0/982296912 conn(0x55c31615e060 msgr2=0x55c31616bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/982296912 shutdown_connections 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.474+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/982296912 wait complete. 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f8c2cc740 1 -- start start 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f8c2cc740 1 Processor -- start 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c316174eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c316162410 0x55c3161753f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f8c2cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c31616ccb0 0x55c3161663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841ade50 con 0x55c31616ccb0 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841af2c0 con 0x55c316161af0 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f8c2cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841ae520 con 0x55c316162410 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f8c2cc740 10 client.0 _ll_register_callbacks cb 0x7f5f7801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f837fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c31616ccb0 0x55c3161663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f82ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c316174eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f837fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c31616ccb0 0x55c3161663a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35146/0 (socket says 172.21.15.103:35146) 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f837fe640 1 -- 172.21.15.103:0/2516282953 learned_addr learned my addr 172.21.15.103:0/2516282953 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f827fc640 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c316162410 0x55c3161753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f82ffd640 1 -- 172.21.15.103:0/2516282953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c316162410 msgr2=0x55c3161753f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c316162410 0x55c3161753f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f82ffd640 1 -- 172.21.15.103:0/2516282953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c31616ccb0 msgr2=0x55c3161663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c31616ccb0 0x55c3161663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f82ffd640 1 -- 172.21.15.103:0/2516282953 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c316166a90 con 0x55c316161af0 2024-09-19T06:10:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.475+0000 7f5f837fe640 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c31616ccb0 0x55c3161663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f82ffd640 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c316174eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f740ed3b0 tx=0x7f5f74005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8d191848a18e0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f66ff5640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f66ff5640 1 -- 172.21.15.103:0/2516282953 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f74049040 con 0x55c316161af0 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f66ff5640 1 -- 172.21.15.103:0/2516282953 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f5f740ed630 con 0x55c316161af0 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/2516282953 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f78003bd0 con 0x55c316161af0 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f66ff5640 1 -- 172.21.15.103:0/2516282953 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5f740c4bb0 con 0x55c316161af0 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f8c2cc740 10 client.25463 fetch_fsmap learned FSMap version 30 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/2516282953 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c3161e70b0 con 0x55c316161af0 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f66ff5640 1 -- 172.21.15.103:0/2516282953 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f78003bd0 con 0x55c316161af0 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f66ff5640 1 -- 172.21.15.103:0/2516282953 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f5f740a6040 con 0x55c316161af0 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f8c2cc740 10 client.25463 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f8c2cc740 10 client.25463 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:10:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f8c2cc740 20 client.25463 populate_metadata read hostname 'smithi103' 2024-09-19T06:10:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c3161e7830 0x55c3161e9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f8c2cc740 4 client.25463 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:10:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.476+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/2516282953 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c3160cdd70 con 0x55c3161e7830 2024-09-19T06:10:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.477+0000 7f5f827fc640 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c3161e7830 0x55c3161e9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.477+0000 7f5f66ff5640 10 client.25463 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.477+0000 7f5f827fc640 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c3161e7830 0x55c3161e9c50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7a42666151f28e server_cookie=9cd727646f5c3cf9 in_seq=0 out_seq=0 2024-09-19T06:10:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f66ff5640 1 -- 172.21.15.103:0/2516282953 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c3160cdd70 con 0x55c3161e7830 2024-09-19T06:10:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f66ff5640 10 client.25463 handle_command_reply: tid=0 2024-09-19T06:10:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 client.25463 shutdown 2024-09-19T06:10:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/2516282953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 msgr2=0x55c316174eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c316174eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f740ed3b0 tx=0x7f5f74005a20 comp rx=0 tx=0).stop 2024-09-19T06:10:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/2516282953 shutdown_connections 2024-09-19T06:10:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c3161e7830 0x55c3161e9c50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c31616ccb0 0x55c3161663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c316162410 0x55c3161753f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f66ff5640 0 client.25463 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 --2- 172.21.15.103:0/2516282953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c316161af0 0x55c316174eb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/2516282953 >> 172.21.15.103:0/2516282953 conn(0x55c31615e060 msgr2=0x55c316163550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/2516282953 shutdown_connections 2024-09-19T06:10:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 1 -- 172.21.15.103:0/2516282953 wait complete. 2024-09-19T06:10:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.488+0000 7f5f8c2cc740 20 client.25463 trim_cache size 0 max 16384 2024-09-19T06:10:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:10:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:10:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:10:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:10:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 -- 172.21.15.103:0/2599474510 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5f6c0a3460 msgr2=0x7f5f6c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5f6c0a3460 0x7f5f6c0a5920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0099e0 tx=0x7f5f7c00fe70 comp rx=0 tx=0).stop 2024-09-19T06:10:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 -- 172.21.15.103:0/2599474510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f841009d0 msgr2=0x7f5f8419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f841009d0 0x7f5f8419a460 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5f74005940 tx=0x7f5f740040c0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 -- 172.21.15.103:0/2599474510 shutdown_connections 2024-09-19T06:10:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f5f6c0a3460 0x7f5f6c0a5920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f841069e0 0x7f5f8419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f84101370 0x7f5f8419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 --2- 172.21.15.103:0/2599474510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f841009d0 0x7f5f8419a460 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 -- 172.21.15.103:0/2599474510 >> 172.21.15.103:0/2599474510 conn(0x7f5f840fc6b0 msgr2=0x7f5f8406a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 -- 172.21.15.103:0/2599474510 shutdown_connections 2024-09-19T06:10:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:34.489+0000 7f5f89531640 1 -- 172.21.15.103:0/2599474510 wait complete. 2024-09-19T06:10:35.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:35 smithi174 ceph-mon[34488]: pgmap v100: 97 pgs: 97 active+clean; 91 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.2 MiB/s wr, 664 op/s 2024-09-19T06:10:35.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:35 smithi103 ceph-mon[30925]: pgmap v100: 97 pgs: 97 active+clean; 91 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.2 MiB/s wr, 664 op/s 2024-09-19T06:10:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:35 smithi169 ceph-mon[34350]: pgmap v100: 97 pgs: 97 active+clean; 91 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.2 MiB/s wr, 664 op/s 2024-09-19T06:10:37.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:37 smithi174 ceph-mon[34488]: pgmap v101: 97 pgs: 97 active+clean; 86 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 7.8 MiB/s wr, 958 op/s 2024-09-19T06:10:37.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:37 smithi103 ceph-mon[30925]: pgmap v101: 97 pgs: 97 active+clean; 86 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 7.8 MiB/s wr, 958 op/s 2024-09-19T06:10:37.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:37 smithi169 ceph-mon[34350]: pgmap v101: 97 pgs: 97 active+clean; 86 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 7.8 MiB/s wr, 958 op/s 2024-09-19T06:10:39.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:39 smithi103 ceph-mon[30925]: pgmap v102: 97 pgs: 97 active+clean; 86 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.0 MiB/s wr, 617 op/s 2024-09-19T06:10:39.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:39 smithi169 ceph-mon[34350]: pgmap v102: 97 pgs: 97 active+clean; 86 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.0 MiB/s wr, 617 op/s 2024-09-19T06:10:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:39 smithi174 ceph-mon[34488]: pgmap v102: 97 pgs: 97 active+clean; 86 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.0 MiB/s wr, 617 op/s 2024-09-19T06:10:41.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:41 smithi103 ceph-mon[30925]: pgmap v103: 97 pgs: 97 active+clean; 86 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.0 MiB/s wr, 617 op/s 2024-09-19T06:10:41.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:41 smithi169 ceph-mon[34350]: pgmap v103: 97 pgs: 97 active+clean; 86 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.0 MiB/s wr, 617 op/s 2024-09-19T06:10:41.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:41 smithi174 ceph-mon[34488]: pgmap v103: 97 pgs: 97 active+clean; 86 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.0 MiB/s wr, 617 op/s 2024-09-19T06:10:43.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:43 smithi103 ceph-mon[30925]: pgmap v104: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 7.4 MiB/s wr, 895 op/s 2024-09-19T06:10:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:43 smithi169 ceph-mon[34350]: pgmap v104: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 7.4 MiB/s wr, 895 op/s 2024-09-19T06:10:43.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:43 smithi174 ceph-mon[34488]: pgmap v104: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 7.4 MiB/s wr, 895 op/s 2024-09-19T06:10:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:45 smithi103 ceph-mon[30925]: pgmap v105: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.9 MiB/s wr, 571 op/s 2024-09-19T06:10:45.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:45 smithi169 ceph-mon[34350]: pgmap v105: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.9 MiB/s wr, 571 op/s 2024-09-19T06:10:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:45 smithi174 ceph-mon[34488]: pgmap v105: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.9 MiB/s wr, 571 op/s 2024-09-19T06:10:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 -- 172.21.15.103:0/993245251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4101ad0 msgr2=0x7f75c4101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 --2- 172.21.15.103:0/993245251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4101ad0 0x7f75c4101f30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009930 tx=0x7f75b802a420 comp rx=0 tx=0).stop 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 -- 172.21.15.103:0/993245251 shutdown_connections 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 --2- 172.21.15.103:0/993245251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75c4102470 0x7f75c410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 --2- 172.21.15.103:0/993245251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4101ad0 0x7f75c4101f30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 --2- 172.21.15.103:0/993245251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75c4107b70 0x7f75c4107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 -- 172.21.15.103:0/993245251 >> 172.21.15.103:0/993245251 conn(0x7f75c40fd7d0 msgr2=0x7f75c40ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 -- 172.21.15.103:0/993245251 shutdown_connections 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 -- 172.21.15.103:0/993245251 wait complete. 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 Processor -- start 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.582+0000 7f75ca88d640 1 -- start start 2024-09-19T06:10:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75ca88d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75c4101ad0 0x7f75c41982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75ca88d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102470 0x7f75c4198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75ca88d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75c4107b70 0x7f75c419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75ca88d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4111dd0 con 0x7f75c4102470 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75ca88d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4111c50 con 0x7f75c4107b70 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75ca88d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4111f50 con 0x7f75c4101ad0 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102470 0x7f75c4198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102470 0x7f75c4198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37052/0 (socket says 172.21.15.103:37052) 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c37fe640 1 -- 172.21.15.103:0/2458732044 learned_addr learned my addr 172.21.15.103:0/2458732044 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c8e2a640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75c4107b70 0x7f75c419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c3fff640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75c4101ad0 0x7f75c41982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c37fe640 1 -- 172.21.15.103:0/2458732044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75c4101ad0 msgr2=0x7f75c41982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c37fe640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75c4101ad0 0x7f75c41982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c37fe640 1 -- 172.21.15.103:0/2458732044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75c4107b70 msgr2=0x7f75c419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c37fe640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75c4107b70 0x7f75c419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c37fe640 1 -- 172.21.15.103:0/2458732044 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c419d2b0 con 0x7f75c4102470 2024-09-19T06:10:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c3fff640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75c4101ad0 0x7f75c41982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.583+0000 7f75c37fe640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102470 0x7f75c4198800 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f75b8005940 tx=0x7f75b80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.584+0000 7f75c17fa640 1 -- 172.21.15.103:0/2458732044 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b803f030 con 0x7f75c4102470 2024-09-19T06:10:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.584+0000 7f75ca88d640 1 -- 172.21.15.103:0/2458732044 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c419d540 con 0x7f75c4102470 2024-09-19T06:10:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.584+0000 7f75c17fa640 1 -- 172.21.15.103:0/2458732044 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75b80044c0 con 0x7f75c4102470 2024-09-19T06:10:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.584+0000 7f75c17fa640 1 -- 172.21.15.103:0/2458732044 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8035070 con 0x7f75c4102470 2024-09-19T06:10:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.584+0000 7f75ca88d640 1 -- 172.21.15.103:0/2458732044 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c41a4e30 con 0x7f75c4102470 2024-09-19T06:10:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.586+0000 7f75c17fa640 1 -- 172.21.15.103:0/2458732044 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f75b8042030 con 0x7f75c4102470 2024-09-19T06:10:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75cd62c740 1 Processor -- start 2024-09-19T06:10:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75cd62c740 1 -- start start 2024-09-19T06:10:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f79d0 0x557bd44f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f82f0 0x557bd4506b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd45094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75cd62c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557bd445c2f0 con 0x557bd45070c0 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75cd62c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557bd4404270 con 0x557bd44f79d0 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75cd62c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557bd44582b0 con 0x557bd44f82f0 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75c17fa640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75ac0a3460 0x7f75ac0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75c8e2a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f79d0 0x557bd44f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75c37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd45094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75c8e2a640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75ac0a3460 0x7f75ac0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75c8e2a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f79d0 0x557bd44f7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:56186/0 (socket says 172.21.15.103:56186) 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75c8e2a640 1 -- 172.21.15.103:0/1534611853 learned_addr learned my addr 172.21.15.103:0/1534611853 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75c3fff640 1 --2- 172.21.15.103:0/1534611853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f82f0 0x557bd4506b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.587+0000 7f75c17fa640 1 -- 172.21.15.103:0/2458732044 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f75b80f0020 con 0x7f75c4102470 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75c8e2a640 1 -- 172.21.15.103:0/1534611853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f82f0 msgr2=0x557bd4506b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75c8e2a640 1 --2- 172.21.15.103:0/1534611853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f82f0 0x557bd4506b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75c8e2a640 1 -- 172.21.15.103:0/1534611853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 msgr2=0x557bd45094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75c8e2a640 1 --2- 172.21.15.103:0/1534611853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd45094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75c8e2a640 1 -- 172.21.15.103:0/1534611853 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd4403340 con 0x557bd44f79d0 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75c37fe640 1 --2- 172.21.15.103:0/1534611853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd45094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75c8e2a640 1 --2- 172.21.15.103:0/1534611853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f79d0 0x557bd44f7db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75bc010e80 tx=0x7f75bc00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89412c270671109b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75c8e2a640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75ac0a3460 0x7f75ac0a5920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00fc90 tx=0x7f75bc018000 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75aa7fc640 1 -- 172.21.15.103:0/1534611853 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc019040 con 0x557bd44f79d0 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75aa7fc640 1 -- 172.21.15.103:0/1534611853 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75bc0106a0 con 0x557bd44f79d0 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.588+0000 7f75aa7fc640 1 -- 172.21.15.103:0/1534611853 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0055c0 con 0x557bd44f79d0 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 -- 172.21.15.103:0/1534611853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f79d0 msgr2=0x557bd44f7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 --2- 172.21.15.103:0/1534611853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f79d0 0x557bd44f7db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75bc010e80 tx=0x7f75bc00f790 comp rx=0 tx=0).stop 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 -- 172.21.15.103:0/1534611853 shutdown_connections 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 --2- 172.21.15.103:0/1534611853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd45094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 --2- 172.21.15.103:0/1534611853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f82f0 0x557bd4506b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 --2- 172.21.15.103:0/1534611853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f79d0 0x557bd44f7db0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 -- 172.21.15.103:0/1534611853 >> 172.21.15.103:0/1534611853 conn(0x557bd44f4060 msgr2=0x557bd44f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 -- 172.21.15.103:0/1534611853 shutdown_connections 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 -- 172.21.15.103:0/1534611853 wait complete. 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 -- start start 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.589+0000 7f75cd62c740 1 Processor -- start 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f79d0 0x557bd4504060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f82f0 0x557bd45045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd45070c0 0x557bd4504ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75cd62c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557bd4509c90 con 0x557bd44f82f0 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75cd62c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557bd43e5290 con 0x557bd45070c0 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75cd62c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557bd4509e10 con 0x557bd44f79d0 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75cd62c740 10 client.0 _ll_register_callbacks cb 0x557bd4416140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f82f0 0x557bd45045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f82f0 0x557bd45045a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37070/0 (socket says 172.21.15.103:37070) 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c37fe640 1 -- 172.21.15.103:0/2403402119 learned_addr learned my addr 172.21.15.103:0/2403402119 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c8e2a640 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd45070c0 0x557bd4504ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c3fff640 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f79d0 0x557bd4504060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c37fe640 1 -- 172.21.15.103:0/2403402119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f79d0 msgr2=0x557bd4504060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c37fe640 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f79d0 0x557bd4504060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c37fe640 1 -- 172.21.15.103:0/2403402119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd45070c0 msgr2=0x557bd4504ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c37fe640 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd45070c0 0x557bd4504ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c37fe640 1 -- 172.21.15.103:0/2403402119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd416f210 con 0x557bd44f82f0 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75c37fe640 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f82f0 0x557bd45045a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f75b8031440 tx=0x7f75b80871e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54955efee30751d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75a37fe640 1 -- 172.21.15.103:0/2403402119 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8049040 con 0x557bd44f82f0 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75a37fe640 1 -- 172.21.15.103:0/2403402119 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f75b80eda40 con 0x557bd44f82f0 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.590+0000 7f75cd62c740 1 -- 172.21.15.103:0/2403402119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75bc0106a0 con 0x557bd44f82f0 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75a37fe640 1 -- 172.21.15.103:0/2403402119 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f75b80bd440 con 0x557bd44f82f0 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75cd62c740 10 client.15942 fetch_fsmap learned FSMap version 30 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75cd62c740 1 -- 172.21.15.103:0/2403402119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557bd423b620 con 0x557bd44f82f0 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75a37fe640 1 -- 172.21.15.103:0/2403402119 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75bc0106a0 con 0x557bd44f82f0 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75a37fe640 1 -- 172.21.15.103:0/2403402119 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f75b80b89c0 con 0x557bd44f82f0 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75cd62c740 10 client.15942 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75cd62c740 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:10:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75cd62c740 20 client.15942 populate_metadata read hostname 'smithi103' 2024-09-19T06:10:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75cd62c740 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x557bd45170b0 0x557bd45194f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75cd62c740 4 client.15942 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:10:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75cd62c740 1 -- 172.21.15.103:0/2403402119 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bd4469a20 con 0x557bd45170b0 2024-09-19T06:10:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.591+0000 7f75c3fff640 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x557bd45170b0 0x557bd45194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.592+0000 7f75a37fe640 10 client.15942 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.592+0000 7f75c3fff640 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x557bd45170b0 0x557bd45194f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3f7def5bcc1cf70 server_cookie=e2b4b415006687c0 in_seq=0 out_seq=0 2024-09-19T06:10:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.592+0000 7f75a37fe640 1 -- 172.21.15.103:0/2403402119 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557bd4469a20 con 0x557bd45170b0 2024-09-19T06:10:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.592+0000 7f75a37fe640 10 client.15942 handle_command_reply: tid=0 2024-09-19T06:10:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 client.15942 shutdown 2024-09-19T06:10:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 -- 172.21.15.103:0/2403402119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f82f0 msgr2=0x557bd45045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f82f0 0x557bd45045a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f75b8031440 tx=0x7f75b80871e0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 -- 172.21.15.103:0/2403402119 shutdown_connections 2024-09-19T06:10:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x557bd45170b0 0x557bd45194f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd45070c0 0x557bd4504ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75a37fe640 0 client.15942 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f82f0 0x557bd45045a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 --2- 172.21.15.103:0/2403402119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f79d0 0x557bd4504060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 -- 172.21.15.103:0/2403402119 >> 172.21.15.103:0/2403402119 conn(0x557bd44f4060 msgr2=0x557bd44f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 -- 172.21.15.103:0/2403402119 shutdown_connections 2024-09-19T06:10:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 1 -- 172.21.15.103:0/2403402119 wait complete. 2024-09-19T06:10:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.593+0000 7f75cd62c740 20 client.15942 trim_cache size 0 max 16384 2024-09-19T06:10:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75cd62c740 1 Processor -- start 2024-09-19T06:10:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75cd62c740 1 -- start start 2024-09-19T06:10:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f79d0 0x557bd4505fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 0x557bd451ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd45070c0 0x557bd451f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75cd62c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41adb60 con 0x557bd44f79d0 2024-09-19T06:10:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75cd62c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41ab400 con 0x557bd44f82f0 2024-09-19T06:10:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75cd62c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41a9250 con 0x557bd45070c0 2024-09-19T06:10:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f79d0 0x557bd4505fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 0x557bd451ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f79d0 0x557bd4505fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37082/0 (socket says 172.21.15.103:37082) 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c3fff640 1 -- 172.21.15.103:0/481905260 learned_addr learned my addr 172.21.15.103:0/481905260 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c8e2a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd45070c0 0x557bd451f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c3fff640 1 -- 172.21.15.103:0/481905260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd45070c0 msgr2=0x557bd451f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c3fff640 1 --2- 172.21.15.103:0/481905260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd45070c0 0x557bd451f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c3fff640 1 -- 172.21.15.103:0/481905260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 msgr2=0x557bd451ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c3fff640 1 --2- 172.21.15.103:0/481905260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 0x557bd451ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c3fff640 1 -- 172.21.15.103:0/481905260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd4519b70 con 0x557bd44f79d0 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.608+0000 7f75c3fff640 1 --2- 172.21.15.103:0/481905260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f79d0 0x557bd4505fd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f75b4005940 tx=0x7f75b4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0f8517d99a1a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.609+0000 7f75a9ffb640 1 -- 172.21.15.103:0/481905260 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4023070 con 0x557bd44f79d0 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.609+0000 7f75a9ffb640 1 -- 172.21.15.103:0/481905260 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75b401ead0 con 0x557bd44f79d0 2024-09-19T06:10:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.609+0000 7f75a9ffb640 1 -- 172.21.15.103:0/481905260 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4011d40 con 0x557bd44f79d0 2024-09-19T06:10:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.609+0000 7f75cd62c740 1 -- 172.21.15.103:0/481905260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f79d0 msgr2=0x557bd4505fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.609+0000 7f75cd62c740 1 --2- 172.21.15.103:0/481905260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f79d0 0x557bd4505fd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f75b4005940 tx=0x7f75b4005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 -- 172.21.15.103:0/481905260 shutdown_connections 2024-09-19T06:10:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 --2- 172.21.15.103:0/481905260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd45070c0 0x557bd451f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 --2- 172.21.15.103:0/481905260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 0x557bd451ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 --2- 172.21.15.103:0/481905260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd44f79d0 0x557bd4505fd0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 -- 172.21.15.103:0/481905260 >> 172.21.15.103:0/481905260 conn(0x557bd44f4060 msgr2=0x557bd45058c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 -- 172.21.15.103:0/481905260 shutdown_connections 2024-09-19T06:10:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 -- 172.21.15.103:0/481905260 wait complete. 2024-09-19T06:10:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 -- start start 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 Processor -- start 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f79d0 0x557bd450f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 0x557bd450f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd450c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41a98c0 con 0x557bd45070c0 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41aad30 con 0x557bd44f82f0 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41a9f90 con 0x557bd44f79d0 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.610+0000 7f75cd62c740 10 client.0 _ll_register_callbacks cb 0x7f75b8009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c8e2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd450c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c8e2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd450c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37090/0 (socket says 172.21.15.103:37090) 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c8e2a640 1 -- 172.21.15.103:0/1586068321 learned_addr learned my addr 172.21.15.103:0/1586068321 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c37fe640 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 0x557bd450f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c3fff640 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f79d0 0x557bd450f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c37fe640 1 -- 172.21.15.103:0/1586068321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f79d0 msgr2=0x557bd450f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c37fe640 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f79d0 0x557bd450f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c37fe640 1 -- 172.21.15.103:0/1586068321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 msgr2=0x557bd450c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c37fe640 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd450c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c37fe640 1 -- 172.21.15.103:0/1586068321 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd450c950 con 0x557bd44f82f0 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c8e2a640 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd450c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75c37fe640 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 0x557bd450f820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75b80bc2e0 tx=0x7f75b802a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d3f2db068a5383b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75a37fe640 1 -- 172.21.15.103:0/1586068321 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8049070 con 0x557bd44f82f0 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75a37fe640 1 -- 172.21.15.103:0/1586068321 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f75b803b9c0 con 0x557bd44f82f0 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75cd62c740 1 -- 172.21.15.103:0/1586068321 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75b401ead0 con 0x557bd44f82f0 2024-09-19T06:10:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75a37fe640 1 -- 172.21.15.103:0/1586068321 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f75b80bbe90 con 0x557bd44f82f0 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.611+0000 7f75cd62c740 10 client.25481 fetch_fsmap learned FSMap version 30 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.612+0000 7f75cd62c740 1 -- 172.21.15.103:0/1586068321 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557bd45829b0 con 0x557bd44f82f0 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.612+0000 7f75a37fe640 1 -- 172.21.15.103:0/1586068321 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75b401ead0 con 0x557bd44f82f0 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.612+0000 7f75a37fe640 1 -- 172.21.15.103:0/1586068321 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f75b80d51b0 con 0x557bd44f82f0 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.612+0000 7f75cd62c740 10 client.25481 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.612+0000 7f75cd62c740 10 client.25481 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.612+0000 7f75cd62c740 20 client.25481 populate_metadata read hostname 'smithi103' 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.612+0000 7f75cd62c740 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x557bd4583020 0x557bd4585440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.612+0000 7f75cd62c740 4 client.25481 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.612+0000 7f75cd62c740 1 -- 172.21.15.103:0/1586068321 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557bd4463d70 con 0x557bd4583020 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.612+0000 7f75c3fff640 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x557bd4583020 0x557bd4585440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.613+0000 7f75a37fe640 10 client.25481 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.613+0000 7f75c3fff640 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x557bd4583020 0x557bd4585440 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1259324df286c905 server_cookie=ee6cd00119e869fd in_seq=0 out_seq=0 2024-09-19T06:10:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75a37fe640 1 -- 172.21.15.103:0/1586068321 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557bd4463d70 con 0x557bd4583020 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75a37fe640 10 client.25481 handle_command_reply: tid=0 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 client.25481 shutdown 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 -- 172.21.15.103:0/1586068321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 msgr2=0x557bd450f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 0x557bd450f820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75b80bc2e0 tx=0x7f75b802a420 comp rx=0 tx=0).stop 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 -- 172.21.15.103:0/1586068321 shutdown_connections 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x557bd4583020 0x557bd4585440 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557bd45070c0 0x557bd450c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557bd44f82f0 0x557bd450f820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75a37fe640 0 client.25481 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 --2- 172.21.15.103:0/1586068321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bd44f79d0 0x557bd450f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 -- 172.21.15.103:0/1586068321 >> 172.21.15.103:0/1586068321 conn(0x557bd44f4060 msgr2=0x557bd44f31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 -- 172.21.15.103:0/1586068321 shutdown_connections 2024-09-19T06:10:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 1 -- 172.21.15.103:0/1586068321 wait complete. 2024-09-19T06:10:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.627+0000 7f75cd62c740 20 client.25481 trim_cache size 0 max 16384 2024-09-19T06:10:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:10:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:10:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:10:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 -- 172.21.15.103:0/2458732044 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75ac0a3460 msgr2=0x7f75ac0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75ac0a3460 0x7f75ac0a5920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00fc90 tx=0x7f75bc018000 comp rx=0 tx=0).stop 2024-09-19T06:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 -- 172.21.15.103:0/2458732044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102470 msgr2=0x7f75c4198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102470 0x7f75c4198800 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f75b8005940 tx=0x7f75b80040c0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 -- 172.21.15.103:0/2458732044 shutdown_connections 2024-09-19T06:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f75ac0a3460 0x7f75ac0a5920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75c4107b70 0x7f75c419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102470 0x7f75c4198800 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 --2- 172.21.15.103:0/2458732044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75c4101ad0 0x7f75c41982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 -- 172.21.15.103:0/2458732044 >> 172.21.15.103:0/2458732044 conn(0x7f75c40fd7d0 msgr2=0x7f75c40fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 -- 172.21.15.103:0/2458732044 shutdown_connections 2024-09-19T06:10:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:10:47.628+0000 7f75ca88d640 1 -- 172.21.15.103:0/2458732044 wait complete. 2024-09-19T06:10:47.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:47 smithi103 ceph-mon[30925]: pgmap v106: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 7.0 MiB/s wr, 839 op/s 2024-09-19T06:10:47.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:47 smithi169 ceph-mon[34350]: pgmap v106: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 7.0 MiB/s wr, 839 op/s 2024-09-19T06:10:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:47 smithi174 ceph-mon[34488]: pgmap v106: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 7.0 MiB/s wr, 839 op/s 2024-09-19T06:10:49.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:49 smithi103 ceph-mon[30925]: pgmap v107: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 545 op/s 2024-09-19T06:10:49.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:49 smithi169 ceph-mon[34350]: pgmap v107: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 545 op/s 2024-09-19T06:10:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:49 smithi174 ceph-mon[34488]: pgmap v107: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 545 op/s 2024-09-19T06:10:51.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:51 smithi103 ceph-mon[30925]: pgmap v108: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 545 op/s 2024-09-19T06:10:51.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:51 smithi169 ceph-mon[34350]: pgmap v108: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 545 op/s 2024-09-19T06:10:51.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:51 smithi174 ceph-mon[34488]: pgmap v108: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 545 op/s 2024-09-19T06:10:53.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:53 smithi103 ceph-mon[30925]: pgmap v109: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 6.5 MiB/s wr, 798 op/s 2024-09-19T06:10:53.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:53 smithi169 ceph-mon[34350]: pgmap v109: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 6.5 MiB/s wr, 798 op/s 2024-09-19T06:10:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:53 smithi174 ceph-mon[34488]: pgmap v109: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 6.5 MiB/s wr, 798 op/s 2024-09-19T06:10:55.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:55 smithi103 ceph-mon[30925]: pgmap v110: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.1 MiB/s wr, 520 op/s 2024-09-19T06:10:55.754 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:55 smithi174 ceph-mon[34488]: pgmap v110: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.1 MiB/s wr, 520 op/s 2024-09-19T06:10:55.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:55 smithi169 ceph-mon[34350]: pgmap v110: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.1 MiB/s wr, 520 op/s 2024-09-19T06:10:57.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:57 smithi103 ceph-mon[30925]: pgmap v111: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 6.0 MiB/s wr, 758 op/s 2024-09-19T06:10:57.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:57 smithi169 ceph-mon[34350]: pgmap v111: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 6.0 MiB/s wr, 758 op/s 2024-09-19T06:10:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:57 smithi174 ceph-mon[34488]: pgmap v111: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 6.0 MiB/s wr, 758 op/s 2024-09-19T06:10:59.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:10:59 smithi103 ceph-mon[30925]: pgmap v112: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.9 MiB/s wr, 491 op/s 2024-09-19T06:10:59.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:10:59 smithi169 ceph-mon[34350]: pgmap v112: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.9 MiB/s wr, 491 op/s 2024-09-19T06:10:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:10:59 smithi174 ceph-mon[34488]: pgmap v112: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.9 MiB/s wr, 491 op/s 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.720+0000 7f3d7033a640 1 -- 172.21.15.103:0/482539637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68102460 msgr2=0x7f3d6810e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.720+0000 7f3d7033a640 1 --2- 172.21.15.103:0/482539637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68102460 0x7f3d6810e990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009cd0 tx=0x7f3d6002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.720+0000 7f3d7033a640 1 -- 172.21.15.103:0/482539637 shutdown_connections 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.720+0000 7f3d7033a640 1 --2- 172.21.15.103:0/482539637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68102460 0x7f3d6810e990 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.720+0000 7f3d7033a640 1 --2- 172.21.15.103:0/482539637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d68101ac0 0x7f3d68101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.720+0000 7f3d7033a640 1 --2- 172.21.15.103:0/482539637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d68107ad0 0x7f3d68107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.720+0000 7f3d7033a640 1 -- 172.21.15.103:0/482539637 >> 172.21.15.103:0/482539637 conn(0x7f3d680fd7e0 msgr2=0x7f3d680ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.720+0000 7f3d7033a640 1 -- 172.21.15.103:0/482539637 shutdown_connections 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.720+0000 7f3d7033a640 1 -- 172.21.15.103:0/482539637 wait complete. 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.720+0000 7f3d7033a640 1 Processor -- start 2024-09-19T06:11:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d7033a640 1 -- start start 2024-09-19T06:11:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d7033a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d68101ac0 0x7f3d68198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d7033a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d68102460 0x7f3d68198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d7033a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68107ad0 0x7f3d6819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d7033a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3d68111dc0 con 0x7f3d68107ad0 2024-09-19T06:11:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d7033a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3d68111c40 con 0x7f3d68102460 2024-09-19T06:11:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d7033a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3d68111f40 con 0x7f3d68101ac0 2024-09-19T06:11:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e8d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68107ad0 0x7f3d6819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e8d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68107ad0 0x7f3d6819cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57360/0 (socket says 172.21.15.103:57360) 2024-09-19T06:11:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e8d7640 1 -- 172.21.15.103:0/3335427685 learned_addr learned my addr 172.21.15.103:0/3335427685 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d68102460 0x7f3d68198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e0d6640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d68101ac0 0x7f3d68198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e8d7640 1 -- 172.21.15.103:0/3335427685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d68101ac0 msgr2=0x7f3d68198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e8d7640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d68101ac0 0x7f3d68198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e8d7640 1 -- 172.21.15.103:0/3335427685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d68102460 msgr2=0x7f3d68198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e8d7640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d68102460 0x7f3d68198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e8d7640 1 -- 172.21.15.103:0/3335427685 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6819d200 con 0x7f3d68107ad0 2024-09-19T06:11:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e0d6640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d68101ac0 0x7f3d68198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.721+0000 7f3d6e8d7640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68107ad0 0x7f3d6819cad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3d60033040 tx=0x7f3d60003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.722+0000 7f3d5f7fe640 1 -- 172.21.15.103:0/3335427685 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60004040 con 0x7f3d68107ad0 2024-09-19T06:11:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.722+0000 7f3d7033a640 1 -- 172.21.15.103:0/3335427685 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6819d490 con 0x7f3d68107ad0 2024-09-19T06:11:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.722+0000 7f3d5f7fe640 1 -- 172.21.15.103:0/3335427685 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3d60004690 con 0x7f3d68107ad0 2024-09-19T06:11:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.722+0000 7f3d5f7fe640 1 -- 172.21.15.103:0/3335427685 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60030e10 con 0x7f3d68107ad0 2024-09-19T06:11:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.722+0000 7f3d7033a640 1 -- 172.21.15.103:0/3335427685 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d681a4d80 con 0x7f3d68107ad0 2024-09-19T06:11:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.724+0000 7f3d5f7fe640 1 -- 172.21.15.103:0/3335427685 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f3d600305a0 con 0x7f3d68107ad0 2024-09-19T06:11:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.724+0000 7f3d730d4740 1 Processor -- start 2024-09-19T06:11:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.724+0000 7f3d730d4740 1 -- start start 2024-09-19T06:11:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cd2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cd3410 0x55c230cdd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cddcb0 0x55c230ce00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d730d4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c230c372f0 con 0x55c230cd2af0 2024-09-19T06:11:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d730d4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c230bdf270 con 0x55c230cddcb0 2024-09-19T06:11:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d730d4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c230c332b0 con 0x55c230cd3410 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6d8d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cd2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d5f7fe640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f3d540a3460 0x7f3d540a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6d8d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cd2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57374/0 (socket says 172.21.15.103:57374) 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6d8d5640 1 -- 172.21.15.103:0/1017073165 learned_addr learned my addr 172.21.15.103:0/1017073165 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/1017073165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cddcb0 0x55c230ce00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6e0d6640 1 --2- 172.21.15.103:0/1017073165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cd3410 0x55c230cdd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6e8d7640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f3d540a3460 0x7f3d540a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d5f7fe640 1 -- 172.21.15.103:0/3335427685 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f3d6002e030 con 0x7f3d68107ad0 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6d8d5640 1 -- 172.21.15.103:0/1017073165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cd3410 msgr2=0x55c230cdd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/1017073165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cd3410 0x55c230cdd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6d8d5640 1 -- 172.21.15.103:0/1017073165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 msgr2=0x55c230cd2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/1017073165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cd2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6d8d5640 1 -- 172.21.15.103:0/1017073165 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c230bde340 con 0x55c230cddcb0 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.725+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/1017073165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cddcb0 0x55c230ce00a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3d58013830 tx=0x7f3d58004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b443d1bad0116d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.726+0000 7f3d6e8d7640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f3d540a3460 0x7f3d540a5920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d600bd6d0 tx=0x7f3d6002a8e0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.726+0000 7f3d5cbfe640 1 -- 172.21.15.103:0/1017073165 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58013050 con 0x55c230cddcb0 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.726+0000 7f3d5cbfe640 1 -- 172.21.15.103:0/1017073165 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3d58005020 con 0x55c230cddcb0 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.726+0000 7f3d5cbfe640 1 -- 172.21.15.103:0/1017073165 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800fb40 con 0x55c230cddcb0 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.726+0000 7f3d730d4740 1 -- 172.21.15.103:0/1017073165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cddcb0 msgr2=0x55c230ce00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.726+0000 7f3d730d4740 1 --2- 172.21.15.103:0/1017073165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cddcb0 0x55c230ce00a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3d58013830 tx=0x7f3d58004730 comp rx=0 tx=0).stop 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.726+0000 7f3d730d4740 1 -- 172.21.15.103:0/1017073165 shutdown_connections 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.726+0000 7f3d730d4740 1 --2- 172.21.15.103:0/1017073165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cddcb0 0x55c230ce00a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 --2- 172.21.15.103:0/1017073165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cd3410 0x55c230cdd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 --2- 172.21.15.103:0/1017073165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cd2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 -- 172.21.15.103:0/1017073165 >> 172.21.15.103:0/1017073165 conn(0x55c230ccf060 msgr2=0x55c230ccf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 -- 172.21.15.103:0/1017073165 shutdown_connections 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 -- 172.21.15.103:0/1017073165 wait complete. 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 -- start start 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 Processor -- start 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cdab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 0x55c230cdb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 0x55c230cdb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c230ce0880 con 0x55c230cd2af0 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c230bc0290 con 0x55c230cd3410 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c230ce0a00 con 0x55c230cddcb0 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d730d4740 10 client.0 _ll_register_callbacks cb 0x55c230bf1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d6d8d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cdab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d6e0d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 0x55c230cdb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d6d8d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cdab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57388/0 (socket says 172.21.15.103:57388) 2024-09-19T06:11:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.727+0000 7f3d6d8d5640 1 -- 172.21.15.103:0/3822825565 learned_addr learned my addr 172.21.15.103:0/3822825565 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 0x55c230cdb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d6e0d6640 1 -- 172.21.15.103:0/3822825565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 msgr2=0x55c230cdb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d6e0d6640 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 0x55c230cdb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d6e0d6640 1 -- 172.21.15.103:0/3822825565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 msgr2=0x55c230cdab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d6e0d6640 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cdab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d6e0d6640 1 -- 172.21.15.103:0/3822825565 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c23094a210 con 0x55c230cd3410 2024-09-19T06:11:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cdab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d6e0d6640 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 0x55c230cdb0b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3d64005fd0 tx=0x7f3d6400de30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0a1685a0710e9f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:11:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d51ffb640 1 -- 172.21.15.103:0/3822825565 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6401b440 con 0x55c230cd3410 2024-09-19T06:11:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d730d4740 1 -- 172.21.15.103:0/3822825565 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d58005020 con 0x55c230cd3410 2024-09-19T06:11:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d51ffb640 1 -- 172.21.15.103:0/3822825565 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f3d64011440 con 0x55c230cd3410 2024-09-19T06:11:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d51ffb640 1 -- 172.21.15.103:0/3822825565 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3d64011640 con 0x55c230cd3410 2024-09-19T06:11:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d730d4740 10 client.25493 fetch_fsmap learned FSMap version 30 2024-09-19T06:11:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d730d4740 1 -- 172.21.15.103:0/3822825565 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c230a16620 con 0x55c230cd3410 2024-09-19T06:11:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.728+0000 7f3d51ffb640 1 -- 172.21.15.103:0/3822825565 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3d58005020 con 0x55c230cd3410 2024-09-19T06:11:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.729+0000 7f3d51ffb640 1 -- 172.21.15.103:0/3822825565 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f3d64019070 con 0x55c230cd3410 2024-09-19T06:11:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.729+0000 7f3d730d4740 10 client.25493 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:11:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.729+0000 7f3d730d4740 10 client.25493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:11:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.729+0000 7f3d730d4740 20 client.25493 populate_metadata read hostname 'smithi103' 2024-09-19T06:11:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.729+0000 7f3d730d4740 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c230cedd20 0x55c230cf0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.729+0000 7f3d730d4740 4 client.25493 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:11:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.729+0000 7f3d730d4740 1 -- 172.21.15.103:0/3822825565 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c230c44a20 con 0x55c230cedd20 2024-09-19T06:11:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.729+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c230cedd20 0x55c230cf0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.729+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c230cedd20 0x55c230cf0150 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19e1678e532636e4 server_cookie=ecdf11029e32f76 in_seq=0 out_seq=0 2024-09-19T06:11:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.729+0000 7f3d51ffb640 10 client.25493 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d51ffb640 1 -- 172.21.15.103:0/3822825565 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c230c44a20 con 0x55c230cedd20 2024-09-19T06:11:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d51ffb640 10 client.25493 handle_command_reply: tid=0 2024-09-19T06:11:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 client.25493 shutdown 2024-09-19T06:11:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 -- 172.21.15.103:0/3822825565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 msgr2=0x55c230cdb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 0x55c230cdb0b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3d64005fd0 tx=0x7f3d6400de30 comp rx=0 tx=0).stop 2024-09-19T06:11:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 -- 172.21.15.103:0/3822825565 shutdown_connections 2024-09-19T06:11:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c230cedd20 0x55c230cf0150 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 0x55c230cdb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d51ffb640 0 client.25493 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 0x55c230cdb0b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 --2- 172.21.15.103:0/3822825565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230cdab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 -- 172.21.15.103:0/3822825565 >> 172.21.15.103:0/3822825565 conn(0x55c230ccf060 msgr2=0x55c230cd4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 -- 172.21.15.103:0/3822825565 shutdown_connections 2024-09-19T06:11:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.730+0000 7f3d730d4740 1 -- 172.21.15.103:0/3822825565 wait complete. 2024-09-19T06:11:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.731+0000 7f3d730d4740 20 client.25493 trim_cache size 0 max 16384 2024-09-19T06:11:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d730d4740 1 Processor -- start 2024-09-19T06:11:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d730d4740 1 -- start start 2024-09-19T06:11:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd2af0 0x55c230cd5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cd3410 0x55c230cdb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cddcb0 0x55c230cdcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d730d4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3d681afdc0 con 0x55c230cddcb0 2024-09-19T06:11:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d730d4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3d681ad660 con 0x55c230cd2af0 2024-09-19T06:11:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d730d4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3d681ab4b0 con 0x55c230cd3410 2024-09-19T06:11:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6d8d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cddcb0 0x55c230cdcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6d8d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cddcb0 0x55c230cdcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57394/0 (socket says 172.21.15.103:57394) 2024-09-19T06:11:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6d8d5640 1 -- 172.21.15.103:0/3061402003 learned_addr learned my addr 172.21.15.103:0/3061402003 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6e0d6640 1 --2- 172.21.15.103:0/3061402003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cd3410 0x55c230cdb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/3061402003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd2af0 0x55c230cd5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6d8d5640 1 -- 172.21.15.103:0/3061402003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cd3410 msgr2=0x55c230cdb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/3061402003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cd3410 0x55c230cdb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6d8d5640 1 -- 172.21.15.103:0/3061402003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd2af0 msgr2=0x55c230cd5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/3061402003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd2af0 0x55c230cd5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6d8d5640 1 -- 172.21.15.103:0/3061402003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c230cf07d0 con 0x55c230cddcb0 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/3061402003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cddcb0 0x55c230cdcae0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009850 tx=0x7f3d58009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b012b7a8796f052 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.745+0000 7f3d53fff640 1 -- 172.21.15.103:0/3061402003 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d580134d0 con 0x55c230cddcb0 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d53fff640 1 -- 172.21.15.103:0/3061402003 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3d5800fd00 con 0x55c230cddcb0 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d53fff640 1 -- 172.21.15.103:0/3061402003 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58004a10 con 0x55c230cddcb0 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d730d4740 1 -- 172.21.15.103:0/3061402003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cddcb0 msgr2=0x55c230cdcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d730d4740 1 --2- 172.21.15.103:0/3061402003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cddcb0 0x55c230cdcae0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009850 tx=0x7f3d58009c30 comp rx=0 tx=0).stop 2024-09-19T06:11:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d730d4740 1 -- 172.21.15.103:0/3061402003 shutdown_connections 2024-09-19T06:11:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d730d4740 1 --2- 172.21.15.103:0/3061402003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cddcb0 0x55c230cdcae0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d730d4740 1 --2- 172.21.15.103:0/3061402003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cd3410 0x55c230cdb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d730d4740 1 --2- 172.21.15.103:0/3061402003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd2af0 0x55c230cd5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d730d4740 1 -- 172.21.15.103:0/3061402003 >> 172.21.15.103:0/3061402003 conn(0x55c230ccf060 msgr2=0x55c230cdc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d730d4740 1 -- 172.21.15.103:0/3061402003 shutdown_connections 2024-09-19T06:11:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d730d4740 1 -- 172.21.15.103:0/3061402003 wait complete. 2024-09-19T06:11:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.746+0000 7f3d730d4740 1 -- start start 2024-09-19T06:11:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d730d4740 1 Processor -- start 2024-09-19T06:11:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230ce6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 0x55c230ce6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d730d4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 0x55c230cd76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d730d4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3d681abb20 con 0x55c230cd2af0 2024-09-19T06:11:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d730d4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3d681acf90 con 0x55c230cd3410 2024-09-19T06:11:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d730d4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3d681ac1f0 con 0x55c230cddcb0 2024-09-19T06:11:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d730d4740 10 client.0 _ll_register_callbacks cb 0x7f3d64004080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6d8d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230ce6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6e0d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 0x55c230ce6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6d8d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230ce6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57400/0 (socket says 172.21.15.103:57400) 2024-09-19T06:11:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6d8d5640 1 -- 172.21.15.103:0/2905941677 learned_addr learned my addr 172.21.15.103:0/2905941677 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 0x55c230cd76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6e0d6640 1 -- 172.21.15.103:0/2905941677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 msgr2=0x55c230cd76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6e0d6640 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 0x55c230cd76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6e0d6640 1 -- 172.21.15.103:0/2905941677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 msgr2=0x55c230ce6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6e0d6640 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230ce6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6e0d6640 1 -- 172.21.15.103:0/2905941677 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c230ccee90 con 0x55c230cd3410 2024-09-19T06:11:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.747+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 0x55c230cd76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d6e0d6640 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 0x55c230ce6550 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3d6401bb00 tx=0x7f3d6401b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3c26629b07cf33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:11:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d51ffb640 1 -- 172.21.15.103:0/2905941677 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64028040 con 0x55c230cd3410 2024-09-19T06:11:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d730d4740 1 -- 172.21.15.103:0/2905941677 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d5800fd00 con 0x55c230cd3410 2024-09-19T06:11:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d51ffb640 1 -- 172.21.15.103:0/2905941677 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f3d64003de0 con 0x55c230cd3410 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d51ffb640 1 -- 172.21.15.103:0/2905941677 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3d640117e0 con 0x55c230cd3410 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d730d4740 10 client.25499 fetch_fsmap learned FSMap version 30 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d730d4740 1 -- 172.21.15.103:0/2905941677 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c230d58570 con 0x55c230cd3410 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d51ffb640 1 -- 172.21.15.103:0/2905941677 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3d5800fd00 con 0x55c230cd3410 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d51ffb640 1 -- 172.21.15.103:0/2905941677 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f3d64019040 con 0x55c230cd3410 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d730d4740 10 client.25499 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d730d4740 10 client.25499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d730d4740 20 client.25499 populate_metadata read hostname 'smithi103' 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d730d4740 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c230d58d80 0x55c230d5b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d730d4740 4 client.25499 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.748+0000 7f3d730d4740 1 -- 172.21.15.103:0/2905941677 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c230c3ed70 con 0x55c230d58d80 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.749+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c230d58d80 0x55c230d5b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.749+0000 7f3d6d8d5640 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c230d58d80 0x55c230d5b1a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a840b2893e127060 server_cookie=b883a02fb107a855 in_seq=0 out_seq=0 2024-09-19T06:11:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.749+0000 7f3d51ffb640 10 client.25499 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.766+0000 7f3d51ffb640 1 -- 172.21.15.103:0/2905941677 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c230c3ed70 con 0x55c230d58d80 2024-09-19T06:11:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.766+0000 7f3d51ffb640 10 client.25499 handle_command_reply: tid=0 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.766+0000 7f3d730d4740 1 client.25499 shutdown 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 1 -- 172.21.15.103:0/2905941677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 msgr2=0x55c230ce6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 0x55c230ce6550 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3d6401bb00 tx=0x7f3d6401b9d0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 1 -- 172.21.15.103:0/2905941677 shutdown_connections 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55c230d58d80 0x55c230d5b1a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c230cddcb0 0x55c230cd76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c230cd3410 0x55c230ce6550 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d51ffb640 0 client.25499 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 1 --2- 172.21.15.103:0/2905941677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c230cd2af0 0x55c230ce6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 1 -- 172.21.15.103:0/2905941677 >> 172.21.15.103:0/2905941677 conn(0x55c230ccf060 msgr2=0x55c230cce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 1 -- 172.21.15.103:0/2905941677 shutdown_connections 2024-09-19T06:11:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 1 -- 172.21.15.103:0/2905941677 wait complete. 2024-09-19T06:11:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d730d4740 20 client.25499 trim_cache size 0 max 16384 2024-09-19T06:11:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:11:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:11:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:11:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:11:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d7033a640 1 -- 172.21.15.103:0/3335427685 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f3d540a3460 msgr2=0x7f3d540a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d7033a640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f3d540a3460 0x7f3d540a5920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d600bd6d0 tx=0x7f3d6002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d7033a640 1 -- 172.21.15.103:0/3335427685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68107ad0 msgr2=0x7f3d6819cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.767+0000 7f3d7033a640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68107ad0 0x7f3d6819cad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3d60033040 tx=0x7f3d60003970 comp rx=0 tx=0).stop 2024-09-19T06:11:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.768+0000 7f3d7033a640 1 -- 172.21.15.103:0/3335427685 shutdown_connections 2024-09-19T06:11:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.768+0000 7f3d7033a640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f3d540a3460 0x7f3d540a5920 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.768+0000 7f3d7033a640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68107ad0 0x7f3d6819cad0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.768+0000 7f3d7033a640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d68102460 0x7f3d68198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.768+0000 7f3d7033a640 1 --2- 172.21.15.103:0/3335427685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d68101ac0 0x7f3d68198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.768+0000 7f3d7033a640 1 -- 172.21.15.103:0/3335427685 >> 172.21.15.103:0/3335427685 conn(0x7f3d680fd7e0 msgr2=0x7f3d680fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.768+0000 7f3d7033a640 1 -- 172.21.15.103:0/3335427685 shutdown_connections 2024-09-19T06:11:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:00.768+0000 7f3d7033a640 1 -- 172.21.15.103:0/3335427685 wait complete. 2024-09-19T06:11:01.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:01 smithi103 ceph-mon[30925]: pgmap v113: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.9 MiB/s wr, 491 op/s 2024-09-19T06:11:01.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:01 smithi169 ceph-mon[34350]: pgmap v113: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.9 MiB/s wr, 491 op/s 2024-09-19T06:11:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:01 smithi174 ceph-mon[34488]: pgmap v113: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.9 MiB/s wr, 491 op/s 2024-09-19T06:11:03.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:03 smithi103 ceph-mon[30925]: pgmap v114: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 5.7 MiB/s wr, 730 op/s 2024-09-19T06:11:03.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:03 smithi169 ceph-mon[34350]: pgmap v114: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 5.7 MiB/s wr, 730 op/s 2024-09-19T06:11:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:03 smithi174 ceph-mon[34488]: pgmap v114: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 5.7 MiB/s wr, 730 op/s 2024-09-19T06:11:04.035 INFO:tasks.workunit.client.0.smithi103.stdout:50000 write 0x39280 thru 0x48ee3 (0xfc64 bytes) 2024-09-19T06:11:04.035 INFO:tasks.workunit.client.0.smithi103.stdout:All 50000 operations completed A-OK! 2024-09-19T06:11:04.036 INFO:tasks.workunit.client.0.smithi103.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2024-09-19T06:11:04.036 INFO:tasks.workunit.client.0.smithi103.stdout:Seed set to 1 2024-09-19T06:11:04.167 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T06:11:04.167 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T06:11:04.167 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T06:11:04.167 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T06:11:04.170 INFO:tasks.workunit.client.0.smithi103.stdout:skipping zero length punch hole 2024-09-19T06:11:04.172 INFO:tasks.workunit.client.0.smithi103.stdout:truncating to largest ever: 0x81c806 2024-09-19T06:11:04.233 INFO:tasks.workunit.client.0.smithi103.stdout:truncating to largest ever: 0x9bc582 2024-09-19T06:11:04.248 INFO:tasks.workunit.client.0.smithi103.stdout:truncating to largest ever: 0x9eecbc 2024-09-19T06:11:05.685 INFO:tasks.workunit.client.0.smithi103.stdout:fallocating to largest ever: 0x9f2a70 2024-09-19T06:11:05.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:05 smithi103 ceph-mon[30925]: pgmap v115: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 477 op/s 2024-09-19T06:11:05.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:05 smithi169 ceph-mon[34350]: pgmap v115: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 477 op/s 2024-09-19T06:11:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:05 smithi174 ceph-mon[34488]: pgmap v115: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 477 op/s 2024-09-19T06:11:06.962 INFO:tasks.workunit.client.0.smithi103.stdout:copying to largest ever: 0x9fdd84 2024-09-19T06:11:07.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:07 smithi103 ceph-mon[30925]: pgmap v116: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 5.9 MiB/s wr, 764 op/s 2024-09-19T06:11:07.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:07 smithi169 ceph-mon[34350]: pgmap v116: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 5.9 MiB/s wr, 764 op/s 2024-09-19T06:11:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:07 smithi174 ceph-mon[34488]: pgmap v116: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 5.9 MiB/s wr, 764 op/s 2024-09-19T06:11:09.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:09 smithi103 ceph-mon[30925]: pgmap v117: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 4.1 MiB/s wr, 526 op/s 2024-09-19T06:11:09.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:09 smithi169 ceph-mon[34350]: pgmap v117: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 4.1 MiB/s wr, 526 op/s 2024-09-19T06:11:09.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:09 smithi174 ceph-mon[34488]: pgmap v117: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 4.1 MiB/s wr, 526 op/s 2024-09-19T06:11:11.617 INFO:tasks.workunit.client.0.smithi103.stdout:truncating to largest ever: 0x9ff7e4 2024-09-19T06:11:11.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:11 smithi103 ceph-mon[30925]: pgmap v118: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 4.1 MiB/s wr, 526 op/s 2024-09-19T06:11:11.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:11 smithi169 ceph-mon[34350]: pgmap v118: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 4.1 MiB/s wr, 526 op/s 2024-09-19T06:11:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:11 smithi174 ceph-mon[34488]: pgmap v118: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 4.1 MiB/s wr, 526 op/s 2024-09-19T06:11:12.547 INFO:tasks.workunit.client.0.smithi103.stdout:10000 write 0x723fbd thru 0x733aaa (0xfaee bytes) 2024-09-19T06:11:13.082 INFO:tasks.workunit.client.0.smithi103.stdout:fallocating to largest ever: 0xa00000 2024-09-19T06:11:13.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:13 smithi103 ceph-mon[30925]: pgmap v119: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 7.1 MiB/s wr, 956 op/s 2024-09-19T06:11:13.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:13 smithi169 ceph-mon[34350]: pgmap v119: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 7.1 MiB/s wr, 956 op/s 2024-09-19T06:11:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.863+0000 7f7683cc9640 1 -- 172.21.15.103:0/1129096008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767c107b70 msgr2=0x7f767c107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.863+0000 7f7683cc9640 1 --2- 172.21.15.103:0/1129096008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767c107b70 0x7f767c107f50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7678009930 tx=0x7f767802a420 comp rx=0 tx=0).stop 2024-09-19T06:11:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.863+0000 7f7683cc9640 1 -- 172.21.15.103:0/1129096008 shutdown_connections 2024-09-19T06:11:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.863+0000 7f7683cc9640 1 --2- 172.21.15.103:0/1129096008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f767c102470 0x7f767c10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.863+0000 7f7683cc9640 1 --2- 172.21.15.103:0/1129096008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f767c101ad0 0x7f767c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.863+0000 7f7683cc9640 1 --2- 172.21.15.103:0/1129096008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767c107b70 0x7f767c107f50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.863+0000 7f7683cc9640 1 -- 172.21.15.103:0/1129096008 >> 172.21.15.103:0/1129096008 conn(0x7f767c0fd7b0 msgr2=0x7f767c0ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.863+0000 7f7683cc9640 1 -- 172.21.15.103:0/1129096008 shutdown_connections 2024-09-19T06:11:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.863+0000 7f7683cc9640 1 -- 172.21.15.103:0/1129096008 wait complete. 2024-09-19T06:11:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7683cc9640 1 Processor -- start 2024-09-19T06:11:13.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7683cc9640 1 -- start start 2024-09-19T06:11:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7683cc9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767c101ad0 0x7f767c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7683cc9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f767c102470 0x7f767c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7683cc9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f767c107b70 0x7f767c19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7683cc9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f767c111dd0 con 0x7f767c101ad0 2024-09-19T06:11:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7683cc9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f767c111c50 con 0x7f767c102470 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7683cc9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f767c111f50 con 0x7f767c107b70 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7681a65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767c101ad0 0x7f767c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7681a65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767c101ad0 0x7f767c1982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36908/0 (socket says 172.21.15.103:36908) 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7681a65640 1 -- 172.21.15.103:0/485111954 learned_addr learned my addr 172.21.15.103:0/485111954 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7682266640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f767c107b70 0x7f767c19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7681264640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f767c102470 0x7f767c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7681a65640 1 -- 172.21.15.103:0/485111954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f767c107b70 msgr2=0x7f767c19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7681a65640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f767c107b70 0x7f767c19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7681a65640 1 -- 172.21.15.103:0/485111954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f767c102470 msgr2=0x7f767c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7681a65640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f767c102470 0x7f767c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7681a65640 1 -- 172.21.15.103:0/485111954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c19d290 con 0x7f767c101ad0 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.864+0000 7f7682266640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f767c107b70 0x7f767c19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.865+0000 7f7681a65640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767c101ad0 0x7f767c1982a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7678005940 tx=0x7f76780040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.865+0000 7f7672ffd640 1 -- 172.21.15.103:0/485111954 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767803f030 con 0x7f767c101ad0 2024-09-19T06:11:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.865+0000 7f7672ffd640 1 -- 172.21.15.103:0/485111954 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f76780044c0 con 0x7f767c101ad0 2024-09-19T06:11:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.865+0000 7f7672ffd640 1 -- 172.21.15.103:0/485111954 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678035070 con 0x7f767c101ad0 2024-09-19T06:11:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.865+0000 7f7683cc9640 1 -- 172.21.15.103:0/485111954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c19d520 con 0x7f767c101ad0 2024-09-19T06:11:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.865+0000 7f7683cc9640 1 -- 172.21.15.103:0/485111954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c1a4e10 con 0x7f767c101ad0 2024-09-19T06:11:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.867+0000 7f7672ffd640 1 -- 172.21.15.103:0/485111954 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f7678042030 con 0x7f767c101ad0 2024-09-19T06:11:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7686a62740 1 Processor -- start 2024-09-19T06:11:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7686a62740 1 -- start start 2024-09-19T06:11:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7672ffd640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76680a3460 0x7f76680a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7686a62740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7686a62740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098ac2d0 0x5586098bab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7682266640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76680a3460 0x7f76680a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7686a62740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098bb0c0 0x5586098bd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7686a62740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5586098102f0 con 0x5586098ab9b0 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7686a62740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5586097b8270 con 0x5586098bb0c0 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7686a62740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55860980c2b0 con 0x5586098ac2d0 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.868+0000 7f7672ffd640 1 -- 172.21.15.103:0/485111954 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f76780eff60 con 0x7f767c101ad0 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7681a65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7681a65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098abd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36914/0 (socket says 172.21.15.103:36914) 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7681a65640 1 -- 172.21.15.103:0/732080035 learned_addr learned my addr 172.21.15.103:0/732080035 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7682266640 1 --2- 172.21.15.103:0/732080035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098bb0c0 0x5586098bd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7681264640 1 --2- 172.21.15.103:0/732080035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098ac2d0 0x5586098bab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7681a65640 1 -- 172.21.15.103:0/732080035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098ac2d0 msgr2=0x5586098bab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7681a65640 1 --2- 172.21.15.103:0/732080035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098ac2d0 0x5586098bab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7681a65640 1 -- 172.21.15.103:0/732080035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098bb0c0 msgr2=0x5586098bd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7681a65640 1 --2- 172.21.15.103:0/732080035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098bb0c0 0x5586098bd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7681a65640 1 -- 172.21.15.103:0/732080035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586097b7340 con 0x5586098ab9b0 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7682266640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76680a3460 0x7f76680a5920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7674005fd0 tx=0x7f7674013e50 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7681a65640 1 --2- 172.21.15.103:0/732080035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098abd90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f76780b8d10 tx=0x7f76780bbca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e79f76fb91bb5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7667fff640 1 -- 172.21.15.103:0/732080035 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678049070 con 0x5586098ab9b0 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7667fff640 1 -- 172.21.15.103:0/732080035 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f76780ede50 con 0x5586098ab9b0 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.869+0000 7f7667fff640 1 -- 172.21.15.103:0/732080035 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76780b89b0 con 0x5586098ab9b0 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.870+0000 7f7686a62740 1 -- 172.21.15.103:0/732080035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 msgr2=0x5586098abd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.870+0000 7f7686a62740 1 --2- 172.21.15.103:0/732080035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098abd90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f76780b8d10 tx=0x7f76780bbca0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.870+0000 7f7686a62740 1 -- 172.21.15.103:0/732080035 shutdown_connections 2024-09-19T06:11:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.870+0000 7f7686a62740 1 --2- 172.21.15.103:0/732080035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098bb0c0 0x5586098bd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.870+0000 7f7686a62740 1 --2- 172.21.15.103:0/732080035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098ac2d0 0x5586098bab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.870+0000 7f7686a62740 1 --2- 172.21.15.103:0/732080035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098abd90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.870+0000 7f7686a62740 1 -- 172.21.15.103:0/732080035 >> 172.21.15.103:0/732080035 conn(0x5586098a8060 msgr2=0x5586098a8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.871+0000 7f7686a62740 1 -- 172.21.15.103:0/732080035 shutdown_connections 2024-09-19T06:11:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.871+0000 7f7686a62740 1 -- 172.21.15.103:0/732080035 wait complete. 2024-09-19T06:11:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.871+0000 7f7686a62740 1 -- start start 2024-09-19T06:11:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.871+0000 7f7686a62740 1 Processor -- start 2024-09-19T06:11:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.871+0000 7f7686a62740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.871+0000 7f7686a62740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 0x5586098b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7686a62740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7686a62740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5586098bda50 con 0x5586098ab9b0 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7686a62740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558609799290 con 0x5586098ac2d0 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7686a62740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5586098bdbd0 con 0x5586098bb0c0 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7686a62740 10 client.0 _ll_register_callbacks cb 0x5586097ca140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681a65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681a65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098b7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36924/0 (socket says 172.21.15.103:36924) 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681264640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 0x5586098b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681a65640 1 -- 172.21.15.103:0/2593119920 learned_addr learned my addr 172.21.15.103:0/2593119920 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7682266640 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681a65640 1 -- 172.21.15.103:0/2593119920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 msgr2=0x5586098b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681a65640 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681a65640 1 -- 172.21.15.103:0/2593119920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 msgr2=0x5586098b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681a65640 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 0x5586098b84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681a65640 1 -- 172.21.15.103:0/2593119920 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558609523210 con 0x5586098ab9b0 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7682266640 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681264640 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 0x5586098b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7681a65640 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098b7fb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f76780edd00 tx=0x7f76780bbdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80698f3722f8a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f76657fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f76657fa640 1 -- 172.21.15.103:0/2593119920 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678049070 con 0x5586098ab9b0 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f76657fa640 1 -- 172.21.15.103:0/2593119920 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f76780c4a70 con 0x5586098ab9b0 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.872+0000 7f7686a62740 1 -- 172.21.15.103:0/2593119920 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76780ede50 con 0x5586098ab9b0 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f76657fa640 1 -- 172.21.15.103:0/2593119920 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f76780c0640 con 0x5586098ab9b0 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f7686a62740 10 client.15978 fetch_fsmap learned FSMap version 30 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f7686a62740 1 -- 172.21.15.103:0/2593119920 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586095ef620 con 0x5586098ab9b0 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f76657fa640 1 -- 172.21.15.103:0/2593119920 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f76780ede50 con 0x5586098ab9b0 2024-09-19T06:11:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f76657fa640 1 -- 172.21.15.103:0/2593119920 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f76780dc0e0 con 0x5586098ab9b0 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f7686a62740 10 client.15978 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f7686a62740 10 client.15978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f7686a62740 20 client.15978 populate_metadata read hostname 'smithi103' 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f7686a62740 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5586098caba0 0x5586098ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f7686a62740 4 client.15978 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f7686a62740 1 -- 172.21.15.103:0/2593119920 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55860981da20 con 0x5586098caba0 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.873+0000 7f7681264640 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5586098caba0 0x5586098ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.874+0000 7f76657fa640 10 client.15978 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.874+0000 7f7681264640 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5586098caba0 0x5586098ccf90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfe85940ded8e1d4 server_cookie=27cd399385c9cb43 in_seq=0 out_seq=0 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.874+0000 7f76657fa640 1 -- 172.21.15.103:0/2593119920 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55860981da20 con 0x5586098caba0 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.874+0000 7f76657fa640 10 client.15978 handle_command_reply: tid=0 2024-09-19T06:11:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.874+0000 7f7686a62740 1 client.15978 shutdown 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.874+0000 7f7686a62740 1 -- 172.21.15.103:0/2593119920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 msgr2=0x5586098b7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.874+0000 7f7686a62740 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098b7fb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f76780edd00 tx=0x7f76780bbdd0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.875+0000 7f7686a62740 1 -- 172.21.15.103:0/2593119920 shutdown_connections 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.875+0000 7f7686a62740 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5586098caba0 0x5586098ccf90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.875+0000 7f7686a62740 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.875+0000 7f76657fa640 0 client.15978 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.875+0000 7f7686a62740 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 0x5586098b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.875+0000 7f7686a62740 1 --2- 172.21.15.103:0/2593119920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098b7fb0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.875+0000 7f7686a62740 1 -- 172.21.15.103:0/2593119920 >> 172.21.15.103:0/2593119920 conn(0x5586098a8060 msgr2=0x5586098a71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.875+0000 7f7686a62740 1 -- 172.21.15.103:0/2593119920 shutdown_connections 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.875+0000 7f7686a62740 1 -- 172.21.15.103:0/2593119920 wait complete. 2024-09-19T06:11:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.875+0000 7f7686a62740 20 client.15978 trim_cache size 0 max 16384 2024-09-19T06:11:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7686a62740 1 Processor -- start 2024-09-19T06:11:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7686a62740 1 -- start start 2024-09-19T06:11:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7686a62740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7686a62740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 0x5586098d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7686a62740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7686a62740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f767c1adce0 con 0x5586098ab9b0 2024-09-19T06:11:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7686a62740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f767c1ab580 con 0x5586098ac2d0 2024-09-19T06:11:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7686a62740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f767c1a93f0 con 0x5586098bb0c0 2024-09-19T06:11:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7681a65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7682266640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7681a65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36926/0 (socket says 172.21.15.103:36926) 2024-09-19T06:11:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7681a65640 1 -- 172.21.15.103:0/2904947374 learned_addr learned my addr 172.21.15.103:0/2904947374 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7681264640 1 --2- 172.21.15.103:0/2904947374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 0x5586098d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7682266640 1 -- 172.21.15.103:0/2904947374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 msgr2=0x5586098d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7682266640 1 --2- 172.21.15.103:0/2904947374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 0x5586098d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7682266640 1 -- 172.21.15.103:0/2904947374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 msgr2=0x5586098c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7682266640 1 --2- 172.21.15.103:0/2904947374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7682266640 1 -- 172.21.15.103:0/2904947374 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586098b6f40 con 0x5586098bb0c0 2024-09-19T06:11:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7681a65640 1 --2- 172.21.15.103:0/2904947374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.891+0000 7f7681264640 1 --2- 172.21.15.103:0/2904947374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 0x5586098d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.892+0000 7f7682266640 1 --2- 172.21.15.103:0/2904947374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098d2de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7674013860 tx=0x7f767401f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e101748ac91d910 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.892+0000 7f76677fe640 1 -- 172.21.15.103:0/2904947374 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767402d070 con 0x5586098bb0c0 2024-09-19T06:11:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.892+0000 7f76677fe640 1 -- 172.21.15.103:0/2904947374 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7674004710 con 0x5586098bb0c0 2024-09-19T06:11:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.892+0000 7f76677fe640 1 -- 172.21.15.103:0/2904947374 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674010430 con 0x5586098bb0c0 2024-09-19T06:11:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 -- 172.21.15.103:0/2904947374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 msgr2=0x5586098d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 --2- 172.21.15.103:0/2904947374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098d2de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7674013860 tx=0x7f767401f000 comp rx=0 tx=0).stop 2024-09-19T06:11:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 -- 172.21.15.103:0/2904947374 shutdown_connections 2024-09-19T06:11:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 --2- 172.21.15.103:0/2904947374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098d2de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 --2- 172.21.15.103:0/2904947374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ac2d0 0x5586098d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 --2- 172.21.15.103:0/2904947374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ab9b0 0x5586098c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 -- 172.21.15.103:0/2904947374 >> 172.21.15.103:0/2904947374 conn(0x5586098a8060 msgr2=0x5586098ba030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 -- 172.21.15.103:0/2904947374 shutdown_connections 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 -- 172.21.15.103:0/2904947374 wait complete. 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 -- start start 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 Processor -- start 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ab9b0 0x5586098c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ac2d0 0x5586098b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f767c1a9a40 con 0x5586098ac2d0 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f767c1aaeb0 con 0x5586098ab9b0 2024-09-19T06:11:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.893+0000 7f7686a62740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f767c1aa110 con 0x5586098bb0c0 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7686a62740 10 client.0 _ll_register_callbacks cb 0x7f76780bc1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681a65640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ab9b0 0x5586098c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681264640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ac2d0 0x5586098b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681a65640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ab9b0 0x5586098c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:60904/0 (socket says 172.21.15.103:60904) 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7682266640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681264640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ac2d0 0x5586098b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36940/0 (socket says 172.21.15.103:36940) 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681a65640 1 -- 172.21.15.103:0/433036716 learned_addr learned my addr 172.21.15.103:0/433036716 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681a65640 1 -- 172.21.15.103:0/433036716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 msgr2=0x5586098b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681a65640 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681a65640 1 -- 172.21.15.103:0/433036716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ac2d0 msgr2=0x5586098b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681a65640 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ac2d0 0x5586098b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681a65640 1 -- 172.21.15.103:0/433036716 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586098b5c20 con 0x5586098ab9b0 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681264640 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ac2d0 0x5586098b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7681a65640 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ab9b0 0x5586098c36b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76780762f0 tx=0x7f767802a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9e1a298b1701716 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f76657fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f76657fa640 1 -- 172.21.15.103:0/433036716 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678049040 con 0x5586098ab9b0 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f76657fa640 1 -- 172.21.15.103:0/433036716 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f76780c4a70 con 0x5586098ab9b0 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7686a62740 1 -- 172.21.15.103:0/433036716 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7674004710 con 0x5586098ab9b0 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f76657fa640 1 -- 172.21.15.103:0/433036716 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f76780c4f00 con 0x5586098ab9b0 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7686a62740 10 client.25517 fetch_fsmap learned FSMap version 30 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.894+0000 7f7686a62740 1 -- 172.21.15.103:0/433036716 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586098b5c20 con 0x5586098ab9b0 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f76657fa640 1 -- 172.21.15.103:0/433036716 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7674004710 con 0x5586098ab9b0 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f76657fa640 1 -- 172.21.15.103:0/433036716 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f76780b8090 con 0x5586098ab9b0 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f7686a62740 10 client.25517 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f7686a62740 10 client.25517 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:11:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f7686a62740 20 client.25517 populate_metadata read hostname 'smithi103' 2024-09-19T06:11:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f7686a62740 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558609935d60 0x558609938180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f7686a62740 4 client.25517 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:11:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f7686a62740 1 -- 172.21.15.103:0/433036716 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558609817d70 con 0x558609935d60 2024-09-19T06:11:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f7681264640 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558609935d60 0x558609938180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f7681264640 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558609935d60 0x558609938180 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f0ebdfae57cb9d7 server_cookie=d6e01d30cbbbf010 in_seq=0 out_seq=0 2024-09-19T06:11:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.895+0000 7f76657fa640 10 client.25517 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.908+0000 7f76657fa640 1 -- 172.21.15.103:0/433036716 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558609817d70 con 0x558609935d60 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.908+0000 7f76657fa640 10 client.25517 handle_command_reply: tid=0 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.908+0000 7f7686a62740 1 client.25517 shutdown 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.908+0000 7f7686a62740 1 -- 172.21.15.103:0/433036716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ab9b0 msgr2=0x5586098c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.908+0000 7f7686a62740 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ab9b0 0x5586098c36b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76780762f0 tx=0x7f767802a420 comp rx=0 tx=0).stop 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.908+0000 7f7686a62740 1 -- 172.21.15.103:0/433036716 shutdown_connections 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.908+0000 7f7686a62740 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558609935d60 0x558609938180 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.908+0000 7f7686a62740 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586098bb0c0 0x5586098b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f7686a62740 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586098ac2d0 0x5586098b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f76657fa640 0 client.25517 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f7686a62740 1 --2- 172.21.15.103:0/433036716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586098ab9b0 0x5586098c36b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f7686a62740 1 -- 172.21.15.103:0/433036716 >> 172.21.15.103:0/433036716 conn(0x5586098a8060 msgr2=0x5586098b9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f7686a62740 1 -- 172.21.15.103:0/433036716 shutdown_connections 2024-09-19T06:11:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f7686a62740 1 -- 172.21.15.103:0/433036716 wait complete. 2024-09-19T06:11:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f7686a62740 20 client.25517 trim_cache size 0 max 16384 2024-09-19T06:11:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:11:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:11:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:11:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:11:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f7683cc9640 1 -- 172.21.15.103:0/485111954 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76680a3460 msgr2=0x7f76680a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f7683cc9640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76680a3460 0x7f76680a5920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7674005fd0 tx=0x7f7674013e50 comp rx=0 tx=0).stop 2024-09-19T06:11:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f7683cc9640 1 -- 172.21.15.103:0/485111954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767c101ad0 msgr2=0x7f767c1982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.909+0000 7f7683cc9640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767c101ad0 0x7f767c1982a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7678005940 tx=0x7f76780040c0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.910+0000 7f7683cc9640 1 -- 172.21.15.103:0/485111954 shutdown_connections 2024-09-19T06:11:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.910+0000 7f7683cc9640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f76680a3460 0x7f76680a5920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.910+0000 7f7683cc9640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f767c107b70 0x7f767c19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.910+0000 7f7683cc9640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f767c102470 0x7f767c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.910+0000 7f7683cc9640 1 --2- 172.21.15.103:0/485111954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767c101ad0 0x7f767c1982a0 secure :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7678005940 tx=0x7f76780040c0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.910+0000 7f7683cc9640 1 -- 172.21.15.103:0/485111954 >> 172.21.15.103:0/485111954 conn(0x7f767c0fd7b0 msgr2=0x7f767c0ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.910+0000 7f7683cc9640 1 -- 172.21.15.103:0/485111954 shutdown_connections 2024-09-19T06:11:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:13.910+0000 7f7683cc9640 1 -- 172.21.15.103:0/485111954 wait complete. 2024-09-19T06:11:13.953 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:13 smithi174 ceph-mon[34488]: pgmap v119: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 7.1 MiB/s wr, 956 op/s 2024-09-19T06:11:15.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:15 smithi103 ceph-mon[30925]: pgmap v120: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 5.3 MiB/s wr, 716 op/s 2024-09-19T06:11:15.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:15 smithi169 ceph-mon[34350]: pgmap v120: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 5.3 MiB/s wr, 716 op/s 2024-09-19T06:11:15.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:15 smithi174 ceph-mon[34488]: pgmap v120: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 5.3 MiB/s wr, 716 op/s 2024-09-19T06:11:17.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:17 smithi103 ceph-mon[30925]: pgmap v121: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 8.3 MiB/s wr, 1.14k op/s 2024-09-19T06:11:17.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:17 smithi169 ceph-mon[34350]: pgmap v121: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 8.3 MiB/s wr, 1.14k op/s 2024-09-19T06:11:17.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:17 smithi174 ceph-mon[34488]: pgmap v121: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 8.3 MiB/s wr, 1.14k op/s 2024-09-19T06:11:19.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:19 smithi103 ceph-mon[30925]: pgmap v122: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 6.0 MiB/s wr, 851 op/s 2024-09-19T06:11:19.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:19 smithi169 ceph-mon[34350]: pgmap v122: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 6.0 MiB/s wr, 851 op/s 2024-09-19T06:11:19.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:19 smithi174 ceph-mon[34488]: pgmap v122: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 6.0 MiB/s wr, 851 op/s 2024-09-19T06:11:21.679 INFO:tasks.workunit.client.0.smithi103.stdout:20000 mapread 0x1c4208 thru 0x1c56d4 (0x14cd bytes) 2024-09-19T06:11:21.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:21 smithi169 ceph-mon[34350]: pgmap v123: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 6.0 MiB/s wr, 851 op/s 2024-09-19T06:11:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:21 smithi174 ceph-mon[34488]: pgmap v123: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 6.0 MiB/s wr, 851 op/s 2024-09-19T06:11:21.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:21 smithi103 ceph-mon[30925]: pgmap v123: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 6.0 MiB/s wr, 851 op/s 2024-09-19T06:11:23.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:23 smithi169 ceph-mon[34350]: pgmap v124: 97 pgs: 97 active+clean; 94 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 8.8 MiB/s wr, 1.25k op/s 2024-09-19T06:11:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:23 smithi174 ceph-mon[34488]: pgmap v124: 97 pgs: 97 active+clean; 94 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 8.8 MiB/s wr, 1.25k op/s 2024-09-19T06:11:23.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:23 smithi103 ceph-mon[30925]: pgmap v124: 97 pgs: 97 active+clean; 94 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 8.8 MiB/s wr, 1.25k op/s 2024-09-19T06:11:25.755 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:25 smithi174 ceph-mon[34488]: pgmap v125: 97 pgs: 97 active+clean; 94 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 5.8 MiB/s wr, 815 op/s 2024-09-19T06:11:25.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:25 smithi169 ceph-mon[34350]: pgmap v125: 97 pgs: 97 active+clean; 94 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 5.8 MiB/s wr, 815 op/s 2024-09-19T06:11:25.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:25 smithi103 ceph-mon[30925]: pgmap v125: 97 pgs: 97 active+clean; 94 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 5.8 MiB/s wr, 815 op/s 2024-09-19T06:11:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.006+0000 7f0ab7082640 1 -- 172.21.15.103:0/3675856757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ab01009b0 msgr2=0x7f0ab0100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.006+0000 7f0ab7082640 1 --2- 172.21.15.103:0/3675856757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ab01009b0 0x7f0ab0100e10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009930 tx=0x7f0a9c02a420 comp rx=0 tx=0).stop 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.006+0000 7f0ab7082640 1 -- 172.21.15.103:0/3675856757 shutdown_connections 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.006+0000 7f0ab7082640 1 --2- 172.21.15.103:0/3675856757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ab0101350 0x7f0ab010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.006+0000 7f0ab7082640 1 --2- 172.21.15.103:0/3675856757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ab01009b0 0x7f0ab0100e10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.006+0000 7f0ab7082640 1 --2- 172.21.15.103:0/3675856757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ab01069c0 0x7f0ab0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.006+0000 7f0ab7082640 1 -- 172.21.15.103:0/3675856757 >> 172.21.15.103:0/3675856757 conn(0x7f0ab0077990 msgr2=0x7f0ab00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.006+0000 7f0ab7082640 1 -- 172.21.15.103:0/3675856757 shutdown_connections 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.006+0000 7f0ab7082640 1 -- 172.21.15.103:0/3675856757 wait complete. 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab7082640 1 Processor -- start 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab7082640 1 -- start start 2024-09-19T06:11:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab7082640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ab01009b0 0x7f0ab01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab7082640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ab0101350 0x7f0ab0198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab7082640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ab01069c0 0x7f0ab019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab7082640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab0110cb0 con 0x7f0ab0101350 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab7082640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab0110b30 con 0x7f0ab01069c0 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab7082640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab0110e30 con 0x7f0ab01009b0 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0aaffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ab0101350 0x7f0ab0198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab4e1e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ab01009b0 0x7f0ab01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0aaffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ab0101350 0x7f0ab0198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47992/0 (socket says 172.21.15.103:47992) 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0aaffff640 1 -- 172.21.15.103:0/1941575220 learned_addr learned my addr 172.21.15.103:0/1941575220 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab561f640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ab01069c0 0x7f0ab019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0aaffff640 1 -- 172.21.15.103:0/1941575220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ab01009b0 msgr2=0x7f0ab01982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0aaffff640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ab01009b0 0x7f0ab01982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0aaffff640 1 -- 172.21.15.103:0/1941575220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ab01069c0 msgr2=0x7f0ab019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0aaffff640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ab01069c0 0x7f0ab019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0aaffff640 1 -- 172.21.15.103:0/1941575220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab019d2e0 con 0x7f0ab0101350 2024-09-19T06:11:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.007+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ab01009b0 0x7f0ab01982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.008+0000 7f0aaffff640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ab0101350 0x7f0ab0198830 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c005940 tx=0x7f0a9c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.008+0000 7f0aadffb640 1 -- 172.21.15.103:0/1941575220 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c03f030 con 0x7f0ab0101350 2024-09-19T06:11:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.008+0000 7f0aadffb640 1 -- 172.21.15.103:0/1941575220 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a9c0044c0 con 0x7f0ab0101350 2024-09-19T06:11:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.008+0000 7f0aadffb640 1 -- 172.21.15.103:0/1941575220 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c035070 con 0x7f0ab0101350 2024-09-19T06:11:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.008+0000 7f0ab7082640 1 -- 172.21.15.103:0/1941575220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab019d570 con 0x7f0ab0101350 2024-09-19T06:11:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.008+0000 7f0ab7082640 1 -- 172.21.15.103:0/1941575220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab01a4e60 con 0x7f0ab0101350 2024-09-19T06:11:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.011+0000 7f0ab9e20740 1 Processor -- start 2024-09-19T06:11:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.011+0000 7f0ab9e20740 1 -- start start 2024-09-19T06:11:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.011+0000 7f0aadffb640 1 -- 172.21.15.103:0/1941575220 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f0a9c042030 con 0x7f0ab0101350 2024-09-19T06:11:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.011+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7eeaf0 0x559c9c7eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.011+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7ef410 0x559c9c7f9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.011+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 0x559c9c7fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.011+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559c9c7532f0 con 0x559c9c7f9cb0 2024-09-19T06:11:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.011+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559c9c6fb270 con 0x559c9c7eeaf0 2024-09-19T06:11:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.011+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559c9c74f2b0 con 0x559c9c7ef410 2024-09-19T06:11:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab561f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7eeaf0 0x559c9c7eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0aaffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 0x559c9c7fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab561f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7eeaf0 0x559c9c7eeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:51608/0 (socket says 172.21.15.103:51608) 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab561f640 1 -- 172.21.15.103:0/558911386 learned_addr learned my addr 172.21.15.103:0/558911386 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/558911386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7ef410 0x559c9c7f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab561f640 1 -- 172.21.15.103:0/558911386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7ef410 msgr2=0x559c9c7f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab561f640 1 --2- 172.21.15.103:0/558911386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7ef410 0x559c9c7f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab561f640 1 -- 172.21.15.103:0/558911386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 msgr2=0x559c9c7fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab561f640 1 --2- 172.21.15.103:0/558911386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 0x559c9c7fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab561f640 1 -- 172.21.15.103:0/558911386 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c9c6fa340 con 0x559c9c7eeaf0 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0aadffb640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0aa00a34e0 0x7f0aa00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab561f640 1 --2- 172.21.15.103:0/558911386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7eeaf0 0x559c9c7eeed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009fd0 tx=0x7f0aa80118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0de7860f7eb31a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0aa00a34e0 0x7f0aa00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0a9affd640 1 -- 172.21.15.103:0/558911386 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8004d20 con 0x559c9c7eeaf0 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0aadffb640 1 -- 172.21.15.103:0/1941575220 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f0a9c0eff10 con 0x7f0ab0101350 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0a9affd640 1 -- 172.21.15.103:0/558911386 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0aa8004050 con 0x559c9c7eeaf0 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.012+0000 7f0a9affd640 1 -- 172.21.15.103:0/558911386 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8005280 con 0x559c9c7eeaf0 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.013+0000 7f0ab9e20740 1 -- 172.21.15.103:0/558911386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7eeaf0 msgr2=0x559c9c7eeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.013+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/558911386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7eeaf0 0x559c9c7eeed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009fd0 tx=0x7f0aa80118d0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.013+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0aa00a34e0 0x7f0aa00a59a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x559c9c7ebec0 tx=0x7f0aa4005f90 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.013+0000 7f0ab9e20740 1 -- 172.21.15.103:0/558911386 shutdown_connections 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.013+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/558911386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 0x559c9c7fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.013+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/558911386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7ef410 0x559c9c7f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.013+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/558911386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7eeaf0 0x559c9c7eeed0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.013+0000 7f0ab9e20740 1 -- 172.21.15.103:0/558911386 >> 172.21.15.103:0/558911386 conn(0x559c9c7eb060 msgr2=0x559c9c7eb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.013+0000 7f0ab9e20740 1 -- 172.21.15.103:0/558911386 shutdown_connections 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.013+0000 7f0ab9e20740 1 -- 172.21.15.103:0/558911386 wait complete. 2024-09-19T06:11:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab9e20740 1 -- start start 2024-09-19T06:11:27.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab9e20740 1 Processor -- start 2024-09-19T06:11:27.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c7f7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559c9c7fc880 con 0x559c9c7eeaf0 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559c9c6dc290 con 0x559c9c7ef410 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559c9c7fca00 con 0x559c9c7f9cb0 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab4e1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab9e20740 10 client.0 _ll_register_callbacks cb 0x559c9c70d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab4e1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48014/0 (socket says 172.21.15.103:48014) 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab4e1e640 1 -- 172.21.15.103:0/606710121 learned_addr learned my addr 172.21.15.103:0/606710121 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0aaffff640 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c7f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab561f640 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab4e1e640 1 -- 172.21.15.103:0/606710121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7f9cb0 msgr2=0x559c9c7f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab4e1e640 1 -- 172.21.15.103:0/606710121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 msgr2=0x559c9c7f7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c7f7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0ab4e1e640 1 -- 172.21.15.103:0/606710121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c9c466210 con 0x559c9c7eeaf0 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.014+0000 7f0aaffff640 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c7f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f6bc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400fb90 tx=0x7f0aa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9a5de9c0b95e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0a8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0a8ffff640 1 -- 172.21.15.103:0/606710121 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa402e060 con 0x559c9c7eeaf0 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0ab9e20740 1 -- 172.21.15.103:0/606710121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aa8004050 con 0x559c9c7eeaf0 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0a8ffff640 1 -- 172.21.15.103:0/606710121 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f0aa4018030 con 0x559c9c7eeaf0 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0a8ffff640 1 -- 172.21.15.103:0/606710121 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0aa400fe60 con 0x559c9c7eeaf0 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0ab9e20740 10 client.15996 fetch_fsmap learned FSMap version 30 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0ab9e20740 1 -- 172.21.15.103:0/606710121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c9c532620 con 0x559c9c7eeaf0 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0a8ffff640 1 -- 172.21.15.103:0/606710121 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0aa8004050 con 0x559c9c7eeaf0 2024-09-19T06:11:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0a8ffff640 1 -- 172.21.15.103:0/606710121 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f0aa401c950 con 0x559c9c7eeaf0 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0ab9e20740 10 client.15996 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0ab9e20740 10 client.15996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0ab9e20740 20 client.15996 populate_metadata read hostname 'smithi103' 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.015+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x559c9c80a0f0 0x559c9c80c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.016+0000 7f0ab9e20740 4 client.15996 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.016+0000 7f0ab9e20740 1 -- 172.21.15.103:0/606710121 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c9c760a20 con 0x559c9c80a0f0 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.016+0000 7f0aaffff640 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x559c9c80a0f0 0x559c9c80c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.016+0000 7f0aaffff640 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x559c9c80a0f0 0x559c9c80c590 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0b4bdd91167ae2c server_cookie=3480f4ca2a8ad98b in_seq=0 out_seq=0 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.016+0000 7f0a8ffff640 10 client.15996 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0a8ffff640 1 -- 172.21.15.103:0/606710121 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c9c760a20 con 0x559c9c80a0f0 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0a8ffff640 10 client.15996 handle_command_reply: tid=0 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 client.15996 shutdown 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 -- 172.21.15.103:0/606710121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 msgr2=0x559c9c7f6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f6bc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400fb90 tx=0x7f0aa40046c0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 -- 172.21.15.103:0/606710121 shutdown_connections 2024-09-19T06:11:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x559c9c80a0f0 0x559c9c80c590 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c7f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/606710121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f6bc0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 -- 172.21.15.103:0/606710121 >> 172.21.15.103:0/606710121 conn(0x559c9c7eb060 msgr2=0x559c9c7ea1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0a8ffff640 0 client.15996 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 -- 172.21.15.103:0/606710121 shutdown_connections 2024-09-19T06:11:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 1 -- 172.21.15.103:0/606710121 wait complete. 2024-09-19T06:11:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.017+0000 7f0ab9e20740 20 client.15996 trim_cache size 0 max 16384 2024-09-19T06:11:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab9e20740 1 Processor -- start 2024-09-19T06:11:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab9e20740 1 -- start start 2024-09-19T06:11:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c7f7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab01afed0 con 0x559c9c7eeaf0 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab01ad770 con 0x559c9c7ef410 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab01ab5c0 con 0x559c9c7f9cb0 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab4e1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab4e1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48024/0 (socket says 172.21.15.103:48024) 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab4e1e640 1 -- 172.21.15.103:0/3654130845 learned_addr learned my addr 172.21.15.103:0/3654130845 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0aaffff640 1 --2- 172.21.15.103:0/3654130845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c7f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.034+0000 7f0ab561f640 1 --2- 172.21.15.103:0/3654130845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.035+0000 7f0ab4e1e640 1 -- 172.21.15.103:0/3654130845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7f9cb0 msgr2=0x559c9c7f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.035+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/3654130845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.035+0000 7f0ab4e1e640 1 -- 172.21.15.103:0/3654130845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 msgr2=0x559c9c7f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.035+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/3654130845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c7f7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.035+0000 7f0ab4e1e640 1 -- 172.21.15.103:0/3654130845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c9c7f5110 con 0x559c9c7eeaf0 2024-09-19T06:11:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.035+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/3654130845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f8b30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4019040 tx=0x7f0aa401cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e311bc3bb8fa41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.035+0000 7f0a9a7fc640 1 -- 172.21.15.103:0/3654130845 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4005040 con 0x559c9c7eeaf0 2024-09-19T06:11:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.035+0000 7f0a9a7fc640 1 -- 172.21.15.103:0/3654130845 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0aa401e7f0 con 0x559c9c7eeaf0 2024-09-19T06:11:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.035+0000 7f0a9a7fc640 1 -- 172.21.15.103:0/3654130845 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4004990 con 0x559c9c7eeaf0 2024-09-19T06:11:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 -- 172.21.15.103:0/3654130845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 msgr2=0x559c9c7f8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/3654130845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f8b30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4019040 tx=0x7f0aa401cfd0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 -- 172.21.15.103:0/3654130845 shutdown_connections 2024-09-19T06:11:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/3654130845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/3654130845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c7f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/3654130845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7eeaf0 0x559c9c7f8b30 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 -- 172.21.15.103:0/3654130845 >> 172.21.15.103:0/3654130845 conn(0x559c9c7eb060 msgr2=0x559c9c7f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 -- 172.21.15.103:0/3654130845 shutdown_connections 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 -- 172.21.15.103:0/3654130845 wait complete. 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 -- start start 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.036+0000 7f0ab9e20740 1 Processor -- start 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7eeaf0 0x559c9c801fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c802500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab9e20740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab01abc30 con 0x559c9c7f9cb0 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab01ad0a0 con 0x559c9c7ef410 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab9e20740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab01ac300 con 0x559c9c7eeaf0 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab9e20740 10 client.0 _ll_register_callbacks cb 0x7f0aa400f4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab561f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab561f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48026/0 (socket says 172.21.15.103:48026) 2024-09-19T06:11:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab561f640 1 -- 172.21.15.103:0/2603218453 learned_addr learned my addr 172.21.15.103:0/2603218453 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7eeaf0 0x559c9c801fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0aaffff640 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c802500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab561f640 1 -- 172.21.15.103:0/2603218453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7eeaf0 msgr2=0x559c9c801fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab561f640 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7eeaf0 0x559c9c801fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab561f640 1 -- 172.21.15.103:0/2603218453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 msgr2=0x559c9c802500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab561f640 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c802500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab561f640 1 -- 172.21.15.103:0/2603218453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c9c7f3db0 con 0x559c9c7f9cb0 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7eeaf0 0x559c9c801fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab561f640 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f35b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8006010 tx=0x7f0aa8009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf221ab053876d7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0a8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0a8ffff640 1 -- 172.21.15.103:0/2603218453 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8005390 con 0x559c9c7f9cb0 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0ab9e20740 1 -- 172.21.15.103:0/2603218453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aa401e7f0 con 0x559c9c7f9cb0 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.037+0000 7f0a8ffff640 1 -- 172.21.15.103:0/2603218453 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f0aa8005530 con 0x559c9c7f9cb0 2024-09-19T06:11:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0a8ffff640 1 -- 172.21.15.103:0/2603218453 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0aa8005730 con 0x559c9c7f9cb0 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0ab9e20740 10 client.16002 fetch_fsmap learned FSMap version 30 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0ab9e20740 1 -- 172.21.15.103:0/2603218453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c9c874a40 con 0x559c9c7f9cb0 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0a8ffff640 1 -- 172.21.15.103:0/2603218453 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0aa401e7f0 con 0x559c9c7f9cb0 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0a8ffff640 1 -- 172.21.15.103:0/2603218453 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f0aa8036480 con 0x559c9c7f9cb0 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0ab9e20740 10 client.16002 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0ab9e20740 10 client.16002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0ab9e20740 20 client.16002 populate_metadata read hostname 'smithi103' 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x559c9c874f20 0x559c9c877340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0ab9e20740 4 client.16002 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0ab9e20740 1 -- 172.21.15.103:0/2603218453 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559c9c75ad70 con 0x559c9c874f20 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.038+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x559c9c874f20 0x559c9c877340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.039+0000 7f0a8ffff640 10 client.16002 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.039+0000 7f0ab4e1e640 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x559c9c874f20 0x559c9c877340 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b99d02fcffed1fb7 server_cookie=7b4d52c1b5b4f8cd in_seq=0 out_seq=0 2024-09-19T06:11:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0a8ffff640 1 -- 172.21.15.103:0/2603218453 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559c9c75ad70 con 0x559c9c874f20 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0a8ffff640 10 client.16002 handle_command_reply: tid=0 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 client.16002 shutdown 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 -- 172.21.15.103:0/2603218453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 msgr2=0x559c9c7f35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f35b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8006010 tx=0x7f0aa8009d60 comp rx=0 tx=0).stop 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 -- 172.21.15.103:0/2603218453 shutdown_connections 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x559c9c874f20 0x559c9c877340 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c9c7f9cb0 0x559c9c7f35b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c9c7ef410 0x559c9c802500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0a8ffff640 0 client.16002 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 --2- 172.21.15.103:0/2603218453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559c9c7eeaf0 0x559c9c801fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 -- 172.21.15.103:0/2603218453 >> 172.21.15.103:0/2603218453 conn(0x559c9c7eb060 msgr2=0x559c9c7ea1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 -- 172.21.15.103:0/2603218453 shutdown_connections 2024-09-19T06:11:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 1 -- 172.21.15.103:0/2603218453 wait complete. 2024-09-19T06:11:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.054+0000 7f0ab9e20740 20 client.16002 trim_cache size 0 max 16384 2024-09-19T06:11:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:11:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:11:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:11:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:11:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 -- 172.21.15.103:0/1941575220 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0aa00a34e0 msgr2=0x7f0aa00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0aa00a34e0 0x7f0aa00a59a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x559c9c7ebec0 tx=0x7f0aa4005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 -- 172.21.15.103:0/1941575220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ab0101350 msgr2=0x7f0ab0198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ab0101350 0x7f0ab0198830 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c005940 tx=0x7f0a9c0040c0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 -- 172.21.15.103:0/1941575220 shutdown_connections 2024-09-19T06:11:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0aa00a34e0 0x7f0aa00a59a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ab01069c0 0x7f0ab019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ab0101350 0x7f0ab0198830 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 --2- 172.21.15.103:0/1941575220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ab01009b0 0x7f0ab01982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 -- 172.21.15.103:0/1941575220 >> 172.21.15.103:0/1941575220 conn(0x7f0ab0077990 msgr2=0x7f0ab0069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 -- 172.21.15.103:0/1941575220 shutdown_connections 2024-09-19T06:11:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:27.055+0000 7f0ab7082640 1 -- 172.21.15.103:0/1941575220 wait complete. 2024-09-19T06:11:27.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:27 smithi169 ceph-mon[34350]: pgmap v126: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 8.5 MiB/s wr, 1.21k op/s 2024-09-19T06:11:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:27 smithi174 ceph-mon[34488]: pgmap v126: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 8.5 MiB/s wr, 1.21k op/s 2024-09-19T06:11:27.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:27 smithi103 ceph-mon[30925]: pgmap v126: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 8.5 MiB/s wr, 1.21k op/s 2024-09-19T06:11:29.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:29 smithi169 ceph-mon[34350]: pgmap v127: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 5.5 MiB/s wr, 789 op/s 2024-09-19T06:11:29.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:29 smithi174 ceph-mon[34488]: pgmap v127: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 5.5 MiB/s wr, 789 op/s 2024-09-19T06:11:29.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:29 smithi103 ceph-mon[30925]: pgmap v127: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 5.5 MiB/s wr, 789 op/s 2024-09-19T06:11:31.202 INFO:tasks.workunit.client.0.smithi103.stdout:30000 mapread 0x3fc9cb thru 0x4052a3 (0x88d9 bytes) 2024-09-19T06:11:31.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:31 smithi169 ceph-mon[34350]: pgmap v128: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 5.5 MiB/s wr, 789 op/s 2024-09-19T06:11:31.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:31 smithi174 ceph-mon[34488]: pgmap v128: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 5.5 MiB/s wr, 789 op/s 2024-09-19T06:11:31.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:31 smithi103 ceph-mon[30925]: pgmap v128: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 5.5 MiB/s wr, 789 op/s 2024-09-19T06:11:32.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:32 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:32.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:32 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:32.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:32 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:33.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:33 smithi169 ceph-mon[34350]: pgmap v129: 97 pgs: 97 active+clean; 96 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 8.0 MiB/s wr, 1.16k op/s 2024-09-19T06:11:33.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:33 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:33 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:33.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:33 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:11:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:33 smithi174 ceph-mon[34488]: pgmap v129: 97 pgs: 97 active+clean; 96 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 8.0 MiB/s wr, 1.16k op/s 2024-09-19T06:11:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:33 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:33 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:33 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:11:33.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:33 smithi103 ceph-mon[30925]: pgmap v129: 97 pgs: 97 active+clean; 96 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 8.0 MiB/s wr, 1.16k op/s 2024-09-19T06:11:33.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:33 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:33.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:33 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:33.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:33 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:11:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:35 smithi169 ceph-mon[34350]: pgmap v130: 97 pgs: 97 active+clean; 96 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.3 MiB/s wr, 766 op/s 2024-09-19T06:11:35.795 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:35 smithi103 ceph-mon[30925]: pgmap v130: 97 pgs: 97 active+clean; 96 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.3 MiB/s wr, 766 op/s 2024-09-19T06:11:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:35 smithi174 ceph-mon[34488]: pgmap v130: 97 pgs: 97 active+clean; 96 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.3 MiB/s wr, 766 op/s 2024-09-19T06:11:37.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:37 smithi169 ceph-mon[34350]: pgmap v131: 97 pgs: 97 active+clean; 99 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 7.9 MiB/s wr, 1.12k op/s 2024-09-19T06:11:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:37 smithi174 ceph-mon[34488]: pgmap v131: 97 pgs: 97 active+clean; 99 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 7.9 MiB/s wr, 1.12k op/s 2024-09-19T06:11:37.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:37 smithi103 ceph-mon[30925]: pgmap v131: 97 pgs: 97 active+clean; 99 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 7.9 MiB/s wr, 1.12k op/s 2024-09-19T06:11:39.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:39 smithi169 ceph-mon[34350]: pgmap v132: 97 pgs: 97 active+clean; 99 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.2 MiB/s wr, 728 op/s 2024-09-19T06:11:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:39 smithi174 ceph-mon[34488]: pgmap v132: 97 pgs: 97 active+clean; 99 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.2 MiB/s wr, 728 op/s 2024-09-19T06:11:39.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:39 smithi103 ceph-mon[30925]: pgmap v132: 97 pgs: 97 active+clean; 99 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.2 MiB/s wr, 728 op/s 2024-09-19T06:11:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.155+0000 7f6151c82640 1 -- 172.21.15.103:0/2558834414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614c101350 msgr2=0x7f614c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.155+0000 7f6151c82640 1 --2- 172.21.15.103:0/2558834414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614c101350 0x7f614c10d880 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6144009cd0 tx=0x7f614402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.156+0000 7f6151c82640 1 -- 172.21.15.103:0/2558834414 shutdown_connections 2024-09-19T06:11:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.156+0000 7f6151c82640 1 --2- 172.21.15.103:0/2558834414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614c101350 0x7f614c10d880 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.156+0000 7f6151c82640 1 --2- 172.21.15.103:0/2558834414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f614c1009b0 0x7f614c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.156+0000 7f6151c82640 1 --2- 172.21.15.103:0/2558834414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f614c1069c0 0x7f614c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.156+0000 7f6151c82640 1 -- 172.21.15.103:0/2558834414 >> 172.21.15.103:0/2558834414 conn(0x7f614c077990 msgr2=0x7f614c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.156+0000 7f6151c82640 1 -- 172.21.15.103:0/2558834414 shutdown_connections 2024-09-19T06:11:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.156+0000 7f6151c82640 1 -- 172.21.15.103:0/2558834414 wait complete. 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.156+0000 7f6151c82640 1 Processor -- start 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f6151c82640 1 -- start start 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f6151c82640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f614c1009b0 0x7f614c196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f6151c82640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f614c101350 0x7f614c1973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f6151c82640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614c1069c0 0x7f614c1978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f6151c82640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f614c110cb0 con 0x7f614c1069c0 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f6151c82640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f614c110b30 con 0x7f614c101350 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f6151c82640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f614c110e30 con 0x7f614c1009b0 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f614bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614c1069c0 0x7f614c1978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f614affd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f614c101350 0x7f614c1973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f614bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614c1069c0 0x7f614c1978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45456/0 (socket says 172.21.15.103:45456) 2024-09-19T06:11:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f614bfff640 1 -- 172.21.15.103:0/3600111241 learned_addr learned my addr 172.21.15.103:0/3600111241 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f614b7fe640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f614c1009b0 0x7f614c196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f614b7fe640 1 -- 172.21.15.103:0/3600111241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f614c101350 msgr2=0x7f614c1973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f614b7fe640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f614c101350 0x7f614c1973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f614b7fe640 1 -- 172.21.15.103:0/3600111241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614c1069c0 msgr2=0x7f614c1978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f614b7fe640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614c1069c0 0x7f614c1978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.157+0000 7f614b7fe640 1 -- 172.21.15.103:0/3600111241 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c1a66e0 con 0x7f614c1009b0 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.158+0000 7f614b7fe640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f614c1009b0 0x7f614c196e70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f613c00e9f0 tx=0x7f613c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.158+0000 7f6148ff9640 1 -- 172.21.15.103:0/3600111241 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c00ccc0 con 0x7f614c1009b0 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.158+0000 7f6148ff9640 1 -- 172.21.15.103:0/3600111241 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f613c0108e0 con 0x7f614c1009b0 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.158+0000 7f6151c82640 1 -- 172.21.15.103:0/3600111241 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614c1a69d0 con 0x7f614c1009b0 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.158+0000 7f6148ff9640 1 -- 172.21.15.103:0/3600111241 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c018880 con 0x7f614c1009b0 2024-09-19T06:11:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.158+0000 7f6151c82640 1 -- 172.21.15.103:0/3600111241 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614c1a6f20 con 0x7f614c1009b0 2024-09-19T06:11:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.160+0000 7f6148ff9640 1 -- 172.21.15.103:0/3600111241 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f613c010a90 con 0x7f614c1009b0 2024-09-19T06:11:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f6154a22740 1 Processor -- start 2024-09-19T06:11:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f6154a22740 1 -- start start 2024-09-19T06:11:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f6154a22740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13bdaf0 0x55e1b13bded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f6154a22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f6154a22740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13c8cb0 0x55e1b13cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f6154a22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e1b13222f0 con 0x55e1b13be410 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f6154a22740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e1b12ca270 con 0x55e1b13c8cb0 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f6154a22740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e1b131e2b0 con 0x55e1b13bdaf0 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f6148ff9640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61340a3460 0x7f61340a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13bdaf0 0x55e1b13bded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45460/0 (socket says 172.21.15.103:45460) 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13bdaf0 0x55e1b13bded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:51982/0 (socket says 172.21.15.103:51982) 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614b7fe640 1 -- 172.21.15.103:0/2886627354 learned_addr learned my addr 172.21.15.103:0/2886627354 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614affd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13c8cb0 0x55e1b13cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614bfff640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61340a3460 0x7f61340a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f6148ff9640 1 -- 172.21.15.103:0/3600111241 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f613c0cfff0 con 0x7f614c1009b0 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614affd640 1 -- 172.21.15.103:0/2886627354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13bdaf0 msgr2=0x55e1b13bded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614affd640 1 --2- 172.21.15.103:0/2886627354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13bdaf0 0x55e1b13bded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614affd640 1 -- 172.21.15.103:0/2886627354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 msgr2=0x55e1b13c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614affd640 1 --2- 172.21.15.103:0/2886627354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614affd640 1 -- 172.21.15.103:0/2886627354 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b12c9340 con 0x55e1b13c8cb0 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.161+0000 7f614b7fe640 1 --2- 172.21.15.103:0/2886627354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.162+0000 7f614bfff640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61340a3460 0x7f61340a5920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6144004af0 tx=0x7f6144005c50 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.162+0000 7f614affd640 1 --2- 172.21.15.103:0/2886627354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13c8cb0 0x55e1b13cb0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6140009bf0 tx=0x7f6140011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec149a41c8e7dfba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.162+0000 7f6131ffb640 1 -- 172.21.15.103:0/2886627354 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140004050 con 0x55e1b13c8cb0 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.162+0000 7f6131ffb640 1 -- 172.21.15.103:0/2886627354 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61400054d0 con 0x55e1b13c8cb0 2024-09-19T06:11:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.162+0000 7f6131ffb640 1 -- 172.21.15.103:0/2886627354 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140004d60 con 0x55e1b13c8cb0 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 -- 172.21.15.103:0/2886627354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13c8cb0 msgr2=0x55e1b13cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 --2- 172.21.15.103:0/2886627354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13c8cb0 0x55e1b13cb0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6140009bf0 tx=0x7f6140011810 comp rx=0 tx=0).stop 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 -- 172.21.15.103:0/2886627354 shutdown_connections 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 --2- 172.21.15.103:0/2886627354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13c8cb0 0x55e1b13cb0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 --2- 172.21.15.103:0/2886627354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 --2- 172.21.15.103:0/2886627354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13bdaf0 0x55e1b13bded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 -- 172.21.15.103:0/2886627354 >> 172.21.15.103:0/2886627354 conn(0x55e1b13ba060 msgr2=0x55e1b13ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 -- 172.21.15.103:0/2886627354 shutdown_connections 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 -- 172.21.15.103:0/2886627354 wait complete. 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 -- start start 2024-09-19T06:11:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.163+0000 7f6154a22740 1 Processor -- start 2024-09-19T06:11:40.171 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f6154a22740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f6154a22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f6154a22740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13c8cb0 0x55e1b13c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f6154a22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e1b13cb880 con 0x55e1b13be410 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f6154a22740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e1b12ab290 con 0x55e1b13bdaf0 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f6154a22740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e1b13cba00 con 0x55e1b13c8cb0 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f6154a22740 10 client.0 _ll_register_callbacks cb 0x55e1b12dc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45476/0 (socket says 172.21.15.103:45476) 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:44202/0 (socket says 172.21.15.103:44202) 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614affd640 1 -- 172.21.15.103:0/3407904039 learned_addr learned my addr 172.21.15.103:0/3407904039 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13c8cb0 0x55e1b13c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614b7fe640 1 -- 172.21.15.103:0/3407904039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13c8cb0 msgr2=0x55e1b13c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614b7fe640 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13c8cb0 0x55e1b13c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614b7fe640 1 -- 172.21.15.103:0/3407904039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 msgr2=0x55e1b13c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614b7fe640 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614b7fe640 1 -- 172.21.15.103:0/3407904039 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b1035210 con 0x55e1b13bdaf0 2024-09-19T06:11:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614bfff640 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13c8cb0 0x55e1b13c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f614b7fe640 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c5b00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f613c09c300 tx=0x7f613c010f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=362b5902d714febb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f612affd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:11:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.164+0000 7f612affd640 1 -- 172.21.15.103:0/3407904039 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c0cdbc0 con 0x55e1b13bdaf0 2024-09-19T06:11:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f612affd640 1 -- 172.21.15.103:0/3407904039 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f613c0bc2b0 con 0x55e1b13bdaf0 2024-09-19T06:11:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f6154a22740 1 -- 172.21.15.103:0/3407904039 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61400054d0 con 0x55e1b13bdaf0 2024-09-19T06:11:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f612affd640 1 -- 172.21.15.103:0/3407904039 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f613c0a4f30 con 0x55e1b13bdaf0 2024-09-19T06:11:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f6154a22740 10 client.25547 fetch_fsmap learned FSMap version 30 2024-09-19T06:11:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f6154a22740 1 -- 172.21.15.103:0/3407904039 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e1b1101620 con 0x55e1b13bdaf0 2024-09-19T06:11:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f612affd640 1 -- 172.21.15.103:0/3407904039 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61400054d0 con 0x55e1b13bdaf0 2024-09-19T06:11:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f612affd640 1 -- 172.21.15.103:0/3407904039 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f613c0980c0 con 0x55e1b13bdaf0 2024-09-19T06:11:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f6154a22740 10 client.25547 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:11:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f6154a22740 10 client.25547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:11:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f6154a22740 20 client.25547 populate_metadata read hostname 'smithi103' 2024-09-19T06:11:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f6154a22740 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e1b13d9000 0x55e1b13db4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f6154a22740 4 client.25547 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f6154a22740 1 -- 172.21.15.103:0/3407904039 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1b132fa20 con 0x55e1b13d9000 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.165+0000 7f614affd640 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e1b13d9000 0x55e1b13db4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.166+0000 7f614affd640 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e1b13d9000 0x55e1b13db4a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a4d861b4622d7f server_cookie=afc99bac7af306de in_seq=0 out_seq=0 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.166+0000 7f612affd640 10 client.25547 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.166+0000 7f612affd640 1 -- 172.21.15.103:0/3407904039 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1b132fa20 con 0x55e1b13d9000 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.166+0000 7f612affd640 10 client.25547 handle_command_reply: tid=0 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.166+0000 7f6154a22740 1 client.25547 shutdown 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 1 -- 172.21.15.103:0/3407904039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 msgr2=0x55e1b13c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c5b00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f613c09c300 tx=0x7f613c010f40 comp rx=0 tx=0).stop 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 1 -- 172.21.15.103:0/3407904039 shutdown_connections 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e1b13d9000 0x55e1b13db4a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13c8cb0 0x55e1b13c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13be410 0x55e1b13c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f612affd640 0 client.25547 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 1 --2- 172.21.15.103:0/3407904039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c5b00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 1 -- 172.21.15.103:0/3407904039 >> 172.21.15.103:0/3407904039 conn(0x55e1b13ba060 msgr2=0x55e1b13bfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 1 -- 172.21.15.103:0/3407904039 shutdown_connections 2024-09-19T06:11:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 1 -- 172.21.15.103:0/3407904039 wait complete. 2024-09-19T06:11:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.167+0000 7f6154a22740 20 client.25547 trim_cache size 0 max 16384 2024-09-19T06:11:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.182+0000 7f6154a22740 1 Processor -- start 2024-09-19T06:11:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.182+0000 7f6154a22740 1 -- start start 2024-09-19T06:11:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f6154a22740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f6154a22740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 0x55e1b13c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f6154a22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b13e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f6154a22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f614c1b2110 con 0x55e1b13c8cb0 2024-09-19T06:11:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f6154a22740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f614c1af9b0 con 0x55e1b13bdaf0 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f6154a22740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f614c1ad800 con 0x55e1b13be410 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b13e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b13e0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45488/0 (socket says 172.21.15.103:45488) 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614bfff640 1 -- 172.21.15.103:0/282467360 learned_addr learned my addr 172.21.15.103:0/282467360 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614affd640 1 --2- 172.21.15.103:0/282467360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 0x55e1b13c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614b7fe640 1 -- 172.21.15.103:0/282467360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 msgr2=0x55e1b13c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614b7fe640 1 --2- 172.21.15.103:0/282467360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 0x55e1b13c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614b7fe640 1 -- 172.21.15.103:0/282467360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 msgr2=0x55e1b13e0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614b7fe640 1 --2- 172.21.15.103:0/282467360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b13e0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614b7fe640 1 -- 172.21.15.103:0/282467360 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b13b9e90 con 0x55e1b13bdaf0 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.183+0000 7f614b7fe640 1 --2- 172.21.15.103:0/282467360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c0560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f613c00cf10 tx=0x7f613c09c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=627d838bb29a1618 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f61317fa640 1 -- 172.21.15.103:0/282467360 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c0980c0 con 0x55e1b13bdaf0 2024-09-19T06:11:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f61317fa640 1 -- 172.21.15.103:0/282467360 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f613c098260 con 0x55e1b13bdaf0 2024-09-19T06:11:40.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f61317fa640 1 -- 172.21.15.103:0/282467360 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c0a03b0 con 0x55e1b13bdaf0 2024-09-19T06:11:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f6154a22740 1 -- 172.21.15.103:0/282467360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 msgr2=0x55e1b13c0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f6154a22740 1 --2- 172.21.15.103:0/282467360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c0560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f613c00cf10 tx=0x7f613c09c4b0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f6154a22740 1 -- 172.21.15.103:0/282467360 shutdown_connections 2024-09-19T06:11:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f6154a22740 1 --2- 172.21.15.103:0/282467360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b13e0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f6154a22740 1 --2- 172.21.15.103:0/282467360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 0x55e1b13c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f6154a22740 1 --2- 172.21.15.103:0/282467360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13c0560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f6154a22740 1 -- 172.21.15.103:0/282467360 >> 172.21.15.103:0/282467360 conn(0x55e1b13ba060 msgr2=0x55e1b13c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f6154a22740 1 -- 172.21.15.103:0/282467360 shutdown_connections 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.184+0000 7f6154a22740 1 -- 172.21.15.103:0/282467360 wait complete. 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f6154a22740 1 -- start start 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f6154a22740 1 Processor -- start 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f6154a22740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f6154a22740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 0x55e1b13cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f6154a22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b1441d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f6154a22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f614c1ade70 con 0x55e1b13c8cb0 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f6154a22740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f614c1af2e0 con 0x55e1b13bdaf0 2024-09-19T06:11:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f6154a22740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f614c1ae540 con 0x55e1b13be410 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f6154a22740 10 client.0 _ll_register_callbacks cb 0x7f613c0cd6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f614bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b1441d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f614bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b1441d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45496/0 (socket says 172.21.15.103:45496) 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f614affd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 0x55e1b13cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.185+0000 7f614bfff640 1 -- 172.21.15.103:0/3250305495 learned_addr learned my addr 172.21.15.103:0/3250305495 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f614bfff640 1 -- 172.21.15.103:0/3250305495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 msgr2=0x55e1b13cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f614bfff640 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 0x55e1b13cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f614bfff640 1 -- 172.21.15.103:0/3250305495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 msgr2=0x55e1b13cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f614bfff640 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f614bfff640 1 -- 172.21.15.103:0/3250305495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b14422b0 con 0x55e1b13c8cb0 2024-09-19T06:11:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f614affd640 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 0x55e1b13cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f614bfff640 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b1441d70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6144033040 tx=0x7f61440095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef01d9f48914e579 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f612affd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:11:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f612affd640 1 -- 172.21.15.103:0/3250305495 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614405a060 con 0x55e1b13c8cb0 2024-09-19T06:11:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f6154a22740 1 -- 172.21.15.103:0/3250305495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f613c098260 con 0x55e1b13c8cb0 2024-09-19T06:11:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f612affd640 1 -- 172.21.15.103:0/3250305495 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f61440309b0 con 0x55e1b13c8cb0 2024-09-19T06:11:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f612affd640 1 -- 172.21.15.103:0/3250305495 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6144031850 con 0x55e1b13c8cb0 2024-09-19T06:11:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f6154a22740 10 client.16020 fetch_fsmap learned FSMap version 30 2024-09-19T06:11:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f6154a22740 1 -- 172.21.15.103:0/3250305495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e1b1443420 con 0x55e1b13c8cb0 2024-09-19T06:11:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.186+0000 7f612affd640 1 -- 172.21.15.103:0/3250305495 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f613c098260 con 0x55e1b13c8cb0 2024-09-19T06:11:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.187+0000 7f612affd640 1 -- 172.21.15.103:0/3250305495 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f6144048040 con 0x55e1b13c8cb0 2024-09-19T06:11:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.187+0000 7f6154a22740 10 client.16020 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:11:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.187+0000 7f6154a22740 10 client.16020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:11:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.187+0000 7f6154a22740 20 client.16020 populate_metadata read hostname 'smithi103' 2024-09-19T06:11:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.187+0000 7f6154a22740 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e1b13d9000 0x55e1b1445c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.187+0000 7f6154a22740 4 client.16020 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:11:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.187+0000 7f6154a22740 1 -- 172.21.15.103:0/3250305495 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e1b1329d70 con 0x55e1b13d9000 2024-09-19T06:11:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.187+0000 7f614b7fe640 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e1b13d9000 0x55e1b1445c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.187+0000 7f612affd640 10 client.16020 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.187+0000 7f614b7fe640 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e1b13d9000 0x55e1b1445c10 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46fa6deeaaa621d8 server_cookie=f67e82f7fd9a92aa in_seq=0 out_seq=0 2024-09-19T06:11:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f612affd640 1 -- 172.21.15.103:0/3250305495 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e1b1329d70 con 0x55e1b13d9000 2024-09-19T06:11:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f612affd640 10 client.16020 handle_command_reply: tid=0 2024-09-19T06:11:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 client.16020 shutdown 2024-09-19T06:11:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 -- 172.21.15.103:0/3250305495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 msgr2=0x55e1b1441d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b1441d70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6144033040 tx=0x7f61440095c0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 -- 172.21.15.103:0/3250305495 shutdown_connections 2024-09-19T06:11:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55e1b13d9000 0x55e1b1445c10 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b13c8cb0 0x55e1b1441d70 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1b13be410 0x55e1b13cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 --2- 172.21.15.103:0/3250305495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1b13bdaf0 0x55e1b13cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f612affd640 0 client.16020 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 -- 172.21.15.103:0/3250305495 >> 172.21.15.103:0/3250305495 conn(0x55e1b13ba060 msgr2=0x55e1b13b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 -- 172.21.15.103:0/3250305495 shutdown_connections 2024-09-19T06:11:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.202+0000 7f6154a22740 1 -- 172.21.15.103:0/3250305495 wait complete. 2024-09-19T06:11:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6154a22740 20 client.16020 trim_cache size 0 max 16384 2024-09-19T06:11:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:11:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:11:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:11:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:11:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 -- 172.21.15.103:0/3600111241 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61340a3460 msgr2=0x7f61340a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61340a3460 0x7f61340a5920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6144004af0 tx=0x7f6144005c50 comp rx=0 tx=0).stop 2024-09-19T06:11:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 -- 172.21.15.103:0/3600111241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f614c1009b0 msgr2=0x7f614c196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f614c1009b0 0x7f614c196e70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f613c00e9f0 tx=0x7f613c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 -- 172.21.15.103:0/3600111241 shutdown_connections 2024-09-19T06:11:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f61340a3460 0x7f61340a5920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614c1069c0 0x7f614c1978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f614c101350 0x7f614c1973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 --2- 172.21.15.103:0/3600111241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f614c1009b0 0x7f614c196e70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 -- 172.21.15.103:0/3600111241 >> 172.21.15.103:0/3600111241 conn(0x7f614c077990 msgr2=0x7f614c0ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 -- 172.21.15.103:0/3600111241 shutdown_connections 2024-09-19T06:11:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:40.203+0000 7f6151c82640 1 -- 172.21.15.103:0/3600111241 wait complete. 2024-09-19T06:11:41.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:41 smithi169 ceph-mon[34350]: pgmap v133: 97 pgs: 97 active+clean; 99 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.2 MiB/s wr, 728 op/s 2024-09-19T06:11:41.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:41 smithi174 ceph-mon[34488]: pgmap v133: 97 pgs: 97 active+clean; 99 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.2 MiB/s wr, 728 op/s 2024-09-19T06:11:41.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:41 smithi103 ceph-mon[30925]: pgmap v133: 97 pgs: 97 active+clean; 99 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.2 MiB/s wr, 728 op/s 2024-09-19T06:11:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:43 smithi169 ceph-mon[34350]: pgmap v134: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 7.6 MiB/s wr, 1.08k op/s 2024-09-19T06:11:43.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:43 smithi174 ceph-mon[34488]: pgmap v134: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 7.6 MiB/s wr, 1.08k op/s 2024-09-19T06:11:43.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:43 smithi103 ceph-mon[30925]: pgmap v134: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 7.6 MiB/s wr, 1.08k op/s 2024-09-19T06:11:45.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:45 smithi169 ceph-mon[34350]: pgmap v135: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.1 MiB/s wr, 709 op/s 2024-09-19T06:11:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:45 smithi174 ceph-mon[34488]: pgmap v135: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.1 MiB/s wr, 709 op/s 2024-09-19T06:11:45.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:45 smithi103 ceph-mon[30925]: pgmap v135: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.1 MiB/s wr, 709 op/s 2024-09-19T06:11:47.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:47 smithi169 ceph-mon[34350]: pgmap v136: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 7.5 MiB/s wr, 1.05k op/s 2024-09-19T06:11:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:47 smithi174 ceph-mon[34488]: pgmap v136: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 7.5 MiB/s wr, 1.05k op/s 2024-09-19T06:11:47.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:47 smithi103 ceph-mon[30925]: pgmap v136: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 7.5 MiB/s wr, 1.05k op/s 2024-09-19T06:11:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:49 smithi174 ceph-mon[34488]: pgmap v137: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 687 op/s 2024-09-19T06:11:49.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:49 smithi103 ceph-mon[30925]: pgmap v137: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 687 op/s 2024-09-19T06:11:50.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:49 smithi169 ceph-mon[34350]: pgmap v137: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 687 op/s 2024-09-19T06:11:51.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:51 smithi174 ceph-mon[34488]: pgmap v138: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 687 op/s 2024-09-19T06:11:51.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:51 smithi103 ceph-mon[30925]: pgmap v138: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 687 op/s 2024-09-19T06:11:52.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:51 smithi169 ceph-mon[34350]: pgmap v138: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 687 op/s 2024-09-19T06:11:52.952 INFO:tasks.workunit.client.0.smithi103.stdout:All 50000 operations completed A-OK! 2024-09-19T06:11:52.952 INFO:tasks.workunit.client.0.smithi103.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2024-09-19T06:11:52.953 INFO:tasks.workunit.client.0.smithi103.stdout:Seed set to 1 2024-09-19T06:11:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:52 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:11:52.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:52 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:11:53.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:52 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:11:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.290+0000 7feae4ea5640 1 -- 172.21.15.103:0/1611018953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae01069c0 msgr2=0x7feae0106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.290+0000 7feae4ea5640 1 --2- 172.21.15.103:0/1611018953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae01069c0 0x7feae0106da0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fead0009930 tx=0x7fead002a420 comp rx=0 tx=0).stop 2024-09-19T06:11:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.291+0000 7feae4ea5640 1 -- 172.21.15.103:0/1611018953 shutdown_connections 2024-09-19T06:11:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.291+0000 7feae4ea5640 1 --2- 172.21.15.103:0/1611018953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae0101350 0x7feae010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.291+0000 7feae4ea5640 1 --2- 172.21.15.103:0/1611018953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feae01009b0 0x7feae0100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.291+0000 7feae4ea5640 1 --2- 172.21.15.103:0/1611018953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae01069c0 0x7feae0106da0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.291+0000 7feae4ea5640 1 -- 172.21.15.103:0/1611018953 >> 172.21.15.103:0/1611018953 conn(0x7feae0077990 msgr2=0x7feae00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.291+0000 7feae4ea5640 1 -- 172.21.15.103:0/1611018953 shutdown_connections 2024-09-19T06:11:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.291+0000 7feae4ea5640 1 -- 172.21.15.103:0/1611018953 wait complete. 2024-09-19T06:11:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.291+0000 7feae4ea5640 1 Processor -- start 2024-09-19T06:11:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.291+0000 7feae4ea5640 1 -- start start 2024-09-19T06:11:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feae4ea5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae01009b0 0x7feae00fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feae4ea5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feae0101350 0x7feae00fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feae4ea5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae01069c0 0x7feae00fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feae4ea5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feae0110c70 con 0x7feae01069c0 2024-09-19T06:11:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feae4ea5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feae0110af0 con 0x7feae01009b0 2024-09-19T06:11:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feae4ea5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feae0110df0 con 0x7feae0101350 2024-09-19T06:11:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feaded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae01069c0 0x7feae00fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feaded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae01069c0 0x7feae00fd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60316/0 (socket says 172.21.15.103:60316) 2024-09-19T06:11:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feaded9d640 1 -- 172.21.15.103:0/1572412329 learned_addr learned my addr 172.21.15.103:0/1572412329 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feade59c640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae01009b0 0x7feae00fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feaddd9b640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feae0101350 0x7feae00fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feaded9d640 1 -- 172.21.15.103:0/1572412329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feae0101350 msgr2=0x7feae00fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feaded9d640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feae0101350 0x7feae00fd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feaded9d640 1 -- 172.21.15.103:0/1572412329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae01009b0 msgr2=0x7feae00fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feaded9d640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae01009b0 0x7feae00fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feaded9d640 1 -- 172.21.15.103:0/1572412329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae01a6770 con 0x7feae01069c0 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feaded9d640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae01069c0 0x7feae00fd860 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fead8009fd0 tx=0x7fead800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7fead77fe640 1 -- 172.21.15.103:0/1572412329 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8017070 con 0x7feae01069c0 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7fead77fe640 1 -- 172.21.15.103:0/1572412329 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fead8003e20 con 0x7feae01069c0 2024-09-19T06:11:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7feae4ea5640 1 -- 172.21.15.103:0/1572412329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae01a6a60 con 0x7feae01069c0 2024-09-19T06:11:53.299 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.292+0000 7fead77fe640 1 -- 172.21.15.103:0/1572412329 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8010460 con 0x7feae01069c0 2024-09-19T06:11:53.299 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.293+0000 7feae4ea5640 1 -- 172.21.15.103:0/1572412329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae01a6f60 con 0x7feae01069c0 2024-09-19T06:11:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.295+0000 7fead77fe640 1 -- 172.21.15.103:0/1572412329 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7fead8003970 con 0x7feae01069c0 2024-09-19T06:11:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.295+0000 7fead77fe640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7feacc0a3460 0x7feacc0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feade59c640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7feacc0a3460 0x7feacc0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7fead77fe640 1 -- 172.21.15.103:0/1572412329 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fead80cfb80 con 0x7feae01069c0 2024-09-19T06:11:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feae7c46740 1 Processor -- start 2024-09-19T06:11:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feae7c46740 1 -- start start 2024-09-19T06:11:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feade59c640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7feacc0a3460 0x7feacc0a5920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fead0000c00 tx=0x7fead0032c80 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feae7c46740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f13af0 0x558a20f13ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feae7c46740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f14410 0x558a20f1e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feae7c46740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f1ecb0 0x558a20f210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feae7c46740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558a20e782f0 con 0x558a20f14410 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feae7c46740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558a20e20270 con 0x558a20f13af0 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feae7c46740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558a20e742b0 con 0x558a20f1ecb0 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feaddd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f14410 0x558a20f1e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feaddd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f14410 0x558a20f1e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60324/0 (socket says 172.21.15.103:60324) 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feaddd9b640 1 -- 172.21.15.103:0/3708096263 learned_addr learned my addr 172.21.15.103:0/3708096263 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.296+0000 7feade59c640 1 --2- 172.21.15.103:0/3708096263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f13af0 0x558a20f13ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.297+0000 7feaded9d640 1 --2- 172.21.15.103:0/3708096263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f1ecb0 0x558a20f210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.297+0000 7feaddd9b640 1 -- 172.21.15.103:0/3708096263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f1ecb0 msgr2=0x558a20f210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.297+0000 7feaddd9b640 1 --2- 172.21.15.103:0/3708096263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f1ecb0 0x558a20f210a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.297+0000 7feaddd9b640 1 -- 172.21.15.103:0/3708096263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f13af0 msgr2=0x558a20f13ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.297+0000 7feaddd9b640 1 --2- 172.21.15.103:0/3708096263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f13af0 0x558a20f13ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.297+0000 7feaddd9b640 1 -- 172.21.15.103:0/3708096263 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a20e1f340 con 0x558a20f14410 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.297+0000 7feaddd9b640 1 --2- 172.21.15.103:0/3708096263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f14410 0x558a20f1e770 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7feac800ba70 tx=0x7feac800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667a24559fe7f293 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.297+0000 7fead4ff9640 1 -- 172.21.15.103:0/3708096263 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8017420 con 0x558a20f14410 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.297+0000 7fead4ff9640 1 -- 172.21.15.103:0/3708096263 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feac8017a70 con 0x558a20f14410 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.297+0000 7fead4ff9640 1 -- 172.21.15.103:0/3708096263 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac800fa80 con 0x558a20f14410 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 -- 172.21.15.103:0/3708096263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f14410 msgr2=0x558a20f1e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 --2- 172.21.15.103:0/3708096263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f14410 0x558a20f1e770 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7feac800ba70 tx=0x7feac800bf30 comp rx=0 tx=0).stop 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 -- 172.21.15.103:0/3708096263 shutdown_connections 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 --2- 172.21.15.103:0/3708096263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f1ecb0 0x558a20f210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 --2- 172.21.15.103:0/3708096263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f14410 0x558a20f1e770 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 --2- 172.21.15.103:0/3708096263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f13af0 0x558a20f13ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 -- 172.21.15.103:0/3708096263 >> 172.21.15.103:0/3708096263 conn(0x558a20f10060 msgr2=0x558a20f10440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 -- 172.21.15.103:0/3708096263 shutdown_connections 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 -- 172.21.15.103:0/3708096263 wait complete. 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 -- start start 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 Processor -- start 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f1bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f1c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f1c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558a20f21880 con 0x558a20f1ecb0 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558a20e01290 con 0x558a20f14410 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.298+0000 7feae7c46740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558a20f21a00 con 0x558a20f13af0 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feae7c46740 10 client.0 _ll_register_callbacks cb 0x558a20e32140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feaded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f1c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feaded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f1c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60338/0 (socket says 172.21.15.103:60338) 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feaded9d640 1 -- 172.21.15.103:0/2100798323 learned_addr learned my addr 172.21.15.103:0/2100798323 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feade59c640 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f1bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feaddd9b640 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f1c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feaded9d640 1 -- 172.21.15.103:0/2100798323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 msgr2=0x558a20f1bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feaded9d640 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f1bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feaded9d640 1 -- 172.21.15.103:0/2100798323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 msgr2=0x558a20f1c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feaded9d640 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f1c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feaded9d640 1 -- 172.21.15.103:0/2100798323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a20b8b210 con 0x558a20f1ecb0 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feaded9d640 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f1c5b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fead800b760 tx=0x7fead8003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f053e11b6473ed1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feac5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:11:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feac5ffb640 1 -- 172.21.15.103:0/2100798323 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8020070 con 0x558a20f1ecb0 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feac5ffb640 1 -- 172.21.15.103:0/2100798323 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fead8098520 con 0x558a20f1ecb0 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feae7c46740 1 -- 172.21.15.103:0/2100798323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feac8017a70 con 0x558a20f1ecb0 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feac5ffb640 1 -- 172.21.15.103:0/2100798323 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fead80a0260 con 0x558a20f1ecb0 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feae7c46740 10 client.16032 fetch_fsmap learned FSMap version 31 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feae7c46740 1 -- 172.21.15.103:0/2100798323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558a20c57620 con 0x558a20f1ecb0 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.299+0000 7feac5ffb640 1 -- 172.21.15.103:0/2100798323 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feac8017a70 con 0x558a20f1ecb0 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.300+0000 7feac5ffb640 1 -- 172.21.15.103:0/2100798323 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fead8097c00 con 0x558a20f1ecb0 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.300+0000 7feae7c46740 10 client.16032 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.300+0000 7feae7c46740 10 client.16032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.300+0000 7feae7c46740 20 client.16032 populate_metadata read hostname 'smithi103' 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.300+0000 7feae7c46740 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558a20f2ebe0 0x558a20f30ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.300+0000 7feae7c46740 4 client.16032 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.300+0000 7feae7c46740 1 -- 172.21.15.103:0/2100798323 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a20e85a20 con 0x558a20f2ebe0 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.300+0000 7feade59c640 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558a20f2ebe0 0x558a20f30ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.300+0000 7feade59c640 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558a20f2ebe0 0x558a20f30ff0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c36942c7d99cbd19 server_cookie=deb672d53d83e727 in_seq=0 out_seq=0 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.300+0000 7feac5ffb640 10 client.16032 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feac5ffb640 1 -- 172.21.15.103:0/2100798323 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a20e85a20 con 0x558a20f2ebe0 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feac5ffb640 10 client.16032 handle_command_reply: tid=0 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 client.16032 shutdown 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 -- 172.21.15.103:0/2100798323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 msgr2=0x558a20f1c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f1c5b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fead800b760 tx=0x7fead8003da0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 -- 172.21.15.103:0/2100798323 shutdown_connections 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558a20f2ebe0 0x558a20f30ff0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f1c5b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feac5ffb640 0 client.16032 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f1c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 --2- 172.21.15.103:0/2100798323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f1bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 -- 172.21.15.103:0/2100798323 >> 172.21.15.103:0/2100798323 conn(0x558a20f10060 msgr2=0x558a20f15dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 -- 172.21.15.103:0/2100798323 shutdown_connections 2024-09-19T06:11:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 1 -- 172.21.15.103:0/2100798323 wait complete. 2024-09-19T06:11:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.301+0000 7feae7c46740 20 client.16032 trim_cache size 0 max 16384 2024-09-19T06:11:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.315+0000 7feae7c46740 1 Processor -- start 2024-09-19T06:11:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.315+0000 7feae7c46740 1 -- start start 2024-09-19T06:11:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feae7c46740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f16560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feae7c46740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f1c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feae7c46740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f36950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feae7c46740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feae01b2070 con 0x558a20f1ecb0 2024-09-19T06:11:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feae7c46740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feae01af940 con 0x558a20f14410 2024-09-19T06:11:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feae7c46740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feae01ad790 con 0x558a20f13af0 2024-09-19T06:11:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feaded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f36950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feaded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f36950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60340/0 (socket says 172.21.15.103:60340) 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feaded9d640 1 -- 172.21.15.103:0/822745344 learned_addr learned my addr 172.21.15.103:0/822745344 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feaddd9b640 1 --2- 172.21.15.103:0/822745344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f1c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feade59c640 1 --2- 172.21.15.103:0/822745344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f16560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feaded9d640 1 -- 172.21.15.103:0/822745344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 msgr2=0x558a20f16560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feaded9d640 1 --2- 172.21.15.103:0/822745344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f16560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feaded9d640 1 -- 172.21.15.103:0/822745344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 msgr2=0x558a20f1c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feaded9d640 1 --2- 172.21.15.103:0/822745344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f1c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feaded9d640 1 -- 172.21.15.103:0/822745344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a20f213e0 con 0x558a20f1ecb0 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feade59c640 1 --2- 172.21.15.103:0/822745344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f16560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feaded9d640 1 --2- 172.21.15.103:0/822745344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f36950 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fead8005c40 tx=0x7fead8005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a333b7eea670d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feac7fff640 1 -- 172.21.15.103:0/822745344 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8020030 con 0x558a20f1ecb0 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feac7fff640 1 -- 172.21.15.103:0/822745344 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fead80a4b20 con 0x558a20f1ecb0 2024-09-19T06:11:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.316+0000 7feac7fff640 1 -- 172.21.15.103:0/822745344 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8062070 con 0x558a20f1ecb0 2024-09-19T06:11:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.317+0000 7feae7c46740 1 -- 172.21.15.103:0/822745344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 msgr2=0x558a20f36950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.317+0000 7feae7c46740 1 --2- 172.21.15.103:0/822745344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f36950 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fead8005c40 tx=0x7fead8005e30 comp rx=0 tx=0).stop 2024-09-19T06:11:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.317+0000 7feae7c46740 1 -- 172.21.15.103:0/822745344 shutdown_connections 2024-09-19T06:11:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.317+0000 7feae7c46740 1 --2- 172.21.15.103:0/822745344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f36950 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.317+0000 7feae7c46740 1 --2- 172.21.15.103:0/822745344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f1c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.317+0000 7feae7c46740 1 --2- 172.21.15.103:0/822745344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f16560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.317+0000 7feae7c46740 1 -- 172.21.15.103:0/822745344 >> 172.21.15.103:0/822745344 conn(0x558a20f10060 msgr2=0x558a20f1dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.317+0000 7feae7c46740 1 -- 172.21.15.103:0/822745344 shutdown_connections 2024-09-19T06:11:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.317+0000 7feae7c46740 1 -- 172.21.15.103:0/822745344 wait complete. 2024-09-19T06:11:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.317+0000 7feae7c46740 1 -- start start 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feae7c46740 1 Processor -- start 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feae7c46740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f273d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feae7c46740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f226f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feae7c46740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f22c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feae7c46740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feae01ade00 con 0x558a20f1ecb0 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feae7c46740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feae01af270 con 0x558a20f14410 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feae7c46740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feae01ae4d0 con 0x558a20f13af0 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feae7c46740 10 client.0 _ll_register_callbacks cb 0x7fead8009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feaded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f22c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feaded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f22c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60350/0 (socket says 172.21.15.103:60350) 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feaded9d640 1 -- 172.21.15.103:0/341683841 learned_addr learned my addr 172.21.15.103:0/341683841 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feaddd9b640 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.324 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feade59c640 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f273d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feaded9d640 1 -- 172.21.15.103:0/341683841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 msgr2=0x558a20f273d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feaded9d640 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f273d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feaded9d640 1 -- 172.21.15.103:0/341683841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 msgr2=0x558a20f226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feaded9d640 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f226f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feaded9d640 1 -- 172.21.15.103:0/341683841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a20f23460 con 0x558a20f1ecb0 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feaded9d640 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f22c30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fead80cfea0 tx=0x7fead80097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6dfe921f115236 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.318+0000 7feac5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feac5ffb640 1 -- 172.21.15.103:0/341683841 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead807f030 con 0x558a20f1ecb0 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feac5ffb640 1 -- 172.21.15.103:0/341683841 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fead8097c00 con 0x558a20f1ecb0 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feae7c46740 1 -- 172.21.15.103:0/341683841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fead80a4b20 con 0x558a20f1ecb0 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feac5ffb640 1 -- 172.21.15.103:0/341683841 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fead80a8020 con 0x558a20f1ecb0 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feae7c46740 10 client.16038 fetch_fsmap learned FSMap version 31 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feae7c46740 1 -- 172.21.15.103:0/341683841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558a20f99890 con 0x558a20f1ecb0 2024-09-19T06:11:53.325 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feac5ffb640 1 -- 172.21.15.103:0/341683841 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fead80a4b20 con 0x558a20f1ecb0 2024-09-19T06:11:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feac5ffb640 1 -- 172.21.15.103:0/341683841 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fead807aa90 con 0x558a20f1ecb0 2024-09-19T06:11:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feae7c46740 10 client.16038 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:11:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feae7c46740 10 client.16038 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:11:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feae7c46740 20 client.16038 populate_metadata read hostname 'smithi103' 2024-09-19T06:11:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feae7c46740 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558a20f99d60 0x558a20f9c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feae7c46740 4 client.16038 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:11:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feae7c46740 1 -- 172.21.15.103:0/341683841 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558a20e7fd70 con 0x558a20f99d60 2024-09-19T06:11:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.319+0000 7feade59c640 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558a20f99d60 0x558a20f9c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.320+0000 7feac5ffb640 10 client.16038 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.320+0000 7feade59c640 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558a20f99d60 0x558a20f9c150 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e6059d775d59c61 server_cookie=104c14f224b63652 in_seq=0 out_seq=0 2024-09-19T06:11:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.332+0000 7feac5ffb640 1 -- 172.21.15.103:0/341683841 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558a20e7fd70 con 0x558a20f99d60 2024-09-19T06:11:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.332+0000 7feac5ffb640 10 client.16038 handle_command_reply: tid=0 2024-09-19T06:11:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.332+0000 7feae7c46740 1 client.16038 shutdown 2024-09-19T06:11:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 1 -- 172.21.15.103:0/341683841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 msgr2=0x558a20f22c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f22c30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fead80cfea0 tx=0x7fead80097f0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 1 -- 172.21.15.103:0/341683841 shutdown_connections 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x558a20f99d60 0x558a20f9c150 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558a20f1ecb0 0x558a20f22c30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a20f14410 0x558a20f226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 1 --2- 172.21.15.103:0/341683841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a20f13af0 0x558a20f273d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feac5ffb640 0 client.16038 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 1 -- 172.21.15.103:0/341683841 >> 172.21.15.103:0/341683841 conn(0x558a20f10060 msgr2=0x558a20f0e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 1 -- 172.21.15.103:0/341683841 shutdown_connections 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 1 -- 172.21.15.103:0/341683841 wait complete. 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae7c46740 20 client.16038 trim_cache size 0 max 16384 2024-09-19T06:11:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:11:53.336 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:11:53.336 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:11:53.336 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:11:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae4ea5640 1 -- 172.21.15.103:0/1572412329 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7feacc0a3460 msgr2=0x7feacc0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae4ea5640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7feacc0a3460 0x7feacc0a5920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fead0000c00 tx=0x7fead0032c80 comp rx=0 tx=0).stop 2024-09-19T06:11:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae4ea5640 1 -- 172.21.15.103:0/1572412329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae01069c0 msgr2=0x7feae00fd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae4ea5640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae01069c0 0x7feae00fd860 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fead8009fd0 tx=0x7fead800b260 comp rx=0 tx=0).stop 2024-09-19T06:11:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae4ea5640 1 -- 172.21.15.103:0/1572412329 shutdown_connections 2024-09-19T06:11:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae4ea5640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7feacc0a3460 0x7feacc0a5920 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae4ea5640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae01069c0 0x7feae00fd860 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae4ea5640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feae0101350 0x7feae00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae4ea5640 1 --2- 172.21.15.103:0/1572412329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae01009b0 0x7feae00fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.333+0000 7feae4ea5640 1 -- 172.21.15.103:0/1572412329 >> 172.21.15.103:0/1572412329 conn(0x7feae0077990 msgr2=0x7feae00699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.334+0000 7feae4ea5640 1 -- 172.21.15.103:0/1572412329 shutdown_connections 2024-09-19T06:11:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:11:53.334+0000 7feae4ea5640 1 -- 172.21.15.103:0/1572412329 wait complete. 2024-09-19T06:11:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:53 smithi174 ceph-mon[34488]: pgmap v139: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 7.3 MiB/s wr, 1.00k op/s 2024-09-19T06:11:53.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:53 smithi103 ceph-mon[30925]: pgmap v139: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 7.3 MiB/s wr, 1.00k op/s 2024-09-19T06:11:54.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:53 smithi169 ceph-mon[34350]: pgmap v139: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 7.3 MiB/s wr, 1.00k op/s 2024-09-19T06:11:54.068 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T06:11:54.068 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T06:11:54.068 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T06:11:54.068 INFO:tasks.workunit.client.0.smithi103.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T06:11:54.070 INFO:tasks.workunit.client.0.smithi103.stdout:skipping zero size read 2024-09-19T06:11:54.082 INFO:tasks.workunit.client.0.smithi103.stdout:truncating to largest ever: 0x1c37b90 2024-09-19T06:11:54.090 INFO:tasks.workunit.client.0.smithi103.stdout:truncating to largest ever: 0x5bd330d 2024-09-19T06:11:54.099 INFO:tasks.workunit.client.0.smithi103.stdout:copying to largest ever: 0x637bf99 2024-09-19T06:11:54.263 INFO:tasks.workunit.client.0.smithi103.stdout:copying to largest ever: 0x63d9b9c 2024-09-19T06:11:55.829 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:55 smithi169 ceph-mon[34350]: pgmap v140: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 653 op/s 2024-09-19T06:11:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:55 smithi174 ceph-mon[34488]: pgmap v140: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 653 op/s 2024-09-19T06:11:55.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:55 smithi103 ceph-mon[30925]: pgmap v140: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 653 op/s 2024-09-19T06:11:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:57 smithi174 ceph-mon[34488]: pgmap v141: 97 pgs: 97 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.6 MiB/s wr, 967 op/s 2024-09-19T06:11:57.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:57 smithi103 ceph-mon[30925]: pgmap v141: 97 pgs: 97 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.6 MiB/s wr, 967 op/s 2024-09-19T06:11:58.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:57 smithi169 ceph-mon[34350]: pgmap v141: 97 pgs: 97 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.6 MiB/s wr, 967 op/s 2024-09-19T06:11:58.064 INFO:tasks.workunit.client.0.smithi103.stdout:copying to largest ever: 0x63ee1da 2024-09-19T06:11:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:11:59 smithi174 ceph-mon[34488]: pgmap v142: 97 pgs: 97 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 4.2 MiB/s wr, 631 op/s 2024-09-19T06:11:59.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:11:59 smithi103 ceph-mon[30925]: pgmap v142: 97 pgs: 97 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 4.2 MiB/s wr, 631 op/s 2024-09-19T06:12:00.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:11:59 smithi169 ceph-mon[34350]: pgmap v142: 97 pgs: 97 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 4.2 MiB/s wr, 631 op/s 2024-09-19T06:12:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:01 smithi174 ceph-mon[34488]: pgmap v143: 97 pgs: 97 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 4.2 MiB/s wr, 631 op/s 2024-09-19T06:12:01.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:01 smithi103 ceph-mon[30925]: pgmap v143: 97 pgs: 97 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 4.2 MiB/s wr, 631 op/s 2024-09-19T06:12:02.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:01 smithi169 ceph-mon[34350]: pgmap v143: 97 pgs: 97 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 4.2 MiB/s wr, 631 op/s 2024-09-19T06:12:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:03 smithi174 ceph-mon[34488]: pgmap v144: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 6.6 MiB/s wr, 1.17k op/s 2024-09-19T06:12:03.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:03 smithi103 ceph-mon[30925]: pgmap v144: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 6.6 MiB/s wr, 1.17k op/s 2024-09-19T06:12:04.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:03 smithi169 ceph-mon[34350]: pgmap v144: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 6.6 MiB/s wr, 1.17k op/s 2024-09-19T06:12:04.879 INFO:tasks.workunit.client.0.smithi103.stdout:10000 write 0x4c35901 thru 0x4c3d40f (0x7b0f bytes) 2024-09-19T06:12:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:05 smithi174 ceph-mon[34488]: pgmap v145: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 4.2 MiB/s wr, 849 op/s 2024-09-19T06:12:05.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:05 smithi103 ceph-mon[30925]: pgmap v145: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 4.2 MiB/s wr, 849 op/s 2024-09-19T06:12:06.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:05 smithi169 ceph-mon[34350]: pgmap v145: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 4.2 MiB/s wr, 849 op/s 2024-09-19T06:12:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.437+0000 7f827f62e640 1 -- 172.21.15.103:0/2716072292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e410 msgr2=0x7f8278110800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.437+0000 7f827f62e640 1 --2- 172.21.15.103:0/2716072292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e410 0x7f8278110800 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8270009ca0 tx=0x7f827002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.437+0000 7f827f62e640 1 -- 172.21.15.103:0/2716072292 shutdown_connections 2024-09-19T06:12:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.437+0000 7f827f62e640 1 --2- 172.21.15.103:0/2716072292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e410 0x7f8278110800 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.437+0000 7f827f62e640 1 --2- 172.21.15.103:0/2716072292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278101210 0x7f827810ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.437+0000 7f827f62e640 1 --2- 172.21.15.103:0/2716072292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8278100860 0x7f8278100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.437+0000 7f827f62e640 1 -- 172.21.15.103:0/2716072292 >> 172.21.15.103:0/2716072292 conn(0x7f8278077990 msgr2=0x7f82780fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.439+0000 7f827f62e640 1 -- 172.21.15.103:0/2716072292 shutdown_connections 2024-09-19T06:12:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.440+0000 7f827f62e640 1 -- 172.21.15.103:0/2716072292 wait complete. 2024-09-19T06:12:06.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.441+0000 7f827f62e640 1 Processor -- start 2024-09-19T06:12:06.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.441+0000 7f827f62e640 1 -- start start 2024-09-19T06:12:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827f62e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278100860 0x7f827819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827f62e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8278101210 0x7f827819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827f62e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e410 0x7f827819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827f62e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8278113f30 con 0x7f827810e410 2024-09-19T06:12:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827f62e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8278113db0 con 0x7f8278100860 2024-09-19T06:12:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827f62e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f82781140b0 con 0x7f8278101210 2024-09-19T06:12:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827d3ca640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278100860 0x7f827819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827d3ca640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278100860 0x7f827819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:33176/0 (socket says 172.21.15.103:33176) 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827d3ca640 1 -- 172.21.15.103:0/2077867686 learned_addr learned my addr 172.21.15.103:0/2077867686 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827cbc9640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8278101210 0x7f827819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827dbcb640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e410 0x7f827819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827d3ca640 1 -- 172.21.15.103:0/2077867686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8278101210 msgr2=0x7f827819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827d3ca640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8278101210 0x7f827819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827d3ca640 1 -- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e410 msgr2=0x7f827819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827d3ca640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e410 0x7f827819ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827d3ca640 1 -- 172.21.15.103:0/2077867686 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827819f430 con 0x7f8278100860 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827dbcb640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e410 0x7f827819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.442+0000 7f827cbc9640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8278101210 0x7f827819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.443+0000 7f827d3ca640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278100860 0x7f827819a440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f827400d770 tx=0x7f827400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.443+0000 7f826e7fc640 1 -- 172.21.15.103:0/2077867686 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274017070 con 0x7f8278100860 2024-09-19T06:12:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.443+0000 7f826e7fc640 1 -- 172.21.15.103:0/2077867686 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82740054d0 con 0x7f8278100860 2024-09-19T06:12:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.443+0000 7f827f62e640 1 -- 172.21.15.103:0/2077867686 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827819f720 con 0x7f8278100860 2024-09-19T06:12:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.443+0000 7f827f62e640 1 -- 172.21.15.103:0/2077867686 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82781a6fb0 con 0x7f8278100860 2024-09-19T06:12:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.443+0000 7f826e7fc640 1 -- 172.21.15.103:0/2077867686 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274004cf0 con 0x7f8278100860 2024-09-19T06:12:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.446+0000 7f826e7fc640 1 -- 172.21.15.103:0/2077867686 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f8274004e90 con 0x7f8278100860 2024-09-19T06:12:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f82823cc740 1 Processor -- start 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f82823cc740 1 -- start start 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f82823cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b2af0 0x55ab349b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f82823cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b3410 0x55ab349bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f82823cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f82823cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ab349172f0 con 0x55ab349b2af0 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f82823cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ab348bf270 con 0x55ab349bdcb0 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f82823cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ab349132b0 con 0x55ab349b3410 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f827dbcb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b2af0 0x55ab349b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f827dbcb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b2af0 0x55ab349b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39454/0 (socket says 172.21.15.103:39454) 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f827dbcb640 1 -- 172.21.15.103:0/389652058 learned_addr learned my addr 172.21.15.103:0/389652058 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f827d3ca640 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b3410 0x55ab349bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f827cbc9640 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.447+0000 7f826e7fc640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f82640a3460 0x7f82640a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f827dbcb640 1 -- 172.21.15.103:0/389652058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b3410 msgr2=0x55ab349bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f827dbcb640 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b3410 0x55ab349bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f827dbcb640 1 -- 172.21.15.103:0/389652058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 msgr2=0x55ab349c00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f827dbcb640 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349c00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f827dbcb640 1 -- 172.21.15.103:0/389652058 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab348be340 con 0x55ab349b2af0 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f827cbc9640 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f827d3ca640 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b3410 0x55ab349bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f826e7fc640 1 -- 172.21.15.103:0/2077867686 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f82740cf790 con 0x7f8278100860 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f827dbcb640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f82640a3460 0x7f82640a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f827dbcb640 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b2af0 0x55ab349b2ed0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8270005ef0 tx=0x7f8270005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a186f5f3c0e165c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f82637fe640 1 -- 172.21.15.103:0/389652058 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827004d070 con 0x55ab349b2af0 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f82637fe640 1 -- 172.21.15.103:0/389652058 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8270040070 con 0x55ab349b2af0 2024-09-19T06:12:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.448+0000 7f82637fe640 1 -- 172.21.15.103:0/389652058 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8270004600 con 0x55ab349b2af0 2024-09-19T06:12:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.449+0000 7f827dbcb640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f82640a3460 0x7f82640a5920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f827004a000 tx=0x7f827004b000 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.449+0000 7f82823cc740 1 -- 172.21.15.103:0/389652058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b2af0 msgr2=0x55ab349b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.449+0000 7f82823cc740 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b2af0 0x55ab349b2ed0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8270005ef0 tx=0x7f8270005f20 comp rx=0 tx=0).stop 2024-09-19T06:12:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.449+0000 7f82823cc740 1 -- 172.21.15.103:0/389652058 shutdown_connections 2024-09-19T06:12:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.449+0000 7f82823cc740 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.449+0000 7f82823cc740 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b3410 0x55ab349bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.449+0000 7f82823cc740 1 --2- 172.21.15.103:0/389652058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b2af0 0x55ab349b2ed0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.449+0000 7f82823cc740 1 -- 172.21.15.103:0/389652058 >> 172.21.15.103:0/389652058 conn(0x55ab349af060 msgr2=0x55ab349af440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.449+0000 7f82823cc740 1 -- 172.21.15.103:0/389652058 shutdown_connections 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.449+0000 7f82823cc740 1 -- 172.21.15.103:0/389652058 wait complete. 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f82823cc740 1 -- start start 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f82823cc740 1 Processor -- start 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f82823cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 0x55ab349bac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f82823cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b3410 0x55ab349bb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f82823cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349bb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f82823cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ab349c0880 con 0x55ab349b3410 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f82823cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ab348a0290 con 0x55ab349bdcb0 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f82823cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ab349c0a00 con 0x55ab349b2af0 2024-09-19T06:12:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f82823cc740 10 client.0 _ll_register_callbacks cb 0x55ab348d1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f827cbc9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b3410 0x55ab349bb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f827cbc9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b3410 0x55ab349bb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39458/0 (socket says 172.21.15.103:39458) 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f827cbc9640 1 -- 172.21.15.103:0/4009717184 learned_addr learned my addr 172.21.15.103:0/4009717184 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f827d3ca640 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 0x55ab349bac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.450+0000 7f827dbcb640 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349bb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f827cbc9640 1 -- 172.21.15.103:0/4009717184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 msgr2=0x55ab349bac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f827cbc9640 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 0x55ab349bac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f827cbc9640 1 -- 172.21.15.103:0/4009717184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 msgr2=0x55ab349bb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f827cbc9640 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349bb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f827cbc9640 1 -- 172.21.15.103:0/4009717184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab3462a210 con 0x55ab349b3410 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f827d3ca640 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 0x55ab349bac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f827dbcb640 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349bb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f827cbc9640 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b3410 0x55ab349bb170 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8268012d20 tx=0x7f826800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e52d255a5953cce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f8260ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f8260ff9640 1 -- 172.21.15.103:0/4009717184 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82680120d0 con 0x55ab349b3410 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f8260ff9640 1 -- 172.21.15.103:0/4009717184 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f8268004030 con 0x55ab349b3410 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f82823cc740 1 -- 172.21.15.103:0/4009717184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8270040070 con 0x55ab349b3410 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f8260ff9640 1 -- 172.21.15.103:0/4009717184 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8268012270 con 0x55ab349b3410 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f82823cc740 10 client.16050 fetch_fsmap learned FSMap version 31 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f82823cc740 1 -- 172.21.15.103:0/4009717184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ab346f6620 con 0x55ab349b3410 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.451+0000 7f8260ff9640 1 -- 172.21.15.103:0/4009717184 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8270040070 con 0x55ab349b3410 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.452+0000 7f8260ff9640 1 -- 172.21.15.103:0/4009717184 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8268026480 con 0x55ab349b3410 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.452+0000 7f82823cc740 10 client.16050 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.452+0000 7f82823cc740 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.452+0000 7f82823cc740 20 client.16050 populate_metadata read hostname 'smithi103' 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.452+0000 7f82823cc740 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ab349ce170 0x55ab349d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.452+0000 7f82823cc740 4 client.16050 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.452+0000 7f82823cc740 1 -- 172.21.15.103:0/4009717184 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab34924a20 con 0x55ab349ce170 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.452+0000 7f827d3ca640 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ab349ce170 0x55ab349d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.452+0000 7f827d3ca640 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ab349ce170 0x55ab349d05b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3afcc524662c163 server_cookie=243aa20af9df20a4 in_seq=0 out_seq=0 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.452+0000 7f8260ff9640 10 client.16050 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f8260ff9640 1 -- 172.21.15.103:0/4009717184 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab34924a20 con 0x55ab349ce170 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f8260ff9640 10 client.16050 handle_command_reply: tid=0 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f82823cc740 1 client.16050 shutdown 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f82823cc740 1 -- 172.21.15.103:0/4009717184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b3410 msgr2=0x55ab349bb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f82823cc740 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b3410 0x55ab349bb170 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8268012d20 tx=0x7f826800f790 comp rx=0 tx=0).stop 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f82823cc740 1 -- 172.21.15.103:0/4009717184 shutdown_connections 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f82823cc740 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ab349ce170 0x55ab349d05b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f82823cc740 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349bb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f82823cc740 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349b3410 0x55ab349bb170 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f82823cc740 1 --2- 172.21.15.103:0/4009717184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 0x55ab349bac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f82823cc740 1 -- 172.21.15.103:0/4009717184 >> 172.21.15.103:0/4009717184 conn(0x55ab349af060 msgr2=0x55ab349b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f8260ff9640 0 client.16050 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.453+0000 7f82823cc740 1 -- 172.21.15.103:0/4009717184 shutdown_connections 2024-09-19T06:12:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.454+0000 7f82823cc740 1 -- 172.21.15.103:0/4009717184 wait complete. 2024-09-19T06:12:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.454+0000 7f82823cc740 20 client.16050 trim_cache size 0 max 16384 2024-09-19T06:12:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f82823cc740 1 Processor -- start 2024-09-19T06:12:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f82823cc740 1 -- start start 2024-09-19T06:12:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f82823cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349af060 0x55ab349bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f82823cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349b2af0 0x55ab349bcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f82823cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349bdcb0 0x55ab349d5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f82823cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f82781b2160 con 0x55ab349bdcb0 2024-09-19T06:12:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f82823cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f82781afa30 con 0x55ab349b2af0 2024-09-19T06:12:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f82823cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f82781ad880 con 0x55ab349af060 2024-09-19T06:12:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f827dbcb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349bdcb0 0x55ab349d5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f827cbc9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349b2af0 0x55ab349bcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f827dbcb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349bdcb0 0x55ab349d5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39466/0 (socket says 172.21.15.103:39466) 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f827cbc9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349b2af0 0x55ab349bcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:33206/0 (socket says 172.21.15.103:33206) 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f827dbcb640 1 -- 172.21.15.103:0/892543138 learned_addr learned my addr 172.21.15.103:0/892543138 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.472+0000 7f827d3ca640 1 --2- 172.21.15.103:0/892543138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349af060 0x55ab349bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.473+0000 7f827cbc9640 1 -- 172.21.15.103:0/892543138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349af060 msgr2=0x55ab349bb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.473+0000 7f827cbc9640 1 --2- 172.21.15.103:0/892543138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349af060 0x55ab349bb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.473+0000 7f827cbc9640 1 -- 172.21.15.103:0/892543138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349bdcb0 msgr2=0x55ab349d5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.473+0000 7f827cbc9640 1 --2- 172.21.15.103:0/892543138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349bdcb0 0x55ab349d5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.473+0000 7f827cbc9640 1 -- 172.21.15.103:0/892543138 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab349ca660 con 0x55ab349b2af0 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.473+0000 7f827dbcb640 1 --2- 172.21.15.103:0/892543138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349bdcb0 0x55ab349d5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.473+0000 7f827cbc9640 1 --2- 172.21.15.103:0/892543138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349b2af0 0x55ab349bcba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55ab349bbd20 tx=0x7f8268009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=261c4c28ff27a93e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.473+0000 7f8262ffd640 1 -- 172.21.15.103:0/892543138 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826800fe80 con 0x55ab349b2af0 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.473+0000 7f8262ffd640 1 -- 172.21.15.103:0/892543138 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8268026480 con 0x55ab349b2af0 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.473+0000 7f8262ffd640 1 -- 172.21.15.103:0/892543138 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82680056c0 con 0x55ab349b2af0 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 -- 172.21.15.103:0/892543138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349b2af0 msgr2=0x55ab349bcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 --2- 172.21.15.103:0/892543138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349b2af0 0x55ab349bcba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55ab349bbd20 tx=0x7f8268009c00 comp rx=0 tx=0).stop 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 -- 172.21.15.103:0/892543138 shutdown_connections 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 --2- 172.21.15.103:0/892543138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349bdcb0 0x55ab349d5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 --2- 172.21.15.103:0/892543138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349b2af0 0x55ab349bcba0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 --2- 172.21.15.103:0/892543138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349af060 0x55ab349bb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 -- 172.21.15.103:0/892543138 >> 172.21.15.103:0/892543138 conn(0x55ab349af9e0 msgr2=0x55ab349bc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 -- 172.21.15.103:0/892543138 shutdown_connections 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 -- 172.21.15.103:0/892543138 wait complete. 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 -- start start 2024-09-19T06:12:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.474+0000 7f82823cc740 1 Processor -- start 2024-09-19T06:12:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f82823cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349af060 0x55ab349c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f82823cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 0x55ab349c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f82823cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349b7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f82823cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f82781adef0 con 0x55ab349af060 2024-09-19T06:12:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f82823cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f82781af360 con 0x55ab349bdcb0 2024-09-19T06:12:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f82823cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f82781ae5c0 con 0x55ab349b2af0 2024-09-19T06:12:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f82823cc740 10 client.0 _ll_register_callbacks cb 0x7f8268009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827d3ca640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349af060 0x55ab349c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827dbcb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827d3ca640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349af060 0x55ab349c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39478/0 (socket says 172.21.15.103:39478) 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827d3ca640 1 -- 172.21.15.103:0/3448538083 learned_addr learned my addr 172.21.15.103:0/3448538083 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827cbc9640 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 0x55ab349c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827dbcb640 1 -- 172.21.15.103:0/3448538083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 msgr2=0x55ab349c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827dbcb640 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 0x55ab349c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827dbcb640 1 -- 172.21.15.103:0/3448538083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349af060 msgr2=0x55ab349c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827dbcb640 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349af060 0x55ab349c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827dbcb640 1 -- 172.21.15.103:0/3448538083 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab349b7b40 con 0x55ab349bdcb0 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.475+0000 7f827d3ca640 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349af060 0x55ab349c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f827dbcb640 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349b7480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f827002a900 tx=0x7f8270050000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3e0ae23581177c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f8260ff9640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f8260ff9640 1 -- 172.21.15.103:0/3448538083 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827004d040 con 0x55ab349bdcb0 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f8260ff9640 1 -- 172.21.15.103:0/3448538083 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f82700305c0 con 0x55ab349bdcb0 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f82823cc740 1 -- 172.21.15.103:0/3448538083 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8268026480 con 0x55ab349bdcb0 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f8260ff9640 1 -- 172.21.15.103:0/3448538083 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8270068050 con 0x55ab349bdcb0 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f82823cc740 10 client.25589 fetch_fsmap learned FSMap version 31 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f82823cc740 1 -- 172.21.15.103:0/3448538083 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ab34a387c0 con 0x55ab349bdcb0 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f8260ff9640 1 -- 172.21.15.103:0/3448538083 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8268026480 con 0x55ab349bdcb0 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f8260ff9640 1 -- 172.21.15.103:0/3448538083 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8270051450 con 0x55ab349bdcb0 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f82823cc740 10 client.25589 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f82823cc740 10 client.25589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f82823cc740 20 client.25589 populate_metadata read hostname 'smithi103' 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f82823cc740 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ab34a38bb0 0x55ab34a3afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f82823cc740 4 client.25589 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:12:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.476+0000 7f82823cc740 1 -- 172.21.15.103:0/3448538083 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ab3491ed70 con 0x55ab34a38bb0 2024-09-19T06:12:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.477+0000 7f827d3ca640 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ab34a38bb0 0x55ab34a3afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.477+0000 7f8260ff9640 10 client.25589 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.477+0000 7f827d3ca640 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ab34a38bb0 0x55ab34a3afa0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=943fbc7d77e31863 server_cookie=8c876270668461b6 in_seq=0 out_seq=0 2024-09-19T06:12:06.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.493+0000 7f8260ff9640 1 -- 172.21.15.103:0/3448538083 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ab3491ed70 con 0x55ab34a38bb0 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.493+0000 7f8260ff9640 10 client.25589 handle_command_reply: tid=0 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.493+0000 7f82823cc740 1 client.25589 shutdown 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 1 -- 172.21.15.103:0/3448538083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 msgr2=0x55ab349b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349b7480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f827002a900 tx=0x7f8270050000 comp rx=0 tx=0).stop 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 1 -- 172.21.15.103:0/3448538083 shutdown_connections 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55ab34a38bb0 0x55ab34a3afa0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab349bdcb0 0x55ab349b7480 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab349b2af0 0x55ab349c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f8260ff9640 0 client.25589 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 1 --2- 172.21.15.103:0/3448538083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab349af060 0x55ab349c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 1 -- 172.21.15.103:0/3448538083 >> 172.21.15.103:0/3448538083 conn(0x55ab349af9e0 msgr2=0x55ab349ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 1 -- 172.21.15.103:0/3448538083 shutdown_connections 2024-09-19T06:12:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 1 -- 172.21.15.103:0/3448538083 wait complete. 2024-09-19T06:12:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f82823cc740 20 client.25589 trim_cache size 0 max 16384 2024-09-19T06:12:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:12:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:12:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:12:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:12:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f827f62e640 1 -- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f82640a3460 msgr2=0x7f82640a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f827f62e640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f82640a3460 0x7f82640a5920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f827004a000 tx=0x7f827004b000 comp rx=0 tx=0).stop 2024-09-19T06:12:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f827f62e640 1 -- 172.21.15.103:0/2077867686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278100860 msgr2=0x7f827819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f827f62e640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278100860 0x7f827819a440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f827400d770 tx=0x7f827400dc30 comp rx=0 tx=0).stop 2024-09-19T06:12:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f827f62e640 1 -- 172.21.15.103:0/2077867686 shutdown_connections 2024-09-19T06:12:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f827f62e640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f82640a3460 0x7f82640a5920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f827f62e640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f827810e410 0x7f827819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f827f62e640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8278101210 0x7f827819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f827f62e640 1 --2- 172.21.15.103:0/2077867686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8278100860 0x7f827819a440 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.494+0000 7f827f62e640 1 -- 172.21.15.103:0/2077867686 >> 172.21.15.103:0/2077867686 conn(0x7f8278077990 msgr2=0x7f82780ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.495+0000 7f827f62e640 1 -- 172.21.15.103:0/2077867686 shutdown_connections 2024-09-19T06:12:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:06.495+0000 7f827f62e640 1 -- 172.21.15.103:0/2077867686 wait complete. 2024-09-19T06:12:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:07 smithi174 ceph-mon[34488]: pgmap v146: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 1.38k op/s 2024-09-19T06:12:07.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:07 smithi103 ceph-mon[30925]: pgmap v146: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 1.38k op/s 2024-09-19T06:12:08.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:07 smithi169 ceph-mon[34350]: pgmap v146: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 1.38k op/s 2024-09-19T06:12:09.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:09 smithi174 ceph-mon[34488]: pgmap v147: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 4.7 MiB/s wr, 1.07k op/s 2024-09-19T06:12:09.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:09 smithi103 ceph-mon[30925]: pgmap v147: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 4.7 MiB/s wr, 1.07k op/s 2024-09-19T06:12:10.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:09 smithi169 ceph-mon[34350]: pgmap v147: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 4.7 MiB/s wr, 1.07k op/s 2024-09-19T06:12:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:11 smithi174 ceph-mon[34488]: pgmap v148: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 4.7 MiB/s wr, 1.07k op/s 2024-09-19T06:12:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:11 smithi103 ceph-mon[30925]: pgmap v148: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 4.7 MiB/s wr, 1.07k op/s 2024-09-19T06:12:12.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:11 smithi169 ceph-mon[34350]: pgmap v148: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 4.7 MiB/s wr, 1.07k op/s 2024-09-19T06:12:13.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:13 smithi174 ceph-mon[34488]: pgmap v149: 97 pgs: 97 active+clean; 133 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 7.1 MiB/s wr, 1.59k op/s 2024-09-19T06:12:13.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:13 smithi103 ceph-mon[30925]: pgmap v149: 97 pgs: 97 active+clean; 133 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 7.1 MiB/s wr, 1.59k op/s 2024-09-19T06:12:14.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:13 smithi169 ceph-mon[34350]: pgmap v149: 97 pgs: 97 active+clean; 133 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 7.1 MiB/s wr, 1.59k op/s 2024-09-19T06:12:15.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:15 smithi174 ceph-mon[34488]: pgmap v150: 97 pgs: 97 active+clean; 133 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 4.8 MiB/s wr, 1.05k op/s 2024-09-19T06:12:15.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:15 smithi103 ceph-mon[30925]: pgmap v150: 97 pgs: 97 active+clean; 133 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 4.8 MiB/s wr, 1.05k op/s 2024-09-19T06:12:16.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:15 smithi169 ceph-mon[34350]: pgmap v150: 97 pgs: 97 active+clean; 133 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 4.8 MiB/s wr, 1.05k op/s 2024-09-19T06:12:16.179 INFO:tasks.workunit.client.0.smithi103.stdout:20000 trunc from 0x62a09d3 to 0x111d204 2024-09-19T06:12:17.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:17 smithi174 ceph-mon[34488]: pgmap v151: 97 pgs: 97 active+clean; 138 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 7.1 MiB/s wr, 1.54k op/s 2024-09-19T06:12:17.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:17 smithi103 ceph-mon[30925]: pgmap v151: 97 pgs: 97 active+clean; 138 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 7.1 MiB/s wr, 1.54k op/s 2024-09-19T06:12:18.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:17 smithi169 ceph-mon[34350]: pgmap v151: 97 pgs: 97 active+clean; 138 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 7.1 MiB/s wr, 1.54k op/s 2024-09-19T06:12:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.598+0000 7ffa4299f640 1 -- 172.21.15.103:0/1206666634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa3c1009d0 msgr2=0x7ffa3c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.598+0000 7ffa4299f640 1 --2- 172.21.15.103:0/1206666634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa3c1009d0 0x7ffa3c100e30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009900 tx=0x7ffa2402a410 comp rx=0 tx=0).stop 2024-09-19T06:12:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.598+0000 7ffa4299f640 1 -- 172.21.15.103:0/1206666634 shutdown_connections 2024-09-19T06:12:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.598+0000 7ffa4299f640 1 --2- 172.21.15.103:0/1206666634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c101370 0x7ffa3c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.598+0000 7ffa4299f640 1 --2- 172.21.15.103:0/1206666634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa3c1009d0 0x7ffa3c100e30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.598+0000 7ffa4299f640 1 --2- 172.21.15.103:0/1206666634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa3c1069e0 0x7ffa3c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.598+0000 7ffa4299f640 1 -- 172.21.15.103:0/1206666634 >> 172.21.15.103:0/1206666634 conn(0x7ffa3c0fc6b0 msgr2=0x7ffa3c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.598+0000 7ffa4299f640 1 -- 172.21.15.103:0/1206666634 shutdown_connections 2024-09-19T06:12:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.598+0000 7ffa4299f640 1 -- 172.21.15.103:0/1206666634 wait complete. 2024-09-19T06:12:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa4299f640 1 Processor -- start 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa4299f640 1 -- start start 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa4299f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa3c1009d0 0x7ffa3c199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa4299f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c101370 0x7ffa3c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa4299f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa3c1069e0 0x7ffa3c1a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa4299f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c110cd0 con 0x7ffa3c101370 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa4299f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c110b50 con 0x7ffa3c1009d0 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa4299f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c110e50 con 0x7ffa3c1069e0 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c101370 0x7ffa3c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa3bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa3c1009d0 0x7ffa3c199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c101370 0x7ffa3c199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49086/0 (socket says 172.21.15.103:49086) 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa33fff640 1 -- 172.21.15.103:0/4220059506 learned_addr learned my addr 172.21.15.103:0/4220059506 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa40f3c640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa3c1069e0 0x7ffa3c1a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa33fff640 1 -- 172.21.15.103:0/4220059506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa3c1069e0 msgr2=0x7ffa3c1a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa33fff640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa3c1069e0 0x7ffa3c1a41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa33fff640 1 -- 172.21.15.103:0/4220059506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa3c1009d0 msgr2=0x7ffa3c199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa33fff640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa3c1009d0 0x7ffa3c199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa33fff640 1 -- 172.21.15.103:0/4220059506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c1a46e0 con 0x7ffa3c101370 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.599+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa3c1009d0 0x7ffa3c199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.600+0000 7ffa33fff640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c101370 0x7ffa3c199660 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ffa24006010 tx=0x7ffa240040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.600+0000 7ffa39ffb640 1 -- 172.21.15.103:0/4220059506 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2403f030 con 0x7ffa3c101370 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.600+0000 7ffa39ffb640 1 -- 172.21.15.103:0/4220059506 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa240044c0 con 0x7ffa3c101370 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.600+0000 7ffa4299f640 1 -- 172.21.15.103:0/4220059506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c1a48b0 con 0x7ffa3c101370 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.600+0000 7ffa39ffb640 1 -- 172.21.15.103:0/4220059506 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24035070 con 0x7ffa3c101370 2024-09-19T06:12:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.600+0000 7ffa4299f640 1 -- 172.21.15.103:0/4220059506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c1a4d10 con 0x7ffa3c101370 2024-09-19T06:12:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.602+0000 7ffa39ffb640 1 -- 172.21.15.103:0/4220059506 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7ffa24042030 con 0x7ffa3c101370 2024-09-19T06:12:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa45816740 1 Processor -- start 2024-09-19T06:12:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa45816740 1 -- start start 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa45816740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e234af0 0x55b33e234ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa45816740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa45816740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 0x55b33e2420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa45816740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b33e1992f0 con 0x55b33e23fcb0 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa45816740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b33e141270 con 0x55b33e235410 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa45816740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b33e1952b0 con 0x55b33e234af0 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 0x55b33e2420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa3bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa40f3c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e234af0 0x55b33e234ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 0x55b33e2420a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49088/0 (socket says 172.21.15.103:49088) 2024-09-19T06:12:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa33fff640 1 -- 172.21.15.103:0/1789065306 learned_addr learned my addr 172.21.15.103:0/1789065306 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.603+0000 7ffa39ffb640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffa280a3460 0x7ffa280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa3bfff640 1 -- 172.21.15.103:0/1789065306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e234af0 msgr2=0x55b33e234ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/1789065306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e234af0 0x55b33e234ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa3bfff640 1 -- 172.21.15.103:0/1789065306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 msgr2=0x55b33e2420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/1789065306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 0x55b33e2420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa3bfff640 1 -- 172.21.15.103:0/1789065306 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33e140340 con 0x55b33e235410 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa40f3c640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffa280a3460 0x7ffa280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa39ffb640 1 -- 172.21.15.103:0/4220059506 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7ffa240effc0 con 0x7ffa3c101370 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/1789065306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23f770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009fb0 tx=0x7ffa2c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54e7dfbbb2853e09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa327fc640 1 -- 172.21.15.103:0/1789065306 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c004310 con 0x55b33e235410 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa327fc640 1 -- 172.21.15.103:0/1789065306 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa2c0044b0 con 0x55b33e235410 2024-09-19T06:12:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa40f3c640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffa280a3460 0x7ffa280a5920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffa34005fd0 tx=0x7ffa34004a40 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.604+0000 7ffa327fc640 1 -- 172.21.15.103:0/1789065306 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0035f0 con 0x55b33e235410 2024-09-19T06:12:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.605+0000 7ffa45816740 1 -- 172.21.15.103:0/1789065306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 msgr2=0x55b33e23f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.605+0000 7ffa45816740 1 --2- 172.21.15.103:0/1789065306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23f770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009fb0 tx=0x7ffa2c0118d0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.605+0000 7ffa45816740 1 -- 172.21.15.103:0/1789065306 shutdown_connections 2024-09-19T06:12:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.605+0000 7ffa45816740 1 --2- 172.21.15.103:0/1789065306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 0x55b33e2420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.605+0000 7ffa45816740 1 --2- 172.21.15.103:0/1789065306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23f770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.605+0000 7ffa45816740 1 --2- 172.21.15.103:0/1789065306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e234af0 0x55b33e234ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.605+0000 7ffa45816740 1 -- 172.21.15.103:0/1789065306 >> 172.21.15.103:0/1789065306 conn(0x55b33e231060 msgr2=0x55b33e231440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.605+0000 7ffa45816740 1 -- 172.21.15.103:0/1789065306 shutdown_connections 2024-09-19T06:12:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.605+0000 7ffa45816740 1 -- 172.21.15.103:0/1789065306 wait complete. 2024-09-19T06:12:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.605+0000 7ffa45816740 1 -- start start 2024-09-19T06:12:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa45816740 1 Processor -- start 2024-09-19T06:12:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa45816740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e234af0 0x55b33e23cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa45816740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa45816740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 0x55b33e23d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa45816740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b33e242920 con 0x55b33e23fcb0 2024-09-19T06:12:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa45816740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b33e122290 con 0x55b33e235410 2024-09-19T06:12:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa45816740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b33e242aa0 con 0x55b33e234af0 2024-09-19T06:12:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa45816740 10 client.0 _ll_register_callbacks cb 0x55b33e153140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:49712/0 (socket says 172.21.15.103:49712) 2024-09-19T06:12:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa33fff640 1 -- 172.21.15.103:0/2510055891 learned_addr learned my addr 172.21.15.103:0/2510055891 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa40f3c640 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 0x55b33e23d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e234af0 0x55b33e23cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.606+0000 7ffa33fff640 1 -- 172.21.15.103:0/2510055891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e234af0 msgr2=0x55b33e23cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa33fff640 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e234af0 0x55b33e23cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa33fff640 1 -- 172.21.15.103:0/2510055891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 msgr2=0x55b33e23d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa33fff640 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 0x55b33e23d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa33fff640 1 -- 172.21.15.103:0/2510055891 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33deac210 con 0x55b33e235410 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa33fff640 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23d090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa240b8750 tx=0x7ffa24005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=535d2f0f4805e517 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2510055891 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24049070 con 0x55b33e235410 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2510055891 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7ffa240b8960 con 0x55b33e235410 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa45816740 1 -- 172.21.15.103:0/2510055891 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa2c0044b0 con 0x55b33e235410 2024-09-19T06:12:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2510055891 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffa240b8590 con 0x55b33e235410 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa45816740 10 client.25601 fetch_fsmap learned FSMap version 31 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa45816740 1 -- 172.21.15.103:0/2510055891 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b33df78620 con 0x55b33e235410 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.607+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2510055891 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa240bc9f0 con 0x55b33e235410 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.608+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2510055891 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ffa240f3cc0 con 0x55b33e235410 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.608+0000 7ffa45816740 10 client.25601 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.608+0000 7ffa45816740 10 client.25601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.608+0000 7ffa45816740 20 client.25601 populate_metadata read hostname 'smithi103' 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.608+0000 7ffa45816740 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55b33e24fd80 0x55b33e2521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.608+0000 7ffa45816740 4 client.25601 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.608+0000 7ffa45816740 1 -- 172.21.15.103:0/2510055891 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffa2c0044b0 con 0x55b33e24fd80 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.608+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55b33e24fd80 0x55b33e2521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.609+0000 7ffa1b7fe640 10 client.25601 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.609+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55b33e24fd80 0x55b33e2521a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3da0dff123554fa server_cookie=6003957b968912ee in_seq=0 out_seq=0 2024-09-19T06:12:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2510055891 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ffa2c0044b0 con 0x55b33e24fd80 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa1b7fe640 10 client.25601 handle_command_reply: tid=0 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa45816740 1 client.25601 shutdown 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa45816740 1 -- 172.21.15.103:0/2510055891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 msgr2=0x55b33e23d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa45816740 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23d090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa240b8750 tx=0x7ffa24005b50 comp rx=0 tx=0).stop 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa45816740 1 -- 172.21.15.103:0/2510055891 shutdown_connections 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa45816740 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55b33e24fd80 0x55b33e2521a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa45816740 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e23fcb0 0x55b33e23d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa45816740 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e235410 0x55b33e23d090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa1b7fe640 0 client.25601 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.611+0000 7ffa45816740 1 --2- 172.21.15.103:0/2510055891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e234af0 0x55b33e23cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.612+0000 7ffa45816740 1 -- 172.21.15.103:0/2510055891 >> 172.21.15.103:0/2510055891 conn(0x55b33e231060 msgr2=0x55b33e236d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.612+0000 7ffa45816740 1 -- 172.21.15.103:0/2510055891 shutdown_connections 2024-09-19T06:12:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.612+0000 7ffa45816740 1 -- 172.21.15.103:0/2510055891 wait complete. 2024-09-19T06:12:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.612+0000 7ffa45816740 20 client.25601 trim_cache size 0 max 16384 2024-09-19T06:12:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.630+0000 7ffa45816740 1 Processor -- start 2024-09-19T06:12:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa45816740 1 -- start start 2024-09-19T06:12:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa45816740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e23d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa45816740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e235410 0x55b33e257a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa45816740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 0x55b33e257fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa45816740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c1afe20 con 0x55b33e234af0 2024-09-19T06:12:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa45816740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c1ad6f0 con 0x55b33e23fcb0 2024-09-19T06:12:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa45816740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c1ab540 con 0x55b33e235410 2024-09-19T06:12:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa3bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e23d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa3bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e23d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49106/0 (socket says 172.21.15.103:49106) 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa3bfff640 1 -- 172.21.15.103:0/4107097644 learned_addr learned my addr 172.21.15.103:0/4107097644 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa40f3c640 1 --2- 172.21.15.103:0/4107097644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 0x55b33e257fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa3bfff640 1 -- 172.21.15.103:0/4107097644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e235410 msgr2=0x55b33e257a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/4107097644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e235410 0x55b33e257a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa3bfff640 1 -- 172.21.15.103:0/4107097644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 msgr2=0x55b33e257fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.631+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/4107097644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 0x55b33e257fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.632+0000 7ffa3bfff640 1 -- 172.21.15.103:0/4107097644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33e230e90 con 0x55b33e234af0 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.632+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/4107097644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e23d400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009d40 tx=0x7ffa2c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ca8a96d97919d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.632+0000 7ffa31ffb640 1 -- 172.21.15.103:0/4107097644 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c004310 con 0x55b33e234af0 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.632+0000 7ffa31ffb640 1 -- 172.21.15.103:0/4107097644 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa2c030070 con 0x55b33e234af0 2024-09-19T06:12:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.632+0000 7ffa31ffb640 1 -- 172.21.15.103:0/4107097644 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c02b500 con 0x55b33e234af0 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.633+0000 7ffa45816740 1 -- 172.21.15.103:0/4107097644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 msgr2=0x55b33e23d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.633+0000 7ffa45816740 1 --2- 172.21.15.103:0/4107097644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e23d400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009d40 tx=0x7ffa2c005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.634+0000 7ffa45816740 1 -- 172.21.15.103:0/4107097644 shutdown_connections 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.634+0000 7ffa45816740 1 --2- 172.21.15.103:0/4107097644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 0x55b33e257fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.634+0000 7ffa45816740 1 --2- 172.21.15.103:0/4107097644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e235410 0x55b33e257a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.634+0000 7ffa45816740 1 --2- 172.21.15.103:0/4107097644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e23d400 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.634+0000 7ffa45816740 1 -- 172.21.15.103:0/4107097644 >> 172.21.15.103:0/4107097644 conn(0x55b33e231060 msgr2=0x55b33e23ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.634+0000 7ffa45816740 1 -- 172.21.15.103:0/4107097644 shutdown_connections 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.634+0000 7ffa45816740 1 -- 172.21.15.103:0/4107097644 wait complete. 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.634+0000 7ffa45816740 1 -- start start 2024-09-19T06:12:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa45816740 1 Processor -- start 2024-09-19T06:12:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa45816740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e243e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa45816740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e235410 0x55b33e244370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa45816740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 0x55b33e2b9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa45816740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c1abbb0 con 0x55b33e234af0 2024-09-19T06:12:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa45816740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c1ad020 con 0x55b33e23fcb0 2024-09-19T06:12:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa45816740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c1ac280 con 0x55b33e235410 2024-09-19T06:12:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa45816740 10 client.0 _ll_register_callbacks cb 0x7ffa24005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa3bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e243e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e235410 0x55b33e244370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa40f3c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 0x55b33e2b9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa3bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e243e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49122/0 (socket says 172.21.15.103:49122) 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa3bfff640 1 -- 172.21.15.103:0/2677916502 learned_addr learned my addr 172.21.15.103:0/2677916502 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e235410 0x55b33e244370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:43262/0 (socket says 172.21.15.103:43262) 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa3bfff640 1 -- 172.21.15.103:0/2677916502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e235410 msgr2=0x55b33e244370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e235410 0x55b33e244370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa3bfff640 1 -- 172.21.15.103:0/2677916502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 msgr2=0x55b33e2b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 0x55b33e2b9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa3bfff640 1 -- 172.21.15.103:0/2677916502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33e231cf0 con 0x55b33e234af0 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.635+0000 7ffa40f3c640 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 0x55b33e2b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.636+0000 7ffa3bfff640 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e243e30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c011910 tx=0x7ffa2c0093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c486d2e14ce5721d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.636+0000 7ffa1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.636+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2677916502 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0037f0 con 0x55b33e234af0 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.636+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2677916502 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7ffa2c003990 con 0x55b33e234af0 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.636+0000 7ffa45816740 1 -- 172.21.15.103:0/2677916502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa2c030070 con 0x55b33e234af0 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.636+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2677916502 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffa2c003b90 con 0x55b33e234af0 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.636+0000 7ffa45816740 10 client.16074 fetch_fsmap learned FSMap version 31 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.636+0000 7ffa45816740 1 -- 172.21.15.103:0/2677916502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b33e2baf10 con 0x55b33e234af0 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.637+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2677916502 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa2c030070 con 0x55b33e234af0 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.637+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2677916502 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ffa2c00f480 con 0x55b33e234af0 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.637+0000 7ffa45816740 10 client.16074 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.637+0000 7ffa45816740 10 client.16074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.637+0000 7ffa45816740 20 client.16074 populate_metadata read hostname 'smithi103' 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.637+0000 7ffa45816740 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55b33e2bb360 0x55b33e2bd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.637+0000 7ffa45816740 4 client.16074 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:12:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.637+0000 7ffa45816740 1 -- 172.21.15.103:0/2677916502 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b33e1a6a20 con 0x55b33e2bb360 2024-09-19T06:12:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.637+0000 7ffa33fff640 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55b33e2bb360 0x55b33e2bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.638+0000 7ffa1b7fe640 10 client.16074 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.638+0000 7ffa33fff640 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55b33e2bb360 0x55b33e2bd780 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=118b85d277cfb9ff server_cookie=7118d6b0e70c5e6b in_seq=0 out_seq=0 2024-09-19T06:12:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa1b7fe640 1 -- 172.21.15.103:0/2677916502 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b33e1a6a20 con 0x55b33e2bb360 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa1b7fe640 10 client.16074 handle_command_reply: tid=0 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 client.16074 shutdown 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 -- 172.21.15.103:0/2677916502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 msgr2=0x55b33e243e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e243e30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c011910 tx=0x7ffa2c0093e0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 -- 172.21.15.103:0/2677916502 shutdown_connections 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55b33e2bb360 0x55b33e2bd780 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa1b7fe640 0 client.16074 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b33e23fcb0 0x55b33e2b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b33e235410 0x55b33e244370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 --2- 172.21.15.103:0/2677916502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b33e234af0 0x55b33e243e30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 -- 172.21.15.103:0/2677916502 >> 172.21.15.103:0/2677916502 conn(0x55b33e231060 msgr2=0x55b33e23ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 -- 172.21.15.103:0/2677916502 shutdown_connections 2024-09-19T06:12:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 1 -- 172.21.15.103:0/2677916502 wait complete. 2024-09-19T06:12:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.650+0000 7ffa45816740 20 client.16074 trim_cache size 0 max 16384 2024-09-19T06:12:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:12:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:12:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:12:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:12:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 -- 172.21.15.103:0/4220059506 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffa280a3460 msgr2=0x7ffa280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffa280a3460 0x7ffa280a5920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffa34005fd0 tx=0x7ffa34004a40 comp rx=0 tx=0).stop 2024-09-19T06:12:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 -- 172.21.15.103:0/4220059506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c101370 msgr2=0x7ffa3c199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c101370 0x7ffa3c199660 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ffa24006010 tx=0x7ffa240040c0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 -- 172.21.15.103:0/4220059506 shutdown_connections 2024-09-19T06:12:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7ffa280a3460 0x7ffa280a5920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa3c1069e0 0x7ffa3c1a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c101370 0x7ffa3c199660 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 --2- 172.21.15.103:0/4220059506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa3c1009d0 0x7ffa3c199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 -- 172.21.15.103:0/4220059506 >> 172.21.15.103:0/4220059506 conn(0x7ffa3c0fc6b0 msgr2=0x7ffa3c0fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 -- 172.21.15.103:0/4220059506 shutdown_connections 2024-09-19T06:12:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:19.651+0000 7ffa4299f640 1 -- 172.21.15.103:0/4220059506 wait complete. 2024-09-19T06:12:19.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:19 smithi174 ceph-mon[34488]: pgmap v152: 97 pgs: 97 active+clean; 138 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 4.8 MiB/s wr, 1.01k op/s 2024-09-19T06:12:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:19 smithi103 ceph-mon[30925]: pgmap v152: 97 pgs: 97 active+clean; 138 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 4.8 MiB/s wr, 1.01k op/s 2024-09-19T06:12:20.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:19 smithi169 ceph-mon[34350]: pgmap v152: 97 pgs: 97 active+clean; 138 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 4.8 MiB/s wr, 1.01k op/s 2024-09-19T06:12:21.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:21 smithi174 ceph-mon[34488]: pgmap v153: 97 pgs: 97 active+clean; 138 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 4.8 MiB/s wr, 1.01k op/s 2024-09-19T06:12:21.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:21 smithi103 ceph-mon[30925]: pgmap v153: 97 pgs: 97 active+clean; 138 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 4.8 MiB/s wr, 1.01k op/s 2024-09-19T06:12:22.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:21 smithi169 ceph-mon[34350]: pgmap v153: 97 pgs: 97 active+clean; 138 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 4.8 MiB/s wr, 1.01k op/s 2024-09-19T06:12:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:23 smithi174 ceph-mon[34488]: pgmap v154: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 7.2 MiB/s wr, 1.49k op/s 2024-09-19T06:12:23.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:23 smithi103 ceph-mon[30925]: pgmap v154: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 7.2 MiB/s wr, 1.49k op/s 2024-09-19T06:12:24.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:23 smithi169 ceph-mon[34350]: pgmap v154: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 7.2 MiB/s wr, 1.49k op/s 2024-09-19T06:12:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:25 smithi174 ceph-mon[34488]: pgmap v155: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 4.7 MiB/s wr, 969 op/s 2024-09-19T06:12:25.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:25 smithi103 ceph-mon[30925]: pgmap v155: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 4.7 MiB/s wr, 969 op/s 2024-09-19T06:12:26.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:25 smithi169 ceph-mon[34350]: pgmap v155: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 4.7 MiB/s wr, 969 op/s 2024-09-19T06:12:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:27 smithi174 ceph-mon[34488]: pgmap v156: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.9 MiB/s wr, 1.45k op/s 2024-09-19T06:12:27.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:27 smithi103 ceph-mon[30925]: pgmap v156: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.9 MiB/s wr, 1.45k op/s 2024-09-19T06:12:28.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:27 smithi169 ceph-mon[34350]: pgmap v156: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.9 MiB/s wr, 1.45k op/s 2024-09-19T06:12:29.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:29 smithi174 ceph-mon[34488]: pgmap v157: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 4.5 MiB/s wr, 968 op/s 2024-09-19T06:12:29.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:29 smithi103 ceph-mon[30925]: pgmap v157: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 4.5 MiB/s wr, 968 op/s 2024-09-19T06:12:30.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:29 smithi169 ceph-mon[34350]: pgmap v157: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 4.5 MiB/s wr, 968 op/s 2024-09-19T06:12:31.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:31 smithi174 ceph-mon[34488]: pgmap v158: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 4.5 MiB/s wr, 968 op/s 2024-09-19T06:12:31.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:31 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:12:31.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:31 smithi103 ceph-mon[30925]: pgmap v158: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 4.5 MiB/s wr, 968 op/s 2024-09-19T06:12:31.995 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:31 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:12:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:31 smithi169 ceph-mon[34350]: pgmap v158: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 4.5 MiB/s wr, 968 op/s 2024-09-19T06:12:32.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:31 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:12:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 -- 172.21.15.103:0/1662504068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2eb81069c0 msgr2=0x7f2eb8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 --2- 172.21.15.103:0/1662504068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2eb81069c0 0x7f2eb8106da0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009930 tx=0x7f2eac02a420 comp rx=0 tx=0).stop 2024-09-19T06:12:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 -- 172.21.15.103:0/1662504068 shutdown_connections 2024-09-19T06:12:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 --2- 172.21.15.103:0/1662504068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2eb8101350 0x7f2eb810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 --2- 172.21.15.103:0/1662504068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2eb81009b0 0x7f2eb8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 --2- 172.21.15.103:0/1662504068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2eb81069c0 0x7f2eb8106da0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 -- 172.21.15.103:0/1662504068 >> 172.21.15.103:0/1662504068 conn(0x7f2eb8077990 msgr2=0x7f2eb80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 -- 172.21.15.103:0/1662504068 shutdown_connections 2024-09-19T06:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 -- 172.21.15.103:0/1662504068 wait complete. 2024-09-19T06:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 Processor -- start 2024-09-19T06:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.755+0000 7f2ebede4640 1 -- start start 2024-09-19T06:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebede4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2eb81009b0 0x7f2eb81990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebede4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2eb8101350 0x7f2eb8199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebede4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2eb81069c0 0x7f2eb81a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebede4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8110cb0 con 0x7f2eb81009b0 2024-09-19T06:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebede4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8110b30 con 0x7f2eb81069c0 2024-09-19T06:12:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebede4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8110e30 con 0x7f2eb8101350 2024-09-19T06:12:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebcb80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2eb81009b0 0x7f2eb81990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebcb80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2eb81009b0 0x7f2eb81990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45676/0 (socket says 172.21.15.103:45676) 2024-09-19T06:12:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebcb80640 1 -- 172.21.15.103:0/2997114534 learned_addr learned my addr 172.21.15.103:0/2997114534 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebd381640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2eb81069c0 0x7f2eb81a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2eb7fff640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2eb8101350 0x7f2eb8199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebcb80640 1 -- 172.21.15.103:0/2997114534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2eb8101350 msgr2=0x7f2eb8199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebcb80640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2eb8101350 0x7f2eb8199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebcb80640 1 -- 172.21.15.103:0/2997114534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2eb81069c0 msgr2=0x7f2eb81a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebcb80640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2eb81069c0 0x7f2eb81a4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebcb80640 1 -- 172.21.15.103:0/2997114534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb81a46a0 con 0x7f2eb81009b0 2024-09-19T06:12:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2eb7fff640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2eb8101350 0x7f2eb8199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebcb80640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2eb81009b0 0x7f2eb81990e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2eac005940 tx=0x7f2eac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2eb5ffb640 1 -- 172.21.15.103:0/2997114534 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac03f030 con 0x7f2eb81009b0 2024-09-19T06:12:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2ebede4640 1 -- 172.21.15.103:0/2997114534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb81a4870 con 0x7f2eb81009b0 2024-09-19T06:12:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2eb5ffb640 1 -- 172.21.15.103:0/2997114534 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2eac0318a0 con 0x7f2eb81009b0 2024-09-19T06:12:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.756+0000 7f2eb5ffb640 1 -- 172.21.15.103:0/2997114534 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac035070 con 0x7f2eb81009b0 2024-09-19T06:12:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.757+0000 7f2ebede4640 1 -- 172.21.15.103:0/2997114534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb81a4d30 con 0x7f2eb81009b0 2024-09-19T06:12:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.760+0000 7f2eb5ffb640 1 -- 172.21.15.103:0/2997114534 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f2eac042030 con 0x7f2eb81009b0 2024-09-19T06:12:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.760+0000 7f2ec1c56740 1 Processor -- start 2024-09-19T06:12:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.760+0000 7f2ec1c56740 1 -- start start 2024-09-19T06:12:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.760+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 0x55a885943ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.760+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88594e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.760+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a8859510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ec1c56740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a8858a82f0 con 0x55a88594ecb0 2024-09-19T06:12:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ec1c56740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a885850270 con 0x55a885944410 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ec1c56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a8858a42b0 con 0x55a885943af0 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ebd381640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 0x55a885943ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ebd381640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 0x55a885943ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:38580/0 (socket says 172.21.15.103:38580) 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ebd381640 1 -- 172.21.15.103:0/1352627345 learned_addr learned my addr 172.21.15.103:0/1352627345 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ebcb80640 1 --2- 172.21.15.103:0/1352627345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88594e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2eb7fff640 1 --2- 172.21.15.103:0/1352627345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a8859510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ebd381640 1 -- 172.21.15.103:0/1352627345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 msgr2=0x55a88594e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ebd381640 1 --2- 172.21.15.103:0/1352627345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88594e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ebd381640 1 -- 172.21.15.103:0/1352627345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 msgr2=0x55a8859510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ebd381640 1 --2- 172.21.15.103:0/1352627345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a8859510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ebd381640 1 -- 172.21.15.103:0/1352627345 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88584f340 con 0x55a885943af0 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2ebd381640 1 --2- 172.21.15.103:0/1352627345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 0x55a885943ed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000a430 tx=0x7f2eb0009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=137bb224edeac355 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.761+0000 7f2eb5ffb640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2ea80a3460 0x7f2ea80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.762+0000 7f2ea2ffd640 1 -- 172.21.15.103:0/1352627345 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0013790 con 0x55a885943af0 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.762+0000 7f2ebcb80640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2ea80a3460 0x7f2ea80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.762+0000 7f2ea2ffd640 1 -- 172.21.15.103:0/1352627345 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2eb0019070 con 0x55a885943af0 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.762+0000 7f2ea2ffd640 1 -- 172.21.15.103:0/1352627345 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0014d00 con 0x55a885943af0 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.762+0000 7f2eb5ffb640 1 -- 172.21.15.103:0/2997114534 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f2eac0f0470 con 0x7f2eb81009b0 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.763+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1352627345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 msgr2=0x55a885943ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.763+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/1352627345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 0x55a885943ed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000a430 tx=0x7f2eb0009650 comp rx=0 tx=0).stop 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.763+0000 7f2ebcb80640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2ea80a3460 0x7f2ea80a5920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0edcc0 tx=0x7f2eac0f6060 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.763+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1352627345 shutdown_connections 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.763+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/1352627345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a8859510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.763+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/1352627345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88594e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.764+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/1352627345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 0x55a885943ed0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.764+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1352627345 >> 172.21.15.103:0/1352627345 conn(0x55a885940060 msgr2=0x55a885940440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.764+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1352627345 shutdown_connections 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.764+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1352627345 wait complete. 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.765+0000 7f2ec1c56740 1 -- start start 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.765+0000 7f2ec1c56740 1 Processor -- start 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.765+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 0x55a88594bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.765+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88594c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.765+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a88594c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.765+0000 7f2ec1c56740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a885955c90 con 0x55a88594ecb0 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.765+0000 7f2ec1c56740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a885831290 con 0x55a885944410 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.765+0000 7f2ec1c56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a885955e10 con 0x55a885943af0 2024-09-19T06:12:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.765+0000 7f2ec1c56740 10 client.0 _ll_register_callbacks cb 0x55a885862140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ebd381640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a88594c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88594c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ebd381640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a88594c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45700/0 (socket says 172.21.15.103:45700) 2024-09-19T06:12:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ebd381640 1 -- 172.21.15.103:0/537005902 learned_addr learned my addr 172.21.15.103:0/537005902 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ebd381640 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 0x55a88594bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ebd381640 1 -- 172.21.15.103:0/537005902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 msgr2=0x55a88594bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ebd381640 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 0x55a88594bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ebd381640 1 -- 172.21.15.103:0/537005902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 msgr2=0x55a88594c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ebd381640 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88594c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ebd381640 1 -- 172.21.15.103:0/537005902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8855bb210 con 0x55a88594ecb0 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2eb7fff640 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88594c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ebd381640 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a88594c650 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0014450 tx=0x7f2eb0004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee922011bcdbc04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2e97fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2e97fff640 1 -- 172.21.15.103:0/537005902 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00139d0 con 0x55a88594ecb0 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2e97fff640 1 -- 172.21.15.103:0/537005902 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f2eb0013b70 con 0x55a88594ecb0 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.766+0000 7f2ec1c56740 1 -- 172.21.15.103:0/537005902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2eb0019070 con 0x55a88594ecb0 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2e97fff640 1 -- 172.21.15.103:0/537005902 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2eb0013d70 con 0x55a88594ecb0 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2ec1c56740 10 client.16086 fetch_fsmap learned FSMap version 32 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2ec1c56740 1 -- 172.21.15.103:0/537005902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a885687620 con 0x55a88594ecb0 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2e97fff640 1 -- 172.21.15.103:0/537005902 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2eb0019070 con 0x55a88594ecb0 2024-09-19T06:12:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2e97fff640 1 -- 172.21.15.103:0/537005902 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f2eb001f410 con 0x55a88594ecb0 2024-09-19T06:12:32.781 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2ec1c56740 10 client.16086 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:12:32.781 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2ec1c56740 10 client.16086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:32.781 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2ec1c56740 20 client.16086 populate_metadata read hostname 'smithi103' 2024-09-19T06:12:32.781 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a885963050 0x55a885965440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.781 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2ec1c56740 4 client.16086 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:32.781 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2ec1c56740 1 -- 172.21.15.103:0/537005902 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8858b5a20 con 0x55a885963050 2024-09-19T06:12:32.781 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.767+0000 7f2eb7fff640 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a885963050 0x55a885965440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.768+0000 7f2e97fff640 10 client.16086 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.768+0000 7f2eb7fff640 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a885963050 0x55a885965440 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdb3ec4067ea1bec server_cookie=ae1403658f88ab97 in_seq=0 out_seq=0 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2e97fff640 1 -- 172.21.15.103:0/537005902 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a8858b5a20 con 0x55a885963050 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2e97fff640 10 client.16086 handle_command_reply: tid=0 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 client.16086 shutdown 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 -- 172.21.15.103:0/537005902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 msgr2=0x55a88594c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a88594c650 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0014450 tx=0x7f2eb0004b50 comp rx=0 tx=0).stop 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 -- 172.21.15.103:0/537005902 shutdown_connections 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a885963050 0x55a885965440 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a88594c650 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88594c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2e97fff640 0 client.16086 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/537005902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885943af0 0x55a88594bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 -- 172.21.15.103:0/537005902 >> 172.21.15.103:0/537005902 conn(0x55a885940060 msgr2=0x55a885945d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 -- 172.21.15.103:0/537005902 shutdown_connections 2024-09-19T06:12:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 1 -- 172.21.15.103:0/537005902 wait complete. 2024-09-19T06:12:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.769+0000 7f2ec1c56740 20 client.16086 trim_cache size 0 max 16384 2024-09-19T06:12:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.788+0000 7f2ec1c56740 1 Processor -- start 2024-09-19T06:12:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.788+0000 7f2ec1c56740 1 -- start start 2024-09-19T06:12:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.788+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a885943af0 0x55a88594db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.788+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88596abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.788+0000 7f2ebd381640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a885943af0 0x55a88594db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ebd381640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a885943af0 0x55a88594db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45716/0 (socket says 172.21.15.103:45716) 2024-09-19T06:12:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88594ecb0 0x55a88596b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ebd381640 1 -- 172.21.15.103:0/1719912234 learned_addr learned my addr 172.21.15.103:0/1719912234 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1719912234 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81adcf0 con 0x55a885943af0 2024-09-19T06:12:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1719912234 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81ab5c0 con 0x55a885944410 2024-09-19T06:12:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1719912234 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81a9410 con 0x55a88594ecb0 2024-09-19T06:12:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2eb7fff640 1 --2- 172.21.15.103:0/1719912234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88596abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ebd381640 1 --2- 172.21.15.103:0/1719912234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88594ecb0 0x55a88596b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ebd381640 1 -- 172.21.15.103:0/1719912234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88594ecb0 msgr2=0x55a88596b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ebd381640 1 --2- 172.21.15.103:0/1719912234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88594ecb0 0x55a88596b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ebd381640 1 -- 172.21.15.103:0/1719912234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 msgr2=0x55a88596abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ebd381640 1 --2- 172.21.15.103:0/1719912234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88596abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.789+0000 7f2ebd381640 1 -- 172.21.15.103:0/1719912234 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88595ef30 con 0x55a885943af0 2024-09-19T06:12:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.790+0000 7f2ebd381640 1 --2- 172.21.15.103:0/1719912234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a885943af0 0x55a88594db40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2eb001f7e0 tx=0x7f2eb0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dc4b740a4d27a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.790+0000 7f2ea27fc640 1 -- 172.21.15.103:0/1719912234 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0009740 con 0x55a885943af0 2024-09-19T06:12:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.790+0000 7f2ea27fc640 1 -- 172.21.15.103:0/1719912234 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2eb0019040 con 0x55a885943af0 2024-09-19T06:12:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.790+0000 7f2ea27fc640 1 -- 172.21.15.103:0/1719912234 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb001f410 con 0x55a885943af0 2024-09-19T06:12:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1719912234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a885943af0 msgr2=0x55a88594db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/1719912234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a885943af0 0x55a88594db40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2eb001f7e0 tx=0x7f2eb0000f40 comp rx=0 tx=0).stop 2024-09-19T06:12:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1719912234 shutdown_connections 2024-09-19T06:12:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/1719912234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88594ecb0 0x55a88596b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/1719912234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885944410 0x55a88596abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/1719912234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a885943af0 0x55a88594db40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1719912234 >> 172.21.15.103:0/1719912234 conn(0x55a885940060 msgr2=0x55a88594d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1719912234 shutdown_connections 2024-09-19T06:12:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 -- 172.21.15.103:0/1719912234 wait complete. 2024-09-19T06:12:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 -- start start 2024-09-19T06:12:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.791+0000 7f2ec1c56740 1 Processor -- start 2024-09-19T06:12:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885943af0 0x55a88595b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885944410 0x55a88595b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2ec1c56740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a885958070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2ec1c56740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81a9a80 con 0x55a88594ecb0 2024-09-19T06:12:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2ec1c56740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81aaef0 con 0x55a885943af0 2024-09-19T06:12:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2ec1c56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81aa150 con 0x55a885944410 2024-09-19T06:12:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885944410 0x55a88595b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2ec1c56740 10 client.0 _ll_register_callbacks cb 0x7f2ea40095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885944410 0x55a88595b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:38600/0 (socket says 172.21.15.103:38600) 2024-09-19T06:12:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2ebd381640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885943af0 0x55a88595b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2eb7fff640 1 -- 172.21.15.103:0/826071567 learned_addr learned my addr 172.21.15.103:0/826071567 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2ebd381640 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a885958070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2eb7fff640 1 -- 172.21.15.103:0/826071567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885943af0 msgr2=0x55a88595b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2eb7fff640 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885943af0 0x55a88595b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2eb7fff640 1 -- 172.21.15.103:0/826071567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 msgr2=0x55a885958070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2eb7fff640 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a885958070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2eb7fff640 1 -- 172.21.15.103:0/826071567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88595bcd0 con 0x55a885944410 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2ebd381640 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885943af0 0x55a88595b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2eb7fff640 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885944410 0x55a88595b5e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4000c00 tx=0x7f2ea4012d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f722bc6336752ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.792+0000 7f2e97fff640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2e97fff640 1 -- 172.21.15.103:0/826071567 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea401f930 con 0x55a885944410 2024-09-19T06:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2e97fff640 1 -- 172.21.15.103:0/826071567 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f2ea401fad0 con 0x55a885944410 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2ec1c56740 1 -- 172.21.15.103:0/826071567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2eb0019040 con 0x55a885944410 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2e97fff640 1 -- 172.21.15.103:0/826071567 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2ea401fcd0 con 0x55a885944410 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2ec1c56740 10 client.25648 fetch_fsmap learned FSMap version 32 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2ec1c56740 1 -- 172.21.15.103:0/826071567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a8859ce230 con 0x55a885944410 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2e97fff640 1 -- 172.21.15.103:0/826071567 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ea4003aa0 con 0x55a885944410 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2e97fff640 1 -- 172.21.15.103:0/826071567 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f2ea4027660 con 0x55a885944410 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2ec1c56740 10 client.25648 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2ec1c56740 10 client.25648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2ec1c56740 20 client.25648 populate_metadata read hostname 'smithi103' 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a8859cea10 0x55a8859d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2ec1c56740 4 client.25648 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:12:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.793+0000 7f2ec1c56740 1 -- 172.21.15.103:0/826071567 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f2eb0019040 con 0x55a8859cea10 2024-09-19T06:12:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.794+0000 7f2ebd381640 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a8859cea10 0x55a8859d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.794+0000 7f2e97fff640 10 client.25648 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.794+0000 7f2ebd381640 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a8859cea10 0x55a8859d0e30 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d1a140dc1ce5c25 server_cookie=c53514a62aec44c2 in_seq=0 out_seq=0 2024-09-19T06:12:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.808+0000 7f2e97fff640 1 -- 172.21.15.103:0/826071567 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f2eb0019040 con 0x55a8859cea10 2024-09-19T06:12:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.808+0000 7f2e97fff640 10 client.25648 handle_command_reply: tid=0 2024-09-19T06:12:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.808+0000 7f2ec1c56740 1 client.25648 shutdown 2024-09-19T06:12:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.810+0000 7f2ec1c56740 1 -- 172.21.15.103:0/826071567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885944410 msgr2=0x55a88595b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.810+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885944410 0x55a88595b5e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4000c00 tx=0x7f2ea4012d10 comp rx=0 tx=0).stop 2024-09-19T06:12:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.811+0000 7f2ec1c56740 1 -- 172.21.15.103:0/826071567 shutdown_connections 2024-09-19T06:12:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.811+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x55a8859cea10 0x55a8859d0e30 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.811+0000 7f2e97fff640 0 client.25648 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.811+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88594ecb0 0x55a885958070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.811+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a885944410 0x55a88595b5e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.811+0000 7f2ec1c56740 1 --2- 172.21.15.103:0/826071567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a885943af0 0x55a88595b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.811+0000 7f2ec1c56740 1 -- 172.21.15.103:0/826071567 >> 172.21.15.103:0/826071567 conn(0x55a885940060 msgr2=0x55a88595e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.811+0000 7f2ec1c56740 1 -- 172.21.15.103:0/826071567 shutdown_connections 2024-09-19T06:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.811+0000 7f2ec1c56740 1 -- 172.21.15.103:0/826071567 wait complete. 2024-09-19T06:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.811+0000 7f2ec1c56740 20 client.25648 trim_cache size 0 max 16384 2024-09-19T06:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:12:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 -- 172.21.15.103:0/2997114534 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2ea80a3460 msgr2=0x7f2ea80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2ea80a3460 0x7f2ea80a5920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0edcc0 tx=0x7f2eac0f6060 comp rx=0 tx=0).stop 2024-09-19T06:12:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 -- 172.21.15.103:0/2997114534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2eb81009b0 msgr2=0x7f2eb81990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2eb81009b0 0x7f2eb81990e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2eac005940 tx=0x7f2eac0042f0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 -- 172.21.15.103:0/2997114534 shutdown_connections 2024-09-19T06:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f2ea80a3460 0x7f2ea80a5920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2eb81069c0 0x7f2eb81a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2eb8101350 0x7f2eb8199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 --2- 172.21.15.103:0/2997114534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2eb81009b0 0x7f2eb81990e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 -- 172.21.15.103:0/2997114534 >> 172.21.15.103:0/2997114534 conn(0x7f2eb8077990 msgr2=0x7f2eb80ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 -- 172.21.15.103:0/2997114534 shutdown_connections 2024-09-19T06:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:32.812+0000 7f2ebede4640 1 -- 172.21.15.103:0/2997114534 wait complete. 2024-09-19T06:12:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:33 smithi174 ceph-mon[34488]: pgmap v159: 97 pgs: 97 active+clean; 162 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 1.43k op/s 2024-09-19T06:12:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:33 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:33 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:33 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:33 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:12:33.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:33 smithi103 ceph-mon[30925]: pgmap v159: 97 pgs: 97 active+clean; 162 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 1.43k op/s 2024-09-19T06:12:33.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:33 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:33.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:33 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:33.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:33 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:33.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:33 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:12:34.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:33 smithi169 ceph-mon[34350]: pgmap v159: 97 pgs: 97 active+clean; 162 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 1.43k op/s 2024-09-19T06:12:34.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:33 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:34.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:33 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:34.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:33 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:34.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:33 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:12:34.463 INFO:tasks.workunit.client.0.smithi103.stdout:fallocating to largest ever: 0x6400000 2024-09-19T06:12:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:35 smithi174 ceph-mon[34488]: pgmap v160: 97 pgs: 97 active+clean; 162 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 4.1 MiB/s wr, 947 op/s 2024-09-19T06:12:35.997 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:35 smithi103 ceph-mon[30925]: pgmap v160: 97 pgs: 97 active+clean; 162 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 4.1 MiB/s wr, 947 op/s 2024-09-19T06:12:36.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:35 smithi169 ceph-mon[34350]: pgmap v160: 97 pgs: 97 active+clean; 162 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 4.1 MiB/s wr, 947 op/s 2024-09-19T06:12:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:37 smithi174 ceph-mon[34488]: pgmap v161: 97 pgs: 97 active+clean; 121 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.2 MiB/s wr, 1.41k op/s 2024-09-19T06:12:37.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:37 smithi103 ceph-mon[30925]: pgmap v161: 97 pgs: 97 active+clean; 121 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.2 MiB/s wr, 1.41k op/s 2024-09-19T06:12:38.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:37 smithi169 ceph-mon[34350]: pgmap v161: 97 pgs: 97 active+clean; 121 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.2 MiB/s wr, 1.41k op/s 2024-09-19T06:12:39.953 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:39 smithi174 ceph-mon[34488]: pgmap v162: 97 pgs: 97 active+clean; 121 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 4.1 MiB/s wr, 927 op/s 2024-09-19T06:12:39.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:39 smithi103 ceph-mon[30925]: pgmap v162: 97 pgs: 97 active+clean; 121 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 4.1 MiB/s wr, 927 op/s 2024-09-19T06:12:40.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:39 smithi169 ceph-mon[34350]: pgmap v162: 97 pgs: 97 active+clean; 121 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 4.1 MiB/s wr, 927 op/s 2024-09-19T06:12:40.409 INFO:tasks.workunit.client.0.smithi103.stdout:40000 falloc from 0x4cbeead to 0x4cc78f9 (0x8a4c bytes) 2024-09-19T06:12:41.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:41 smithi174 ceph-mon[34488]: pgmap v163: 97 pgs: 97 active+clean; 121 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 4.1 MiB/s wr, 927 op/s 2024-09-19T06:12:41.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:41 smithi103 ceph-mon[30925]: pgmap v163: 97 pgs: 97 active+clean; 121 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 4.1 MiB/s wr, 927 op/s 2024-09-19T06:12:42.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:41 smithi169 ceph-mon[34350]: pgmap v163: 97 pgs: 97 active+clean; 121 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 4.1 MiB/s wr, 927 op/s 2024-09-19T06:12:43.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:43 smithi174 ceph-mon[34488]: pgmap v164: 97 pgs: 97 active+clean; 126 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.2 MiB/s wr, 1.40k op/s 2024-09-19T06:12:43.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:43 smithi103 ceph-mon[30925]: pgmap v164: 97 pgs: 97 active+clean; 126 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.2 MiB/s wr, 1.40k op/s 2024-09-19T06:12:44.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:43 smithi169 ceph-mon[34350]: pgmap v164: 97 pgs: 97 active+clean; 126 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.2 MiB/s wr, 1.40k op/s 2024-09-19T06:12:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.920+0000 7fe36202e640 1 -- 172.21.15.103:0/4122800123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe35c1069e0 msgr2=0x7fe35c106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.920+0000 7fe36202e640 1 --2- 172.21.15.103:0/4122800123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe35c1069e0 0x7fe35c106dc0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009930 tx=0x7fe34c02a420 comp rx=0 tx=0).stop 2024-09-19T06:12:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.920+0000 7fe36202e640 1 -- 172.21.15.103:0/4122800123 shutdown_connections 2024-09-19T06:12:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.920+0000 7fe36202e640 1 --2- 172.21.15.103:0/4122800123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe35c101370 0x7fe35c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.920+0000 7fe36202e640 1 --2- 172.21.15.103:0/4122800123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe35c1009d0 0x7fe35c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.920+0000 7fe36202e640 1 --2- 172.21.15.103:0/4122800123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe35c1069e0 0x7fe35c106dc0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.920+0000 7fe36202e640 1 -- 172.21.15.103:0/4122800123 >> 172.21.15.103:0/4122800123 conn(0x7fe35c0fc6b0 msgr2=0x7fe35c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.920+0000 7fe36202e640 1 -- 172.21.15.103:0/4122800123 shutdown_connections 2024-09-19T06:12:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.920+0000 7fe36202e640 1 -- 172.21.15.103:0/4122800123 wait complete. 2024-09-19T06:12:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.921+0000 7fe36202e640 1 Processor -- start 2024-09-19T06:12:45.925 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.921+0000 7fe36202e640 1 -- start start 2024-09-19T06:12:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.921+0000 7fe36202e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe35c1009d0 0x7fe35c199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.921+0000 7fe36202e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe35c101370 0x7fe35c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.921+0000 7fe36202e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe35c1069e0 0x7fe35c1a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.921+0000 7fe36202e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c110d20 con 0x7fe35c1009d0 2024-09-19T06:12:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.921+0000 7fe36202e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c110ba0 con 0x7fe35c1069e0 2024-09-19T06:12:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.921+0000 7fe36202e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c110ea0 con 0x7fe35c101370 2024-09-19T06:12:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe35c1009d0 0x7fe35c199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe35c1009d0 0x7fe35c199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33644/0 (socket says 172.21.15.103:33644) 2024-09-19T06:12:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35b7fe640 1 -- 172.21.15.103:0/2615363983 learned_addr learned my addr 172.21.15.103:0/2615363983 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35bfff640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe35c1069e0 0x7fe35c1a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35affd640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe35c101370 0x7fe35c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35b7fe640 1 -- 172.21.15.103:0/2615363983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe35c101370 msgr2=0x7fe35c199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe35c101370 0x7fe35c199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35b7fe640 1 -- 172.21.15.103:0/2615363983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe35c1069e0 msgr2=0x7fe35c1a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe35c1069e0 0x7fe35c1a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35b7fe640 1 -- 172.21.15.103:0/2615363983 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35c1a46f0 con 0x7fe35c1009d0 2024-09-19T06:12:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe35c1009d0 0x7fe35c199130 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe34c005ab0 tx=0x7fe34c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe358ff9640 1 -- 172.21.15.103:0/2615363983 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c03f070 con 0x7fe35c1009d0 2024-09-19T06:12:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe358ff9640 1 -- 172.21.15.103:0/2615363983 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe34c031b50 con 0x7fe35c1009d0 2024-09-19T06:12:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe36202e640 1 -- 172.21.15.103:0/2615363983 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35c1a48c0 con 0x7fe35c1009d0 2024-09-19T06:12:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe358ff9640 1 -- 172.21.15.103:0/2615363983 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c035030 con 0x7fe35c1009d0 2024-09-19T06:12:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.922+0000 7fe36202e640 1 -- 172.21.15.103:0/2615363983 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35c1a4d20 con 0x7fe35c1009d0 2024-09-19T06:12:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe358ff9640 1 -- 172.21.15.103:0/2615363983 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7fe34c042070 con 0x7fe35c1009d0 2024-09-19T06:12:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe364dca740 1 Processor -- start 2024-09-19T06:12:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe364dca740 1 -- start start 2024-09-19T06:12:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe364dca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x559180116ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe364dca740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x559180121770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe364dca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x5591801240a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe364dca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55918007b2f0 con 0x559180121cb0 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe364dca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559180023270 con 0x559180116af0 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe364dca740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5591800772b0 con 0x559180117410 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe358ff9640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe3440a3460 0x7fe3440a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe35affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x5591801240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.925+0000 7fe35bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x559180116ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x559180116ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:49484/0 (socket says 172.21.15.103:49484) 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35bfff640 1 -- 172.21.15.103:0/323445908 learned_addr learned my addr 172.21.15.103:0/323445908 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35bfff640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe3440a3460 0x7fe3440a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/323445908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x559180121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35bfff640 1 -- 172.21.15.103:0/323445908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 msgr2=0x559180121770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35bfff640 1 --2- 172.21.15.103:0/323445908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x559180121770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35bfff640 1 -- 172.21.15.103:0/323445908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 msgr2=0x5591801240a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35bfff640 1 --2- 172.21.15.103:0/323445908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x5591801240a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35bfff640 1 -- 172.21.15.103:0/323445908 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559180022340 con 0x559180116af0 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe358ff9640 1 -- 172.21.15.103:0/2615363983 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fe34c0f0450 con 0x7fe35c1009d0 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35bfff640 1 --2- 172.21.15.103:0/323445908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x559180116ed0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3540094d0 tx=0x7fe3540107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b38af39400e253b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe35bfff640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe3440a3460 0x7fe3440a5920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe354005c40 tx=0x7fe35401d000 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe341ffb640 1 -- 172.21.15.103:0/323445908 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354012840 con 0x559180116af0 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe341ffb640 1 -- 172.21.15.103:0/323445908 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe354009d60 con 0x559180116af0 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.926+0000 7fe341ffb640 1 -- 172.21.15.103:0/323445908 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35400dda0 con 0x559180116af0 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.927+0000 7fe364dca740 1 -- 172.21.15.103:0/323445908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 msgr2=0x559180116ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.927+0000 7fe364dca740 1 --2- 172.21.15.103:0/323445908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x559180116ed0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3540094d0 tx=0x7fe3540107a0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.927+0000 7fe364dca740 1 -- 172.21.15.103:0/323445908 shutdown_connections 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.927+0000 7fe364dca740 1 --2- 172.21.15.103:0/323445908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x5591801240a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.927+0000 7fe364dca740 1 --2- 172.21.15.103:0/323445908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x559180121770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.927+0000 7fe364dca740 1 --2- 172.21.15.103:0/323445908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x559180116ed0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.927+0000 7fe364dca740 1 -- 172.21.15.103:0/323445908 >> 172.21.15.103:0/323445908 conn(0x559180113060 msgr2=0x559180113440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.927+0000 7fe364dca740 1 -- 172.21.15.103:0/323445908 shutdown_connections 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.927+0000 7fe364dca740 1 -- 172.21.15.103:0/323445908 wait complete. 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe364dca740 1 -- start start 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe364dca740 1 Processor -- start 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe364dca740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180116af0 0x55918011ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe364dca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180117410 0x55918011f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe364dca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918011f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe364dca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559180124880 con 0x559180121cb0 2024-09-19T06:12:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe364dca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559180004290 con 0x559180117410 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe364dca740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559180124a00 con 0x559180116af0 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe35bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918011f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe364dca740 10 client.0 _ll_register_callbacks cb 0x559180035140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe35bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918011f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33664/0 (socket says 172.21.15.103:33664) 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe35bfff640 1 -- 172.21.15.103:0/3804052010 learned_addr learned my addr 172.21.15.103:0/3804052010 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180116af0 0x55918011ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.928+0000 7fe35affd640 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180117410 0x55918011f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe35b7fe640 1 -- 172.21.15.103:0/3804052010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180117410 msgr2=0x55918011f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180117410 0x55918011f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe35b7fe640 1 -- 172.21.15.103:0/3804052010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 msgr2=0x55918011f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918011f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe35b7fe640 1 -- 172.21.15.103:0/3804052010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55917fd8e210 con 0x559180116af0 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe35bfff640 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918011f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180116af0 0x55918011ec50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0edbf0 tx=0x7fe34c08f5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=429f83346240d3f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe33affd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe33affd640 1 -- 172.21.15.103:0/3804052010 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c049070 con 0x559180116af0 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe33affd640 1 -- 172.21.15.103:0/3804052010 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fe34c0b8df0 con 0x559180116af0 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe364dca740 1 -- 172.21.15.103:0/3804052010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559180088a20 con 0x559180116af0 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe33affd640 1 -- 172.21.15.103:0/3804052010 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe34c08b020 con 0x559180116af0 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe364dca740 10 client.25660 fetch_fsmap learned FSMap version 32 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe364dca740 1 -- 172.21.15.103:0/3804052010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55917fe5a620 con 0x559180116af0 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.929+0000 7fe33affd640 1 -- 172.21.15.103:0/3804052010 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x559180088a20 con 0x559180116af0 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.930+0000 7fe33affd640 1 -- 172.21.15.103:0/3804052010 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fe34c0b8040 con 0x559180116af0 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.930+0000 7fe364dca740 10 client.25660 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.930+0000 7fe364dca740 10 client.25660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.930+0000 7fe364dca740 20 client.25660 populate_metadata read hostname 'smithi103' 2024-09-19T06:12:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.930+0000 7fe364dca740 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5591801360b0 0x559180138530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.930+0000 7fe364dca740 4 client.25660 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.930+0000 7fe364dca740 1 -- 172.21.15.103:0/3804052010 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559180082d70 con 0x5591801360b0 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.930+0000 7fe35affd640 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5591801360b0 0x559180138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.930+0000 7fe33affd640 10 client.25660 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.930+0000 7fe35affd640 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5591801360b0 0x559180138530 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85fce547a4703226 server_cookie=608687dabe69bfea in_seq=0 out_seq=0 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe33affd640 1 -- 172.21.15.103:0/3804052010 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559180082d70 con 0x5591801360b0 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe33affd640 10 client.25660 handle_command_reply: tid=0 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 client.25660 shutdown 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 -- 172.21.15.103:0/3804052010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180116af0 msgr2=0x55918011ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180116af0 0x55918011ec50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0edbf0 tx=0x7fe34c08f5b0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 -- 172.21.15.103:0/3804052010 shutdown_connections 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5591801360b0 0x559180138530 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918011f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180117410 0x55918011f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 --2- 172.21.15.103:0/3804052010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180116af0 0x55918011ec50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 -- 172.21.15.103:0/3804052010 >> 172.21.15.103:0/3804052010 conn(0x559180113060 msgr2=0x559180118dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe33affd640 0 client.25660 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 -- 172.21.15.103:0/3804052010 shutdown_connections 2024-09-19T06:12:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 1 -- 172.21.15.103:0/3804052010 wait complete. 2024-09-19T06:12:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.931+0000 7fe364dca740 20 client.25660 trim_cache size 0 max 16384 2024-09-19T06:12:45.958 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:45 smithi174 ceph-mon[34488]: pgmap v165: 97 pgs: 97 active+clean; 126 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 4.2 MiB/s wr, 940 op/s 2024-09-19T06:12:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.951+0000 7fe364dca740 1 Processor -- start 2024-09-19T06:12:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.951+0000 7fe364dca740 1 -- start start 2024-09-19T06:12:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.951+0000 7fe364dca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x55918011f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.951+0000 7fe364dca740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x55918013de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.951+0000 7fe364dca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918013e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.951+0000 7fe364dca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c1adbb0 con 0x559180121cb0 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.951+0000 7fe364dca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c1ab480 con 0x559180116af0 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.951+0000 7fe364dca740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c1a92f0 con 0x559180117410 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918013e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x55918011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918013e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33666/0 (socket says 172.21.15.103:33666) 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35affd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x55918013de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35bfff640 1 -- 172.21.15.103:0/1326868265 learned_addr learned my addr 172.21.15.103:0/1326868265 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/1326868265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x55918011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.103:49490/0 (socket says 172.21.15.103:49490) 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35bfff640 1 -- 172.21.15.103:0/1326868265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 msgr2=0x55918013de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35bfff640 1 --2- 172.21.15.103:0/1326868265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x55918013de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35bfff640 1 -- 172.21.15.103:0/1326868265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 msgr2=0x55918011f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35bfff640 1 --2- 172.21.15.103:0/1326868265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x55918011f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35bfff640 1 -- 172.21.15.103:0/1326868265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55918011fa40 con 0x559180121cb0 2024-09-19T06:12:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/1326868265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x55918011f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35affd640 1 --2- 172.21.15.103:0/1326868265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x55918013de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe35bfff640 1 --2- 172.21.15.103:0/1326868265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918013e380 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe354010ca0 tx=0x7fe354010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21bb08aa75aab6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe3417fa640 1 -- 172.21.15.103:0/1326868265 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354012840 con 0x559180121cb0 2024-09-19T06:12:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe3417fa640 1 -- 172.21.15.103:0/1326868265 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe354003e20 con 0x559180121cb0 2024-09-19T06:12:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.952+0000 7fe3417fa640 1 -- 172.21.15.103:0/1326868265 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35400dea0 con 0x559180121cb0 2024-09-19T06:12:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.953+0000 7fe364dca740 1 -- 172.21.15.103:0/1326868265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 msgr2=0x55918013e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.953+0000 7fe364dca740 1 --2- 172.21.15.103:0/1326868265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918013e380 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe354010ca0 tx=0x7fe354010f70 comp rx=0 tx=0).stop 2024-09-19T06:12:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.953+0000 7fe364dca740 1 -- 172.21.15.103:0/1326868265 shutdown_connections 2024-09-19T06:12:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.953+0000 7fe364dca740 1 --2- 172.21.15.103:0/1326868265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180121cb0 0x55918013e380 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.953+0000 7fe364dca740 1 --2- 172.21.15.103:0/1326868265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x55918013de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.953+0000 7fe364dca740 1 --2- 172.21.15.103:0/1326868265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180116af0 0x55918011f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.953+0000 7fe364dca740 1 -- 172.21.15.103:0/1326868265 >> 172.21.15.103:0/1326868265 conn(0x559180113060 msgr2=0x559180119ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.953+0000 7fe364dca740 1 -- 172.21.15.103:0/1326868265 shutdown_connections 2024-09-19T06:12:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.953+0000 7fe364dca740 1 -- 172.21.15.103:0/1326868265 wait complete. 2024-09-19T06:12:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe364dca740 1 -- start start 2024-09-19T06:12:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe364dca740 1 Processor -- start 2024-09-19T06:12:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe364dca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180116af0 0x559180125020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe364dca740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x559180125560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe364dca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180121cb0 0x55918019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe364dca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c1a9940 con 0x559180116af0 2024-09-19T06:12:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe364dca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c1aadb0 con 0x559180121cb0 2024-09-19T06:12:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe364dca740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c1aa010 con 0x559180117410 2024-09-19T06:12:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe364dca740 10 client.0 _ll_register_callbacks cb 0x7fe34c005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180116af0 0x559180125020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180116af0 0x559180125020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33680/0 (socket says 172.21.15.103:33680) 2024-09-19T06:12:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35affd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x559180125560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35b7fe640 1 -- 172.21.15.103:0/2273933922 learned_addr learned my addr 172.21.15.103:0/2273933922 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35bfff640 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180121cb0 0x55918019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35b7fe640 1 -- 172.21.15.103:0/2273933922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 msgr2=0x559180125560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x559180125560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35b7fe640 1 -- 172.21.15.103:0/2273933922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180121cb0 msgr2=0x55918019ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180121cb0 0x55918019ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35b7fe640 1 -- 172.21.15.103:0/2273933922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55918019f340 con 0x559180116af0 2024-09-19T06:12:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.954+0000 7fe35affd640 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x559180125560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe35b7fe640 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180116af0 0x559180125020 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ee1f0 tx=0x7fe34c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facecb1a51b91890 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe33affd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:12:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe33affd640 1 -- 172.21.15.103:0/2273933922 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c049040 con 0x559180116af0 2024-09-19T06:12:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe33affd640 1 -- 172.21.15.103:0/2273933922 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7fe34c0bc9e0 con 0x559180116af0 2024-09-19T06:12:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe364dca740 1 -- 172.21.15.103:0/2273933922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe354003e20 con 0x559180116af0 2024-09-19T06:12:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe33affd640 1 -- 172.21.15.103:0/2273933922 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe34c0da050 con 0x559180116af0 2024-09-19T06:12:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe364dca740 10 client.16110 fetch_fsmap learned FSMap version 32 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe364dca740 1 -- 172.21.15.103:0/2273933922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5591801a0550 con 0x559180116af0 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe33affd640 1 -- 172.21.15.103:0/2273933922 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe354003e20 con 0x559180116af0 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe33affd640 1 -- 172.21.15.103:0/2273933922 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fe34c0b8040 con 0x559180116af0 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe364dca740 10 client.16110 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe364dca740 10 client.16110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe364dca740 20 client.16110 populate_metadata read hostname 'smithi103' 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe364dca740 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5591801a0ae0 0x5591801a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe364dca740 4 client.16110 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.955+0000 7fe364dca740 1 -- 172.21.15.103:0/2273933922 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55917ffff900 con 0x5591801a0ae0 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.956+0000 7fe35affd640 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5591801a0ae0 0x5591801a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.956+0000 7fe33affd640 10 client.16110 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.956+0000 7fe35affd640 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5591801a0ae0 0x5591801a2ed0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8028608bb54c7aa server_cookie=3d3c0ee86efe0ad1 in_seq=0 out_seq=0 2024-09-19T06:12:45.974 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe33affd640 1 -- 172.21.15.103:0/2273933922 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55917ffff900 con 0x5591801a0ae0 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe33affd640 10 client.16110 handle_command_reply: tid=0 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 client.16110 shutdown 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 -- 172.21.15.103:0/2273933922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180116af0 msgr2=0x559180125020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180116af0 0x559180125020 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ee1f0 tx=0x7fe34c02a420 comp rx=0 tx=0).stop 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 -- 172.21.15.103:0/2273933922 shutdown_connections 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x5591801a0ae0 0x5591801a2ed0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559180121cb0 0x55918019ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe33affd640 0 client.16110 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559180117410 0x559180125560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 --2- 172.21.15.103:0/2273933922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559180116af0 0x559180125020 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 -- 172.21.15.103:0/2273933922 >> 172.21.15.103:0/2273933922 conn(0x559180113060 msgr2=0x5591801119a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 -- 172.21.15.103:0/2273933922 shutdown_connections 2024-09-19T06:12:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 1 -- 172.21.15.103:0/2273933922 wait complete. 2024-09-19T06:12:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.973+0000 7fe364dca740 20 client.16110 trim_cache size 0 max 16384 2024-09-19T06:12:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:12:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:12:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:12:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:12:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 -- 172.21.15.103:0/2615363983 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe3440a3460 msgr2=0x7fe3440a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe3440a3460 0x7fe3440a5920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe354005c40 tx=0x7fe35401d000 comp rx=0 tx=0).stop 2024-09-19T06:12:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 -- 172.21.15.103:0/2615363983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe35c1009d0 msgr2=0x7fe35c199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe35c1009d0 0x7fe35c199130 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe34c005ab0 tx=0x7fe34c003b90 comp rx=0 tx=0).stop 2024-09-19T06:12:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 -- 172.21.15.103:0/2615363983 shutdown_connections 2024-09-19T06:12:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fe3440a3460 0x7fe3440a5920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe35c1069e0 0x7fe35c1a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe35c101370 0x7fe35c199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 --2- 172.21.15.103:0/2615363983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe35c1009d0 0x7fe35c199130 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 -- 172.21.15.103:0/2615363983 >> 172.21.15.103:0/2615363983 conn(0x7fe35c0fc6b0 msgr2=0x7fe35c0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 -- 172.21.15.103:0/2615363983 shutdown_connections 2024-09-19T06:12:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:45.974+0000 7fe36202e640 1 -- 172.21.15.103:0/2615363983 wait complete. 2024-09-19T06:12:45.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:45 smithi103 ceph-mon[30925]: pgmap v165: 97 pgs: 97 active+clean; 126 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 4.2 MiB/s wr, 940 op/s 2024-09-19T06:12:46.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:45 smithi169 ceph-mon[34350]: pgmap v165: 97 pgs: 97 active+clean; 126 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 4.2 MiB/s wr, 940 op/s 2024-09-19T06:12:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:47 smithi174 ceph-mon[34488]: pgmap v166: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.3 MiB/s wr, 1.40k op/s 2024-09-19T06:12:47.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:47 smithi103 ceph-mon[30925]: pgmap v166: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.3 MiB/s wr, 1.40k op/s 2024-09-19T06:12:48.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:47 smithi169 ceph-mon[34350]: pgmap v166: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.3 MiB/s wr, 1.40k op/s 2024-09-19T06:12:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:49 smithi174 ceph-mon[34488]: pgmap v167: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 4.2 MiB/s wr, 940 op/s 2024-09-19T06:12:49.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:49 smithi103 ceph-mon[30925]: pgmap v167: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 4.2 MiB/s wr, 940 op/s 2024-09-19T06:12:50.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:49 smithi169 ceph-mon[34350]: pgmap v167: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 4.2 MiB/s wr, 940 op/s 2024-09-19T06:12:51.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:51 smithi174 ceph-mon[34488]: pgmap v168: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 4.2 MiB/s wr, 940 op/s 2024-09-19T06:12:51.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:51 smithi103 ceph-mon[30925]: pgmap v168: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 4.2 MiB/s wr, 940 op/s 2024-09-19T06:12:52.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:51 smithi169 ceph-mon[34350]: pgmap v168: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 4.2 MiB/s wr, 940 op/s 2024-09-19T06:12:52.875 INFO:tasks.workunit.client.0.smithi103.stdout:All 50000 operations completed A-OK! 2024-09-19T06:12:52.878 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T06:12:52.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T06:12:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:53 smithi174 ceph-mon[34488]: pgmap v169: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.2 MiB/s wr, 1.39k op/s 2024-09-19T06:12:53.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:53 smithi103 ceph-mon[30925]: pgmap v169: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.2 MiB/s wr, 1.39k op/s 2024-09-19T06:12:54.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:53 smithi169 ceph-mon[34350]: pgmap v169: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 6.2 MiB/s wr, 1.39k op/s 2024-09-19T06:12:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:55 smithi174 ceph-mon[34488]: pgmap v170: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 4.1 MiB/s wr, 910 op/s 2024-09-19T06:12:55.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:55 smithi103 ceph-mon[30925]: pgmap v170: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 4.1 MiB/s wr, 910 op/s 2024-09-19T06:12:56.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:55 smithi169 ceph-mon[34350]: pgmap v170: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 4.1 MiB/s wr, 910 op/s 2024-09-19T06:12:56.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:56 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:12:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:56 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:12:57.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:56 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:12:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:57 smithi174 ceph-mon[34488]: pgmap v171: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 5.3 MiB/s wr, 1.11k op/s 2024-09-19T06:12:57.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:57 smithi103 ceph-mon[30925]: pgmap v171: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 5.3 MiB/s wr, 1.11k op/s 2024-09-19T06:12:58.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:57 smithi169 ceph-mon[34350]: pgmap v171: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 5.3 MiB/s wr, 1.11k op/s 2024-09-19T06:12:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.064+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3626123516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a401048e0 msgr2=0x7f8a40108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.064+0000 7f8a45fe4640 1 --2- 172.21.15.103:0/3626123516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a401048e0 0x7f8a40108920 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009900 tx=0x7f8a3402a410 comp rx=0 tx=0).stop 2024-09-19T06:12:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.064+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3626123516 shutdown_connections 2024-09-19T06:12:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.064+0000 7f8a45fe4640 1 --2- 172.21.15.103:0/3626123516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a40109080 0x7f8a40110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.064+0000 7f8a45fe4640 1 --2- 172.21.15.103:0/3626123516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a401048e0 0x7f8a40108920 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.064+0000 7f8a45fe4640 1 --2- 172.21.15.103:0/3626123516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a40103f30 0x7f8a40104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.064+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3626123516 >> 172.21.15.103:0/3626123516 conn(0x7f8a400ff980 msgr2=0x7f8a40101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.064+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3626123516 shutdown_connections 2024-09-19T06:12:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.064+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3626123516 wait complete. 2024-09-19T06:12:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a45fe4640 1 Processor -- start 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a45fe4640 1 -- start start 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a45fe4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a40103f30 0x7f8a4019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a45fe4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a40109080 0x7f8a4019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a45fe4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a4019eda0 0x7f8a4019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a45fe4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40113f30 con 0x7f8a40109080 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a45fe4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40113db0 con 0x7f8a40103f30 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a45fe4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8a401140b0 con 0x7f8a4019eda0 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a3effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a40109080 0x7f8a4019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a3effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a40109080 0x7f8a4019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59508/0 (socket says 172.21.15.103:59508) 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a3effd640 1 -- 172.21.15.103:0/3519837939 learned_addr learned my addr 172.21.15.103:0/3519837939 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.065+0000 7f8a3ffff640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a4019eda0 0x7f8a4019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a3f7fe640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a40103f30 0x7f8a4019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a3effd640 1 -- 172.21.15.103:0/3519837939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a4019eda0 msgr2=0x7f8a4019f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a3effd640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a4019eda0 0x7f8a4019f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a3effd640 1 -- 172.21.15.103:0/3519837939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a40103f30 msgr2=0x7f8a4019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a3effd640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a40103f30 0x7f8a4019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a3effd640 1 -- 172.21.15.103:0/3519837939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4019f890 con 0x7f8a40109080 2024-09-19T06:12:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a3effd640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a40109080 0x7f8a4019aa20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8a34004270 tx=0x7f8a340042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a3cff9640 1 -- 172.21.15.103:0/3519837939 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3403f030 con 0x7f8a40109080 2024-09-19T06:12:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3519837939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4019fb20 con 0x7f8a40109080 2024-09-19T06:12:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a3cff9640 1 -- 172.21.15.103:0/3519837939 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a340044c0 con 0x7f8a40109080 2024-09-19T06:12:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a3cff9640 1 -- 172.21.15.103:0/3519837939 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34035070 con 0x7f8a40109080 2024-09-19T06:12:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.066+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3519837939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a401a7340 con 0x7f8a40109080 2024-09-19T06:12:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a48e56740 1 Processor -- start 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a48e56740 1 -- start start 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3cff9640 1 -- 172.21.15.103:0/3519837939 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f8a34042030 con 0x7f8a40109080 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab246ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab2477770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 0x562ab247a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a48e56740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562ab23d12f0 con 0x562ab246d410 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a48e56740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ab2379270 con 0x562ab2477cb0 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a48e56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562ab23cd2b0 con 0x562ab246caf0 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab2477770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab246ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab2477770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59514/0 (socket says 172.21.15.103:59514) 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3f7fe640 1 -- 172.21.15.103:0/1914427096 learned_addr learned my addr 172.21.15.103:0/1914427096 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3effd640 1 --2- 172.21.15.103:0/1914427096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 0x562ab247a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3ffff640 1 -- 172.21.15.103:0/1914427096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 msgr2=0x562ab247a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3ffff640 1 --2- 172.21.15.103:0/1914427096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 0x562ab247a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3ffff640 1 -- 172.21.15.103:0/1914427096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 msgr2=0x562ab2477770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3ffff640 1 --2- 172.21.15.103:0/1914427096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab2477770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3ffff640 1 -- 172.21.15.103:0/1914427096 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab2378340 con 0x562ab246caf0 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.069+0000 7f8a3f7fe640 1 --2- 172.21.15.103:0/1914427096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab2477770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.070+0000 7f8a3cff9640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8a280a3460 0x7f8a280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.070+0000 7f8a3ffff640 1 --2- 172.21.15.103:0/1914427096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab246ced0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009eb0 tx=0x7f8a380107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b03e36fa4820d5e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.070+0000 7f8a3f7fe640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8a280a3460 0x7f8a280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.070+0000 7f8a3cff9640 1 -- 172.21.15.103:0/3519837939 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f8a340f01f0 con 0x7f8a40109080 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.070+0000 7f8a25ffb640 1 -- 172.21.15.103:0/1914427096 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38003b70 con 0x562ab246caf0 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.070+0000 7f8a25ffb640 1 -- 172.21.15.103:0/1914427096 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a38015070 con 0x562ab246caf0 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.070+0000 7f8a25ffb640 1 -- 172.21.15.103:0/1914427096 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3801a760 con 0x562ab246caf0 2024-09-19T06:12:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a48e56740 1 -- 172.21.15.103:0/1914427096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 msgr2=0x562ab246ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a3f7fe640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8a280a3460 0x7f8a280a5920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x562ab2469ec0 tx=0x7f8a3000d5a0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a48e56740 1 --2- 172.21.15.103:0/1914427096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab246ced0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009eb0 tx=0x7f8a380107a0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a48e56740 1 -- 172.21.15.103:0/1914427096 shutdown_connections 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a48e56740 1 --2- 172.21.15.103:0/1914427096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 0x562ab247a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a48e56740 1 --2- 172.21.15.103:0/1914427096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab2477770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a48e56740 1 --2- 172.21.15.103:0/1914427096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab246ced0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a48e56740 1 -- 172.21.15.103:0/1914427096 >> 172.21.15.103:0/1914427096 conn(0x562ab2469060 msgr2=0x562ab2469440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a48e56740 1 -- 172.21.15.103:0/1914427096 shutdown_connections 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a48e56740 1 -- 172.21.15.103:0/1914427096 wait complete. 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.071+0000 7f8a48e56740 1 -- start start 2024-09-19T06:12:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a48e56740 1 Processor -- start 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab2474be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 0x562ab2475120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2475660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a48e56740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562ab247a880 con 0x562ab2477cb0 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a48e56740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ab235a290 con 0x562ab246d410 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a48e56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562ab247aa00 con 0x562ab246caf0 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a48e56740 10 client.0 _ll_register_callbacks cb 0x562ab238b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab2474be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2475660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab2474be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:51094/0 (socket says 172.21.15.103:51094) 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2475660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59522/0 (socket says 172.21.15.103:59522) 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3f7fe640 1 -- 172.21.15.103:0/2535686765 learned_addr learned my addr 172.21.15.103:0/2535686765 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3effd640 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 0x562ab2475120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3f7fe640 1 -- 172.21.15.103:0/2535686765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 msgr2=0x562ab2475120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3f7fe640 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 0x562ab2475120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3f7fe640 1 -- 172.21.15.103:0/2535686765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 msgr2=0x562ab2475660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3f7fe640 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2475660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3f7fe640 1 -- 172.21.15.103:0/2535686765 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab20e4210 con 0x562ab246caf0 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.072+0000 7f8a3ffff640 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2475660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.073+0000 7f8a3f7fe640 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab2474be0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8a300043f0 tx=0x7f8a300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0996395aa4f9fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.073+0000 7f8a1effd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.073+0000 7f8a1effd640 1 -- 172.21.15.103:0/2535686765 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a300108a0 con 0x562ab246caf0 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.073+0000 7f8a48e56740 1 -- 172.21.15.103:0/2535686765 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a38015070 con 0x562ab246caf0 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.073+0000 7f8a1effd640 1 -- 172.21.15.103:0/2535686765 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f8a30010a40 con 0x562ab246caf0 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.073+0000 7f8a1effd640 1 -- 172.21.15.103:0/2535686765 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8a30010c40 con 0x562ab246caf0 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.073+0000 7f8a48e56740 10 client.25678 fetch_fsmap learned FSMap version 33 2024-09-19T06:12:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.073+0000 7f8a48e56740 1 -- 172.21.15.103:0/2535686765 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562ab21b0620 con 0x562ab246caf0 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.073+0000 7f8a1effd640 1 -- 172.21.15.103:0/2535686765 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a38015070 con 0x562ab246caf0 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.074+0000 7f8a1effd640 1 -- 172.21.15.103:0/2535686765 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f8a3001f420 con 0x562ab246caf0 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.074+0000 7f8a48e56740 10 client.25678 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.074+0000 7f8a48e56740 10 client.25678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.074+0000 7f8a48e56740 20 client.25678 populate_metadata read hostname 'smithi103' 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.074+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562ab2487ca0 0x562ab248a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.074+0000 7f8a48e56740 4 client.25678 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.074+0000 7f8a48e56740 1 -- 172.21.15.103:0/2535686765 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ab23dea20 con 0x562ab2487ca0 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.074+0000 7f8a3effd640 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562ab2487ca0 0x562ab248a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.074+0000 7f8a1effd640 10 client.25678 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.074+0000 7f8a3effd640 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562ab2487ca0 0x562ab248a090 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30d46335cc2a04ff server_cookie=691cefa7b101b0fb in_seq=0 out_seq=0 2024-09-19T06:12:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a1effd640 1 -- 172.21.15.103:0/2535686765 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ab23dea20 con 0x562ab2487ca0 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a1effd640 10 client.25678 handle_command_reply: tid=0 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 client.25678 shutdown 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 -- 172.21.15.103:0/2535686765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 msgr2=0x562ab2474be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab2474be0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8a300043f0 tx=0x7f8a300046c0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 -- 172.21.15.103:0/2535686765 shutdown_connections 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562ab2487ca0 0x562ab248a090 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2475660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a1effd640 0 client.25678 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 0x562ab2475120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2535686765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab2474be0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 -- 172.21.15.103:0/2535686765 >> 172.21.15.103:0/2535686765 conn(0x562ab2469060 msgr2=0x562ab246edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 -- 172.21.15.103:0/2535686765 shutdown_connections 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.075+0000 7f8a48e56740 1 -- 172.21.15.103:0/2535686765 wait complete. 2024-09-19T06:12:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.076+0000 7f8a48e56740 20 client.25678 trim_cache size 0 max 16384 2024-09-19T06:12:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a48e56740 1 Processor -- start 2024-09-19T06:12:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a48e56740 1 -- start start 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab246f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab24754f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 0x562ab248f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a48e56740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8a401b2150 con 0x562ab246d410 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a48e56740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a401afa20 con 0x562ab2477cb0 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a48e56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8a401ad890 con 0x562ab246caf0 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab24754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab24754f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59534/0 (socket says 172.21.15.103:59534) 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3effd640 1 -- 172.21.15.103:0/3836888720 learned_addr learned my addr 172.21.15.103:0/3836888720 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3f7fe640 1 --2- 172.21.15.103:0/3836888720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab246f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3ffff640 1 --2- 172.21.15.103:0/3836888720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 0x562ab248f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3effd640 1 -- 172.21.15.103:0/3836888720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 msgr2=0x562ab246f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3effd640 1 --2- 172.21.15.103:0/3836888720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab246f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3effd640 1 -- 172.21.15.103:0/3836888720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 msgr2=0x562ab248f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3effd640 1 --2- 172.21.15.103:0/3836888720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 0x562ab248f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3effd640 1 -- 172.21.15.103:0/3836888720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab2486890 con 0x562ab246d410 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3ffff640 1 --2- 172.21.15.103:0/3836888720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 0x562ab248f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a3effd640 1 --2- 172.21.15.103:0/3836888720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab24754f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8a340ed9f0 tx=0x7f8a340f3d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4eb98935b4148c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.090+0000 7f8a257fa640 1 -- 172.21.15.103:0/3836888720 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34049040 con 0x562ab246d410 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a257fa640 1 -- 172.21.15.103:0/3836888720 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a340bcc20 con 0x562ab246d410 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a257fa640 1 -- 172.21.15.103:0/3836888720 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340c08d0 con 0x562ab246d410 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a48e56740 1 -- 172.21.15.103:0/3836888720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 msgr2=0x562ab24754f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a48e56740 1 --2- 172.21.15.103:0/3836888720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab24754f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8a340ed9f0 tx=0x7f8a340f3d40 comp rx=0 tx=0).stop 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a48e56740 1 -- 172.21.15.103:0/3836888720 shutdown_connections 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a48e56740 1 --2- 172.21.15.103:0/3836888720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab2477cb0 0x562ab248f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a48e56740 1 --2- 172.21.15.103:0/3836888720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab246d410 0x562ab24754f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a48e56740 1 --2- 172.21.15.103:0/3836888720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab246f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a48e56740 1 -- 172.21.15.103:0/3836888720 >> 172.21.15.103:0/3836888720 conn(0x562ab2469060 msgr2=0x562ab2476c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a48e56740 1 -- 172.21.15.103:0/3836888720 shutdown_connections 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a48e56740 1 -- 172.21.15.103:0/3836888720 wait complete. 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.091+0000 7f8a48e56740 1 -- start start 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a48e56740 1 Processor -- start 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab2471c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 0x562ab2472140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a48e56740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2472680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a48e56740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8a401adee0 con 0x562ab2477cb0 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a48e56740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a401af350 con 0x562ab246d410 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a48e56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8a401ae5b0 con 0x562ab246caf0 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a48e56740 10 client.0 _ll_register_callbacks cb 0x7f8a3000d980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a3ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2472680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a3ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2472680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59538/0 (socket says 172.21.15.103:59538) 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a3ffff640 1 -- 172.21.15.103:0/2556429148 learned_addr learned my addr 172.21.15.103:0/2556429148 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a3f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab2471c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a3effd640 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 0x562ab2472140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a3ffff640 1 -- 172.21.15.103:0/2556429148 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 msgr2=0x562ab2471c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a3ffff640 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab2471c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a3ffff640 1 -- 172.21.15.103:0/2556429148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 msgr2=0x562ab2472140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a3ffff640 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 0x562ab2472140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.092+0000 7f8a3ffff640 1 -- 172.21.15.103:0/2556429148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab2469cf0 con 0x562ab2477cb0 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a3effd640 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 0x562ab2472140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a3ffff640 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2472680 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8a38005cc0 tx=0x7f8a38009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98db0f04483549b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a1effd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T06:12:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a1effd640 1 -- 172.21.15.103:0/2556429148 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38004520 con 0x562ab2477cb0 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a1effd640 1 -- 172.21.15.103:0/2556429148 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8440+0+0 (secure 0 0 0) 0x7f8a380046c0 con 0x562ab2477cb0 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a48e56740 1 -- 172.21.15.103:0/2556429148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a340bcc20 con 0x562ab2477cb0 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a1effd640 1 -- 172.21.15.103:0/2556429148 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8a38004990 con 0x562ab2477cb0 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a48e56740 10 client.16128 fetch_fsmap learned FSMap version 33 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a48e56740 1 -- 172.21.15.103:0/2556429148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562ab24f29a0 con 0x562ab2477cb0 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a1effd640 1 -- 172.21.15.103:0/2556429148 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a340bcc20 con 0x562ab2477cb0 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a1effd640 1 -- 172.21.15.103:0/2556429148 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f8a3801a470 con 0x562ab2477cb0 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a48e56740 10 client.16128 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a48e56740 10 client.16128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a48e56740 20 client.16128 populate_metadata read hostname 'smithi103' 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.093+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562ab24f2e40 0x562ab24f5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.094+0000 7f8a48e56740 4 client.16128 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.094+0000 7f8a48e56740 1 -- 172.21.15.103:0/2556429148 --> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ab23d8d70 con 0x562ab24f2e40 2024-09-19T06:12:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.094+0000 7f8a3f7fe640 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562ab24f2e40 0x562ab24f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.094+0000 7f8a3f7fe640 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562ab24f2e40 0x562ab24f5260 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9da97ced4e23eca server_cookie=2c7fe82850c68627 in_seq=0 out_seq=0 2024-09-19T06:12:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.094+0000 7f8a1effd640 10 client.16128 ms_handle_connect on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.122+0000 7f8a1effd640 1 -- 172.21.15.103:0/2556429148 <== mds.0 v2:172.21.15.169:6838/3987841064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562ab23d8d70 con 0x562ab24f2e40 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.122+0000 7f8a1effd640 10 client.16128 handle_command_reply: tid=0 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.122+0000 7f8a48e56740 1 client.16128 shutdown 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 1 -- 172.21.15.103:0/2556429148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 msgr2=0x562ab2472680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2472680 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8a38005cc0 tx=0x7f8a38009c30 comp rx=0 tx=0).stop 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 1 -- 172.21.15.103:0/2556429148 shutdown_connections 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.169:6838/3987841064,v1:172.21.15.169:6839/3987841064] conn(0x562ab24f2e40 0x562ab24f5260 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ab2477cb0 0x562ab2472680 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a1effd640 0 client.16128 ms_handle_reset on v2:172.21.15.169:6838/3987841064 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ab246d410 0x562ab2472140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 1 --2- 172.21.15.103:0/2556429148 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ab246caf0 0x562ab2471c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 1 -- 172.21.15.103:0/2556429148 >> 172.21.15.103:0/2556429148 conn(0x562ab2469060 msgr2=0x562ab2476c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 1 -- 172.21.15.103:0/2556429148 shutdown_connections 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 1 -- 172.21.15.103:0/2556429148 wait complete. 2024-09-19T06:12:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a48e56740 20 client.16128 trim_cache size 0 max 16384 2024-09-19T06:12:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-19T06:12:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-19T06:12:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-19T06:12:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-19T06:12:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3519837939 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8a280a3460 msgr2=0x7f8a280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a45fe4640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8a280a3460 0x7f8a280a5920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x562ab2469ec0 tx=0x7f8a3000d5a0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3519837939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a40109080 msgr2=0x7f8a4019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a45fe4640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a40109080 0x7f8a4019aa20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8a34004270 tx=0x7f8a340042a0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3519837939 shutdown_connections 2024-09-19T06:12:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a45fe4640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8a280a3460 0x7f8a280a5920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a45fe4640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a4019eda0 0x7f8a4019f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a45fe4640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a40109080 0x7f8a4019aa20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.123+0000 7f8a45fe4640 1 --2- 172.21.15.103:0/3519837939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a40103f30 0x7f8a4019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.124+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3519837939 >> 172.21.15.103:0/3519837939 conn(0x7f8a400ff980 msgr2=0x7f8a40100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.124+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3519837939 shutdown_connections 2024-09-19T06:12:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-19T06:12:59.124+0000 7f8a45fe4640 1 -- 172.21.15.103:0/3519837939 wait complete. 2024-09-19T06:12:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:12:59 smithi174 ceph-mon[34488]: pgmap v172: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.2 MiB/s wr, 645 op/s 2024-09-19T06:12:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:12:59 smithi103 ceph-mon[30925]: pgmap v172: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.2 MiB/s wr, 645 op/s 2024-09-19T06:13:00.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:12:59 smithi169 ceph-mon[34350]: pgmap v172: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.2 MiB/s wr, 645 op/s 2024-09-19T06:13:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:01 smithi174 ceph-mon[34488]: pgmap v173: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.2 MiB/s wr, 645 op/s 2024-09-19T06:13:01.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:01 smithi103 ceph-mon[30925]: pgmap v173: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.2 MiB/s wr, 645 op/s 2024-09-19T06:13:02.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:01 smithi169 ceph-mon[34350]: pgmap v173: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.2 MiB/s wr, 645 op/s 2024-09-19T06:13:02.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:02 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:02.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:02 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:03.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:02 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:03 smithi174 ceph-mon[34488]: pgmap v174: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 4.1 MiB/s wr, 752 op/s 2024-09-19T06:13:03.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:03 smithi103 ceph-mon[30925]: pgmap v174: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 4.1 MiB/s wr, 752 op/s 2024-09-19T06:13:04.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:03 smithi169 ceph-mon[34350]: pgmap v174: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 4.1 MiB/s wr, 752 op/s 2024-09-19T06:13:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:05 smithi174 ceph-mon[34488]: pgmap v175: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 305 op/s 2024-09-19T06:13:05.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:05 smithi103 ceph-mon[30925]: pgmap v175: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 305 op/s 2024-09-19T06:13:06.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:05 smithi169 ceph-mon[34350]: pgmap v175: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 305 op/s 2024-09-19T06:13:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:07 smithi174 ceph-mon[34488]: pgmap v176: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 517 op/s 2024-09-19T06:13:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:07 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:07.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:07 smithi103 ceph-mon[30925]: pgmap v176: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 517 op/s 2024-09-19T06:13:07.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:07 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:08.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:07 smithi169 ceph-mon[34350]: pgmap v176: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 517 op/s 2024-09-19T06:13:08.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:07 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:09.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:09 smithi174 ceph-mon[34488]: pgmap v177: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 318 op/s 2024-09-19T06:13:09.988 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:09 smithi103 ceph-mon[30925]: pgmap v177: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 318 op/s 2024-09-19T06:13:09.989 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-09-19T06:13:09.989 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T06:13:10.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:09 smithi169 ceph-mon[34350]: pgmap v177: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 318 op/s 2024-09-19T06:13:10.318 DEBUG:teuthology.parallel:result is None 2024-09-19T06:13:10.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:13:10.350 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:13:10.351 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T06:13:10.368 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T06:13:10.399 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T06:13:10.415 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T06:13:10.415 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:13:10.415 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T06:13:10.415 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T06:13:10.466 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T06:13:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:11 smithi174 ceph-mon[34488]: pgmap v178: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 318 op/s 2024-09-19T06:13:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:11 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:11 smithi103 ceph-mon[30925]: pgmap v178: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 318 op/s 2024-09-19T06:13:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:11 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:12.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:11 smithi169 ceph-mon[34350]: pgmap v178: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 318 op/s 2024-09-19T06:13:12.029 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:11 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:13.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:13 smithi174 ceph-mon[34488]: pgmap v179: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 460 op/s 2024-09-19T06:13:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:13 smithi103 ceph-mon[30925]: pgmap v179: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 460 op/s 2024-09-19T06:13:14.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:13 smithi169 ceph-mon[34350]: pgmap v179: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 460 op/s 2024-09-19T06:13:15.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:15 smithi174 ceph-mon[34488]: pgmap v180: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 353 op/s 2024-09-19T06:13:15.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:15 smithi103 ceph-mon[30925]: pgmap v180: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 353 op/s 2024-09-19T06:13:16.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:15 smithi169 ceph-mon[34350]: pgmap v180: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 353 op/s 2024-09-19T06:13:16.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:16 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:16.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:16 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:17.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:16 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:17.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:17 smithi174 ceph-mon[34488]: pgmap v181: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 369 op/s 2024-09-19T06:13:17.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:17 smithi103 ceph-mon[30925]: pgmap v181: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 369 op/s 2024-09-19T06:13:18.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:17 smithi169 ceph-mon[34350]: pgmap v181: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 369 op/s 2024-09-19T06:13:19.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:19 smithi174 ceph-mon[34488]: pgmap v182: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 727 KiB/s wr, 157 op/s 2024-09-19T06:13:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:19 smithi103 ceph-mon[30925]: pgmap v182: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 727 KiB/s wr, 157 op/s 2024-09-19T06:13:20.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:19 smithi169 ceph-mon[34350]: pgmap v182: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 727 KiB/s wr, 157 op/s 2024-09-19T06:13:21.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:20 smithi169 ceph-mon[34350]: pgmap v183: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 727 KiB/s wr, 157 op/s 2024-09-19T06:13:21.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:20 smithi174 ceph-mon[34488]: pgmap v183: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 727 KiB/s wr, 157 op/s 2024-09-19T06:13:21.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:20 smithi103 ceph-mon[30925]: pgmap v183: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 727 KiB/s wr, 157 op/s 2024-09-19T06:13:23.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:22 smithi174 ceph-mon[34488]: pgmap v184: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 739 KiB/s wr, 162 op/s 2024-09-19T06:13:23.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:22 smithi103 ceph-mon[30925]: pgmap v184: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 739 KiB/s wr, 162 op/s 2024-09-19T06:13:23.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:22 smithi169 ceph-mon[34350]: pgmap v184: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 739 KiB/s wr, 162 op/s 2024-09-19T06:13:25.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:24 smithi174 ceph-mon[34488]: pgmap v185: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:13:25.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:24 smithi103 ceph-mon[30925]: pgmap v185: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:13:25.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:24 smithi169 ceph-mon[34350]: pgmap v185: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:13:27.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:26 smithi174 ceph-mon[34488]: pgmap v186: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T06:13:27.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:26 smithi103 ceph-mon[30925]: pgmap v186: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T06:13:27.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:26 smithi169 ceph-mon[34350]: pgmap v186: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T06:13:29.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:28 smithi174 ceph-mon[34488]: pgmap v187: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T06:13:29.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:28 smithi103 ceph-mon[30925]: pgmap v187: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T06:13:29.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:28 smithi169 ceph-mon[34350]: pgmap v187: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T06:13:31.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:30 smithi174 ceph-mon[34488]: pgmap v188: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T06:13:31.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:30 smithi103 ceph-mon[30925]: pgmap v188: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T06:13:31.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:30 smithi169 ceph-mon[34350]: pgmap v188: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T06:13:33.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:32 smithi174 ceph-mon[34488]: pgmap v189: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-19T06:13:33.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:32 smithi103 ceph-mon[30925]: pgmap v189: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-19T06:13:33.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:32 smithi169 ceph-mon[34350]: pgmap v189: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-19T06:13:34.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:33 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:13:34.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:33 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:13:34.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:33 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:13:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:34 smithi174 ceph-mon[34488]: pgmap v190: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-19T06:13:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:34 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:13:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:34 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:13:35.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:34 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:13:35.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:34 smithi103 ceph-mon[30925]: pgmap v190: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-19T06:13:35.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:34 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:13:35.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:34 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:13:35.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:34 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:13:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:34 smithi169 ceph-mon[34350]: pgmap v190: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-19T06:13:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:34 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:13:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:34 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:13:35.278 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:34 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:13:37.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:36 smithi174 ceph-mon[34488]: pgmap v191: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T06:13:37.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:36 smithi103 ceph-mon[30925]: pgmap v191: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T06:13:37.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:36 smithi169 ceph-mon[34350]: pgmap v191: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T06:13:39.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:38 smithi174 ceph-mon[34488]: pgmap v192: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T06:13:39.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:38 smithi103 ceph-mon[30925]: pgmap v192: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T06:13:39.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:38 smithi169 ceph-mon[34350]: pgmap v192: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T06:13:41.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:40 smithi174 ceph-mon[34488]: pgmap v193: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T06:13:41.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:40 smithi103 ceph-mon[30925]: pgmap v193: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T06:13:41.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:40 smithi169 ceph-mon[34350]: pgmap v193: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T06:13:43.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:42 smithi174 ceph-mon[34488]: pgmap v194: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T06:13:43.243 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:42 smithi103 ceph-mon[30925]: pgmap v194: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T06:13:43.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:42 smithi169 ceph-mon[34350]: pgmap v194: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T06:13:45.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:44 smithi174 ceph-mon[34488]: pgmap v195: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:13:45.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:44 smithi103 ceph-mon[30925]: pgmap v195: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:13:45.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:44 smithi169 ceph-mon[34350]: pgmap v195: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:13:47.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:46 smithi174 ceph-mon[34488]: pgmap v196: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:13:47.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:46 smithi103 ceph-mon[30925]: pgmap v196: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:13:47.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:46 smithi169 ceph-mon[34350]: pgmap v196: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:13:49.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:48 smithi174 ceph-mon[34488]: pgmap v197: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:13:49.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:48 smithi103 ceph-mon[30925]: pgmap v197: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:13:49.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:48 smithi169 ceph-mon[34350]: pgmap v197: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:13:51.208 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:50 smithi174 ceph-mon[34488]: pgmap v198: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:13:51.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:50 smithi103 ceph-mon[30925]: pgmap v198: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:13:51.279 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:50 smithi169 ceph-mon[34350]: pgmap v198: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:13:53.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:52 smithi174 ceph-mon[34488]: pgmap v199: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:13:53.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:52 smithi103 ceph-mon[30925]: pgmap v199: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:13:53.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:52 smithi169 ceph-mon[34350]: pgmap v199: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:13:55.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:54 smithi174 ceph-mon[34488]: pgmap v200: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:13:55.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:54 smithi103 ceph-mon[30925]: pgmap v200: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:13:55.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:54 smithi169 ceph-mon[34350]: pgmap v200: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:13:57.204 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:56 smithi174 ceph-mon[34488]: pgmap v201: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:13:57.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:56 smithi103 ceph-mon[30925]: pgmap v201: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:13:57.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:56 smithi169 ceph-mon[34350]: pgmap v201: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:13:59.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:13:58 smithi103 ceph-mon[30925]: pgmap v202: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:13:59.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:13:58 smithi169 ceph-mon[34350]: pgmap v202: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:13:59.454 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:13:58 smithi174 ceph-mon[34488]: pgmap v202: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:01.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:01 smithi174 ceph-mon[34488]: pgmap v203: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:01.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:01 smithi103 ceph-mon[30925]: pgmap v203: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:01.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:01 smithi169 ceph-mon[34350]: pgmap v203: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:03.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:03 smithi174 ceph-mon[34488]: pgmap v204: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:14:03.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:03 smithi103 ceph-mon[30925]: pgmap v204: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:14:03.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:03 smithi169 ceph-mon[34350]: pgmap v204: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:14:05.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:05 smithi174 ceph-mon[34488]: pgmap v205: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:14:05.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:05 smithi103 ceph-mon[30925]: pgmap v205: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:14:05.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:05 smithi169 ceph-mon[34350]: pgmap v205: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:14:07.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:07 smithi174 ceph-mon[34488]: pgmap v206: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:14:07.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:07 smithi103 ceph-mon[30925]: pgmap v206: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:14:07.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:07 smithi169 ceph-mon[34350]: pgmap v206: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:14:09.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:09 smithi174 ceph-mon[34488]: pgmap v207: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:14:09.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:09 smithi103 ceph-mon[30925]: pgmap v207: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:14:09.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:09 smithi169 ceph-mon[34350]: pgmap v207: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:14:11.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:11 smithi174 ceph-mon[34488]: pgmap v208: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:14:11.740 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:11 smithi174 ceph-mon[34488]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:14:11.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:11 smithi103 ceph-mon[30925]: pgmap v208: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:14:11.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:11 smithi103 ceph-mon[30925]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:14:11.787 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:11 smithi169 ceph-mon[34350]: pgmap v208: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:14:11.788 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:11 smithi169 ceph-mon[34350]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:14:13.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:13 smithi174 ceph-mon[34488]: pgmap v210: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:14:13.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:13 smithi103 ceph-mon[30925]: pgmap v210: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:14:13.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:13 smithi169 ceph-mon[34350]: pgmap v210: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:14:15.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:15 smithi174 ceph-mon[34488]: pgmap v211: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:14:15.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:15 smithi174 ceph-mon[34488]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:14:15.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:15 smithi103 ceph-mon[30925]: pgmap v211: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:14:15.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:15 smithi103 ceph-mon[30925]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:14:15.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:15 smithi169 ceph-mon[34350]: pgmap v211: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:14:15.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:15 smithi169 ceph-mon[34350]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:14:17.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:17 smithi174 ceph-mon[34488]: pgmap v213: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:14:17.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:17 smithi103 ceph-mon[30925]: pgmap v213: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:14:17.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:17 smithi169 ceph-mon[34350]: pgmap v213: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:14:19.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:19 smithi174 ceph-mon[34488]: pgmap v214: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:14:19.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:19 smithi103 ceph-mon[30925]: pgmap v214: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:14:19.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:19 smithi169 ceph-mon[34350]: pgmap v214: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:14:21.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:21 smithi174 ceph-mon[34488]: pgmap v215: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 216 B/s wr, 6 op/s 2024-09-19T06:14:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:21 smithi103 ceph-mon[30925]: pgmap v215: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 216 B/s wr, 6 op/s 2024-09-19T06:14:21.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:21 smithi169 ceph-mon[34350]: pgmap v215: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 216 B/s wr, 6 op/s 2024-09-19T06:14:23.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:23 smithi174 ceph-mon[34488]: pgmap v216: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:14:23.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:23 smithi103 ceph-mon[30925]: pgmap v216: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:14:23.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:23 smithi169 ceph-mon[34350]: pgmap v216: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:14:25.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:25 smithi174 ceph-mon[34488]: pgmap v217: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:14:25.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:25 smithi103 ceph-mon[30925]: pgmap v217: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:14:25.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:25 smithi169 ceph-mon[34350]: pgmap v217: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:14:27.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:27 smithi174 ceph-mon[34488]: pgmap v218: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 97 B/s wr, 8 op/s 2024-09-19T06:14:27.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:27 smithi103 ceph-mon[30925]: pgmap v218: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 97 B/s wr, 8 op/s 2024-09-19T06:14:27.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:27 smithi169 ceph-mon[34350]: pgmap v218: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 97 B/s wr, 8 op/s 2024-09-19T06:14:29.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:29 smithi174 ceph-mon[34488]: pgmap v219: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T06:14:29.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:29 smithi103 ceph-mon[30925]: pgmap v219: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T06:14:29.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:29 smithi169 ceph-mon[34350]: pgmap v219: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T06:14:31.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:31 smithi174 ceph-mon[34488]: pgmap v220: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T06:14:31.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:31 smithi103 ceph-mon[30925]: pgmap v220: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T06:14:31.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:31 smithi169 ceph-mon[34350]: pgmap v220: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T06:14:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:33 smithi174 ceph-mon[34488]: pgmap v221: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-19T06:14:33.813 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:33 smithi169 ceph-mon[34350]: pgmap v221: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-19T06:14:33.813 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:33 smithi103 ceph-mon[30925]: pgmap v221: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-19T06:14:34.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:34 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:34.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:34 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:34.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:34 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:35.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:35 smithi174 ceph-mon[34488]: pgmap v222: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:35.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:35 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:35.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:35 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:35.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:35 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:14:35.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:35 smithi103 ceph-mon[30925]: pgmap v222: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:35.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:35 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:35.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:35 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:35.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:35 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:14:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:35 smithi169 ceph-mon[34350]: pgmap v222: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:35 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:35 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:35.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:35 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:14:37.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:37 smithi174 ceph-mon[34488]: pgmap v223: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:37.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:37 smithi103 ceph-mon[30925]: pgmap v223: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:37.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:37 smithi169 ceph-mon[34350]: pgmap v223: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:39.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:39 smithi103 ceph-mon[30925]: pgmap v224: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:39.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:39 smithi169 ceph-mon[34350]: pgmap v224: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:39 smithi174 ceph-mon[34488]: pgmap v224: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:41.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:41 smithi103 ceph-mon[30925]: pgmap v225: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:41.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:41 smithi169 ceph-mon[34350]: pgmap v225: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:41.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:41 smithi174 ceph-mon[34488]: pgmap v225: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:43.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:43 smithi103 ceph-mon[30925]: pgmap v226: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:43 smithi169 ceph-mon[34350]: pgmap v226: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:43.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:43 smithi174 ceph-mon[34488]: pgmap v226: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:45.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:45 smithi103 ceph-mon[30925]: pgmap v227: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:45.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:45 smithi169 ceph-mon[34350]: pgmap v227: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:45 smithi174 ceph-mon[34488]: pgmap v227: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:47.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:47 smithi103 ceph-mon[30925]: pgmap v228: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:47.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:47 smithi169 ceph-mon[34350]: pgmap v228: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:47 smithi174 ceph-mon[34488]: pgmap v228: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:49.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:49 smithi103 ceph-mon[30925]: pgmap v229: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:49.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:49 smithi169 ceph-mon[34350]: pgmap v229: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:49 smithi174 ceph-mon[34488]: pgmap v229: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:51.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:51 smithi103 ceph-mon[30925]: pgmap v230: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:51.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:51 smithi169 ceph-mon[34350]: pgmap v230: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:51.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:51 smithi174 ceph-mon[34488]: pgmap v230: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:53.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:53 smithi103 ceph-mon[30925]: pgmap v231: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:53.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:53 smithi169 ceph-mon[34350]: pgmap v231: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:53 smithi174 ceph-mon[34488]: pgmap v231: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:55.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:55 smithi103 ceph-mon[30925]: pgmap v232: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:55.756 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:55 smithi174 ceph-mon[34488]: pgmap v232: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:55.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:55 smithi169 ceph-mon[34350]: pgmap v232: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:57.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:57 smithi103 ceph-mon[30925]: pgmap v233: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:57.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:57 smithi169 ceph-mon[34350]: pgmap v233: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:57 smithi174 ceph-mon[34488]: pgmap v233: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:59.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:14:59 smithi103 ceph-mon[30925]: pgmap v234: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:59.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:14:59 smithi169 ceph-mon[34350]: pgmap v234: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:14:59 smithi174 ceph-mon[34488]: pgmap v234: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:01.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:01 smithi103 ceph-mon[30925]: pgmap v235: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:01.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:01 smithi169 ceph-mon[34350]: pgmap v235: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:01 smithi174 ceph-mon[34488]: pgmap v235: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:03.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:03 smithi103 ceph-mon[30925]: pgmap v236: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:15:03.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:03 smithi169 ceph-mon[34350]: pgmap v236: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:15:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:03 smithi174 ceph-mon[34488]: pgmap v236: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:15:05.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:05 smithi169 ceph-mon[34350]: pgmap v237: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:15:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:05 smithi174 ceph-mon[34488]: pgmap v237: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:15:05.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:05 smithi103 ceph-mon[30925]: pgmap v237: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:15:07.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:07 smithi169 ceph-mon[34350]: pgmap v238: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:15:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:07 smithi174 ceph-mon[34488]: pgmap v238: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:15:07.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:07 smithi103 ceph-mon[30925]: pgmap v238: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:15:09.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:09 smithi169 ceph-mon[34350]: pgmap v239: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:15:09.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:09 smithi174 ceph-mon[34488]: pgmap v239: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:15:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:09 smithi103 ceph-mon[30925]: pgmap v239: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:15:11.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:11 smithi169 ceph-mon[34350]: pgmap v240: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:15:11.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:11 smithi169 ceph-mon[34350]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:15:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:11 smithi174 ceph-mon[34488]: pgmap v240: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:15:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:11 smithi174 ceph-mon[34488]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:15:11.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:11 smithi103 ceph-mon[30925]: pgmap v240: 97 pgs: 97 active+clean; 171 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:15:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:11 smithi103 ceph-mon[30925]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:15:13.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:13 smithi169 ceph-mon[34350]: pgmap v242: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:13.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:13 smithi174 ceph-mon[34488]: pgmap v242: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:13 smithi103 ceph-mon[30925]: pgmap v242: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:15.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:15 smithi169 ceph-mon[34350]: pgmap v243: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:15.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:15 smithi174 ceph-mon[34488]: pgmap v243: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:15.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:15 smithi103 ceph-mon[30925]: pgmap v243: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:17.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:17 smithi169 ceph-mon[34350]: pgmap v244: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:17.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:17 smithi174 ceph-mon[34488]: pgmap v244: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:17.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:17 smithi103 ceph-mon[30925]: pgmap v244: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:19.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:19 smithi169 ceph-mon[34350]: pgmap v245: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:19.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:19 smithi174 ceph-mon[34488]: pgmap v245: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:19 smithi103 ceph-mon[30925]: pgmap v245: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:21.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:21 smithi174 ceph-mon[34488]: pgmap v246: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:21.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:21 smithi174 ceph-mon[34488]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:15:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:21 smithi103 ceph-mon[30925]: pgmap v246: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:21 smithi103 ceph-mon[30925]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:15:21.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:21 smithi169 ceph-mon[34350]: pgmap v246: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:15:21.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:21 smithi169 ceph-mon[34350]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:15:23.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:23 smithi174 ceph-mon[34488]: pgmap v248: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:15:23.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:23 smithi103 ceph-mon[30925]: pgmap v248: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:15:23.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:23 smithi169 ceph-mon[34350]: pgmap v248: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:15:25.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:25 smithi174 ceph-mon[34488]: pgmap v249: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:15:25.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:25 smithi103 ceph-mon[30925]: pgmap v249: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:15:25.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:25 smithi169 ceph-mon[34350]: pgmap v249: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:15:26.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:26 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:26.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:26 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:26.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:26 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:27.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:27 smithi174 ceph-mon[34488]: pgmap v250: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:15:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:27 smithi103 ceph-mon[30925]: pgmap v250: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:15:27.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:27 smithi169 ceph-mon[34350]: pgmap v250: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:15:29.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:29 smithi174 ceph-mon[34488]: pgmap v251: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:15:29.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:29 smithi103 ceph-mon[30925]: pgmap v251: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:15:29.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:29 smithi169 ceph-mon[34350]: pgmap v251: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:15:31.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:31 smithi174 ceph-mon[34488]: pgmap v252: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:15:31.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:31 smithi103 ceph-mon[30925]: pgmap v252: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:15:31.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:31 smithi169 ceph-mon[34350]: pgmap v252: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:15:33.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:33 smithi174 ceph-mon[34488]: pgmap v253: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-19T06:15:33.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:33 smithi103 ceph-mon[30925]: pgmap v253: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-19T06:15:33.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:33 smithi169 ceph-mon[34350]: pgmap v253: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-19T06:15:35.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:35 smithi174 ceph-mon[34488]: pgmap v254: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:35.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:35 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:15:35.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:35 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:15:35.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:35 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:15:35.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:35 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:15:35.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:35 smithi103 ceph-mon[30925]: pgmap v254: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:35.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:35 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:15:35.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:35 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:15:35.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:35 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:15:35.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:35 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:15:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:35 smithi169 ceph-mon[34350]: pgmap v254: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:35 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:15:35.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:35 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:15:35.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:35 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:15:35.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:35 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:15:37.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:37 smithi174 ceph-mon[34488]: pgmap v255: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:37.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:37 smithi103 ceph-mon[30925]: pgmap v255: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:37.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:37 smithi169 ceph-mon[34350]: pgmap v255: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:39.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:39 smithi174 ceph-mon[34488]: pgmap v256: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:39.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:39 smithi103 ceph-mon[30925]: pgmap v256: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:39.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:39 smithi169 ceph-mon[34350]: pgmap v256: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:41.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:41 smithi103 ceph-mon[30925]: pgmap v257: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:41.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:41 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:41.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:41 smithi169 ceph-mon[34350]: pgmap v257: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:41.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:41 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:41.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:41 smithi174 ceph-mon[34488]: pgmap v257: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:41.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:41 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:43.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:43 smithi103 ceph-mon[30925]: pgmap v258: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:43 smithi169 ceph-mon[34350]: pgmap v258: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:43.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:43 smithi174 ceph-mon[34488]: pgmap v258: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:45.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:45 smithi103 ceph-mon[30925]: pgmap v259: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:45.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:45 smithi169 ceph-mon[34350]: pgmap v259: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:45 smithi174 ceph-mon[34488]: pgmap v259: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:47.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:47 smithi103 ceph-mon[30925]: pgmap v260: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:47.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:47 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:47.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:47 smithi169 ceph-mon[34350]: pgmap v260: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:47.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:47 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:47 smithi174 ceph-mon[34488]: pgmap v260: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:47 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:49.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:49 smithi103 ceph-mon[30925]: pgmap v261: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:49.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:49 smithi169 ceph-mon[34350]: pgmap v261: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:49 smithi174 ceph-mon[34488]: pgmap v261: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:51.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:51 smithi103 ceph-mon[30925]: pgmap v262: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:51.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:51 smithi169 ceph-mon[34350]: pgmap v262: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:51.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:51 smithi174 ceph-mon[34488]: pgmap v262: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:52.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:52 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:52.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:52 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:52.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:52 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:15:53.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:53 smithi169 ceph-mon[34350]: pgmap v263: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:53 smithi174 ceph-mon[34488]: pgmap v263: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:53.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:53 smithi103 ceph-mon[30925]: pgmap v263: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:55.756 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:55 smithi174 ceph-mon[34488]: pgmap v264: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:55.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:55 smithi169 ceph-mon[34350]: pgmap v264: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:55.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:55 smithi103 ceph-mon[30925]: pgmap v264: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:57.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:57 smithi169 ceph-mon[34350]: pgmap v265: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:57 smithi174 ceph-mon[34488]: pgmap v265: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:57.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:57 smithi103 ceph-mon[30925]: pgmap v265: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:15:59.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:15:59 smithi169 ceph-mon[34350]: pgmap v266: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:15:59 smithi174 ceph-mon[34488]: pgmap v266: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:15:59 smithi103 ceph-mon[30925]: pgmap v266: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:01.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:01 smithi169 ceph-mon[34350]: pgmap v267: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:01.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:01 smithi174 ceph-mon[34488]: pgmap v267: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:01.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:01 smithi103 ceph-mon[30925]: pgmap v267: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:03.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:03 smithi169 ceph-mon[34350]: pgmap v268: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:16:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:03 smithi174 ceph-mon[34488]: pgmap v268: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:16:03.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:03 smithi103 ceph-mon[30925]: pgmap v268: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:16:05.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:05 smithi169 ceph-mon[34350]: pgmap v269: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:16:05.795 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:05 smithi103 ceph-mon[30925]: pgmap v269: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:16:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:05 smithi174 ceph-mon[34488]: pgmap v269: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:16:07.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:07 smithi169 ceph-mon[34350]: pgmap v270: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:16:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:07 smithi174 ceph-mon[34488]: pgmap v270: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:16:07.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:07 smithi103 ceph-mon[30925]: pgmap v270: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T06:16:09.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:09 smithi169 ceph-mon[34350]: pgmap v271: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:16:09.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:09 smithi174 ceph-mon[34488]: pgmap v271: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:16:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:09 smithi103 ceph-mon[30925]: pgmap v271: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:16:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:11 smithi174 ceph-mon[34488]: pgmap v272: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:16:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:11 smithi174 ceph-mon[34488]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:16:11.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:11 smithi103 ceph-mon[30925]: pgmap v272: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:16:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:11 smithi103 ceph-mon[30925]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:16:12.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:11 smithi169 ceph-mon[34350]: pgmap v272: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:16:12.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:11 smithi169 ceph-mon[34350]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:16:13.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:13 smithi174 ceph-mon[34488]: pgmap v274: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:13 smithi103 ceph-mon[30925]: pgmap v274: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:14.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:13 smithi169 ceph-mon[34350]: pgmap v274: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:15.956 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:15 smithi174 ceph-mon[34488]: pgmap v275: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:16.524 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:15 smithi169 ceph-mon[34350]: pgmap v275: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:16.524 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:15 smithi103 ceph-mon[30925]: pgmap v275: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:17.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:17 smithi174 ceph-mon[34488]: pgmap v276: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:17.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:17 smithi103 ceph-mon[30925]: pgmap v276: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:18.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:17 smithi169 ceph-mon[34350]: pgmap v276: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:19.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:19 smithi174 ceph-mon[34488]: pgmap v277: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:19.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:19 smithi103 ceph-mon[30925]: pgmap v277: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:20.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:19 smithi169 ceph-mon[34350]: pgmap v277: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:21.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:21 smithi174 ceph-mon[34488]: pgmap v278: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:21.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:21 smithi174 ceph-mon[34488]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:16:21.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:21 smithi103 ceph-mon[30925]: pgmap v278: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:21 smithi103 ceph-mon[30925]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:16:21.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:21 smithi169 ceph-mon[34350]: pgmap v278: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:16:21.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:21 smithi169 ceph-mon[34350]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:16:22.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:22 smithi174 ceph-mon[34488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:16:22.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:22 smithi103 ceph-mon[30925]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:16:23.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:22 smithi169 ceph-mon[34350]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:16:23.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:23 smithi174 ceph-mon[34488]: pgmap v280: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:16:23.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:23 smithi103 ceph-mon[30925]: pgmap v280: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:16:24.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:23 smithi169 ceph-mon[34350]: pgmap v280: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:16:25.830 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:25 smithi169 ceph-mon[34350]: pgmap v281: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:16:25.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:25 smithi174 ceph-mon[34488]: pgmap v281: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:16:25.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:25 smithi103 ceph-mon[30925]: pgmap v281: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:16:27.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:27 smithi174 ceph-mon[34488]: pgmap v282: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:16:27.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:27 smithi103 ceph-mon[30925]: pgmap v282: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:16:28.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:27 smithi169 ceph-mon[34350]: pgmap v282: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:16:29.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:29 smithi174 ceph-mon[34488]: pgmap v283: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:16:29.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:29 smithi103 ceph-mon[30925]: pgmap v283: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:16:30.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:29 smithi169 ceph-mon[34350]: pgmap v283: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:16:31.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:31 smithi174 ceph-mon[34488]: pgmap v284: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:16:31.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:31 smithi103 ceph-mon[30925]: pgmap v284: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:16:32.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:31 smithi169 ceph-mon[34350]: pgmap v284: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:16:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:33 smithi174 ceph-mon[34488]: pgmap v285: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-19T06:16:33.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:33 smithi103 ceph-mon[30925]: pgmap v285: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-19T06:16:34.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:33 smithi169 ceph-mon[34350]: pgmap v285: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-19T06:16:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:35 smithi174 ceph-mon[34488]: pgmap v286: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:35 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:16:35.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:35 smithi103 ceph-mon[30925]: pgmap v286: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:35.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:35 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:16:36.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:35 smithi169 ceph-mon[34350]: pgmap v286: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:36.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:35 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:16:36.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:36 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:16:36.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:36 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:16:36.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:36 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:16:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:36 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:16:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:36 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:16:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:36 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:16:37.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:36 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:16:37.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:36 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:16:37.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:36 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:16:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:37 smithi174 ceph-mon[34488]: pgmap v287: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:37.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:37 smithi103 ceph-mon[30925]: pgmap v287: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:38.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:37 smithi169 ceph-mon[34350]: pgmap v287: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:39 smithi174 ceph-mon[34488]: pgmap v288: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:39.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:39 smithi103 ceph-mon[30925]: pgmap v288: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:40.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:39 smithi169 ceph-mon[34350]: pgmap v288: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:41.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:41 smithi174 ceph-mon[34488]: pgmap v289: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:41.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:41 smithi103 ceph-mon[30925]: pgmap v289: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:42.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:41 smithi169 ceph-mon[34350]: pgmap v289: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:43.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:43 smithi174 ceph-mon[34488]: pgmap v290: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:43.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:43 smithi103 ceph-mon[30925]: pgmap v290: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:44.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:43 smithi169 ceph-mon[34350]: pgmap v290: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:45.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:45 smithi174 ceph-mon[34488]: pgmap v291: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:45.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:45 smithi103 ceph-mon[30925]: pgmap v291: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:46.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:45 smithi169 ceph-mon[34350]: pgmap v291: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:47.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:47 smithi174 ceph-mon[34488]: pgmap v292: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:47.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:47 smithi103 ceph-mon[30925]: pgmap v292: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:48.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:47 smithi169 ceph-mon[34350]: pgmap v292: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:49.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:49 smithi174 ceph-mon[34488]: pgmap v293: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:49.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:49 smithi103 ceph-mon[30925]: pgmap v293: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:50.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:49 smithi169 ceph-mon[34350]: pgmap v293: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:51.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:51 smithi174 ceph-mon[34488]: pgmap v294: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:51.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:51 smithi103 ceph-mon[30925]: pgmap v294: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:52.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:51 smithi169 ceph-mon[34350]: pgmap v294: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:53 smithi174 ceph-mon[34488]: pgmap v295: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:53.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:53 smithi103 ceph-mon[30925]: pgmap v295: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:54.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:53 smithi169 ceph-mon[34350]: pgmap v295: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:55.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:55 smithi174 ceph-mon[34488]: pgmap v296: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:55.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:55 smithi103 ceph-mon[30925]: pgmap v296: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:56.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:55 smithi169 ceph-mon[34350]: pgmap v296: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:57 smithi174 ceph-mon[34488]: pgmap v297: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:57.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:57 smithi103 ceph-mon[30925]: pgmap v297: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:58.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:57 smithi169 ceph-mon[34350]: pgmap v297: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:16:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:16:59 smithi174 ceph-mon[34488]: pgmap v298: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:16:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:16:59 smithi103 ceph-mon[30925]: pgmap v298: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:00.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:16:59 smithi169 ceph-mon[34350]: pgmap v298: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:01 smithi174 ceph-mon[34488]: pgmap v299: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:01.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:01 smithi103 ceph-mon[30925]: pgmap v299: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:02.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:01 smithi169 ceph-mon[34350]: pgmap v299: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:03.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:03 smithi174 ceph-mon[34488]: pgmap v300: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:17:03.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:03 smithi103 ceph-mon[30925]: pgmap v300: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:17:04.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:03 smithi169 ceph-mon[34350]: pgmap v300: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:17:05.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:05 smithi174 ceph-mon[34488]: pgmap v301: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-19T06:17:05.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:05 smithi103 ceph-mon[30925]: pgmap v301: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-19T06:17:06.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:05 smithi169 ceph-mon[34350]: pgmap v301: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-19T06:17:07.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:07 smithi174 ceph-mon[34488]: pgmap v302: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:17:07.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:07 smithi103 ceph-mon[30925]: pgmap v302: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:17:08.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:07 smithi169 ceph-mon[34350]: pgmap v302: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:17:09.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:09 smithi174 ceph-mon[34488]: pgmap v303: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:17:09.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:09 smithi103 ceph-mon[30925]: pgmap v303: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:17:10.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:09 smithi169 ceph-mon[34350]: pgmap v303: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:17:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:11 smithi174 ceph-mon[34488]: pgmap v304: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:17:11.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:11 smithi174 ceph-mon[34488]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:17:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:11 smithi103 ceph-mon[30925]: pgmap v304: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:17:11.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:11 smithi103 ceph-mon[30925]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:17:12.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:11 smithi169 ceph-mon[34350]: pgmap v304: 97 pgs: 97 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:17:12.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:11 smithi169 ceph-mon[34350]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:17:13.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:13 smithi174 ceph-mon[34488]: pgmap v306: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T06:17:13.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:13 smithi103 ceph-mon[30925]: pgmap v306: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T06:17:14.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:13 smithi169 ceph-mon[34350]: pgmap v306: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T06:17:15.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:15 smithi174 ceph-mon[34488]: pgmap v307: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T06:17:15.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:15 smithi103 ceph-mon[30925]: pgmap v307: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T06:17:16.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:15 smithi169 ceph-mon[34350]: pgmap v307: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 167 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T06:17:17.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:17 smithi174 ceph-mon[34488]: pgmap v308: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:17:17.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:17 smithi103 ceph-mon[30925]: pgmap v308: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:17:18.027 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:17 smithi169 ceph-mon[34350]: pgmap v308: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:17:19.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:19 smithi174 ceph-mon[34488]: pgmap v309: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:17:19.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:19 smithi103 ceph-mon[30925]: pgmap v309: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:17:20.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:19 smithi169 ceph-mon[34350]: pgmap v309: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:17:21.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:21 smithi174 ceph-mon[34488]: pgmap v310: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:17:21.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:21 smithi174 ceph-mon[34488]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:17:21.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:21 smithi103 ceph-mon[30925]: pgmap v310: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:17:21.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:21 smithi103 ceph-mon[30925]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:17:21.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:21 smithi169 ceph-mon[34350]: pgmap v310: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T06:17:21.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:21 smithi169 ceph-mon[34350]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:17:23.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:23 smithi174 ceph-mon[34488]: pgmap v312: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:17:23.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:23 smithi103 ceph-mon[30925]: pgmap v312: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:17:23.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:23 smithi169 ceph-mon[34350]: pgmap v312: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:17:25.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:25 smithi174 ceph-mon[34488]: pgmap v313: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:17:25.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:25 smithi103 ceph-mon[30925]: pgmap v313: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:17:25.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:25 smithi169 ceph-mon[34350]: pgmap v313: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:17:27.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:27 smithi174 ceph-mon[34488]: pgmap v314: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:17:27.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:27 smithi103 ceph-mon[30925]: pgmap v314: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:17:27.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:27 smithi169 ceph-mon[34350]: pgmap v314: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:17:29.535 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T06:17:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 -- 172.21.15.103:0/3497401950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f58101370 msgr2=0x7f7f5810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 --2- 172.21.15.103:0/3497401950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f58101370 0x7f7f5810d8a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009cd0 tx=0x7f7f5002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 -- 172.21.15.103:0/3497401950 shutdown_connections 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 --2- 172.21.15.103:0/3497401950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f58101370 0x7f7f5810d8a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 --2- 172.21.15.103:0/3497401950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f581009d0 0x7f7f58100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 --2- 172.21.15.103:0/3497401950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f581069e0 0x7f7f58106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 -- 172.21.15.103:0/3497401950 >> 172.21.15.103:0/3497401950 conn(0x7f7f580fc6f0 msgr2=0x7f7f580feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 -- 172.21.15.103:0/3497401950 shutdown_connections 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 -- 172.21.15.103:0/3497401950 wait complete. 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 Processor -- start 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.645+0000 7f7f5e90a640 1 -- start start 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5e90a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f581009d0 0x7f7f581970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5e90a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f58101370 0x7f7f581975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5e90a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f581069e0 0x7f7f5819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5e90a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58110cd0 con 0x7f7f581069e0 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5e90a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58110b50 con 0x7f7f58101370 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5e90a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58110e50 con 0x7f7f581009d0 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5cea7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f581069e0 0x7f7f5819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5cea7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f581069e0 0x7f7f5819b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41872/0 (socket says 172.21.15.103:41872) 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5cea7640 1 -- 172.21.15.103:0/2117526766 learned_addr learned my addr 172.21.15.103:0/2117526766 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f577fe640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f58101370 0x7f7f581975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f57fff640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f581009d0 0x7f7f581970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5cea7640 1 -- 172.21.15.103:0/2117526766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f581009d0 msgr2=0x7f7f581970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5cea7640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f581009d0 0x7f7f581970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5cea7640 1 -- 172.21.15.103:0/2117526766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f58101370 msgr2=0x7f7f581975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5cea7640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f58101370 0x7f7f581975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5cea7640 1 -- 172.21.15.103:0/2117526766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5819c090 con 0x7f7f581069e0 2024-09-19T06:17:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f57fff640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f581009d0 0x7f7f581970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.646+0000 7f7f5cea7640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f581069e0 0x7f7f5819b960 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7f50005cc0 tx=0x7f7f50003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.647+0000 7f7f557fa640 1 -- 172.21.15.103:0/2117526766 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50004450 con 0x7f7f581069e0 2024-09-19T06:17:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.647+0000 7f7f557fa640 1 -- 172.21.15.103:0/2117526766 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f50031c90 con 0x7f7f581069e0 2024-09-19T06:17:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.647+0000 7f7f557fa640 1 -- 172.21.15.103:0/2117526766 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5003b400 con 0x7f7f581069e0 2024-09-19T06:17:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.647+0000 7f7f5e90a640 1 -- 172.21.15.103:0/2117526766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5819c320 con 0x7f7f581069e0 2024-09-19T06:17:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.647+0000 7f7f5e90a640 1 -- 172.21.15.103:0/2117526766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f581a3c10 con 0x7f7f581069e0 2024-09-19T06:17:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.648+0000 7f7f5e90a640 1 -- 172.21.15.103:0/2117526766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f58100e30 con 0x7f7f581069e0 2024-09-19T06:17:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.649+0000 7f7f557fa640 1 -- 172.21.15.103:0/2117526766 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f7f50004680 con 0x7f7f581069e0 2024-09-19T06:17:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.650+0000 7f7f557fa640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7f440a34e0 0x7f7f440a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.650+0000 7f7f557fa640 1 -- 172.21.15.103:0/2117526766 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f7f5002e030 con 0x7f7f581069e0 2024-09-19T06:17:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.650+0000 7f7f57fff640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7f440a34e0 0x7f7f440a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.650+0000 7f7f57fff640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7f440a34e0 0x7f7f440a59a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f48005e10 tx=0x7f7f48005da0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:29.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.653+0000 7f7f557fa640 1 -- 172.21.15.103:0/2117526766 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f500bde10 con 0x7f7f581069e0 2024-09-19T06:17:29.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:29 smithi174 ceph-mon[34488]: pgmap v315: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:17:29.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:29 smithi103 ceph-mon[30925]: pgmap v315: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:17:29.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:29 smithi169 ceph-mon[34350]: pgmap v315: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:17:29.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.842+0000 7f7f5e90a640 1 -- 172.21.15.103:0/2117526766 --> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f7f580fe390 con 0x7f7f440a34e0 2024-09-19T06:17:29.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.850+0000 7f7f557fa640 1 -- 172.21.15.103:0/2117526766 <== mgr.15189 v2:172.21.15.103:6800/266758959 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f7f580fe390 con 0x7f7f440a34e0 2024-09-19T06:17:29.852 INFO:teuthology.orchestra.run.smithi103.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T06:07:28", "first": "2024-09-19T06:08:00", "last": "2024-09-19T06:17:00", "last_pruned": "2024-09-19T06:17:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-19T06:17:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.852+0000 7f7f5e90a640 1 -- 172.21.15.103:0/2117526766 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7f440a34e0 msgr2=0x7f7f440a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.852+0000 7f7f5e90a640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7f440a34e0 0x7f7f440a59a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f48005e10 tx=0x7f7f48005da0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.852+0000 7f7f5e90a640 1 -- 172.21.15.103:0/2117526766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f581069e0 msgr2=0x7f7f5819b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.852+0000 7f7f5e90a640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f581069e0 0x7f7f5819b960 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7f50005cc0 tx=0x7f7f50003c20 comp rx=0 tx=0).stop 2024-09-19T06:17:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.852+0000 7f7f5e90a640 1 -- 172.21.15.103:0/2117526766 shutdown_connections 2024-09-19T06:17:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.853+0000 7f7f5e90a640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f7f440a34e0 0x7f7f440a59a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.853+0000 7f7f5e90a640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f581069e0 0x7f7f5819b960 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.853+0000 7f7f5e90a640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f58101370 0x7f7f581975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.853+0000 7f7f5e90a640 1 --2- 172.21.15.103:0/2117526766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f581009d0 0x7f7f581970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.853+0000 7f7f5e90a640 1 -- 172.21.15.103:0/2117526766 >> 172.21.15.103:0/2117526766 conn(0x7f7f580fc6f0 msgr2=0x7f7f580fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.853+0000 7f7f5e90a640 1 -- 172.21.15.103:0/2117526766 shutdown_connections 2024-09-19T06:17:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.853+0000 7f7f5e90a640 1 -- 172.21.15.103:0/2117526766 wait complete. 2024-09-19T06:17:29.865 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T06:17:29.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.965+0000 7f10d6518640 1 -- 172.21.15.103:0/4114998748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10d0100830 msgr2=0x7f10d0100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.965+0000 7f10d6518640 1 --2- 172.21.15.103:0/4114998748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10d0100830 0x7f10d0100c10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009930 tx=0x7f10c002a4d0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.965+0000 7f10d6518640 1 -- 172.21.15.103:0/4114998748 shutdown_connections 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.965+0000 7f10d6518640 1 --2- 172.21.15.103:0/4114998748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d01080f0 0x7f10d010ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.965+0000 7f10d6518640 1 --2- 172.21.15.103:0/4114998748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d0101150 0x7f10d0107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.965+0000 7f10d6518640 1 --2- 172.21.15.103:0/4114998748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10d0100830 0x7f10d0100c10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.965+0000 7f10d6518640 1 -- 172.21.15.103:0/4114998748 >> 172.21.15.103:0/4114998748 conn(0x7f10d0075ec0 msgr2=0x7f10d00762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.965+0000 7f10d6518640 1 -- 172.21.15.103:0/4114998748 shutdown_connections 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.965+0000 7f10d6518640 1 -- 172.21.15.103:0/4114998748 wait complete. 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10d6518640 1 Processor -- start 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10d6518640 1 -- start start 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10d6518640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10d0100830 0x7f10d01982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10d6518640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d0101150 0x7f10d0198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10d6518640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d01080f0 0x7f10d019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10d6518640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f10d0111dd0 con 0x7f10d0100830 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10d6518640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10d0111c50 con 0x7f10d01080f0 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10d6518640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10d0111f50 con 0x7f10d0101150 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10cffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10d0100830 0x7f10d01982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10cffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10d0100830 0x7f10d01982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41892/0 (socket says 172.21.15.103:41892) 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10cffff640 1 -- 172.21.15.103:0/3324052103 learned_addr learned my addr 172.21.15.103:0/3324052103 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10cf7fe640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d0101150 0x7f10d0198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10d4ab5640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d01080f0 0x7f10d019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10cffff640 1 -- 172.21.15.103:0/3324052103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d0101150 msgr2=0x7f10d0198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10cffff640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d0101150 0x7f10d0198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10cffff640 1 -- 172.21.15.103:0/3324052103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d01080f0 msgr2=0x7f10d019cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10cffff640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d01080f0 0x7f10d019cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.966+0000 7f10cffff640 1 -- 172.21.15.103:0/3324052103 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d019d2b0 con 0x7f10d0100830 2024-09-19T06:17:29.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.967+0000 7f10cffff640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10d0100830 0x7f10d01982c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f10c0005940 tx=0x7f10c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:29.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.967+0000 7f10cd7fa640 1 -- 172.21.15.103:0/3324052103 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c003f030 con 0x7f10d0100830 2024-09-19T06:17:29.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.967+0000 7f10d6518640 1 -- 172.21.15.103:0/3324052103 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d019d540 con 0x7f10d0100830 2024-09-19T06:17:29.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.967+0000 7f10cd7fa640 1 -- 172.21.15.103:0/3324052103 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10c00318a0 con 0x7f10d0100830 2024-09-19T06:17:29.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.967+0000 7f10cd7fa640 1 -- 172.21.15.103:0/3324052103 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0035070 con 0x7f10d0100830 2024-09-19T06:17:29.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.967+0000 7f10d6518640 1 -- 172.21.15.103:0/3324052103 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d01a4e30 con 0x7f10d0100830 2024-09-19T06:17:29.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.968+0000 7f10d6518640 1 -- 172.21.15.103:0/3324052103 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d0100c10 con 0x7f10d0100830 2024-09-19T06:17:29.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.969+0000 7f10cd7fa640 1 -- 172.21.15.103:0/3324052103 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f10c0042030 con 0x7f10d0100830 2024-09-19T06:17:29.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.970+0000 7f10cd7fa640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10b80a3460 0x7f10b80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.970+0000 7f10cf7fe640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10b80a3460 0x7f10b80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.970+0000 7f10cd7fa640 1 -- 172.21.15.103:0/3324052103 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f10c00f07a0 con 0x7f10d0100830 2024-09-19T06:17:29.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.970+0000 7f10cf7fe640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10b80a3460 0x7f10b80a5920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f10c4005fd0 tx=0x7f10c4005850 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:29.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:29.973+0000 7f10cd7fa640 1 -- 172.21.15.103:0/3324052103 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10c00bd180 con 0x7f10d0100830 2024-09-19T06:17:30.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.161+0000 7f10d6518640 1 -- 172.21.15.103:0/3324052103 --> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f10d010a0e0 con 0x7f10b80a3460 2024-09-19T06:17:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.169+0000 7f10cd7fa640 1 -- 172.21.15.103:0/3324052103 <== mgr.15189 v2:172.21.15.103:6800/266758959 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f10d010a0e0 con 0x7f10b80a3460 2024-09-19T06:17:30.171 INFO:teuthology.orchestra.run.smithi103.stdout:/ 1m 6m3h 2024-09-19T06:17:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.170+0000 7f10d6518640 1 -- 172.21.15.103:0/3324052103 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10b80a3460 msgr2=0x7f10b80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.170+0000 7f10d6518640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10b80a3460 0x7f10b80a5920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f10c4005fd0 tx=0x7f10c4005850 comp rx=0 tx=0).stop 2024-09-19T06:17:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.171+0000 7f10d6518640 1 -- 172.21.15.103:0/3324052103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10d0100830 msgr2=0x7f10d01982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.171+0000 7f10d6518640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10d0100830 0x7f10d01982c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f10c0005940 tx=0x7f10c00042f0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.171+0000 7f10d6518640 1 -- 172.21.15.103:0/3324052103 shutdown_connections 2024-09-19T06:17:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.171+0000 7f10d6518640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f10b80a3460 0x7f10b80a5920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.171+0000 7f10d6518640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10d01080f0 0x7f10d019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.171+0000 7f10d6518640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d0101150 0x7f10d0198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.171+0000 7f10d6518640 1 --2- 172.21.15.103:0/3324052103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10d0100830 0x7f10d01982c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.171+0000 7f10d6518640 1 -- 172.21.15.103:0/3324052103 >> 172.21.15.103:0/3324052103 conn(0x7f10d0075ec0 msgr2=0x7f10d0105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:30.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.171+0000 7f10d6518640 1 -- 172.21.15.103:0/3324052103 shutdown_connections 2024-09-19T06:17:30.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.171+0000 7f10d6518640 1 -- 172.21.15.103:0/3324052103 wait complete. 2024-09-19T06:17:30.183 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T06:17:30.195 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T06:17:30.195 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T06:17:30.196 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T06:17:30.251 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:17:30.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.349+0000 7f7152682640 1 -- 172.21.15.103:0/3100648205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f714c1009a0 msgr2=0x7f714c100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.349+0000 7f7152682640 1 --2- 172.21.15.103:0/3100648205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f714c1009a0 0x7f714c100e00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7140009930 tx=0x7f714002a420 comp rx=0 tx=0).stop 2024-09-19T06:17:30.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.349+0000 7f7152682640 1 -- 172.21.15.103:0/3100648205 shutdown_connections 2024-09-19T06:17:30.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.349+0000 7f7152682640 1 --2- 172.21.15.103:0/3100648205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f714c101340 0x7f714c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.349+0000 7f7152682640 1 --2- 172.21.15.103:0/3100648205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f714c1009a0 0x7f714c100e00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.349+0000 7f7152682640 1 --2- 172.21.15.103:0/3100648205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f714c1069b0 0x7f714c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.349+0000 7f7152682640 1 -- 172.21.15.103:0/3100648205 >> 172.21.15.103:0/3100648205 conn(0x7f714c0fc6c0 msgr2=0x7f714c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:30.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.349+0000 7f7152682640 1 -- 172.21.15.103:0/3100648205 shutdown_connections 2024-09-19T06:17:30.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.349+0000 7f7152682640 1 -- 172.21.15.103:0/3100648205 wait complete. 2024-09-19T06:17:30.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f7152682640 1 Processor -- start 2024-09-19T06:17:30.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f7152682640 1 -- start start 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f7152682640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f714c1009a0 0x7f714c199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f7152682640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f714c101340 0x7f714c1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f7152682640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f714c1069b0 0x7f714c1a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f7152682640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f714c110ca0 con 0x7f714c101340 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f7152682640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f714c110b20 con 0x7f714c1069b0 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f7152682640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f714c110e20 con 0x7f714c1009a0 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f714b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f714c101340 0x7f714c1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f714b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f714c101340 0x7f714c1996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52388/0 (socket says 172.21.15.103:52388) 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f714b7fe640 1 -- 172.21.15.103:0/2643116383 learned_addr learned my addr 172.21.15.103:0/2643116383 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f714bfff640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f714c1009a0 0x7f714c199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f7150c1f640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f714c1069b0 0x7f714c1a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f714b7fe640 1 -- 172.21.15.103:0/2643116383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f714c1009a0 msgr2=0x7f714c199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f714b7fe640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f714c1009a0 0x7f714c199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f714b7fe640 1 -- 172.21.15.103:0/2643116383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f714c1069b0 msgr2=0x7f714c1a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f714b7fe640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f714c1069b0 0x7f714c1a4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.350+0000 7f714b7fe640 1 -- 172.21.15.103:0/2643116383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c1a4740 con 0x7f714c101340 2024-09-19T06:17:30.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.351+0000 7f714b7fe640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f714c101340 0x7f714c1996c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7140005940 tx=0x7f71400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:30.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.351+0000 7f71497fa640 1 -- 172.21.15.103:0/2643116383 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714003f030 con 0x7f714c101340 2024-09-19T06:17:30.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.351+0000 7f7152682640 1 -- 172.21.15.103:0/2643116383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714c1a4910 con 0x7f714c101340 2024-09-19T06:17:30.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.351+0000 7f71497fa640 1 -- 172.21.15.103:0/2643116383 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71400318a0 con 0x7f714c101340 2024-09-19T06:17:30.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.351+0000 7f71497fa640 1 -- 172.21.15.103:0/2643116383 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140035070 con 0x7f714c101340 2024-09-19T06:17:30.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.351+0000 7f7152682640 1 -- 172.21.15.103:0/2643116383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714c1a4d70 con 0x7f714c101340 2024-09-19T06:17:30.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.352+0000 7f7152682640 1 -- 172.21.15.103:0/2643116383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714c100e00 con 0x7f714c101340 2024-09-19T06:17:30.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.353+0000 7f71497fa640 1 -- 172.21.15.103:0/2643116383 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f7140042030 con 0x7f714c101340 2024-09-19T06:17:30.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.353+0000 7f71497fa640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f71340a33c0 0x7f71340a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.354+0000 7f714bfff640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f71340a33c0 0x7f71340a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.354+0000 7f71497fa640 1 -- 172.21.15.103:0/2643116383 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f71400f0780 con 0x7f714c101340 2024-09-19T06:17:30.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.354+0000 7f714bfff640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f71340a33c0 0x7f71340a5880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f713c009ae0 tx=0x7f713c005f90 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:30.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.357+0000 7f71497fa640 1 -- 172.21.15.103:0/2643116383 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f71400bd180 con 0x7f714c101340 2024-09-19T06:17:30.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.527+0000 7f7152682640 1 -- 172.21.15.103:0/2643116383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f714c108980 con 0x7f714c101340 2024-09-19T06:17:30.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.528+0000 7f71497fa640 1 -- 172.21.15.103:0/2643116383 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+23152 (secure 0 0 0) 0x7f71400bca80 con 0x7f714c101340 2024-09-19T06:17:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:17:30.531 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"f3f6d2a8-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:58:00.204662+0000","modified":"2024-09-19T06:17:20.435963+0000","last_up_change":"2024-09-19T06:04:35.519456+0000","last_in_change":"2024-09-19T06:04:12.159352+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:00:59.680195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:05:21.617020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:05:23.597579+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":88,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd4c0151-c2ca-486c-b60a-50a235f0d10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6803","nonce":123668985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6805","nonce":123668985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6809","nonce":123668985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":123668985},{"type":"v1","addr":"172.21.15.103:6807","nonce":123668985}]},"public_addr":"172.21.15.103:6803/123668985","cluster_addr":"172.21.15.103:6805/123668985","heartbeat_back_addr":"172.21.15.103:6809/123668985","heartbeat_front_addr":"172.21.15.103:6807/123668985","state":["exists","up"]},{"osd":1,"uuid":"e20d7ef7-90a3-4bcc-b7e9-b4fc0c9d49d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6801","nonce":528006707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6803","nonce":528006707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6807","nonce":528006707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":528006707},{"type":"v1","addr":"172.21.15.169:6805","nonce":528006707}]},"public_addr":"172.21.15.169:6801/528006707","cluster_addr":"172.21.15.169:6803/528006707","heartbeat_back_addr":"172.21.15.169:6807/528006707","heartbeat_front_addr":"172.21.15.169:6805/528006707","state":["exists","up"]},{"osd":2,"uuid":"1e8e4188-7656-44b4-9064-cf52b6b5d2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6801","nonce":3967741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6803","nonce":3967741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6807","nonce":3967741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3967741036},{"type":"v1","addr":"172.21.15.174:6805","nonce":3967741036}]},"public_addr":"172.21.15.174:6801/3967741036","cluster_addr":"172.21.15.174:6803/3967741036","heartbeat_back_addr":"172.21.15.174:6807/3967741036","heartbeat_front_addr":"172.21.15.174:6805/3967741036","state":["exists","up"]},{"osd":3,"uuid":"7afabe9f-7421-423a-ba92-f2c6c9e57d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6811","nonce":1485292164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6813","nonce":1485292164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6817","nonce":1485292164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1485292164},{"type":"v1","addr":"172.21.15.103:6815","nonce":1485292164}]},"public_addr":"172.21.15.103:6811/1485292164","cluster_addr":"172.21.15.103:6813/1485292164","heartbeat_back_addr":"172.21.15.103:6817/1485292164","heartbeat_front_addr":"172.21.15.103:6815/1485292164","state":["exists","up"]},{"osd":4,"uuid":"64f13201-dc73-4167-ba72-82b720f23503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6809","nonce":1020121864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6811","nonce":1020121864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6815","nonce":1020121864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1020121864},{"type":"v1","addr":"172.21.15.169:6813","nonce":1020121864}]},"public_addr":"172.21.15.169:6809/1020121864","cluster_addr":"172.21.15.169:6811/1020121864","heartbeat_back_addr":"172.21.15.169:6815/1020121864","heartbeat_front_addr":"172.21.15.169:6813/1020121864","state":["exists","up"]},{"osd":5,"uuid":"ab67f7da-dbde-496e-9a67-cf4fc7be01a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6809","nonce":2373718681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6811","nonce":2373718681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6815","nonce":2373718681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2373718681},{"type":"v1","addr":"172.21.15.174:6813","nonce":2373718681}]},"public_addr":"172.21.15.174:6809/2373718681","cluster_addr":"172.21.15.174:6811/2373718681","heartbeat_back_addr":"172.21.15.174:6815/2373718681","heartbeat_front_addr":"172.21.15.174:6813/2373718681","state":["exists","up"]},{"osd":6,"uuid":"751db20c-1173-4ab2-99fd-29882790017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6819","nonce":2136065370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6821","nonce":2136065370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6825","nonce":2136065370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2136065370},{"type":"v1","addr":"172.21.15.103:6823","nonce":2136065370}]},"public_addr":"172.21.15.103:6819/2136065370","cluster_addr":"172.21.15.103:6821/2136065370","heartbeat_back_addr":"172.21.15.103:6825/2136065370","heartbeat_front_addr":"172.21.15.103:6823/2136065370","state":["exists","up"]},{"osd":7,"uuid":"4bff8a33-9e53-43f6-be75-e3d1483adc68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6817","nonce":337716664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6819","nonce":337716664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6823","nonce":337716664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":337716664},{"type":"v1","addr":"172.21.15.169:6821","nonce":337716664}]},"public_addr":"172.21.15.169:6817/337716664","cluster_addr":"172.21.15.169:6819/337716664","heartbeat_back_addr":"172.21.15.169:6823/337716664","heartbeat_front_addr":"172.21.15.169:6821/337716664","state":["exists","up"]},{"osd":8,"uuid":"b2a01657-b797-40d9-9837-dd8475335c05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6817","nonce":1949689360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6819","nonce":1949689360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6823","nonce":1949689360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1949689360},{"type":"v1","addr":"172.21.15.174:6821","nonce":1949689360}]},"public_addr":"172.21.15.174:6817/1949689360","cluster_addr":"172.21.15.174:6819/1949689360","heartbeat_back_addr":"172.21.15.174:6823/1949689360","heartbeat_front_addr":"172.21.15.174:6821/1949689360","state":["exists","up"]},{"osd":9,"uuid":"a0c75553-c854-445a-9eed-de0409117cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6827","nonce":1803309974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6829","nonce":1803309974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6833","nonce":1803309974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1803309974},{"type":"v1","addr":"172.21.15.103:6831","nonce":1803309974}]},"public_addr":"172.21.15.103:6827/1803309974","cluster_addr":"172.21.15.103:6829/1803309974","heartbeat_back_addr":"172.21.15.103:6833/1803309974","heartbeat_front_addr":"172.21.15.103:6831/1803309974","state":["exists","up"]},{"osd":10,"uuid":"0725ebf6-d24b-4683-a82d-ac043bc775a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6825","nonce":1441835592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6827","nonce":1441835592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6831","nonce":1441835592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1441835592},{"type":"v1","addr":"172.21.15.169:6829","nonce":1441835592}]},"public_addr":"172.21.15.169:6825/1441835592","cluster_addr":"172.21.15.169:6827/1441835592","heartbeat_back_addr":"172.21.15.169:6831/1441835592","heartbeat_front_addr":"172.21.15.169:6829/1441835592","state":["exists","up"]},{"osd":11,"uuid":"32e645a1-8f34-4719-a667-5279a3669279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6825","nonce":1501737377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6827","nonce":1501737377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6831","nonce":1501737377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1501737377},{"type":"v1","addr":"172.21.15.174:6829","nonce":1501737377}]},"public_addr":"172.21.15.174:6825/1501737377","cluster_addr":"172.21.15.174:6827/1501737377","heartbeat_back_addr":"172.21.15.174:6831/1501737377","heartbeat_front_addr":"172.21.15.174:6829/1501737377","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:06.545804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:31.436698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:55.535677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:20.280284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:43.708929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:08.155745+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:31.975606+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:56.142202+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:20.597908+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:44.934327+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:09.241155+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:33.668591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/1612408044":"2024-09-20T06:07:19.742943+0000","172.21.15.103:0/2210851046":"2024-09-20T06:07:19.742943+0000","172.21.15.103:6800/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/1922728800":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6801/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/3630145046":"2024-09-20T05:58:21.953764+0000","172.21.15.103:6801/3148507486":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/4227764370":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/2607266510":"2024-09-20T06:07:19.742943+0000","172.21.15.103:0/4011994567":"2024-09-20T05:58:21.953764+0000","172.21.15.103:0/3490453176":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/1099848692":"2024-09-20T05:58:45.371786+0000","172.21.15.103:0/550453146":"2024-09-20T06:07:19.742943+0000","172.21.15.103:6800/1007431406":"2024-09-20T05:58:45.371786+0000","172.21.15.103:6800/253046125":"2024-09-20T06:07:19.742943+0000","172.21.15.103:6801/253046125":"2024-09-20T06:07:19.742943+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:17:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.530+0000 7f7152682640 1 -- 172.21.15.103:0/2643116383 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f71340a33c0 msgr2=0x7f71340a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.530+0000 7f7152682640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f71340a33c0 0x7f71340a5880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f713c009ae0 tx=0x7f713c005f90 comp rx=0 tx=0).stop 2024-09-19T06:17:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.530+0000 7f7152682640 1 -- 172.21.15.103:0/2643116383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f714c101340 msgr2=0x7f714c1996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.530+0000 7f7152682640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f714c101340 0x7f714c1996c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7140005940 tx=0x7f71400042f0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.531+0000 7f7152682640 1 -- 172.21.15.103:0/2643116383 shutdown_connections 2024-09-19T06:17:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.531+0000 7f7152682640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f71340a33c0 0x7f71340a5880 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.531+0000 7f7152682640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f714c1069b0 0x7f714c1a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.531+0000 7f7152682640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f714c101340 0x7f714c1996c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.531+0000 7f7152682640 1 --2- 172.21.15.103:0/2643116383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f714c1009a0 0x7f714c199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.531+0000 7f7152682640 1 -- 172.21.15.103:0/2643116383 >> 172.21.15.103:0/2643116383 conn(0x7f714c0fc6c0 msgr2=0x7f714c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.531+0000 7f7152682640 1 -- 172.21.15.103:0/2643116383 shutdown_connections 2024-09-19T06:17:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.531+0000 7f7152682640 1 -- 172.21.15.103:0/2643116383 wait complete. 2024-09-19T06:17:30.544 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:00:59.680195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:05:21.617020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:05:23.597579+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 88, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:17:30.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:17:30.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.645+0000 7fbcfdc53640 1 -- 172.21.15.103:0/2622810531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf8101350 msgr2=0x7fbcf8101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.645+0000 7fbcfdc53640 1 --2- 172.21.15.103:0/2622810531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf8101350 0x7fbcf8101730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009900 tx=0x7fbce802a410 comp rx=0 tx=0).stop 2024-09-19T06:17:30.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.645+0000 7fbcfdc53640 1 -- 172.21.15.103:0/2622810531 shutdown_connections 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.645+0000 7fbcfdc53640 1 --2- 172.21.15.103:0/2622810531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf8105f80 0x7fbcf810dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.645+0000 7fbcfdc53640 1 --2- 172.21.15.103:0/2622810531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcf8101d00 0x7fbcf8105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.645+0000 7fbcfdc53640 1 --2- 172.21.15.103:0/2622810531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf8101350 0x7fbcf8101730 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.645+0000 7fbcfdc53640 1 -- 172.21.15.103:0/2622810531 >> 172.21.15.103:0/2622810531 conn(0x7fbcf8077170 msgr2=0x7fbcf80fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.645+0000 7fbcfdc53640 1 -- 172.21.15.103:0/2622810531 shutdown_connections 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.645+0000 7fbcfdc53640 1 -- 172.21.15.103:0/2622810531 wait complete. 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcfdc53640 1 Processor -- start 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcfdc53640 1 -- start start 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcfdc53640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcf8101350 0x7fbcf81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcfdc53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf8105f80 0x7fbcf81989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcfdc53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf819cd60 0x7fbcf819d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcfdc53640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8110e90 con 0x7fbcf8105f80 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcfdc53640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8110d10 con 0x7fbcf819cd60 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcfdc53640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8111010 con 0x7fbcf8101350 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcf6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf8105f80 0x7fbcf81989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcf6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf8105f80 0x7fbcf81989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52404/0 (socket says 172.21.15.103:52404) 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcf6ffd640 1 -- 172.21.15.103:0/1716159957 learned_addr learned my addr 172.21.15.103:0/1716159957 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.646+0000 7fbcf77fe640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcf8101350 0x7fbcf81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf6ffd640 1 -- 172.21.15.103:0/1716159957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcf8101350 msgr2=0x7fbcf81984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf7fff640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf819cd60 0x7fbcf819d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf6ffd640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcf8101350 0x7fbcf81984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf6ffd640 1 -- 172.21.15.103:0/1716159957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf819cd60 msgr2=0x7fbcf819d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf6ffd640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf819cd60 0x7fbcf819d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf6ffd640 1 -- 172.21.15.103:0/1716159957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf819d850 con 0x7fbcf8105f80 2024-09-19T06:17:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf7fff640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf819cd60 0x7fbcf819d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf6ffd640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf8105f80 0x7fbcf81989e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00c970 tx=0x7fbcec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf4ff9640 1 -- 172.21.15.103:0/1716159957 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec014070 con 0x7fbcf8105f80 2024-09-19T06:17:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf4ff9640 1 -- 172.21.15.103:0/1716159957 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcec004440 con 0x7fbcf8105f80 2024-09-19T06:17:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcf4ff9640 1 -- 172.21.15.103:0/1716159957 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec003e50 con 0x7fbcf8105f80 2024-09-19T06:17:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcfdc53640 1 -- 172.21.15.103:0/1716159957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf819db40 con 0x7fbcf8105f80 2024-09-19T06:17:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.647+0000 7fbcfdc53640 1 -- 172.21.15.103:0/1716159957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf81a5330 con 0x7fbcf8105f80 2024-09-19T06:17:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.648+0000 7fbcfdc53640 1 -- 172.21.15.103:0/1716159957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf8101730 con 0x7fbcf8105f80 2024-09-19T06:17:30.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.649+0000 7fbcf4ff9640 1 -- 172.21.15.103:0/1716159957 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7fbcec017070 con 0x7fbcf8105f80 2024-09-19T06:17:30.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.650+0000 7fbcf4ff9640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbce00a3560 0x7fbce00a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.650+0000 7fbcf77fe640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbce00a3560 0x7fbce00a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.650+0000 7fbcf4ff9640 1 -- 172.21.15.103:0/1716159957 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7fbcec0d0020 con 0x7fbcf8105f80 2024-09-19T06:17:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.650+0000 7fbcf77fe640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbce00a3560 0x7fbce00a5a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbce8031440 tx=0x7fbce80095f0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.653+0000 7fbcf4ff9640 1 -- 172.21.15.103:0/1716159957 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbcec01e020 con 0x7fbcf8105f80 2024-09-19T06:17:30.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.823+0000 7fbcfdc53640 1 -- 172.21.15.103:0/1716159957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbcf8101d00 con 0x7fbcf8105f80 2024-09-19T06:17:30.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.824+0000 7fbcf4ff9640 1 -- 172.21.15.103:0/1716159957 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7fbcec09ca20 con 0x7fbcf8105f80 2024-09-19T06:17:30.826 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-19T06:17:30.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 -- 172.21.15.103:0/1716159957 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbce00a3560 msgr2=0x7fbce00a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbce00a3560 0x7fbce00a5a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbce8031440 tx=0x7fbce80095f0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 -- 172.21.15.103:0/1716159957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf8105f80 msgr2=0x7fbcf81989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf8105f80 0x7fbcf81989e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00c970 tx=0x7fbcec00ce30 comp rx=0 tx=0).stop 2024-09-19T06:17:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 -- 172.21.15.103:0/1716159957 shutdown_connections 2024-09-19T06:17:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7fbce00a3560 0x7fbce00a5a20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf819cd60 0x7fbcf819d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf8105f80 0x7fbcf81989e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 --2- 172.21.15.103:0/1716159957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcf8101350 0x7fbcf81984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 -- 172.21.15.103:0/1716159957 >> 172.21.15.103:0/1716159957 conn(0x7fbcf8077170 msgr2=0x7fbcf8100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 -- 172.21.15.103:0/1716159957 shutdown_connections 2024-09-19T06:17:30.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.826+0000 7fbcfdc53640 1 -- 172.21.15.103:0/1716159957 wait complete. 2024-09-19T06:17:30.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:17:30.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.940+0000 7f8ee5966640 1 -- 172.21.15.103:0/220530494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee0100980 msgr2=0x7f8ee0100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.940+0000 7f8ee5966640 1 --2- 172.21.15.103:0/220530494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee0100980 0x7f8ee0100de0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009930 tx=0x7f8ed402a420 comp rx=0 tx=0).stop 2024-09-19T06:17:30.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.940+0000 7f8ee5966640 1 -- 172.21.15.103:0/220530494 shutdown_connections 2024-09-19T06:17:30.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.940+0000 7f8ee5966640 1 --2- 172.21.15.103:0/220530494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ee0101320 0x7f8ee010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.940+0000 7f8ee5966640 1 --2- 172.21.15.103:0/220530494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee0100980 0x7f8ee0100de0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.940+0000 7f8ee5966640 1 --2- 172.21.15.103:0/220530494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ee0106990 0x7f8ee0106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.940+0000 7f8ee5966640 1 -- 172.21.15.103:0/220530494 >> 172.21.15.103:0/220530494 conn(0x7f8ee00779d0 msgr2=0x7f8ee00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.940+0000 7f8ee5966640 1 -- 172.21.15.103:0/220530494 shutdown_connections 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.940+0000 7f8ee5966640 1 -- 172.21.15.103:0/220530494 wait complete. 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8ee5966640 1 Processor -- start 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8ee5966640 1 -- start start 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8ee5966640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee0100980 0x7f8ee0199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8ee5966640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ee0101320 0x7f8ee01997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8ee5966640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ee0106990 0x7f8ee01a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8ee5966640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0110c80 con 0x7f8ee0100980 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8ee5966640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0110b00 con 0x7f8ee0101320 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8ee5966640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0110e00 con 0x7f8ee0106990 2024-09-19T06:17:30.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8edeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee0100980 0x7f8ee0199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8edeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee0100980 0x7f8ee0199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52430/0 (socket says 172.21.15.103:52430) 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.941+0000 7f8edeffd640 1 -- 172.21.15.103:0/2613690580 learned_addr learned my addr 172.21.15.103:0/2613690580 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8ede7fc640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ee0101320 0x7f8ee01997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8edf7fe640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ee0106990 0x7f8ee01a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8edeffd640 1 -- 172.21.15.103:0/2613690580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ee0106990 msgr2=0x7f8ee01a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8edeffd640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ee0106990 0x7f8ee01a42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8edeffd640 1 -- 172.21.15.103:0/2613690580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ee0101320 msgr2=0x7f8ee01997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8edeffd640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ee0101320 0x7f8ee01997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8edeffd640 1 -- 172.21.15.103:0/2613690580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee01a4830 con 0x7f8ee0100980 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8ede7fc640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ee0101320 0x7f8ee01997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8edeffd640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee0100980 0x7f8ee0199270 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000ba50 tx=0x7f8ed000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8ee4964640 1 -- 172.21.15.103:0/2613690580 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0019070 con 0x7f8ee0100980 2024-09-19T06:17:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8ee5966640 1 -- 172.21.15.103:0/2613690580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee01a4a00 con 0x7f8ee0100980 2024-09-19T06:17:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8ee4964640 1 -- 172.21.15.103:0/2613690580 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ed000cbe0 con 0x7f8ee0100980 2024-09-19T06:17:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8ee4964640 1 -- 172.21.15.103:0/2613690580 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed00075d0 con 0x7f8ee0100980 2024-09-19T06:17:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.942+0000 7f8ee5966640 1 -- 172.21.15.103:0/2613690580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee01a4ed0 con 0x7f8ee0100980 2024-09-19T06:17:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.943+0000 7f8ee5966640 1 -- 172.21.15.103:0/2613690580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee0100de0 con 0x7f8ee0100980 2024-09-19T06:17:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.944+0000 7f8ee4964640 1 -- 172.21.15.103:0/2613690580 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f8ed001c070 con 0x7f8ee0100980 2024-09-19T06:17:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.945+0000 7f8ee4964640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8ec80a33c0 0x7f8ec80a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.945+0000 7f8ee4964640 1 -- 172.21.15.103:0/2613690580 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f8ed00cf780 con 0x7f8ee0100980 2024-09-19T06:17:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.945+0000 7f8ede7fc640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8ec80a33c0 0x7f8ec80a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.945+0000 7f8ede7fc640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8ec80a33c0 0x7f8ec80a5880 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4000c00 tx=0x7f8ed4031400 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:30.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:30.948+0000 7f8ee4964640 1 -- 172.21.15.103:0/2613690580 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ed009c290 con 0x7f8ee0100980 2024-09-19T06:17:31.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.118+0000 7f8ee5966640 1 -- 172.21.15.103:0/2613690580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8ee0108f40 con 0x7f8ee0100980 2024-09-19T06:17:31.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.118+0000 7f8ee4964640 1 -- 172.21.15.103:0/2613690580 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f8ed009bb90 con 0x7f8ee0100980 2024-09-19T06:17:31.121 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-09-19T06:17:31.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 -- 172.21.15.103:0/2613690580 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8ec80a33c0 msgr2=0x7f8ec80a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8ec80a33c0 0x7f8ec80a5880 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4000c00 tx=0x7f8ed4031400 comp rx=0 tx=0).stop 2024-09-19T06:17:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 -- 172.21.15.103:0/2613690580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee0100980 msgr2=0x7f8ee0199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee0100980 0x7f8ee0199270 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000ba50 tx=0x7f8ed000bf10 comp rx=0 tx=0).stop 2024-09-19T06:17:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 -- 172.21.15.103:0/2613690580 shutdown_connections 2024-09-19T06:17:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f8ec80a33c0 0x7f8ec80a5880 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ee0106990 0x7f8ee01a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ee0101320 0x7f8ee01997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 --2- 172.21.15.103:0/2613690580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee0100980 0x7f8ee0199270 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 -- 172.21.15.103:0/2613690580 >> 172.21.15.103:0/2613690580 conn(0x7f8ee00779d0 msgr2=0x7f8ee00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 -- 172.21.15.103:0/2613690580 shutdown_connections 2024-09-19T06:17:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.120+0000 7f8ee5966640 1 -- 172.21.15.103:0/2613690580 wait complete. 2024-09-19T06:17:31.133 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:17:31.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.233+0000 7f6d1922e640 1 -- 172.21.15.103:0/3144053050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d14101350 msgr2=0x7f6d1410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.233+0000 7f6d1922e640 1 --2- 172.21.15.103:0/3144053050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d14101350 0x7f6d1410d880 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009cd0 tx=0x7f6d0c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.233+0000 7f6d1922e640 1 -- 172.21.15.103:0/3144053050 shutdown_connections 2024-09-19T06:17:31.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.233+0000 7f6d1922e640 1 --2- 172.21.15.103:0/3144053050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d14101350 0x7f6d1410d880 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.233+0000 7f6d1922e640 1 --2- 172.21.15.103:0/3144053050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d141009b0 0x7f6d14100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.233+0000 7f6d1922e640 1 --2- 172.21.15.103:0/3144053050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d141069c0 0x7f6d14106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.233+0000 7f6d1922e640 1 -- 172.21.15.103:0/3144053050 >> 172.21.15.103:0/3144053050 conn(0x7f6d140fc690 msgr2=0x7f6d140feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:31.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.233+0000 7f6d1922e640 1 -- 172.21.15.103:0/3144053050 shutdown_connections 2024-09-19T06:17:31.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.233+0000 7f6d1922e640 1 -- 172.21.15.103:0/3144053050 wait complete. 2024-09-19T06:17:31.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.233+0000 7f6d1922e640 1 Processor -- start 2024-09-19T06:17:31.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1922e640 1 -- start start 2024-09-19T06:17:31.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1922e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d141009b0 0x7f6d14199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1922e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d14101350 0x7f6d14199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1922e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d141069c0 0x7f6d141a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1922e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6d14110cb0 con 0x7f6d141069c0 2024-09-19T06:17:31.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1922e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d14110b30 con 0x7f6d141009b0 2024-09-19T06:17:31.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1922e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6d14110e30 con 0x7f6d14101350 2024-09-19T06:17:31.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d141069c0 0x7f6d141a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d141069c0 0x7f6d141a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52436/0 (socket says 172.21.15.103:52436) 2024-09-19T06:17:31.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1359e640 1 -- 172.21.15.103:0/3385960980 learned_addr learned my addr 172.21.15.103:0/3385960980 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:17:31.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1259c640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d14101350 0x7f6d14199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d12d9d640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d141009b0 0x7f6d14199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1359e640 1 -- 172.21.15.103:0/3385960980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d14101350 msgr2=0x7f6d14199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1359e640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d14101350 0x7f6d14199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1359e640 1 -- 172.21.15.103:0/3385960980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d141009b0 msgr2=0x7f6d14199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1359e640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d141009b0 0x7f6d14199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1359e640 1 -- 172.21.15.103:0/3385960980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d141a47c0 con 0x7f6d141069c0 2024-09-19T06:17:31.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.234+0000 7f6d1359e640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d141069c0 0x7f6d141a4280 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c005cc0 tx=0x7f6d0c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:31.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.235+0000 7f6cfbfff640 1 -- 172.21.15.103:0/3385960980 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c004450 con 0x7f6d141069c0 2024-09-19T06:17:31.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.235+0000 7f6d1922e640 1 -- 172.21.15.103:0/3385960980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d141a4990 con 0x7f6d141069c0 2024-09-19T06:17:31.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.235+0000 7f6cfbfff640 1 -- 172.21.15.103:0/3385960980 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d0c031c90 con 0x7f6d141069c0 2024-09-19T06:17:31.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.235+0000 7f6cfbfff640 1 -- 172.21.15.103:0/3385960980 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c030e70 con 0x7f6d141069c0 2024-09-19T06:17:31.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.235+0000 7f6d1922e640 1 -- 172.21.15.103:0/3385960980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d141a4ed0 con 0x7f6d141069c0 2024-09-19T06:17:31.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.236+0000 7f6d1922e640 1 -- 172.21.15.103:0/3385960980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d14100e10 con 0x7f6d141069c0 2024-09-19T06:17:31.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.237+0000 7f6cfbfff640 1 -- 172.21.15.103:0/3385960980 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f6d0c0045f0 con 0x7f6d141069c0 2024-09-19T06:17:31.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.237+0000 7f6cfbfff640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f6cfc0a33c0 0x7f6cfc0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.238+0000 7f6d12d9d640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f6cfc0a33c0 0x7f6cfc0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.238+0000 7f6cfbfff640 1 -- 172.21.15.103:0/3385960980 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f6d0c02e030 con 0x7f6d141069c0 2024-09-19T06:17:31.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.238+0000 7f6d12d9d640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f6cfc0a33c0 0x7f6cfc0a5880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009990 tx=0x7f6d04009110 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:31.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.240+0000 7f6cfbfff640 1 -- 172.21.15.103:0/3385960980 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d0c04b060 con 0x7f6d141069c0 2024-09-19T06:17:31.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.407+0000 7f6d1922e640 1 -- 172.21.15.103:0/3385960980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6d14108f40 con 0x7f6d141069c0 2024-09-19T06:17:31.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.408+0000 7f6cfbfff640 1 -- 172.21.15.103:0/3385960980 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f6d0c0098b0 con 0x7f6d141069c0 2024-09-19T06:17:31.410 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-09-19T06:17:31.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.409+0000 7f6d1922e640 1 -- 172.21.15.103:0/3385960980 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f6cfc0a33c0 msgr2=0x7f6cfc0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.409+0000 7f6d1922e640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f6cfc0a33c0 0x7f6cfc0a5880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009990 tx=0x7f6d04009110 comp rx=0 tx=0).stop 2024-09-19T06:17:31.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.410+0000 7f6d1922e640 1 -- 172.21.15.103:0/3385960980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d141069c0 msgr2=0x7f6d141a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.410+0000 7f6d1922e640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d141069c0 0x7f6d141a4280 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c005cc0 tx=0x7f6d0c003c20 comp rx=0 tx=0).stop 2024-09-19T06:17:31.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.410+0000 7f6d1922e640 1 -- 172.21.15.103:0/3385960980 shutdown_connections 2024-09-19T06:17:31.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.410+0000 7f6d1922e640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f6cfc0a33c0 0x7f6cfc0a5880 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.410+0000 7f6d1922e640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d141069c0 0x7f6d141a4280 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.410+0000 7f6d1922e640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d14101350 0x7f6d14199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.410+0000 7f6d1922e640 1 --2- 172.21.15.103:0/3385960980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d141009b0 0x7f6d14199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.410+0000 7f6d1922e640 1 -- 172.21.15.103:0/3385960980 >> 172.21.15.103:0/3385960980 conn(0x7f6d140fc690 msgr2=0x7f6d140fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:31.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.410+0000 7f6d1922e640 1 -- 172.21.15.103:0/3385960980 shutdown_connections 2024-09-19T06:17:31.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.410+0000 7f6d1922e640 1 -- 172.21.15.103:0/3385960980 wait complete. 2024-09-19T06:17:31.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.519+0000 7f634dc0a640 1 -- 172.21.15.103:0/52745385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6348102440 msgr2=0x7f634810e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.519+0000 7f634dc0a640 1 --2- 172.21.15.103:0/52745385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6348102440 0x7f634810e970 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6340009cd0 tx=0x7f634002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.519+0000 7f634dc0a640 1 -- 172.21.15.103:0/52745385 shutdown_connections 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.519+0000 7f634dc0a640 1 --2- 172.21.15.103:0/52745385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6348102440 0x7f634810e970 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.519+0000 7f634dc0a640 1 --2- 172.21.15.103:0/52745385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6348101aa0 0x7f6348101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.519+0000 7f634dc0a640 1 --2- 172.21.15.103:0/52745385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6348107ab0 0x7f6348107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.519+0000 7f634dc0a640 1 -- 172.21.15.103:0/52745385 >> 172.21.15.103:0/52745385 conn(0x7f63480fd7c0 msgr2=0x7f63480ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.519+0000 7f634dc0a640 1 -- 172.21.15.103:0/52745385 shutdown_connections 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.519+0000 7f634dc0a640 1 -- 172.21.15.103:0/52745385 wait complete. 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.520+0000 7f634dc0a640 1 Processor -- start 2024-09-19T06:17:31.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.520+0000 7f634dc0a640 1 -- start start 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.520+0000 7f634dc0a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6348101aa0 0x7f6348198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.520+0000 7f634dc0a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6348102440 0x7f6348198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.520+0000 7f634dc0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6348107ab0 0x7f634819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.520+0000 7f634dc0a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6348111da0 con 0x7f6348107ab0 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.520+0000 7f634dc0a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6348111c20 con 0x7f6348101aa0 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.520+0000 7f634dc0a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6348111f20 con 0x7f6348102440 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.520+0000 7f6347fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6348107ab0 0x7f634819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6347fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6348107ab0 0x7f634819cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52454/0 (socket says 172.21.15.103:52454) 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6347fff640 1 -- 172.21.15.103:0/1775492608 learned_addr learned my addr 172.21.15.103:0/1775492608 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6346ffd640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6348102440 0x7f6348198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f63477fe640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6348101aa0 0x7f6348198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6347fff640 1 -- 172.21.15.103:0/1775492608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6348102440 msgr2=0x7f6348198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6347fff640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6348102440 0x7f6348198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6347fff640 1 -- 172.21.15.103:0/1775492608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6348101aa0 msgr2=0x7f6348198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6347fff640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6348101aa0 0x7f6348198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6347fff640 1 -- 172.21.15.103:0/1775492608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634819d240 con 0x7f6348107ab0 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f63477fe640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6348101aa0 0x7f6348198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6347fff640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6348107ab0 0x7f634819cb10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6340005cc0 tx=0x7f6340003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6344ff9640 1 -- 172.21.15.103:0/1775492608 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340004450 con 0x7f6348107ab0 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f634dc0a640 1 -- 172.21.15.103:0/1775492608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634819d4d0 con 0x7f6348107ab0 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6344ff9640 1 -- 172.21.15.103:0/1775492608 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6340031c90 con 0x7f6348107ab0 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f6344ff9640 1 -- 172.21.15.103:0/1775492608 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634003b400 con 0x7f6348107ab0 2024-09-19T06:17:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.521+0000 7f634dc0a640 1 -- 172.21.15.103:0/1775492608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63481a4dc0 con 0x7f6348107ab0 2024-09-19T06:17:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.522+0000 7f634dc0a640 1 -- 172.21.15.103:0/1775492608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6348101f00 con 0x7f6348107ab0 2024-09-19T06:17:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.523+0000 7f6344ff9640 1 -- 172.21.15.103:0/1775492608 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f6340004680 con 0x7f6348107ab0 2024-09-19T06:17:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.524+0000 7f6344ff9640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f63300a33c0 0x7f63300a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.524+0000 7f63477fe640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f63300a33c0 0x7f63300a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.524+0000 7f6344ff9640 1 -- 172.21.15.103:0/1775492608 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f634002e030 con 0x7f6348107ab0 2024-09-19T06:17:31.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.524+0000 7f63477fe640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f63300a33c0 0x7f63300a5880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6338005e10 tx=0x7f6338005da0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:31.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.527+0000 7f6344ff9640 1 -- 172.21.15.103:0/1775492608 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f63400bde40 con 0x7f6348107ab0 2024-09-19T06:17:31.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.740+0000 7f634dc0a640 1 -- 172.21.15.103:0/1775492608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f63481995a0 con 0x7f6348107ab0 2024-09-19T06:17:31.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:31 smithi103 ceph-mon[30925]: from='client.16134 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:17:31.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:31 smithi103 ceph-mon[30925]: pgmap v316: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:17:31.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:31 smithi103 ceph-mon[30925]: from='client.16140 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:17:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:31 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2643116383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:17:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:31 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1716159957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:17:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:31 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2613690580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:17:31.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:31 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/3385960980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:17:31.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.748+0000 7f6344ff9640 1 -- 172.21.15.103:0/1775492608 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+742878 (secure 0 0 0) 0x7f63481995a0 con 0x7f6348107ab0 2024-09-19T06:17:31.760 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T06:17:31.760 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 26, 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: "active_gid": 15189, 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: "active_name": "x", 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: "active_addrs": { 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 266758959 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 266758959 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: "active_addr": "172.21.15.103:6801/266758959", 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: "active_change": "2024-09-19T06:07:19.743135+0000", 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: "available": true, 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: "standbys": [ 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: "gid": 24767, 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "y", 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "available_modules": [ 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "alerts", 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.763 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.764 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.765 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.766 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.767 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.768 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.769 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_destination": { 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_destination", 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.770 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_from_name": { 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_from_name", 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.771 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "Ceph", 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email From: name", 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_host": { 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_host", 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.772 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP server", 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_password": { 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_password", 2024-09-19T06:17:31.773 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Password to authenticate with", 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_port": { 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_port", 2024-09-19T06:17:31.774 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "465", 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP port", 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_sender": { 2024-09-19T06:17:31.775 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_sender", 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_ssl": { 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_ssl", 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.777 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_user": { 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_user", 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.778 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "User to authenticate as", 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "balancer", 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: "active": { 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "active", 2024-09-19T06:17:31.779 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.780 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_time": { 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_time", 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0000", 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_weekday": { 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_weekday", 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:17:31.782 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_max_iterations": { 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "25", 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "250", 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.783 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:17:31.784 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.784 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.784 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.784 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_metrics": { 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_metrics", 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_step": { 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_step", 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.5", 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0.001", 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "0.999", 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:17:31.786 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:17:31.787 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.787 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.787 INFO:teuthology.orchestra.run.smithi103.stdout: "end_time": { 2024-09-19T06:17:31.787 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_time", 2024-09-19T06:17:31.787 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.787 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.787 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.787 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2359", 2024-09-19T06:17:31.788 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.788 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.788 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.788 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:17:31.788 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:17:31.788 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.788 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "end_weekday": { 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_weekday", 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:17:31.789 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.790 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:31.791 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:31.792 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.792 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.792 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.792 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.792 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.792 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.792 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.792 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.792 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.792 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.793 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:31.794 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "min_score": { 2024-09-19T06:17:31.795 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_score", 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.796 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "upmap", 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-compat", 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "none", 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "read", 2024-09-19T06:17:31.797 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap", 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap-read" 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Balancer mode", 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_ids": { 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_ids", 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.798 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.799 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_deviation": { 2024-09-19T06:17:31.800 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_deviation", 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_optimizations": { 2024-09-19T06:17:31.801 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm", 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_down_multiplier": { 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_down_multiplier", 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.803 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_refresh_rate": { 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_refresh_rate", 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "20", 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_starting_port": { 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_starting_port", 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4721", 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.806 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_ptrace": { 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_ptrace", 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:17:31.807 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_interval": { 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_interval", 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.808 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.809 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.7", 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_log_destination": { 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm_log_destination", 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.810 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "file", 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "file,syslog", 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "syslog" 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.811 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "cgroups_split": { 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cgroups_split", 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.812 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "config_checks_enabled": { 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_checks_enabled", 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:17:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.814 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.814 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.814 INFO:teuthology.orchestra.run.smithi103.stdout: "config_dashboard": { 2024-09-19T06:17:31.814 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_dashboard", 2024-09-19T06:17:31.814 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.814 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.814 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.814 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.814 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_alertmanager": { 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_alertmanager", 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.815 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_base": { 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_base", 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.816 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_elasticsearch": { 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:17:31.817 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "elasticsearch container image", 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_grafana": { 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_grafana", 2024-09-19T06:17:31.818 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_haproxy": { 2024-09-19T06:17:31.819 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_haproxy", 2024-09-19T06:17:31.820 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.820 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.820 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.820 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:17:31.820 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.820 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.820 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "HAproxy container image", 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_agent": { 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.821 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_collector": { 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.822 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_query": { 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:17:31.823 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger query container image", 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_keepalived": { 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_keepalived", 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.824 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Keepalived container image", 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_loki": { 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_loki", 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.825 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Loki container image", 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_node_exporter": { 2024-09-19T06:17:31.826 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_node_exporter", 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nvmeof": { 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nvmeof", 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nvme-of container image", 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.828 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_prometheus": { 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_prometheus", 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.829 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_promtail": { 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_promtail", 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Promtail container image", 2024-09-19T06:17:31.830 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba": { 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba", 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.831 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_snmp_gateway": { 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.832 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "container_init": { 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_init", 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.833 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "daemon_cache_timeout": { 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.834 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.835 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "900", 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "default_registry": { 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_registry", 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.836 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io", 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: "device_cache_timeout": { 2024-09-19T06:17:31.837 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_cache_timeout", 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1800", 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "device_enhanced_scan": { 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_enhanced_scan", 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.839 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "facts_cache_timeout": { 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "facts_cache_timeout", 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:17:31.840 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "grafana_dashboards_path": { 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.841 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "host_check_interval": { 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "host_check_interval", 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.842 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "hw_monitoring": { 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hw_monitoring", 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "inventory_list_all": { 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "inventory_list_all", 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.844 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.845 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.846 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "log_refresh_metadata": { 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_refresh_metadata", 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.847 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.848 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.849 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.851 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:17:31.852 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.853 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.853 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.853 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:17:31.853 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:17:31.853 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.853 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.853 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.853 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "*", 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "max_count_per_host": { 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_count_per_host", 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.854 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd_draining_count": { 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_osd_draining_count", 2024-09-19T06:17:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: "migration_current": { 2024-09-19T06:17:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "migration_current", 2024-09-19T06:17:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "internal - do not modify", 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "root", 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm-package", 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "root" 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "oob_default_addr": { 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "oob_default_addr", 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "169.254.1.1", 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "prometheus_alerts_path": { 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_insecure": { 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_insecure", 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:17:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_password": { 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_password", 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:17:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_url": { 2024-09-19T06:17:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_url", 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_username": { 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_username", 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:17:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "secure_monitoring_stack": { 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "service_discovery_port": { 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "service_discovery_port", 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8765", 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "ssh_config_file": { 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssh_config_file", 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "use_agent": { 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_agent", 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "use_repo_digest": { 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_repo_digest", 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_failed_host_check": { 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_daemons": { 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:17:31.873 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_hosts": { 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:17:31.874 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.876 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crash", 2024-09-19T06:17:31.876 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:31.876 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:31.876 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:31.876 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:31.876 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:31.876 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.876 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.876 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.877 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.878 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:31.879 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.880 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.880 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.880 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.880 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.880 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.880 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.880 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.880 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.880 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.880 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.881 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "retain_interval": { 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retain_interval", 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.882 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "31536000", 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_recent_interval": { 2024-09-19T06:17:31.883 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_recent_interval", 2024-09-19T06:17:31.884 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.884 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.884 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.884 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1209600", 2024-09-19T06:17:31.884 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.884 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.884 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dashboard", 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:31.885 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.886 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.887 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.887 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:17:31.887 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:17:31.887 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.887 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.887 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.887 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.887 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.888 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.888 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.888 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.888 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.888 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.888 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.888 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:17:31.888 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:17:31.888 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:17:31.889 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.891 INFO:teuthology.orchestra.run.smithi103.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:17:31.892 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:17:31.892 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.892 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.892 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.892 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.892 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.892 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.892 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.892 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.892 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.893 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.894 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.895 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.896 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.897 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:17:31.898 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:17:31.899 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:17:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.901 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-19T06:17:31.902 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.903 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.904 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.904 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.904 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.904 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.904 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.904 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.904 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.904 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_URL": { 2024-09-19T06:17:31.904 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.906 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.907 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.908 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.908 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.908 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.908 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:17:31.908 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:17:31.908 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.908 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.908 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.908 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.909 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:17:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:17:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.912 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.913 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.914 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.914 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.914 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.914 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.914 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.914 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.914 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.914 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.914 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.915 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.916 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.917 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.919 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.920 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.921 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:17:31.922 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.925 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8", 2024-09-19T06:17:31.926 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.927 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "45", 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.928 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:17:31.929 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.930 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.931 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.932 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.934 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.935 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "cross_origin_url": { 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cross_origin_url", 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "crt_file": { 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crt_file", 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "debug": { 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "debug", 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.938 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "jwt_token_ttl": { 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "jwt_token_ttl", 2024-09-19T06:17:31.939 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "28800", 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-19T06:17:31.940 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.942 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.943 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:31.944 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.945 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.946 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.948 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.948 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.948 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.948 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.948 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.948 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.948 INFO:teuthology.orchestra.run.smithi103.stdout: "motd": { 2024-09-19T06:17:31.948 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "motd", 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "The message of the day", 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:17:31.949 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.950 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8080", 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.952 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.953 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl_server_port": { 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl_server_port", 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8443", 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.954 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "redirect", 2024-09-19T06:17:31.955 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect" 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-19T06:17:31.956 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "url_prefix": { 2024-09-19T06:17:31.957 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url_prefix", 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.958 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_monitoring": { 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_monitoring", 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.959 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "monitor device health metrics", 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.960 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.961 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.962 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.963 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.964 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.964 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.964 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.964 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.964 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.964 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.964 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.964 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.965 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "mark_out_threshold": { 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mark_out_threshold", 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2419200", 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.966 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": { 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_name", 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "device_health_metrics", 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "retention_period": { 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retention_period", 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15552000", 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:17:31.968 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_frequency": { 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_frequency", 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.969 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "self_heal": { 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "self_heal", 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.971 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_threshold": { 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_threshold", 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7257600", 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.972 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "diskprediction_local", 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:31.973 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.974 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.975 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.977 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "predict_interval": { 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predict_interval", 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.979 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "predictor_model": { 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predictor_model", 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "prophetstor", 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.980 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.981 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "influx", 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": false, 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: "batch_size": { 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "batch_size", 2024-09-19T06:17:31.982 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5000", 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.983 INFO:teuthology.orchestra.run.smithi103.stdout: "database": { 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "database", 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "ceph", 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.984 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": { 2024-09-19T06:17:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hostname", 2024-09-19T06:17:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "30", 2024-09-19T06:17:31.986 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "5", 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.988 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.989 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.990 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.991 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.992 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "password": { 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "password", 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.993 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "port": { 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "port", 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8086", 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.994 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server port", 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "false", 2024-09-19T06:17:31.995 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: "threads": { 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threads", 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:31.996 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "32", 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "username": { 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "username", 2024-09-19T06:17:31.997 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout: "verify_ssl": { 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "verify_ssl", 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "true", 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:31.999 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "insights", 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.000 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.001 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.002 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.003 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.004 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.005 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "iostat", 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.006 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.008 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.009 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.010 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "k8sevents", 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.011 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_event_retention_days": { 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7", 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "config_check_secs": { 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_check_secs", 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "10", 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:17:32.013 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.014 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.015 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.015 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.015 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.015 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.015 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.015 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.015 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.015 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.015 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.016 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.017 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.018 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.019 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "localpool", 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: "failure_domain": { 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "failure_domain", 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.020 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "host", 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.021 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.022 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.023 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.024 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.025 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": { 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_size", 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "num_rep": { 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "num_rep", 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3", 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.028 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": { 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_num", 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "128", 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.029 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "prefix": { 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prefix", 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:17:32.030 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "subtree": { 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "subtree", 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "rack", 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.031 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mds_autoscaler", 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.032 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.033 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.034 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.035 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.037 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirroring", 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.038 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.039 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.040 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.041 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "nfs", 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.043 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.044 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.046 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.047 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.048 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "fail_fs": { 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "fail_fs", 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.050 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.051 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.054 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.055 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator": { 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.056 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "rook", 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "test_orchestrator" 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Orchestrator backend", 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.057 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_perf_query", 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.058 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.059 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_support", 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_autoscaler", 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "threshold": { 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threshold", 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1.0", 2024-09-19T06:17:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "scaling threshold", 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "progress", 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_pg_recovery_event": { 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.078 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.084 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: "max_completed_events": { 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_completed_events", 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "50", 2024-09-19T06:17:32.085 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus", 2024-09-19T06:17:32.087 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "cache": { 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cache", 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.088 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "exclude_perf_counters": { 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "exclude_perf_counters", 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:17:32.089 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.090 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.091 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.092 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.093 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.094 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools": { 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools", 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.095 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.096 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "300", 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_interval": { 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_interval", 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15.0", 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.099 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "9283", 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "stale_cache_strategy": { 2024-09-19T06:17:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stale_cache_strategy", 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "log", 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-19T06:17:32.101 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "default", 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "default", 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "error" 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.102 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.108 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_snap_create": { 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.110 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.111 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "trash_purge_schedule": { 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "trash_purge_schedule", 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.112 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "restful", 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_auth": { 2024-09-19T06:17:32.113 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_auth", 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-19T06:17:32.114 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-19T06:17:32.115 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.115 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.115 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.115 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.115 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.115 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.115 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.115 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.115 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.116 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.118 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.120 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-19T06:17:32.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-19T06:17:32.122 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rgw", 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.124 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.126 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.127 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.128 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.133 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:17:32.134 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.135 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rook", 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.138 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.141 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "storage_class": { 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "storage_class", 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "local", 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.142 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "selftest", 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.145 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.146 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "roption1": { 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption1", 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.149 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "roption2": { 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption2", 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "xyz", 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.150 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption1": { 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption1", 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.151 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption2": { 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption2", 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.152 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption3": { 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption3", 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.153 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption4": { 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption4", 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.154 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption5": { 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption5", 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption6": { 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption6", 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.156 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption7": { 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption7", 2024-09-19T06:17:32.157 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "42", 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "testkey": { 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testkey", 2024-09-19T06:17:32.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "testlkey": { 2024-09-19T06:17:32.159 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testlkey", 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.160 INFO:teuthology.orchestra.run.smithi103.stdout: "testnewline": { 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testnewline", 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.161 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_m_granularity": { 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_m_granularity", 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.162 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "dump_on_update": { 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dump_on_update", 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.163 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.164 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.165 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.166 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.169 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stats", 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.170 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.171 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.172 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.173 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.175 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "status", 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.176 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.178 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.179 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.180 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telegraf", 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "address": { 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "address", 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.182 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15", 2024-09-19T06:17:32.183 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.184 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.185 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.187 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.188 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.189 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telemetry", 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_basic": { 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_basic", 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.190 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_crash": { 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_crash", 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.191 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_device": { 2024-09-19T06:17:32.192 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_device", 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.193 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_ident": { 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_ident", 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_perf": { 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_perf", 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.195 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "contact": { 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "contact", 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.196 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "description": { 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "description", 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.197 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "device_url": { 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_url", 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.198 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.199 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "24", 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "8", 2024-09-19T06:17:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "last_opt_revision": { 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "last_opt_revision", 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1", 2024-09-19T06:17:32.201 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard": { 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard", 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.202 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard_description": { 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard_description", 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.203 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.204 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.206 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.207 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.208 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "organization": { 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "organization", 2024-09-19T06:17:32.209 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "proxy": { 2024-09-19T06:17:32.210 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "proxy", 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "url": { 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url", 2024-09-19T06:17:32.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "test_orchestrator", 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.213 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.214 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.215 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.216 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.217 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.218 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.219 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.221 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.222 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.223 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_clones": { 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_clones", 2024-09-19T06:17:32.224 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4", 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.225 INFO:teuthology.orchestra.run.smithi103.stdout: "periodic_async_work": { 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "periodic_async_work", 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Periodically check for async work", 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_delay": { 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.227 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.228 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix", 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: "discovery_interval": { 2024-09-19T06:17:32.229 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "discovery_interval", 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "100", 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.230 INFO:teuthology.orchestra.run.smithi103.stdout: "identifier": { 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "identifier", 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.232 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.233 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.234 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.235 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.236 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.237 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_host": { 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_host", 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.238 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_port": { 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_port", 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10051", 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.239 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_sender": { 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_sender", 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:17:32.240 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.241 INFO:teuthology.orchestra.run.smithi103.stdout: "gid": 24770, 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "z", 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "available_modules": [ 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "alerts", 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.242 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.243 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.244 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.245 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.246 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.247 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_destination": { 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_destination", 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.249 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_from_name": { 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_from_name", 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "Ceph", 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email From: name", 2024-09-19T06:17:32.250 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_host": { 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_host", 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP server", 2024-09-19T06:17:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_password": { 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_password", 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Password to authenticate with", 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_port": { 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_port", 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "465", 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP port", 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_sender": { 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_sender", 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_ssl": { 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_ssl", 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_user": { 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_user", 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "User to authenticate as", 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "balancer", 2024-09-19T06:17:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "active": { 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "active", 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_time": { 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_time", 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0000", 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:17:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_weekday": { 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_weekday", 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_max_iterations": { 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "25", 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "250", 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_metrics": { 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_metrics", 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_step": { 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_step", 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.5", 2024-09-19T06:17:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0.001", 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "0.999", 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "end_time": { 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_time", 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2359", 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "end_weekday": { 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_weekday", 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.267 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.268 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.269 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.270 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "min_score": { 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_score", 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.272 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "upmap", 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-compat", 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "none", 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "read", 2024-09-19T06:17:32.273 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap", 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap-read" 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Balancer mode", 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_ids": { 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_ids", 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.274 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.275 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_deviation": { 2024-09-19T06:17:32.276 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_deviation", 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.277 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_optimizations": { 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.278 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm", 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_down_multiplier": { 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_down_multiplier", 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_refresh_rate": { 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_refresh_rate", 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "20", 2024-09-19T06:17:32.280 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_starting_port": { 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_starting_port", 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.281 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4721", 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_ptrace": { 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_ptrace", 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.282 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_interval": { 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_interval", 2024-09-19T06:17:32.283 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:17:32.284 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.7", 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.285 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_log_destination": { 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm_log_destination", 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "file", 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "file,syslog", 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: "syslog" 2024-09-19T06:17:32.286 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "cgroups_split": { 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cgroups_split", 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.287 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "config_checks_enabled": { 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_checks_enabled", 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.288 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "config_dashboard": { 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_dashboard", 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.289 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_alertmanager": { 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_alertmanager", 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.290 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_base": { 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_base", 2024-09-19T06:17:32.291 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_elasticsearch": { 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "elasticsearch container image", 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_grafana": { 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_grafana", 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_haproxy": { 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_haproxy", 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "HAproxy container image", 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.295 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_agent": { 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:17:32.296 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_collector": { 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.297 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_query": { 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.298 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger query container image", 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_keepalived": { 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_keepalived", 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:17:32.299 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Keepalived container image", 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_loki": { 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_loki", 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.300 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Loki container image", 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_node_exporter": { 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_node_exporter", 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.301 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nvmeof": { 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nvmeof", 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.302 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nvme-of container image", 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_prometheus": { 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_prometheus", 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_promtail": { 2024-09-19T06:17:32.304 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_promtail", 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Promtail container image", 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba": { 2024-09-19T06:17:32.305 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba", 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.306 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_snmp_gateway": { 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.307 INFO:teuthology.orchestra.run.smithi103.stdout: "container_init": { 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_init", 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.308 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "daemon_cache_timeout": { 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.309 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "900", 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:17:32.310 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "default_registry": { 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_registry", 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io", 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.311 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "device_cache_timeout": { 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_cache_timeout", 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1800", 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.312 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "device_enhanced_scan": { 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_enhanced_scan", 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.313 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "facts_cache_timeout": { 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "facts_cache_timeout", 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.314 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "grafana_dashboards_path": { 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.315 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "host_check_interval": { 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "host_check_interval", 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.316 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "hw_monitoring": { 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hw_monitoring", 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.317 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "inventory_list_all": { 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "inventory_list_all", 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.318 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.319 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.320 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "log_refresh_metadata": { 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_refresh_metadata", 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.321 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.322 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.323 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "*", 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "max_count_per_host": { 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_count_per_host", 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd_draining_count": { 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_osd_draining_count", 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "migration_current": { 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "migration_current", 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.330 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "internal - do not modify", 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.331 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "root", 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm-package", 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "root" 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "oob_default_addr": { 2024-09-19T06:17:32.332 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "oob_default_addr", 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "169.254.1.1", 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: "prometheus_alerts_path": { 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.334 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_insecure": { 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_insecure", 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.335 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_password": { 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_password", 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:17:32.336 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_url": { 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_url", 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.337 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_username": { 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_username", 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.338 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "secure_monitoring_stack": { 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.339 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "service_discovery_port": { 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "service_discovery_port", 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.340 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8765", 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "ssh_config_file": { 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssh_config_file", 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.341 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "use_agent": { 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_agent", 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.342 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "use_repo_digest": { 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_repo_digest", 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.343 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_failed_host_check": { 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.344 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_daemons": { 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:17:32.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_hosts": { 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:17:32.346 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.347 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crash", 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.348 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.349 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.350 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.351 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.352 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "retain_interval": { 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retain_interval", 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "31536000", 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.354 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_recent_interval": { 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_recent_interval", 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1209600", 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:17:32.355 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dashboard", 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.356 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:17:32.357 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:17:32.358 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:17:32.359 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.360 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.362 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.363 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.364 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.365 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.366 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.367 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.368 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.369 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:17:32.370 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:17:32.371 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:17:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.373 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_URL": { 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.377 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.378 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.379 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.380 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.383 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.384 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.385 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.386 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.387 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.388 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:17:32.389 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.391 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.392 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8", 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.393 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "45", 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.394 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.395 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.396 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.397 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.398 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.399 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.400 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:17:32.401 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "cross_origin_url": { 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cross_origin_url", 2024-09-19T06:17:32.402 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "crt_file": { 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crt_file", 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.403 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "debug": { 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "debug", 2024-09-19T06:17:32.404 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "jwt_token_ttl": { 2024-09-19T06:17:32.405 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "jwt_token_ttl", 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "28800", 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.407 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.408 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.410 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.411 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.412 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "motd": { 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "motd", 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.413 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "The message of the day", 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.414 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.415 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8080", 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.416 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.417 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl_server_port": { 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl_server_port", 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8443", 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.418 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "redirect", 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.419 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect" 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.420 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "url_prefix": { 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url_prefix", 2024-09-19T06:17:32.421 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_monitoring": { 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_monitoring", 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.423 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "monitor device health metrics", 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.424 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.426 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.427 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.428 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "mark_out_threshold": { 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mark_out_threshold", 2024-09-19T06:17:32.429 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2419200", 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": { 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_name", 2024-09-19T06:17:32.430 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "device_health_metrics", 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "retention_period": { 2024-09-19T06:17:32.431 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retention_period", 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15552000", 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_frequency": { 2024-09-19T06:17:32.432 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_frequency", 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.433 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "self_heal": { 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "self_heal", 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.434 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.435 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_threshold": { 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_threshold", 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7257600", 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.436 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "diskprediction_local", 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.437 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.438 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.439 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.440 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "predict_interval": { 2024-09-19T06:17:32.442 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predict_interval", 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "predictor_model": { 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predictor_model", 2024-09-19T06:17:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "prophetstor", 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.444 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "influx", 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": false, 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "batch_size": { 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "batch_size", 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5000", 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.446 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "database": { 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "database", 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "ceph", 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.447 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": { 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hostname", 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.448 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "30", 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "5", 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.449 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.450 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.452 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.453 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.454 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "password": { 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "password", 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.455 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "port": { 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "port", 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.456 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8086", 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server port", 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "false", 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "threads": { 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threads", 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.458 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "32", 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "username": { 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "username", 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.459 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "verify_ssl": { 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "verify_ssl", 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "true", 2024-09-19T06:17:32.460 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "insights", 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.461 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.462 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.463 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.464 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "iostat", 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.467 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.468 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.469 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.470 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.471 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.472 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "k8sevents", 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_event_retention_days": { 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7", 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.473 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: "config_check_secs": { 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_check_secs", 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.474 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "10", 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.475 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.476 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.477 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.478 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.479 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.480 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "localpool", 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: "failure_domain": { 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "failure_domain", 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.481 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "host", 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.482 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.484 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.485 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.486 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": { 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_size", 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.487 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "num_rep": { 2024-09-19T06:17:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "num_rep", 2024-09-19T06:17:32.489 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.489 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.489 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.489 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3", 2024-09-19T06:17:32.489 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.489 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.489 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.489 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": { 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_num", 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "128", 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.490 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "prefix": { 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prefix", 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.491 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "subtree": { 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "subtree", 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "rack", 2024-09-19T06:17:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mds_autoscaler", 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.493 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.494 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.495 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.496 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.497 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.498 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirroring", 2024-09-19T06:17:32.499 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.500 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.501 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.502 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.503 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.504 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "nfs", 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.505 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.506 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.507 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.508 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.509 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.510 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.511 INFO:teuthology.orchestra.run.smithi103.stdout: "fail_fs": { 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "fail_fs", 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.513 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.515 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.516 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.517 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator": { 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "rook", 2024-09-19T06:17:32.518 INFO:teuthology.orchestra.run.smithi103.stdout: "test_orchestrator" 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Orchestrator backend", 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_perf_query", 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.519 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.520 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.521 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.522 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.524 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_support", 2024-09-19T06:17:32.525 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.526 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.527 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.528 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.529 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_autoscaler", 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.531 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.532 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.533 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.534 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.535 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.536 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.537 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "threshold": { 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threshold", 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1.0", 2024-09-19T06:17:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "scaling threshold", 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "progress", 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.539 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_pg_recovery_event": { 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.540 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.541 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.542 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.543 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.544 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.545 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.546 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "max_completed_events": { 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_completed_events", 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "50", 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.547 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.548 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus", 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.549 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "cache": { 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cache", 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.550 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "exclude_perf_counters": { 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "exclude_perf_counters", 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:17:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.552 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.553 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.554 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.555 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools": { 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools", 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.557 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "300", 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_interval": { 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_interval", 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15.0", 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.559 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.560 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "9283", 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.561 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "stale_cache_strategy": { 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stale_cache_strategy", 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "log", 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.562 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "default", 2024-09-19T06:17:32.563 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "default", 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "error" 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-19T06:17:32.564 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.566 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.568 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.568 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.568 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.568 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.568 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.568 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.568 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.568 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.570 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.571 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.572 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_snap_create": { 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.573 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.574 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "trash_purge_schedule": { 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "trash_purge_schedule", 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.575 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "restful", 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.576 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_auth": { 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_auth", 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.580 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.581 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.582 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.583 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-19T06:17:32.585 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rgw", 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.587 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.588 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.589 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.590 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.591 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.592 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rook", 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.594 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.596 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.599 INFO:teuthology.orchestra.run.smithi103.stdout: "storage_class": { 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "storage_class", 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "local", 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.600 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "selftest", 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.601 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.602 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.603 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.604 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.605 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "roption1": { 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption1", 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.607 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "roption2": { 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption2", 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "xyz", 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.608 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption1": { 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption1", 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption2": { 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption2", 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.610 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption3": { 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption3", 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.611 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption4": { 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption4", 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.612 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption5": { 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption5", 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.613 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption6": { 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption6", 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.614 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption7": { 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption7", 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "42", 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "testkey": { 2024-09-19T06:17:32.616 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testkey", 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "testlkey": { 2024-09-19T06:17:32.617 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testlkey", 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.618 INFO:teuthology.orchestra.run.smithi103.stdout: "testnewline": { 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testnewline", 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.619 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_m_granularity": { 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_m_granularity", 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.620 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "dump_on_update": { 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dump_on_update", 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.621 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.622 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.625 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.626 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.627 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stats", 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.628 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.629 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.630 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.631 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.632 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.633 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "status", 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.634 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.635 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.636 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.637 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.638 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.639 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telegraf", 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: "address": { 2024-09-19T06:17:32.640 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "address", 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15", 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.645 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.646 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.647 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telemetry", 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_basic": { 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_basic", 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_crash": { 2024-09-19T06:17:32.649 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_crash", 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_device": { 2024-09-19T06:17:32.650 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_device", 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.651 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_ident": { 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_ident", 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.652 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_perf": { 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_perf", 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.653 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "contact": { 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "contact", 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.654 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "description": { 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "description", 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.655 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "device_url": { 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_url", 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.656 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.657 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "24", 2024-09-19T06:17:32.658 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "8", 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "last_opt_revision": { 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "last_opt_revision", 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1", 2024-09-19T06:17:32.659 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard": { 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard", 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.660 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard_description": { 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard_description", 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.661 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.662 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.663 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.664 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.666 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "organization": { 2024-09-19T06:17:32.667 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "organization", 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.668 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "proxy": { 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "proxy", 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.669 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "url": { 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url", 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.670 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "test_orchestrator", 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.671 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.673 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.674 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.675 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.676 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.677 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.678 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.679 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.680 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.682 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_clones": { 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_clones", 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4", 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.683 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "periodic_async_work": { 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "periodic_async_work", 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.684 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Periodically check for async work", 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_delay": { 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.685 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.686 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix", 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "discovery_interval": { 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "discovery_interval", 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "100", 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.688 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "identifier": { 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "identifier", 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.689 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.690 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.691 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.692 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.693 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.694 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.695 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_host": { 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_host", 2024-09-19T06:17:32.696 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_port": { 2024-09-19T06:17:32.697 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_port", 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10051", 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.698 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_sender": { 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_sender", 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.699 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: "modules": [ 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: "dashboard", 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: "iostat", 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: "nfs", 2024-09-19T06:17:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: "restful", 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_schedule" 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "available_modules": [ 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "alerts", 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.701 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.702 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.704 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.705 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.706 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.707 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_destination": { 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_destination", 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.708 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_from_name": { 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_from_name", 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "Ceph", 2024-09-19T06:17:32.709 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email From: name", 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_host": { 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_host", 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.710 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP server", 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_password": { 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_password", 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.711 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Password to authenticate with", 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_port": { 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_port", 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.712 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "465", 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP port", 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_sender": { 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_sender", 2024-09-19T06:17:32.713 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_ssl": { 2024-09-19T06:17:32.714 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_ssl", 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_user": { 2024-09-19T06:17:32.715 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_user", 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "User to authenticate as", 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.716 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "balancer", 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: "active": { 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "active", 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.717 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_time": { 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_time", 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.718 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0000", 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_weekday": { 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_weekday", 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.719 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_max_iterations": { 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:32.720 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "25", 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "250", 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_metrics": { 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_metrics", 2024-09-19T06:17:32.721 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_step": { 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_step", 2024-09-19T06:17:32.722 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.5", 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0.001", 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "0.999", 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "end_time": { 2024-09-19T06:17:32.723 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_time", 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2359", 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.724 INFO:teuthology.orchestra.run.smithi103.stdout: "end_weekday": { 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_weekday", 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.725 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.726 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.727 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.728 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.729 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "min_score": { 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_score", 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.731 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "upmap", 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.732 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-compat", 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "none", 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "read", 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap", 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap-read" 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Balancer mode", 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_ids": { 2024-09-19T06:17:32.733 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_ids", 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.734 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.735 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_deviation": { 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_deviation", 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:17:32.736 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_optimizations": { 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:17:32.737 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm", 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_down_multiplier": { 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_down_multiplier", 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.738 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_refresh_rate": { 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_refresh_rate", 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.739 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "20", 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_starting_port": { 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_starting_port", 2024-09-19T06:17:32.740 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4721", 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_ptrace": { 2024-09-19T06:17:32.741 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_ptrace", 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_interval": { 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_interval", 2024-09-19T06:17:32.742 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:17:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.7", 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_log_destination": { 2024-09-19T06:17:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm_log_destination", 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "file", 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "file,syslog", 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "syslog" 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "cgroups_split": { 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cgroups_split", 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:17:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "config_checks_enabled": { 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_checks_enabled", 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:17:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "config_dashboard": { 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_dashboard", 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_alertmanager": { 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_alertmanager", 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_base": { 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_base", 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_elasticsearch": { 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "elasticsearch container image", 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_grafana": { 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_grafana", 2024-09-19T06:17:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_haproxy": { 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_haproxy", 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "HAproxy container image", 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_agent": { 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_collector": { 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:17:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_query": { 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger query container image", 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_keepalived": { 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_keepalived", 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Keepalived container image", 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_loki": { 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_loki", 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Loki container image", 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_node_exporter": { 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_node_exporter", 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nvmeof": { 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nvmeof", 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nvme-of container image", 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_prometheus": { 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_prometheus", 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:17:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_promtail": { 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_promtail", 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:17:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Promtail container image", 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba": { 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba", 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_snmp_gateway": { 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "container_init": { 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_init", 2024-09-19T06:17:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "daemon_cache_timeout": { 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "900", 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "default_registry": { 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_registry", 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io", 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:17:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "device_cache_timeout": { 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_cache_timeout", 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1800", 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:17:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "device_enhanced_scan": { 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_enhanced_scan", 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "facts_cache_timeout": { 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "facts_cache_timeout", 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "grafana_dashboards_path": { 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:17:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "host_check_interval": { 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "host_check_interval", 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "hw_monitoring": { 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hw_monitoring", 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "inventory_list_all": { 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "inventory_list_all", 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "log_refresh_metadata": { 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_refresh_metadata", 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:17:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "*", 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "max_count_per_host": { 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_count_per_host", 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd_draining_count": { 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_osd_draining_count", 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "migration_current": { 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "migration_current", 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "internal - do not modify", 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "root", 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm-package", 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "root" 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "oob_default_addr": { 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "oob_default_addr", 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "169.254.1.1", 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "prometheus_alerts_path": { 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_insecure": { 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_insecure", 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_password": { 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_password", 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_url": { 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_url", 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_username": { 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_username", 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "secure_monitoring_stack": { 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "service_discovery_port": { 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "service_discovery_port", 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8765", 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "ssh_config_file": { 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssh_config_file", 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "use_agent": { 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_agent", 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "use_repo_digest": { 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_repo_digest", 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_failed_host_check": { 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_daemons": { 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_hosts": { 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crash", 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "retain_interval": { 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retain_interval", 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "31536000", 2024-09-19T06:17:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_recent_interval": { 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_recent_interval", 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1209600", 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dashboard", 2024-09-19T06:17:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:17:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:17:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_URL": { 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:17:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:17:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:17:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:17:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8", 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:17:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "45", 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:17:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:17:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "cross_origin_url": { 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cross_origin_url", 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "crt_file": { 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crt_file", 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.862 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "debug": { 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "debug", 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:17:32.863 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "jwt_token_ttl": { 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "jwt_token_ttl", 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "28800", 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.864 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.865 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.866 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.868 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.869 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.870 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "motd": { 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "motd", 2024-09-19T06:17:32.871 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "The message of the day", 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.872 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.874 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8080", 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-19T06:17:32.875 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.876 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl_server_port": { 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl_server_port", 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8443", 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "redirect", 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect" 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.878 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.879 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "url_prefix": { 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url_prefix", 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.881 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_monitoring": { 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_monitoring", 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "monitor device health metrics", 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.883 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.884 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.885 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.886 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.887 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "mark_out_threshold": { 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mark_out_threshold", 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2419200", 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": { 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_name", 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "device_health_metrics", 2024-09-19T06:17:32.889 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "retention_period": { 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retention_period", 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.890 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15552000", 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_frequency": { 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_frequency", 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.891 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "self_heal": { 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "self_heal", 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.892 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.893 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_threshold": { 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_threshold", 2024-09-19T06:17:32.894 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7257600", 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "diskprediction_local", 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.896 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.897 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.899 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "predict_interval": { 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predict_interval", 2024-09-19T06:17:32.901 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "predictor_model": { 2024-09-19T06:17:32.902 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predictor_model", 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "prophetstor", 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.903 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.904 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "influx", 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": false, 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: "batch_size": { 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "batch_size", 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.905 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5000", 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "database": { 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "database", 2024-09-19T06:17:32.906 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "ceph", 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": { 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hostname", 2024-09-19T06:17:32.907 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.908 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "30", 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "5", 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.909 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.910 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.911 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.912 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.913 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "password": { 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "password", 2024-09-19T06:17:32.914 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "port": { 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "port", 2024-09-19T06:17:32.915 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8086", 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server port", 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-19T06:17:32.916 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "false", 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.917 INFO:teuthology.orchestra.run.smithi103.stdout: "threads": { 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threads", 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "32", 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "username": { 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "username", 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.919 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "verify_ssl": { 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "verify_ssl", 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "true", 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:17:32.920 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "insights", 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.921 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.922 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.923 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.924 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.926 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "iostat", 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.927 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.928 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.929 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.930 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.931 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "k8sevents", 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_event_retention_days": { 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7", 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.933 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "config_check_secs": { 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_check_secs", 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "10", 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.934 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.935 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "localpool", 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "failure_domain": { 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "failure_domain", 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "host", 2024-09-19T06:17:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.946 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": { 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_size", 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.947 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "num_rep": { 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "num_rep", 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.948 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3", 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": { 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_num", 2024-09-19T06:17:32.949 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "128", 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "prefix": { 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prefix", 2024-09-19T06:17:32.950 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "subtree": { 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "subtree", 2024-09-19T06:17:32.951 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "rack", 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mds_autoscaler", 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.953 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.954 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.955 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.956 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.957 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirroring", 2024-09-19T06:17:32.958 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.959 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.960 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.961 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.962 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.963 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "nfs", 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.964 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.965 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.966 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.967 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.968 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.969 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "fail_fs": { 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "fail_fs", 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.970 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.971 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.972 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.974 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.975 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.976 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator": { 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "rook", 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "test_orchestrator" 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.977 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Orchestrator backend", 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_perf_query", 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.978 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.980 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.981 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.982 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.984 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.984 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.984 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.984 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.984 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.984 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.984 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.984 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_support", 2024-09-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.988 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.989 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.990 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_autoscaler", 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:32.991 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.992 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.993 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:32.994 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:32.995 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.996 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:32.997 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "threshold": { 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threshold", 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-19T06:17:32.998 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1.0", 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "scaling threshold", 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "progress", 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_pg_recovery_event": { 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.000 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.001 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.002 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.003 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.004 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.005 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.006 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "max_completed_events": { 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_completed_events", 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.007 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "50", 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus", 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "cache": { 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cache", 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.010 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "exclude_perf_counters": { 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "exclude_perf_counters", 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.011 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.012 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.013 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.014 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.016 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.017 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools": { 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools", 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "300", 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.019 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_interval": { 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_interval", 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15.0", 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.020 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:17:33.021 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "9283", 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:17:33.022 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "stale_cache_strategy": { 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stale_cache_strategy", 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "log", 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.023 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "default", 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.024 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: "default", 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: "error" 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.025 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.026 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.027 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.028 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.029 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.030 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.031 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_snap_create": { 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.032 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:17:33.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "trash_purge_schedule": { 2024-09-19T06:17:33.034 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "trash_purge_schedule", 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.035 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "restful", 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_auth": { 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_auth", 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.036 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rgw", 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rook", 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.057 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "storage_class": { 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "storage_class", 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "local", 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "selftest", 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.060 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.061 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.062 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.063 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "roption1": { 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption1", 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "roption2": { 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption2", 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "xyz", 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption1": { 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption1", 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption2": { 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption2", 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption3": { 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption3", 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.070 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption4": { 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption4", 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.071 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption5": { 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption5", 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption6": { 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption6", 2024-09-19T06:17:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption7": { 2024-09-19T06:17:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption7", 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "42", 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "testkey": { 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testkey", 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "testlkey": { 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testlkey", 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "testnewline": { 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testnewline", 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_m_granularity": { 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_m_granularity", 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "dump_on_update": { 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dump_on_update", 2024-09-19T06:17:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stats", 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "status", 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telegraf", 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "address": { 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "address", 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15", 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telemetry", 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_basic": { 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_basic", 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_crash": { 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_crash", 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_device": { 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_device", 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_ident": { 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_ident", 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_perf": { 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_perf", 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "contact": { 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "contact", 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "description": { 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "description", 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "device_url": { 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_url", 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "24", 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "8", 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "last_opt_revision": { 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "last_opt_revision", 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1", 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard": { 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard", 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard_description": { 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard_description", 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "organization": { 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "organization", 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "proxy": { 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "proxy", 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "url": { 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url", 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:17:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "test_orchestrator", 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_clones": { 2024-09-19T06:17:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_clones", 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4", 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "periodic_async_work": { 2024-09-19T06:17:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "periodic_async_work", 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Periodically check for async work", 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_delay": { 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix", 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "discovery_interval": { 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "discovery_interval", 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "100", 2024-09-19T06:17:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "identifier": { 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "identifier", 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_host": { 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_host", 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_port": { 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_port", 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10051", 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_sender": { 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_sender", 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-19T06:17:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "services": { 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "dashboard": "https://172.21.15.103:8443/" 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "always_on_modules": { 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus": [ 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific": [ 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy": [ 2024-09-19T06:17:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "reef": [ 2024-09-19T06:17:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "squid": [ 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-09-19T06:17:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "last_failure_osd_epoch": 81, 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "active_clients": [ 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2749735310 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "libcephsqlite", 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1636165636 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 4183279691 2024-09-19T06:17:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 85464323 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3523421902 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T06:17:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-09-19T06:17:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1403441611 2024-09-19T06:17:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T06:17:33.167 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:31 smithi174 ceph-mon[34488]: from='client.16134 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:31 smithi174 ceph-mon[34488]: pgmap v316: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:31 smithi174 ceph-mon[34488]: from='client.16140 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:31 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2643116383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:31 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1716159957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:31 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2613690580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:31 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/3385960980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:32 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/1775492608' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:31 smithi169 ceph-mon[34350]: from='client.16134 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:31 smithi169 ceph-mon[34350]: pgmap v316: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T06:17:33.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:31 smithi169 ceph-mon[34350]: from='client.16140 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:17:33.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:31 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2643116383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:17:33.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:31 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1716159957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:17:33.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:31 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2613690580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:17:33.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:31 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/3385960980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:17:33.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:32 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/1775492608' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:17:33.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 -- 172.21.15.103:0/1775492608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f63300a33c0 msgr2=0x7f63300a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:33.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f63300a33c0 0x7f63300a5880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6338005e10 tx=0x7f6338005da0 comp rx=0 tx=0).stop 2024-09-19T06:17:33.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 -- 172.21.15.103:0/1775492608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6348107ab0 msgr2=0x7f634819cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:33.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6348107ab0 0x7f634819cb10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6340005cc0 tx=0x7f6340003c20 comp rx=0 tx=0).stop 2024-09-19T06:17:33.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 -- 172.21.15.103:0/1775492608 shutdown_connections 2024-09-19T06:17:33.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f63300a33c0 0x7f63300a5880 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:33.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6348107ab0 0x7f634819cb10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:33.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6348102440 0x7f6348198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:33.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 --2- 172.21.15.103:0/1775492608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6348101aa0 0x7f6348198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:33.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 -- 172.21.15.103:0/1775492608 >> 172.21.15.103:0/1775492608 conn(0x7f63480fd7c0 msgr2=0x7f63480fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:33.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 -- 172.21.15.103:0/1775492608 shutdown_connections 2024-09-19T06:17:33.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:31.753+0000 7f634dc0a640 1 -- 172.21.15.103:0/1775492608 wait complete. 2024-09-19T06:17:33.177 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T06:17:33.177 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T06:17:33.178 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:32 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/1775492608' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:17:33.435 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:33.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:33 smithi103 ceph-mon[30925]: pgmap v317: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T06:17:33.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:33 smithi169 ceph-mon[34350]: pgmap v317: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T06:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 0, 2024-09-19T06:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 2, 2024-09-19T06:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 0, 2024-09-19T06:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.001277515, 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.000241092, 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:33.922 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 2, 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 153, 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 184096, 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 3, 2024-09-19T06:17:33.923 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.011401210, 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.007558290, 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001919252, 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 150, 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.012728168, 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000084854 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:33.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 184096 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 215, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 202, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1586528, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 123232, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.037900247, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.013166429, 2024-09-19T06:17:33.925 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.037834456, 2024-09-19T06:17:33.926 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:33.926 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:33.926 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 202, 2024-09-19T06:17:33.926 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.013195154, 2024-09-19T06:17:33.926 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000065322 2024-09-19T06:17:33.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.926 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:33.926 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:33.926 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:33.927 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:33.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.927 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1586528, 2024-09-19T06:17:33.927 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 123232 2024-09-19T06:17:33.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.927 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-19T06:17:33.927 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-09-19T06:17:33.927 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-19T06:17:33.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.927 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:33.928 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:33.929 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 149034, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 32, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:33.930 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-19T06:17:33.931 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 213, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 1553782, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:33.932 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 213, 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 213, 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 1553782, 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:33.933 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:17:33.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:33 smithi174 ceph-mon[34488]: pgmap v317: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T06:17:34.632 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-19T06:17:34.632 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-19T06:17:34.632 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-19T06:17:34.632 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-19T06:17:34.632 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T06:17:34.632 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T06:17:34.632 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T06:17:34.632 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-19T06:17:34.632 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T06:17:34.633 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T06:17:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:35.385 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:17:35.385 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:35.385 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 4, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 4, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 2992, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 448, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.003172364, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000040365, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.002212279, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.003995324, 2024-09-19T06:17:35.386 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001331774 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 216, 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 205, 2024-09-19T06:17:35.387 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1584896, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 125984, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.036544122, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.013164302, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.036164228, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 204, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.009467047, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000046407 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.388 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1584896, 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 125984 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 2, 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 157, 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 184800, 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-09-19T06:17:35.389 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 3, 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.011691907, 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.008246719, 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001635091, 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 154, 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.007418980, 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000048175 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:35.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 184800 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:35.391 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:35.392 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:35.392 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:35.392 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:35.392 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:35.392 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:35.392 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:35.392 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:35.392 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:35.392 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:35.393 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 149017, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 31, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-19T06:17:35.394 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:35.395 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-19T06:17:35.396 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:35.396 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-19T06:17:35.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:35.396 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:35.396 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-19T06:17:35.396 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-19T06:17:35.396 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-19T06:17:35.396 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 218, 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 1554432, 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 218, 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 218, 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 1554432, 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:35.397 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:17:35.685 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:35 smithi103 ceph-mon[30925]: pgmap v318: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T06:17:35.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:35 smithi169 ceph-mon[34350]: pgmap v318: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T06:17:35.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:35 smithi174 ceph-mon[34488]: pgmap v318: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T06:17:36.136 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T06:17:36.136 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T06:17:36.136 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T06:17:36.136 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T06:17:36.136 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T06:17:36.136 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T06:17:36.136 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T06:17:36.136 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-19T06:17:36.136 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T06:17:36.137 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T06:17:36.704 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:36 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:17:36.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:36 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:17:36.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:36 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:17:37.042 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:37.572 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 213, 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 202, 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1584080, 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 124064, 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.040947899, 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.014535867, 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.037837443, 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:37.573 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 201, 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.010865098, 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000054055 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1584080, 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 124064 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.574 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 2, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 155, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 184448, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 3, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.012619765, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.008742959, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001822164, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 152, 2024-09-19T06:17:37.575 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.007552920, 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000049690 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 184448 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:37.576 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 4, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 4, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 2992, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 448, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.002385353, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000035330, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.002314314, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3, 2024-09-19T06:17:37.577 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.004242159, 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001414053 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-19T06:17:37.578 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:37.579 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:37.581 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 148977, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 30, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-09-19T06:17:37.582 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:37.583 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 215, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 1554042, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 215, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 215, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 1554042, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:37.584 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:37.585 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:37.585 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:37.585 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:37.585 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:17:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:37 smithi103 ceph-mon[30925]: pgmap v319: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T06:17:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:37 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:37 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:37 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:37 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:37 smithi169 ceph-mon[34350]: pgmap v319: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T06:17:37.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:37 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:37 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:37 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:37 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:37 smithi174 ceph-mon[34488]: pgmap v319: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T06:17:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:37 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:37 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:37 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:37.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:37 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:38.272 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T06:17:38.273 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T06:17:38.273 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-19T06:17:38.273 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-19T06:17:38.273 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T06:17:38.273 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T06:17:38.273 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T06:17:38.273 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-19T06:17:38.273 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T06:17:38.273 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T06:17:38.549 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:38.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T06:17:38.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-19T06:17:38.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: Unable to set osd_memory_target on smithi169 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T06:17:38.745 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:38 smithi103 ceph-mon[30925]: Unable to set osd_memory_target on smithi174 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T06:17:38.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: Unable to set osd_memory_target on smithi169 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T06:17:38.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:38 smithi169 ceph-mon[34350]: Unable to set osd_memory_target on smithi174 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T06:17:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:38.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T06:17:38.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-19T06:17:38.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: Unable to set osd_memory_target on smithi169 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T06:17:38.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:38 smithi174 ceph-mon[34488]: Unable to set osd_memory_target on smithi174 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T06:17:39.060 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 218, 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 207, 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1585440, 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 127264, 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.039740198, 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.013696441, 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.038948346, 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:39.061 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 206, 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.010237373, 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000049695 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1585440, 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:39.062 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 6, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 160, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 3312, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 185424, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 3, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.014313127, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.008360933, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.003929747, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 158, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.018977479, 2024-09-19T06:17:39.063 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000120110 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 185424 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 0, 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 2, 2024-09-19T06:17:39.064 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 0, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.000315539, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.000240459, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:39.065 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:39.066 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:39.066 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:39.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.066 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:17:39.066 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:17:39.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.066 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-19T06:17:39.066 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-09-19T06:17:39.066 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-19T06:17:39.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.067 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-19T06:17:39.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:39.067 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:39.068 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:39.069 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 148977, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 30, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:39.070 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-09-19T06:17:39.071 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 220, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 1554692, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 220, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-19T06:17:39.072 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-19T06:17:39.073 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 220, 2024-09-19T06:17:39.073 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 1554692, 2024-09-19T06:17:39.073 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-19T06:17:39.073 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-19T06:17:39.073 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-19T06:17:39.073 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-19T06:17:39.073 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:39.073 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T06:17:39.073 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T06:17:39.690 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:39 smithi103 ceph-mon[30925]: pgmap v320: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T06:17:39.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:39 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:39.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:39 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:39.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:39 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:39 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:39 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:39 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:39 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:17:39.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:39 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:17:39.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:39 smithi103 ceph-mon[30925]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:39.718 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T06:17:39.719 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T06:17:39.719 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-19T06:17:39.719 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-19T06:17:39.719 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T06:17:39.719 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T06:17:39.719 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T06:17:39.719 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-19T06:17:39.719 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T06:17:39.719 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T06:17:39.747 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:39 smithi169 ceph-mon[34350]: pgmap v320: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T06:17:39.747 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:39 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:39.747 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:39 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:39.747 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:39 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.748 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:39 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.748 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:39 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.748 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:39 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.748 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:39 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:17:39.748 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:39 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:17:39.748 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:39 smithi169 ceph-mon[34350]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:39 smithi174 ceph-mon[34488]: pgmap v320: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T06:17:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:39 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:39 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:39 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:39 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:39 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:39 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:17:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:39 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:17:39.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:39 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:17:39.955 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:39 smithi174 ceph-mon[34488]: from='mgr.15189 172.21.15.103:0/4284773287' entity='mgr.x' 2024-09-19T06:17:39.977 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:17:40.458 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-19T06:17:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 47840, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 47249, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 16751940, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 106889966, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 76, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 5, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 2.642421129, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.971760402, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 1.022224125, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.631410866, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 47251, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2.458665219, 2024-09-19T06:17:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000052034 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 30486, 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.004056241, 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000133 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 45536, 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 1584 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 26292, 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 26249, 2024-09-19T06:17:40.460 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 8911882, 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 55972162, 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 14, 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 6, 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 1.417762638, 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.441778989, 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.397668840, 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.491325634, 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 26247, 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2.180033849, 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000083058 2024-09-19T06:17:40.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 275, 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000054434, 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000197 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1798272, 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 481936 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 76756, 2024-09-19T06:17:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 131441, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 27920586, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 93327777, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 20, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 7, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 5.046822869, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 2.035609264, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 2.895443712, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.433625127, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 131436, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 6.228648137, 2024-09-19T06:17:40.463 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000047389 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 161287, 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.025393244, 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000157 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 305072, 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 214352 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-19T06:17:40.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 97407, 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 24.358874400, 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000250073 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2915, 2024-09-19T06:17:40.465 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.282213070, 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000096814 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 28933, 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 22777, 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 22777, 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 67.048299037, 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.002943684 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 6156, 2024-09-19T06:17:40.466 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 6, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 1, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 736, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 22, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 130, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 0, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 1, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 129, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 129, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 6159, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 3, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 3, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 3, 2024-09-19T06:17:40.467 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 35957, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 26678, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 6127, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 35, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 2, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 3, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 115, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 5724, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 7, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 240, 2024-09-19T06:17:40.468 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 3380, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 4, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 234, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 6, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 3380, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 58, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 3, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 55, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 3322, 2024-09-19T06:17:40.469 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 11495, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 16247, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 7982, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 17509, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 13967, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 58, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 18864 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 74, 2024-09-19T06:17:40.470 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 203, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 118, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 166, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 296, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 3, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 1758, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 1752, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 3, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:17:40.471 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 3, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 130, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 22, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 43446, 2024-09-19T06:17:40.472 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 43342, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 43342, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 104, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 847, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 84, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 82, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 82, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 2, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 1, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 1, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 142498987, 2024-09-19T06:17:40.473 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 142926653, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 0, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 27697, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 47.146669540, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001702230 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 0 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 62, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 7483, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 7421, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 23, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 419, 2024-09-19T06:17:40.474 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 396, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 130, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 8194, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 8064, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 3, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 6259, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 6256, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 89892, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 231712 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 50077, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 2064, 2024-09-19T06:17:40.475 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 28933, 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 144, 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 4118, 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 6089, 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 17.707579057, 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.002908125 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1379, 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.756708990, 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000548737 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.476 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3, 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.007774310, 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.002591436 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 4171, 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 15.791361177, 2024-09-19T06:17:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.003785989 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-19T06:17:40.478 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.479 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.480 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.480 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-19T06:17:40.480 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 10, 2024-09-19T06:17:40.480 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.001598781, 2024-09-19T06:17:40.480 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000159878 2024-09-19T06:17:40.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.480 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 67, 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.060700453, 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000905976 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 10, 2024-09-19T06:17:40.481 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.439395508, 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.043939550 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 158, 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.219509713, 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001389301 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 75, 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.399656811, 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.005328757 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.482 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 76, 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.150735972, 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001983368 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.483 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 15, 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.078395937, 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.005226395 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 4, 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.020431413, 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.005107853 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.484 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 9010, 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 28.635054730, 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.003178141 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 8, 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.002823093, 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000352886 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 7, 2024-09-19T06:17:40.486 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.020493516, 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.002927645 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 5, 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.004644796, 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000928959 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1690, 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2.751434780, 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001628067 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.487 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 2, 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 5, 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 3, 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 2, 2024-09-19T06:17:40.488 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 314, 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 157, 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 600, 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 360, 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 360, 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:40.489 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:40.490 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-19T06:17:40.491 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 338702, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 127, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:40.492 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 8032, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 177, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 298798, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 1815, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.493 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 76072, 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 146029412, 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 35, 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 76072, 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 76072, 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 390.697591790, 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.005135892 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-19T06:17:40.494 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 76072, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 84678 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 76072, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 3489, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 72583, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 489, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 3603, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 91, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 27785, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 157, 2024-09-19T06:17:40.495 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 6, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 2372, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 3390, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 7206, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:17:40.496 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 37740, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-19T06:17:40.497 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 89, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 11, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 12, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 12, 2024-09-19T06:17:40.498 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 1678, 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 22, 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 139 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 1, 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-19T06:17:40.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 32, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 10, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 1779, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 1752, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:40.500 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 150884, 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 39941053, 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 150884, 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 150884, 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 39941053, 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:40.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 76072, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 146215070, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 76072, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 146215070, 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:40.502 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 76072, 2024-09-19T06:17:40.503 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 76072, 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 76072, 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 76072, 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 1752, 2024-09-19T06:17:40.504 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 185976, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 1752, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 88, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 185976, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x5636eef68960": { 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:40.505 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 43446, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 138732349, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 43446, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 27697, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 138732349, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:40.506 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:40.507 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:40.507 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-19T06:17:40.623 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:40 smithi169 ceph-mon[34350]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-19T06:17:40.623 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:40 smithi169 ceph-mon[34350]: Unable to set osd_memory_target on smithi103 to 184582451: error parsing value: Value '184582451' is below minimum 939524096 2024-09-19T06:17:40.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:40 smithi103 ceph-mon[30925]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-19T06:17:40.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:40 smithi103 ceph-mon[30925]: Unable to set osd_memory_target on smithi103 to 184582451: error parsing value: Value '184582451' is below minimum 939524096 2024-09-19T06:17:40.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:40 smithi174 ceph-mon[34488]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-19T06:17:40.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:40 smithi174 ceph-mon[34488]: Unable to set osd_memory_target on smithi103 to 184582451: error parsing value: Value '184582451' is below minimum 939524096 2024-09-19T06:17:41.181 INFO:tasks.check_counter:Daemon mds.b mds.exported=115 2024-09-19T06:17:41.182 INFO:tasks.check_counter:Daemon mds.b mds.imported=7 2024-09-19T06:17:41.182 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=74 2024-09-19T06:17:41.182 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=203 2024-09-19T06:17:41.182 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T06:17:41.182 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-19T06:17:41.182 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-19T06:17:41.182 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=22 2024-09-19T06:17:41.182 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T06:17:41.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T06:17:41.483 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:41 smithi169 ceph-mon[34350]: pgmap v321: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T06:17:41.489 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:17:41.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:41 smithi103 ceph-mon[30925]: pgmap v321: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T06:17:41.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:41 smithi174 ceph-mon[34488]: pgmap v321: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T06:17:42.005 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-19T06:17:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 488, 2024-09-19T06:17:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 490, 2024-09-19T06:17:42.005 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 12711687, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 155248, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 7, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.044572041, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.014513397, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.015773675, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.009957596, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 488, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.018147548, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000037187 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.006 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 745, 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 899, 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 13011906, 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 673311, 2024-09-19T06:17:42.007 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 8, 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 6, 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.078355404, 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.022476279, 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.027146181, 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.022084338, 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 897, 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.052079457, 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000058059 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 438304 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1195, 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1165, 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 10374204, 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 429266, 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-19T06:17:42.009 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.134107925, 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.040673518, 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.069484107, 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.030555985, 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1164, 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.052844109, 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000045398 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.010 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1687968, 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 129392 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3638, 2024-09-19T06:17:42.011 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.094778677, 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000026052 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-19T06:17:42.012 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-19T06:17:42.013 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 2078, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 2, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 2076, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 2075, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 1, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-19T06:17:42.014 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 0, 2024-09-19T06:17:42.015 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:17:42.016 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-19T06:17:42.017 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:17:42.018 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 39220, 2024-09-19T06:17:42.019 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 47, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 5, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4194304, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 37984454, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 37981893, 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-19T06:17:42.020 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 39220 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 53, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 4397, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 4344, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 27, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 128, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 101, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 2078, 2024-09-19T06:17:42.021 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 6032, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 3954, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 57420, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 215328 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-19T06:17:42.022 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.024 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.025 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.026 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-19T06:17:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-19T06:17:42.027 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.030 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-19T06:17:42.031 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.032 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-19T06:17:42.033 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 2, 2024-09-19T06:17:42.034 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 3, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 1, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 3, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 2142, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:42.036 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:42.037 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 215191, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 66, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:42.038 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 8032, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 177, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 1644953, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 11408, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:42.039 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 2170, 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 21, 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 3, 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 2170, 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2170, 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.215974147, 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000560356 2024-09-19T06:17:42.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2170, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2171 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 2170, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 2170, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 1365, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 803, 2024-09-19T06:17:42.041 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 1, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-19T06:17:42.042 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-19T06:17:42.043 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 89, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 11, 2024-09-19T06:17:42.044 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 8, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 8, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.045 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:42.046 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 2424, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 35863763, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 2424, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2424, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 35863763, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.047 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2170, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 33794359, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2170, 2024-09-19T06:17:42.048 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 33794359, 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:42.049 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2170, 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 2170, 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2170, 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 2170, 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T06:17:42.050 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x555a55a38b40": { 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:42.052 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:42.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:42.053 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-19T06:17:42.728 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T06:17:42.728 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T06:17:42.728 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-19T06:17:42.729 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-19T06:17:42.729 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-19T06:17:42.729 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:17:42.729 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:17:42.729 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-19T06:17:42.729 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T06:17:42.729 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T06:17:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:17:43.536 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-19T06:17:43.537 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:43.537 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1307, 2024-09-19T06:17:43.537 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1307, 2024-09-19T06:17:43.537 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 54923061, 2024-09-19T06:17:43.537 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 414812, 2024-09-19T06:17:43.537 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 8, 2024-09-19T06:17:43.537 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 4, 2024-09-19T06:17:43.537 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.135233874, 2024-09-19T06:17:43.537 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.042553634, 2024-09-19T06:17:43.537 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.050998265, 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.031025570, 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1306, 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.052462544, 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000040170 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T06:17:43.538 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 860, 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 830, 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 56691123, 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 322000, 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 4, 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.110315869, 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.025449321, 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.081757131, 2024-09-19T06:17:43.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.013991008, 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 829, 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.029208566, 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000035233 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1687584, 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 128272 2024-09-19T06:17:43.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 640, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 795, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 29522150, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 640565, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 8, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 6, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.075148402, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.019189203, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.030227249, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.019722315, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 792, 2024-09-19T06:17:43.541 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.026677900, 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000033684 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 437680 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-19T06:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 4232, 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.130933687, 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000030938 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-19T06:17:43.544 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 1904, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 1237, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 667, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 136, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-19T06:17:43.545 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 2, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-19T06:17:43.546 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 4, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 234, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 6, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:17:43.547 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-19T06:17:43.548 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:17:43.549 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-19T06:17:43.550 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 43446, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 2, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 27, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-19T06:17:43.551 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 142498987, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 142926653, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 142926541, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 43446 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 75, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 7425, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 7350, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 21, 2024-09-19T06:17:43.552 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 327, 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 306, 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 1904, 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 7697, 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 5793, 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 63608, 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 215328 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-19T06:17:43.553 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.554 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.555 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.556 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-19T06:17:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-19T06:17:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-19T06:17:43.559 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.562 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-19T06:17:43.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.564 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 2, 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 5, 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 3, 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 4, 2024-09-19T06:17:43.566 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 2648, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:43.567 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 230584, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 73, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 8032, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 177, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:43.570 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 1561750, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 8405, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 2550, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 26, 2024-09-19T06:17:43.571 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 4, 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 2550, 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2550, 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.531967246, 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000600771 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2550, 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2551 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 2550, 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 2550, 2024-09-19T06:17:43.572 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 1495, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 1052, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-19T06:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 2, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:17:43.574 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-19T06:17:43.575 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 89, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 11, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 10, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 10, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-19T06:17:43.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:17:43.577 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 2803, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 140868248, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 2803, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T06:17:43.578 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2803, 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 140868248, 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:43.579 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2550, 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 138736664, 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2550, 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 138736664, 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:43.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2550, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 2550, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2550, 2024-09-19T06:17:43.581 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 2550, 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:43.582 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x5563fc94eb40": { 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:43.583 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:43.584 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-19T06:17:43.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:43 smithi103 ceph-mon[30925]: pgmap v322: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T06:17:43.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:43 smithi169 ceph-mon[34350]: pgmap v322: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T06:17:43.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:43 smithi174 ceph-mon[34488]: pgmap v322: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T06:17:44.301 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T06:17:44.301 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T06:17:44.301 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-19T06:17:44.301 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-19T06:17:44.301 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-19T06:17:44.301 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:17:44.301 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:17:44.301 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-19T06:17:44.302 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T06:17:44.302 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T06:17:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:17:45.052 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-19T06:17:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 220, 2024-09-19T06:17:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 209, 2024-09-19T06:17:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1585984, 2024-09-19T06:17:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 128544, 2024-09-19T06:17:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-19T06:17:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 0, 2024-09-19T06:17:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.041202875, 2024-09-19T06:17:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.014522677, 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.040563085, 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 208, 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.011430239, 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000054953 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1585984, 2024-09-19T06:17:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 128544 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 2, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 160, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 185328, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.010030823, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.006705627, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.001365569, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 157, 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.017032426, 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000108486 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 185328 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 4, 2024-09-19T06:17:45.056 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 4, 2024-09-19T06:17:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 2992, 2024-09-19T06:17:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 448, 2024-09-19T06:17:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 2, 2024-09-19T06:17:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 1, 2024-09-19T06:17:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.002250743, 2024-09-19T06:17:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.000039995, 2024-09-19T06:17:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.002213221, 2024-09-19T06:17:45.057 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3, 2024-09-19T06:17:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.003909902, 2024-09-19T06:17:45.060 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001303300 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 0, 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-19T06:17:45.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:45.062 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:45.063 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 148962, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 30, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-19T06:17:45.064 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 928, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 2, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:45.065 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 222, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1554952, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 222, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T06:17:45.066 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 222, 2024-09-19T06:17:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1554952, 2024-09-19T06:17:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T06:17:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T06:17:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T06:17:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T06:17:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:45.067 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T06:17:45.067 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-19T06:17:45.743 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:45 smithi169 ceph-mon[34350]: pgmap v323: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:45.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:45 smithi103 ceph-mon[30925]: pgmap v323: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:45.766 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-19T06:17:45.766 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-19T06:17:45.766 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-19T06:17:45.767 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-19T06:17:45.767 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-19T06:17:45.767 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-19T06:17:45.767 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-19T06:17:45.767 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-19T06:17:45.767 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T06:17:45.767 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T06:17:45.795 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:45 smithi174 ceph-mon[34488]: pgmap v323: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:46.025 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:17:46.564 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-19T06:17:46.564 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:46.564 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 15043, 2024-09-19T06:17:46.564 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 12396, 2024-09-19T06:17:46.564 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 27519957, 2024-09-19T06:17:46.564 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 18930434, 2024-09-19T06:17:46.564 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 9, 2024-09-19T06:17:46.564 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 4, 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.749910664, 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.295356523, 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.534735538, 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.034324448, 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 12397, 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.313293735, 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000025271 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 24605, 2024-09-19T06:17:46.565 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.003933528, 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000159 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1699648, 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 176112 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1531, 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 1691, 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 512254, 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 13998404, 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 18, 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 8, 2024-09-19T06:17:46.566 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.157215771, 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.074122153, 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.031076294, 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.039611546, 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1686, 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.095473350, 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000056627 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 21, 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000002618, 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000124 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.567 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 2160, 2024-09-19T06:17:46.568 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 442432 2024-09-19T06:17:46.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.568 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:46.568 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 19978, 2024-09-19T06:17:46.568 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 22125, 2024-09-19T06:17:46.568 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 7267884, 2024-09-19T06:17:46.568 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 19471826, 2024-09-19T06:17:46.568 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 13, 2024-09-19T06:17:46.568 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 6, 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 1.015020367, 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.430170925, 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.674854025, 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.043841774, 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 22124, 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.454884673, 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000020560 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:46.569 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 36639, 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.004816827, 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000131 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-19T06:17:46.570 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2713, 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 3.245587103, 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001196309 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3228, 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.410667345, 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000127220 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.571 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 8235, 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 5103, 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 5103, 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 6.480651888, 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001269969 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 3132, 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 29, 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-09-19T06:17:46.572 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 35, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 3, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 104, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 4, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 3, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 97, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 97, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 4201, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 0, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 0, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 4, 2024-09-19T06:17:46.573 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 15335, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 7601, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 3132, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 125, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 81, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 3794, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 63, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 1997, 2024-09-19T06:17:46.574 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 309, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 4567, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 128182078, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 5, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 309, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 14, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:17:46.575 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 14, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 295, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 2, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 196, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 2518, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 6894, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 979, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 45, 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 4487 2024-09-19T06:17:46.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 107, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 418, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 237, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 374, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 157, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 16, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 1998, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 1982, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-09-19T06:17:46.577 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 81, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 3, 2024-09-19T06:17:46.578 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 39220, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 39220, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 47, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-09-19T06:17:46.579 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 47, 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 5, 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 37984454, 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 0, 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1232, 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 4.079051076, 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.003310918 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 0 2024-09-19T06:17:46.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 67, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 4600, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 4533, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 40, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 366, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 326, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 105, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 6292, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 6187, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 0, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 2011, 2024-09-19T06:17:46.581 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 2011, 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 76300, 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 223520 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 12823, 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 11, 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 8235, 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 21, 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 2537, 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 484, 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.447948182, 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002991628 2024-09-19T06:17:46.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 67, 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.011390242, 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000170003 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.583 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2292, 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.898313203, 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000391934 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.585 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-09-19T06:17:46.585 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.585 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.585 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.585 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-09-19T06:17:46.585 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.585 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.585 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.587 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-09-19T06:17:46.587 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.587 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.587 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.587 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-09-19T06:17:46.587 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.587 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.587 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.588 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3, 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.001444408, 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000481469 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 258, 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.258951622, 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001003688 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3, 2024-09-19T06:17:46.589 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.008012041, 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002670680 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.590 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 16, 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.103185874, 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.006449117 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-09-19T06:17:46.592 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.593 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1980, 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 3.751406316, 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001894649 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:17:46.594 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 2, 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 3, 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 1, 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 2, 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 3006, 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 1503, 2024-09-19T06:17:46.595 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 606, 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:46.596 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:46.597 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:46.598 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 425513, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 139, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 8032, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 177, 2024-09-19T06:17:46.599 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 323918, 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 4412, 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-09-19T06:17:46.600 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 3953, 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 34318466, 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 30, 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 3953, 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3953, 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 11.159851988, 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002823134 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-09-19T06:17:46.601 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3953, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 4128 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 3953, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 449, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 3504, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 0, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 10, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 87, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 1319, 2024-09-19T06:17:46.602 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 59, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 2008, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 309, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 20, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:17:46.603 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-09-19T06:17:46.604 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 89, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 11, 2024-09-19T06:17:46.605 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 12, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 12, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 182, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 82, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 52 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 1, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.606 INFO:teuthology.orchestra.run.smithi174.stdout: "osd-slow-ops": { 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 13, 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 10, 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 1985, 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 1982, 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:46.607 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 36548, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 31992794, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 36548, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 36548, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 31992794, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.608 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 3953, 2024-09-19T06:17:46.609 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 34570692, 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 3953, 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 34570692, 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-19T06:17:46.610 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 3953, 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 3953, 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 3953, 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 3953, 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.611 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 1982, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 253270, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 1982, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 87, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 253270, 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x5573486ce960": { 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 39220, 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 33790150, 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:46.613 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 39220, 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1232, 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 33790150, 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:46.614 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-19T06:17:47.414 INFO:tasks.check_counter:Daemon mds.c mds.exported=81 2024-09-19T06:17:47.414 INFO:tasks.check_counter:Daemon mds.c mds.imported=63 2024-09-19T06:17:47.414 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=107 2024-09-19T06:17:47.414 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=418 2024-09-19T06:17:47.414 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=5 2024-09-19T06:17:47.414 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:17:47.414 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:17:47.414 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=3 2024-09-19T06:17:47.415 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T06:17:47.415 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T06:17:47.715 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:17:47.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:47 smithi103 ceph-mon[30925]: pgmap v324: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:17:47.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:47 smithi169 ceph-mon[34350]: pgmap v324: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:17:47.830 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:47 smithi174 ceph-mon[34488]: pgmap v324: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:17:48.170 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-19T06:17:48.170 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:48.170 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1192, 2024-09-19T06:17:48.170 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 1194, 2024-09-19T06:17:48.170 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 25534800, 2024-09-19T06:17:48.170 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 379063, 2024-09-19T06:17:48.170 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 7, 2024-09-19T06:17:48.170 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 3, 2024-09-19T06:17:48.170 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.122091010, 2024-09-19T06:17:48.170 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.036091491, 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.039436228, 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.035805638, 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1192, 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.048750878, 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000040898 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.171 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 522, 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 679, 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 16914540, 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 605070, 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 8, 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 6, 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.066570977, 2024-09-19T06:17:48.172 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.018158732, 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.024596402, 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.018109214, 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 676, 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.032667262, 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000048324 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.173 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 439648 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 772, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 740, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 6136574, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 294250, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 4, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 3, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.087003525, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.026661036, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.058448458, 2024-09-19T06:17:48.174 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.012957482, 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 740, 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.034453596, 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000046558 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1691232, 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 130480 2024-09-19T06:17:48.175 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3626, 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.098274284, 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000027102 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.176 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-09-19T06:17:48.177 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-19T06:17:48.177 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-19T06:17:48.177 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.177 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.177 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.177 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:48.177 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.177 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-09-19T06:17:48.177 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 0, 2024-09-19T06:17:48.178 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 0, 2024-09-19T06:17:48.178 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-09-19T06:17:48.178 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.178 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.178 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.178 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.178 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-09-19T06:17:48.179 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 0, 2024-09-19T06:17:48.179 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-09-19T06:17:48.179 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-09-19T06:17:48.179 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 0, 2024-09-19T06:17:48.179 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-09-19T06:17:48.179 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 14602, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 530, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 14072, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 0, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 13845, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 0, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 0, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 0, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 1, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 0, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 0, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-09-19T06:17:48.180 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 0, 2024-09-19T06:17:48.181 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:17:48.181 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-09-19T06:17:48.181 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-09-19T06:17:48.181 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-09-19T06:17:48.181 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-09-19T06:17:48.181 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 0, 2024-09-19T06:17:48.181 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 0, 2024-09-19T06:17:48.181 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 0, 2024-09-19T06:17:48.181 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 0, 2024-09-19T06:17:48.181 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-09-19T06:17:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:17:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-09-19T06:17:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 0, 2024-09-19T06:17:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 0, 2024-09-19T06:17:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 0, 2024-09-19T06:17:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:17:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-09-19T06:17:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 0, 2024-09-19T06:17:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 0, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 0 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 0, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 0, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 0, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 0, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 0, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:17:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-09-19T06:17:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 34392, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-09-19T06:17:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 42, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 4, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 50448390, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 50439489, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 34392 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-09-19T06:17:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 6485, 2024-09-19T06:17:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 10221, 2024-09-19T06:17:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 3736, 2024-09-19T06:17:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 263, 2024-09-19T06:17:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 286, 2024-09-19T06:17:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 23, 2024-09-19T06:17:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 14602, 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 15070, 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 468, 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 0, 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 0, 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 0, 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 78492, 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 215328 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 0, 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 0, 2024-09-19T06:17:48.189 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 0, 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 0, 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 0, 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-09-19T06:17:48.190 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.191 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.193 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.194 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.194 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-09-19T06:17:48.194 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.194 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.194 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-09-19T06:17:48.195 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.196 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-09-19T06:17:48.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.198 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.199 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-09-19T06:17:48.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 2, 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 4, 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 2, 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 4, 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 0, 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 0, 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 2615, 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-09-19T06:17:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 215208, 2024-09-19T06:17:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 67, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 8032, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 177, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-19T06:17:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 24089974, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 84982, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 2227, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 21, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 3, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 2227, 2024-09-19T06:17:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2227, 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.187984306, 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000533446 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2227, 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 2228 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 2227, 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 2227, 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 0, 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-09-19T06:17:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 1389, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 836, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-09-19T06:17:48.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 1, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-09-19T06:17:48.210 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-09-19T06:17:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 89, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 11, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 8, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 8, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 0, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 2, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 0 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 0, 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osd-slow-ops": { 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-09-19T06:17:48.213 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 0, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 0, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 0, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 2482, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 48346608, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 2482, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-19T06:17:48.214 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2482, 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 48346608, 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:48.215 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 2227, 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 46266954, 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2227, 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 46266954, 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:48.216 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 2227, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 2227, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2227, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 2227, 2024-09-19T06:17:48.217 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:48.218 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x5637859d2b40": { 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:48.219 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:48.220 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:48.221 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-19T06:17:48.917 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T06:17:48.917 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T06:17:48.917 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-19T06:17:48.917 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-19T06:17:48.917 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-19T06:17:48.917 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:17:48.917 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:17:48.918 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-19T06:17:48.918 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T06:17:48.918 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T06:17:49.164 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:17:49.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:49 smithi174 ceph-mon[34488]: pgmap v325: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:49.668 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-19T06:17:49.668 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:49.668 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 17511, 2024-09-19T06:17:49.668 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 17999, 2024-09-19T06:17:49.668 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 29922232, 2024-09-19T06:17:49.668 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 29490505, 2024-09-19T06:17:49.668 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 10, 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 5, 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.990577250, 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.402031256, 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.639992548, 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.064827032, 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 17998, 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.441013439, 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000024503 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:49.669 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 30152, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.004437244, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000147 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1703952, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 150000 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 40500, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 37299, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 14908504, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 26227215, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 22, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 7, 2024-09-19T06:17:49.670 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 1.788327147, 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.726598853, 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 1.326593303, 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.044846593, 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 37297, 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.797477654, 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000021381 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 69446, 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.009139191, 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000131 2024-09-19T06:17:49.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 5008, 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 128512 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1960, 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 2088, 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 953995, 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 13953204, 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 9, 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 5, 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.206324068, 2024-09-19T06:17:49.672 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.100996887, 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.039893755, 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.051382986, 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2086, 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.161543843, 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000077441 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.673 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 314192 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2998, 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 5.026012377, 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001676455 2024-09-19T06:17:49.674 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 5591, 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.018374848, 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000182145 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 19008, 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 18036, 2024-09-19T06:17:49.675 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 18036, 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 14.795213019, 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000820315 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 972, 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 51, 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 5, 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-09-19T06:17:49.676 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 10945, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 518, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 9974, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 453, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 10203, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 514, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 3, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 3, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 4, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 35959, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 13621, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 726, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 42, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:17:49.677 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 2, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 13, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 432, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 139, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 7713, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 434, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 4567, 2024-09-19T06:17:49.678 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 128182078, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 5, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 434, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 2, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 2, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 432, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 6, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 379, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 4266, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 2, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:17:49.679 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 14977, 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 1331, 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 49, 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 7731 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 171, 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 193, 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 107, 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 209, 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 298, 2024-09-19T06:17:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 42, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 3523, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 3481, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:17:49.681 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 13, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 5, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 1, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 34392, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 34392, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-09-19T06:17:49.682 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 42, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 42, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 4, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 50448390, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 0, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1409, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 10.859911324, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.007707531 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.683 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 0 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 6321, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 10240, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 3919, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 274, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 316, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 42, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 10945, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 15279, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 4334, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 3, 2024-09-19T06:17:49.684 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 3541, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 3538, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 102512, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 223520 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 23243, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 1556, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 19008, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 27, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 4223, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 634, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.632701176, 2024-09-19T06:17:49.685 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002575238 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 312, 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.105784848, 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000339054 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-09-19T06:17:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-09-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 13025, 2024-09-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 4.212621858, 2024-09-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000323425 2024-09-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-09-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.689 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-09-19T06:17:49.689 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.689 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.689 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.689 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-09-19T06:17:49.689 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.689 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.689 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 6, 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.010399916, 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001733319 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-09-19T06:17:49.690 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 12, 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.011744563, 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000978713 2024-09-19T06:17:49.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 508, 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.389973010, 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000767663 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 15, 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.548351800, 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.103223453 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.692 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 42, 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.753332469, 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.017936487 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-09-19T06:17:49.693 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.694 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.695 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1, 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000563894, 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000563894 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3481, 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 6.129739485, 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001760913 2024-09-19T06:17:49.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 2, 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 4, 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 2, 2024-09-19T06:17:49.697 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 2, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 6865, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 3432, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 606, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:49.698 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:49.699 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 650154, 2024-09-19T06:17:49.700 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 200, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 8032, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 177, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-19T06:17:49.701 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 21515613, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 108791, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 5790, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 47158951, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 28, 2024-09-19T06:17:49.702 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 5790, 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 5790, 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 17.359769647, 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002998233 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 5790, 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 6012 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 5790, 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 539, 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 5251, 2024-09-19T06:17:49.703 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 0, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 10, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 105, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 1514, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 66, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 3509, 2024-09-19T06:17:49.704 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 434, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 20, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:17:49.705 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 2, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-09-19T06:17:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 89, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 11, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 12, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 12, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 271, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 0, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 81 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 1, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "osd-slow-ops": { 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 10, 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 3481, 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 3481, 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.708 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 59967, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 40369591, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 59967, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 59967, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 40369591, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.709 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 5790, 2024-09-19T06:17:49.710 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 47610796, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 5790, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 47610796, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:49.711 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 5790, 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 5790, 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 5790, 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 5790, 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-19T06:17:49.712 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 3481, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 451845, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 3481, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 105, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 451845, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:49.713 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x55f3007f2960": { 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 34392, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 46254086, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 34392, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1409, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 46254086, 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:49.714 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:49.715 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:49.715 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:49.715 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:49.715 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:49.715 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-19T06:17:49.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:49 smithi169 ceph-mon[34350]: pgmap v325: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:49.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:49 smithi103 ceph-mon[30925]: pgmap v325: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:50.409 INFO:tasks.check_counter:Daemon mds.i mds.exported=13 2024-09-19T06:17:50.409 INFO:tasks.check_counter:Daemon mds.i mds.imported=139 2024-09-19T06:17:50.409 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=171 2024-09-19T06:17:50.409 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=193 2024-09-19T06:17:50.409 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=5 2024-09-19T06:17:50.409 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:17:50.409 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:17:50.409 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=5 2024-09-19T06:17:50.409 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T06:17:50.410 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T06:17:50.655 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:17:51.176 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-19T06:17:51.176 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:17:51.176 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 4, 2024-09-19T06:17:51.176 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 4, 2024-09-19T06:17:51.176 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 2992, 2024-09-19T06:17:51.176 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 448, 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 4, 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 0, 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.002933865, 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.000035689, 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.002179889, 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3, 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.003958223, 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001319407 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.177 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 2, 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 163, 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 185856, 2024-09-19T06:17:51.178 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 5, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 3, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.010656450, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.007257972, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.001308457, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 160, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.010249304, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000064058 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:51.179 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 185856 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 222, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 211, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1586528, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 129824, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 2, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 1, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.038856261, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.013306280, 2024-09-19T06:17:51.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.039797796, 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 210, 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.011937204, 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000056843 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1586528, 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 129824 2024-09-19T06:17:51.181 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 0, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:17:51.182 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:17:51.183 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:17:51.184 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 149024, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 31, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:17:51.185 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 928, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 2, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-19T06:17:51.186 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 224, 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 1555212, 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 224, 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 224, 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1555212, 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:51.187 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-19T06:17:51.188 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-19T06:17:51.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:51 smithi169 ceph-mon[34350]: pgmap v326: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:51.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:51 smithi174 ceph-mon[34488]: pgmap v326: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:51.847 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-19T06:17:51.847 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-19T06:17:51.847 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-19T06:17:51.848 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-19T06:17:51.848 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-19T06:17:51.848 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-19T06:17:51.848 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-19T06:17:51.848 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-19T06:17:51.848 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T06:17:51.859 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T06:17:51.859 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T06:17:51.859 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:17:51.880 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T06:17:51.880 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:17:51.940 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T06:17:51.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:51 smithi103 ceph-mon[30925]: pgmap v326: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:52.236 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.707+0000 7f832cfd9640 1 -- 172.21.15.103:0/1903983424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8328101420 msgr2=0x7f832810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.707+0000 7f832cfd9640 1 --2- 172.21.15.103:0/1903983424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8328101420 0x7f832810d950 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8320009cd0 tx=0x7f832002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.707+0000 7f832cfd9640 1 -- 172.21.15.103:0/1903983424 shutdown_connections 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.707+0000 7f832cfd9640 1 --2- 172.21.15.103:0/1903983424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8328101420 0x7f832810d950 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.707+0000 7f832cfd9640 1 --2- 172.21.15.103:0/1903983424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8328100a80 0x7f8328100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.707+0000 7f832cfd9640 1 --2- 172.21.15.103:0/1903983424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8328106a80 0x7f8328106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.707+0000 7f832cfd9640 1 -- 172.21.15.103:0/1903983424 >> 172.21.15.103:0/1903983424 conn(0x7f83280fc7a0 msgr2=0x7f83280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.707+0000 7f832cfd9640 1 -- 172.21.15.103:0/1903983424 shutdown_connections 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.707+0000 7f832cfd9640 1 -- 172.21.15.103:0/1903983424 wait complete. 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.708+0000 7f832cfd9640 1 Processor -- start 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.708+0000 7f832cfd9640 1 -- start start 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.708+0000 7f832cfd9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8328100a80 0x7f8328197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.708+0000 7f832cfd9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8328101420 0x7f83281977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.708+0000 7f832cfd9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8328106a80 0x7f832819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.708+0000 7f832cfd9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8328110d50 con 0x7f8328106a80 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.708+0000 7f832cfd9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8328110bd0 con 0x7f8328101420 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.708+0000 7f832cfd9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8328110ed0 con 0x7f8328100a80 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.708+0000 7f8326d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8328106a80 0x7f832819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f8326d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8328106a80 0x7f832819bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48428/0 (socket says 172.21.15.103:48428) 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f8326d9d640 1 -- 172.21.15.103:0/73684283 learned_addr learned my addr 172.21.15.103:0/73684283 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f832659c640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8328100a80 0x7f8328197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f8325d9b640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8328101420 0x7f83281977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f8326d9d640 1 -- 172.21.15.103:0/73684283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8328100a80 msgr2=0x7f8328197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f8326d9d640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8328100a80 0x7f8328197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f8326d9d640 1 -- 172.21.15.103:0/73684283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8328101420 msgr2=0x7f83281977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f8326d9d640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8328101420 0x7f83281977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f8326d9d640 1 -- 172.21.15.103:0/73684283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832819c240 con 0x7f8328106a80 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f8326d9d640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8328106a80 0x7f832819bb60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8320005cc0 tx=0x7f8320003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f831f7fe640 1 -- 172.21.15.103:0/73684283 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8320004240 con 0x7f8328106a80 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f832cfd9640 1 -- 172.21.15.103:0/73684283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832819c4d0 con 0x7f8328106a80 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f831f7fe640 1 -- 172.21.15.103:0/73684283 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83200305a0 con 0x7f8328106a80 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f831f7fe640 1 -- 172.21.15.103:0/73684283 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83200466c0 con 0x7f8328106a80 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.709+0000 7f832cfd9640 1 -- 172.21.15.103:0/73684283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83281a3e10 con 0x7f8328106a80 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.710+0000 7f832cfd9640 1 -- 172.21.15.103:0/73684283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8328100ee0 con 0x7f8328106a80 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.711+0000 7f831f7fe640 1 -- 172.21.15.103:0/73684283 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f8320030ac0 con 0x7f8328106a80 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.712+0000 7f831f7fe640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f83140a33b0 0x7f83140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.712+0000 7f831f7fe640 1 -- 172.21.15.103:0/73684283 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f832002e030 con 0x7f8328106a80 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.712+0000 7f832659c640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f83140a33b0 0x7f83140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.713+0000 7f832659c640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f83140a33b0 0x7f83140a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8318005e10 tx=0x7f8318005da0 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:52.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.715+0000 7f831f7fe640 1 -- 172.21.15.103:0/73684283 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f832004b060 con 0x7f8328106a80 2024-09-19T06:17:52.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.892+0000 7f832cfd9640 1 -- 172.21.15.103:0/73684283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8328109070 con 0x7f8328106a80 2024-09-19T06:17:52.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.893+0000 7f831f7fe640 1 -- 172.21.15.103:0/73684283 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v89) ==== 81+0+959 (secure 0 0 0) 0x7f8320039380 con 0x7f8328106a80 2024-09-19T06:17:52.894 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1612408044 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:52.894 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2210851046 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/3148507486 2024-09-20T05:58:21.953764+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1922728800 2024-09-20T05:58:45.371786+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/1007431406 2024-09-20T05:58:45.371786+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3630145046 2024-09-20T05:58:21.953764+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/3148507486 2024-09-20T05:58:21.953764+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/4227764370 2024-09-20T05:58:21.953764+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2607266510 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/4011994567 2024-09-20T05:58:21.953764+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3490453176 2024-09-20T05:58:45.371786+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1099848692 2024-09-20T05:58:45.371786+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/550453146 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/1007431406 2024-09-20T05:58:45.371786+0000 2024-09-19T06:17:52.895 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/253046125 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:52.896 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/253046125 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:52.896 INFO:teuthology.orchestra.run.smithi103.stderr:listed 16 entries 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 -- 172.21.15.103:0/73684283 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f83140a33b0 msgr2=0x7f83140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f83140a33b0 0x7f83140a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8318005e10 tx=0x7f8318005da0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 -- 172.21.15.103:0/73684283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8328106a80 msgr2=0x7f832819bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8328106a80 0x7f832819bb60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8320005cc0 tx=0x7f8320003ba0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 -- 172.21.15.103:0/73684283 shutdown_connections 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f83140a33b0 0x7f83140a5870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8328106a80 0x7f832819bb60 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8328101420 0x7f83281977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 --2- 172.21.15.103:0/73684283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8328100a80 0x7f8328197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 -- 172.21.15.103:0/73684283 >> 172.21.15.103:0/73684283 conn(0x7f83280fc7a0 msgr2=0x7f83280fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 -- 172.21.15.103:0/73684283 shutdown_connections 2024-09-19T06:17:52.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:52.895+0000 7f832cfd9640 1 -- 172.21.15.103:0/73684283 wait complete. 2024-09-19T06:17:53.544 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T06:17:53.544 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:17:53.602 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T06:17:53.664 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:53 smithi103 ceph-mon[30925]: pgmap v327: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:17:53.664 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:53 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/73684283' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:17:53.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:53 smithi169 ceph-mon[34350]: pgmap v327: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:17:53.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:53 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/73684283' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:17:53.889 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:53 smithi174 ceph-mon[34488]: pgmap v327: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:17:53.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:53 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/73684283' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:17:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.347+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2352958822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ebc1036e0 msgr2=0x7f0ebc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.347+0000 7f0ec3a93640 1 --2- 172.21.15.103:0/2352958822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ebc1036e0 0x7f0ebc107b90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009930 tx=0x7f0eb002a420 comp rx=0 tx=0).stop 2024-09-19T06:17:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.348+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2352958822 shutdown_connections 2024-09-19T06:17:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.348+0000 7f0ec3a93640 1 --2- 172.21.15.103:0/2352958822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ebc1082a0 0x7f0ebc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.348+0000 7f0ec3a93640 1 --2- 172.21.15.103:0/2352958822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ebc1036e0 0x7f0ebc107b90 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.348+0000 7f0ec3a93640 1 --2- 172.21.15.103:0/2352958822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ebc102d30 0x7f0ebc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.348+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2352958822 >> 172.21.15.103:0/2352958822 conn(0x7f0ebc0fc7d0 msgr2=0x7f0ebc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.348+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2352958822 shutdown_connections 2024-09-19T06:17:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.348+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2352958822 wait complete. 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.348+0000 7f0ec3a93640 1 Processor -- start 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.348+0000 7f0ec3a93640 1 -- start start 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec3a93640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ebc102d30 0x7f0ebc1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec3a93640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ebc1036e0 0x7f0ebc198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec3a93640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ebc1082a0 0x7f0ebc19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec3a93640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc111f70 con 0x7f0ebc1036e0 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec3a93640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc111df0 con 0x7f0ebc1082a0 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec3a93640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc1120f0 con 0x7f0ebc102d30 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec102e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ebc1036e0 0x7f0ebc198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec102e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ebc1036e0 0x7f0ebc198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48444/0 (socket says 172.21.15.103:48444) 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec102e640 1 -- 172.21.15.103:0/2690587878 learned_addr learned my addr 172.21.15.103:0/2690587878 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec182f640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ebc102d30 0x7f0ebc1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec2030640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ebc1082a0 0x7f0ebc19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec102e640 1 -- 172.21.15.103:0/2690587878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ebc102d30 msgr2=0x7f0ebc1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec102e640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ebc102d30 0x7f0ebc1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec102e640 1 -- 172.21.15.103:0/2690587878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ebc1082a0 msgr2=0x7f0ebc19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec102e640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ebc1082a0 0x7f0ebc19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec102e640 1 -- 172.21.15.103:0/2690587878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc19d570 con 0x7f0ebc1036e0 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec102e640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ebc1036e0 0x7f0ebc198b00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009230 tx=0x7f0eb0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ebaffd640 1 -- 172.21.15.103:0/2690587878 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb003f030 con 0x7f0ebc1036e0 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ebaffd640 1 -- 172.21.15.103:0/2690587878 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0eb00035f0 con 0x7f0ebc1036e0 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2690587878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ebc19d800 con 0x7f0ebc1036e0 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.349+0000 7f0ebaffd640 1 -- 172.21.15.103:0/2690587878 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0035070 con 0x7f0ebc1036e0 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.350+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2690587878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ebc1a5140 con 0x7f0ebc1036e0 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.351+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2690587878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ebc06a850 con 0x7f0ebc1036e0 2024-09-19T06:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.352+0000 7f0ebaffd640 1 -- 172.21.15.103:0/2690587878 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 138487+0+0 (secure 0 0 0) 0x7f0eb0003aa0 con 0x7f0ebc1036e0 2024-09-19T06:17:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.352+0000 7f0ebaffd640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ea40a33b0 0x7f0ea40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.352+0000 7f0ec182f640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ea40a33b0 0x7f0ea40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.352+0000 7f0ebaffd640 1 -- 172.21.15.103:0/2690587878 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f0eb00f0750 con 0x7f0ebc1036e0 2024-09-19T06:17:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.353+0000 7f0ec182f640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ea40a33b0 0x7f0ea40a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0eac005c40 tx=0x7f0eac008230 comp rx=0 tx=0).ready entity=mgr.15189 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.356+0000 7f0ebaffd640 1 -- 172.21.15.103:0/2690587878 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0eb00bd150 con 0x7f0ebc1036e0 2024-09-19T06:17:54.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.537+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2690587878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0ebc10a2b0 con 0x7f0ebc1036e0 2024-09-19T06:17:54.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.537+0000 7f0ebaffd640 1 -- 172.21.15.103:0/2690587878 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v89) ==== 81+0+959 (secure 0 0 0) 0x7f0eb00bca50 con 0x7f0ebc1036e0 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1612408044 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2210851046 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/3148507486 2024-09-20T05:58:21.953764+0000 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1922728800 2024-09-20T05:58:45.371786+0000 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/1007431406 2024-09-20T05:58:45.371786+0000 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3630145046 2024-09-20T05:58:21.953764+0000 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/3148507486 2024-09-20T05:58:21.953764+0000 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/4227764370 2024-09-20T05:58:21.953764+0000 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2607266510 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/4011994567 2024-09-20T05:58:21.953764+0000 2024-09-19T06:17:54.539 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3490453176 2024-09-20T05:58:45.371786+0000 2024-09-19T06:17:54.540 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1099848692 2024-09-20T05:58:45.371786+0000 2024-09-19T06:17:54.540 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/550453146 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:54.540 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/1007431406 2024-09-20T05:58:45.371786+0000 2024-09-19T06:17:54.540 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/253046125 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:54.540 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/253046125 2024-09-20T06:07:19.742943+0000 2024-09-19T06:17:54.541 INFO:teuthology.orchestra.run.smithi103.stderr:listed 16 entries 2024-09-19T06:17:54.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2690587878 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ea40a33b0 msgr2=0x7f0ea40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:54.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ea40a33b0 0x7f0ea40a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0eac005c40 tx=0x7f0eac008230 comp rx=0 tx=0).stop 2024-09-19T06:17:54.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2690587878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ebc1036e0 msgr2=0x7f0ebc198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:54.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ebc1036e0 0x7f0ebc198b00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009230 tx=0x7f0eb0004270 comp rx=0 tx=0).stop 2024-09-19T06:17:54.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2690587878 shutdown_connections 2024-09-19T06:17:54.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.103:6800/266758959,v1:172.21.15.103:6801/266758959] conn(0x7f0ea40a33b0 0x7f0ea40a5870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:54.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ebc1082a0 0x7f0ebc19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:54.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ebc1036e0 0x7f0ebc198b00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:54.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 --2- 172.21.15.103:0/2690587878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ebc102d30 0x7f0ebc1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:54.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2690587878 >> 172.21.15.103:0/2690587878 conn(0x7f0ebc0fc7d0 msgr2=0x7f0ebc105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:54.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2690587878 shutdown_connections 2024-09-19T06:17:54.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T06:17:54.539+0000 7f0ec3a93640 1 -- 172.21.15.103:0/2690587878 wait complete. 2024-09-19T06:17:55.201 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-19T06:17:55.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:17:55.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T06:17:55.267 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[83404]: fuse finished with error 0 and tester_r 0 2024-09-19T06:17:55.269 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:17:55.756 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:55 smithi174 ceph-mon[34488]: pgmap v328: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:55.756 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:55 smithi174 ceph-mon[34488]: from='client.? 172.21.15.103:0/2690587878' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:17:55.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:55 smithi169 ceph-mon[34350]: pgmap v328: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:55.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:55 smithi169 ceph-mon[34350]: from='client.? 172.21.15.103:0/2690587878' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:17:55.975 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:55 smithi103 ceph-mon[30925]: pgmap v328: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:17:55.975 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:55 smithi103 ceph-mon[30925]: from='client.? 172.21.15.103:0/2690587878' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:17:57.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:57 smithi169 ceph-mon[34350]: pgmap v329: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:17:57.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:57 smithi174 ceph-mon[34488]: pgmap v329: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:17:57.993 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:57 smithi103 ceph-mon[30925]: pgmap v329: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:17:59.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:17:59 smithi169 ceph-mon[34350]: pgmap v330: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:17:59.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:17:59 smithi174 ceph-mon[34488]: pgmap v330: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:17:59.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:17:59 smithi103 ceph-mon[30925]: pgmap v330: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:18:01.371 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T06:18:01.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:18:01.371 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T06:18:01.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:18:01.393 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-19T06:18:01.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T06:18:01.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:18:01.452 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:18:01.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:18:01.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-19T06:18:01.620 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T06:18:01.631 INFO:tasks.cephadm:Teardown begin 2024-09-19T06:18:01.631 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T06:18:01.632 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:18:01.661 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:18:01.695 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:18:01.728 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T06:18:01.728 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:18:01.744 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:18:01.762 DEBUG:teuthology.orchestra.run.smithi174:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:18:01.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:18:01 smithi169 ceph-mon[34350]: pgmap v331: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:18:01.786 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T06:18:01.787 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T06:18:01.787 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:18:01.809 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:18:01 smithi103 ceph-mon[30925]: pgmap v331: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:18:01.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:18:01 smithi174 ceph-mon[34488]: pgmap v331: 97 pgs: 97 active+clean; 166 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:18:02.096 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:18:01 smithi103 systemd[1]: Stopping Ceph mon.a for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:02.413 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:18:02 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a[30921]: 2024-09-19T06:18:02.092+0000 7f2e26944640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:02.413 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:18:02 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a[30921]: 2024-09-19T06:18:02.092+0000 7f2e26944640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T06:18:02.413 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:18:02 smithi103 podman[112234]: 2024-09-19 06:18:02.124106844 +0000 UTC m=+0.142725642 container died d758afa5ef0d243034fe9d6a16b8f2ab6ea89d665efa9783b342a29bdb5dbf2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T06:18:02.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:18:02 smithi103 podman[112234]: 2024-09-19 06:18:02.510226725 +0000 UTC m=+0.528845532 container cleanup d758afa5ef0d243034fe9d6a16b8f2ab6ea89d665efa9783b342a29bdb5dbf2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:18:02.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 19 06:18:02 smithi103 bash[112234]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:18:02.885 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T06:18:02.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:02.973 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T06:18:02.973 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T06:18:02.973 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.b 2024-09-19T06:18:03.277 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:18:03 smithi169 systemd[1]: Stopping Ceph mon.b for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:03.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:18:03 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-b[34346]: 2024-09-19T06:18:03.417+0000 7f6591ce2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:03.777 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:18:03 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-b[34346]: 2024-09-19T06:18:03.417+0000 7f6591ce2640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:18:03.778 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:18:03 smithi169 podman[69928]: 2024-09-19 06:18:03.500022078 +0000 UTC m=+0.332193757 container died c6fb73b8ce3563a9c24ae6fd7c5840e9a7aea5d3752f5756fe9e5a1c8e421cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T06:18:04.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:18:03 smithi169 podman[69928]: 2024-09-19 06:18:03.876190548 +0000 UTC m=+0.708362216 container cleanup c6fb73b8ce3563a9c24ae6fd7c5840e9a7aea5d3752f5756fe9e5a1c8e421cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:18:04.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 19 06:18:03 smithi169 bash[69928]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-b 2024-09-19T06:18:04.308 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T06:18:04.359 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:04.360 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T06:18:04.360 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T06:18:04.360 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.c 2024-09-19T06:18:04.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:18:04 smithi174 systemd[1]: Stopping Ceph mon.c for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:18:04 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-c[34484]: 2024-09-19T06:18:04.646+0000 7f153e202640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:18:04 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-c[34484]: 2024-09-19T06:18:04.646+0000 7f153e202640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:18:04.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:18:04 smithi174 podman[70623]: 2024-09-19 06:18:04.698452838 +0000 UTC m=+0.148023452 container died e9c25c0a3fe4dd7b85e1011979594caca8c1af370909e9f7af5637495fc7ed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:18:05.291 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:18:05 smithi174 podman[70623]: 2024-09-19 06:18:05.072418874 +0000 UTC m=+0.521989482 container cleanup e9c25c0a3fe4dd7b85e1011979594caca8c1af370909e9f7af5637495fc7ed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:18:05.291 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 19 06:18:05 smithi174 bash[70623]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mon-c 2024-09-19T06:18:05.431 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T06:18:05.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:05.479 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T06:18:05.479 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T06:18:05.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:18:05.909 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:18:05 smithi103 systemd[1]: Stopping Ceph mgr.x for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:06.201 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:18:05 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x[31151]: 2024-09-19T06:18:05.906+0000 7fcf96734640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:06.201 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:18:05 smithi103 podman[112354]: 2024-09-19 06:18:05.93836796 +0000 UTC m=+0.263681911 container died d9f2da171f7537487ae8552423ad0836878134afed3b63e3a1dfd6331e18129d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:18:06.494 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:18:06 smithi103 podman[112354]: 2024-09-19 06:18:06.316292406 +0000 UTC m=+0.641606340 container cleanup d9f2da171f7537487ae8552423ad0836878134afed3b63e3a1dfd6331e18129d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:18:06.494 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 19 06:18:06 smithi103 bash[112354]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-x 2024-09-19T06:18:06.774 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T06:18:06.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:06.812 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T06:18:06.812 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T06:18:06.812 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.y 2024-09-19T06:18:07.195 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:18:06 smithi169 systemd[1]: Stopping Ceph mgr.y for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:07.524 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:18:07 smithi169 podman[70054]: 2024-09-19 06:18:07.193791081 +0000 UTC m=+0.182041199 container died 9fb5c9b079c891f9f70834ad9b4781678d68eabf7a094dca4a3835e4b04856a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:18:07.777 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:18:07 smithi169 podman[70054]: 2024-09-19 06:18:07.614187467 +0000 UTC m=+0.602437575 container cleanup 9fb5c9b079c891f9f70834ad9b4781678d68eabf7a094dca4a3835e4b04856a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T06:18:07.777 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 19 06:18:07 smithi169 bash[70054]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-y 2024-09-19T06:18:08.045 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T06:18:08.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:08.080 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T06:18:08.080 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T06:18:08.080 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.z 2024-09-19T06:18:08.400 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:18:08 smithi174 systemd[1]: Stopping Ceph mgr.z for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:08.694 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:18:08 smithi174 podman[70745]: 2024-09-19 06:18:08.398772352 +0000 UTC m=+0.123647652 container died 4675dd7737b4573f8b6368b76276196aa1447e8524fe123409e8c68beb4e2b8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T06:18:08.954 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:18:08 smithi174 podman[70745]: 2024-09-19 06:18:08.767857939 +0000 UTC m=+0.492733238 container cleanup 4675dd7737b4573f8b6368b76276196aa1447e8524fe123409e8c68beb4e2b8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T06:18:08.954 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 19 06:18:08 smithi174 bash[70745]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mgr-z 2024-09-19T06:18:09.148 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T06:18:09.182 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:09.182 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T06:18:09.182 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T06:18:09.182 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.0 2024-09-19T06:18:09.494 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:09 smithi103 systemd[1]: Stopping Ceph osd.0 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:09.993 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:09 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0[45213]: 2024-09-19T06:18:09.570+0000 7ffbd8b4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:09.994 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:09 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0[45213]: 2024-09-19T06:18:09.570+0000 7ffbd8b4f640 -1 osd.0 89 *** Got signal Terminated *** 2024-09-19T06:18:09.994 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:09 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0[45213]: 2024-09-19T06:18:09.570+0000 7ffbd8b4f640 -1 osd.0 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:18:15.324 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:15 smithi103 podman[112487]: 2024-09-19 06:18:15.014004972 +0000 UTC m=+5.644087463 container died 6c83e26358fa24bce7f2260ccb0f71b2528ad92872e313d37d4171614aef9449 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T06:18:15.582 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:15 smithi103 podman[112487]: 2024-09-19 06:18:15.405150507 +0000 UTC m=+6.035232998 container cleanup 6c83e26358fa24bce7f2260ccb0f71b2528ad92872e313d37d4171614aef9449 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:18:15.582 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:15 smithi103 bash[112487]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0 2024-09-19T06:18:15.993 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:15 smithi103 podman[112503]: 2024-09-19 06:18:15.58141228 +0000 UTC m=+0.568524244 container remove 6c83e26358fa24bce7f2260ccb0f71b2528ad92872e313d37d4171614aef9449 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T06:18:16.269 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:16 smithi103 podman[112592]: 2024-09-19 06:18:15.917262558 +0000 UTC m=+0.015972173 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:18:16.269 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:16 smithi103 podman[112592]: 2024-09-19 06:18:16.023854331 +0000 UTC m=+0.122563922 container create 093f7e9f0efe8c7771b8fae81d6183ff3b7438148afcd118810405db048bec45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T06:18:16.269 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:16 smithi103 podman[112592]: 2024-09-19 06:18:16.268206082 +0000 UTC m=+0.366915686 container init 093f7e9f0efe8c7771b8fae81d6183ff3b7438148afcd118810405db048bec45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T06:18:16.679 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:16 smithi103 podman[112592]: 2024-09-19 06:18:16.271984791 +0000 UTC m=+0.370694385 container start 093f7e9f0efe8c7771b8fae81d6183ff3b7438148afcd118810405db048bec45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T06:18:16.679 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:16 smithi103 podman[112592]: 2024-09-19 06:18:16.351514328 +0000 UTC m=+0.450223928 container attach 093f7e9f0efe8c7771b8fae81d6183ff3b7438148afcd118810405db048bec45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:18:16.679 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 19 06:18:16 smithi103 podman[112592]: 2024-09-19 06:18:16.458735703 +0000 UTC m=+0.557445295 container died 093f7e9f0efe8c7771b8fae81d6183ff3b7438148afcd118810405db048bec45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T06:18:17.150 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T06:18:17.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:17.191 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T06:18:17.191 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T06:18:17.191 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.1 2024-09-19T06:18:17.503 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:17 smithi169 systemd[1]: Stopping Ceph osd.1 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:17.777 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1[38719]: 2024-09-19T06:18:17.501+0000 7f384ee49640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:17.777 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1[38719]: 2024-09-19T06:18:17.501+0000 7f384ee49640 -1 osd.1 89 *** Got signal Terminated *** 2024-09-19T06:18:17.778 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1[38719]: 2024-09-19T06:18:17.501+0000 7f384ee49640 -1 osd.1 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:18:23.212 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:22 smithi169 podman[70177]: 2024-09-19 06:18:22.921019817 +0000 UTC m=+5.540502673 container died 6a47aecd2feec9c5c34c0cded6aa3138c309e6bfdecb8fe9caa0c8866c440422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:18:23.527 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:23 smithi169 podman[70177]: 2024-09-19 06:18:23.293565771 +0000 UTC m=+5.913048636 container cleanup 6a47aecd2feec9c5c34c0cded6aa3138c309e6bfdecb8fe9caa0c8866c440422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T06:18:23.527 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:23 smithi169 bash[70177]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1 2024-09-19T06:18:23.868 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:23 smithi169 podman[70192]: 2024-09-19 06:18:23.536568534 +0000 UTC m=+0.617288552 container remove 6a47aecd2feec9c5c34c0cded6aa3138c309e6bfdecb8fe9caa0c8866c440422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T06:18:24.166 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:23 smithi169 podman[70280]: 2024-09-19 06:18:23.77050793 +0000 UTC m=+0.015880512 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:18:24.166 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:23 smithi169 podman[70280]: 2024-09-19 06:18:23.895789569 +0000 UTC m=+0.141162184 container create b2c568b040ae6e42f92a27016315d7d32f080043ae720cdd269126db9c942872 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:18:24.166 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:24 smithi169 podman[70280]: 2024-09-19 06:18:24.106806869 +0000 UTC m=+0.352179444 container init b2c568b040ae6e42f92a27016315d7d32f080043ae720cdd269126db9c942872 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T06:18:24.166 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:24 smithi169 podman[70280]: 2024-09-19 06:18:24.109969911 +0000 UTC m=+0.355342484 container start b2c568b040ae6e42f92a27016315d7d32f080043ae720cdd269126db9c942872 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:18:24.166 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:24 smithi169 podman[70280]: 2024-09-19 06:18:24.16494007 +0000 UTC m=+0.410312660 container attach b2c568b040ae6e42f92a27016315d7d32f080043ae720cdd269126db9c942872 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:18:24.528 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 19 06:18:24 smithi169 podman[70280]: 2024-09-19 06:18:24.295195748 +0000 UTC m=+0.540568331 container died b2c568b040ae6e42f92a27016315d7d32f080043ae720cdd269126db9c942872 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T06:18:24.956 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T06:18:24.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:24.995 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T06:18:24.996 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T06:18:24.996 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.2 2024-09-19T06:18:25.315 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:25 smithi174 systemd[1]: Stopping Ceph osd.2 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:25.572 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:25 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2[39447]: 2024-09-19T06:18:25.313+0000 7fe546251640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:25.573 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:25 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2[39447]: 2024-09-19T06:18:25.313+0000 7fe546251640 -1 osd.2 89 *** Got signal Terminated *** 2024-09-19T06:18:25.573 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:25 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2[39447]: 2024-09-19T06:18:25.313+0000 7fe546251640 -1 osd.2 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:18:31.158 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:30 smithi174 podman[70869]: 2024-09-19 06:18:30.850006163 +0000 UTC m=+5.662901796 container died f77194d6f879c5af8319451938760f77720fec19954fb5351aa4ceaf8ed25f09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:18:31.449 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:31 smithi174 podman[70869]: 2024-09-19 06:18:31.254950768 +0000 UTC m=+6.067846390 container cleanup f77194d6f879c5af8319451938760f77720fec19954fb5351aa4ceaf8ed25f09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T06:18:31.449 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:31 smithi174 bash[70869]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2 2024-09-19T06:18:31.704 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:31 smithi174 podman[70896]: 2024-09-19 06:18:31.447863696 +0000 UTC m=+0.596386323 container remove f77194d6f879c5af8319451938760f77720fec19954fb5351aa4ceaf8ed25f09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T06:18:32.110 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:31 smithi174 podman[70985]: 2024-09-19 06:18:31.676155771 +0000 UTC m=+0.016090115 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:18:32.110 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:31 smithi174 podman[70985]: 2024-09-19 06:18:31.790479216 +0000 UTC m=+0.130413582 container create 5b186d7d40b4c5b3b210ab7cf3d3c595cd2e4fc9df728cea8745dbb2165656e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:18:32.110 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:32 smithi174 podman[70985]: 2024-09-19 06:18:32.017639465 +0000 UTC m=+0.357573799 container init 5b186d7d40b4c5b3b210ab7cf3d3c595cd2e4fc9df728cea8745dbb2165656e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T06:18:32.111 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:32 smithi174 podman[70985]: 2024-09-19 06:18:32.020882398 +0000 UTC m=+0.360816730 container start 5b186d7d40b4c5b3b210ab7cf3d3c595cd2e4fc9df728cea8745dbb2165656e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T06:18:32.111 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:32 smithi174 podman[70985]: 2024-09-19 06:18:32.109505969 +0000 UTC m=+0.449440303 container attach 5b186d7d40b4c5b3b210ab7cf3d3c595cd2e4fc9df728cea8745dbb2165656e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T06:18:32.454 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:32 smithi174 podman[70985]: 2024-09-19 06:18:32.20354851 +0000 UTC m=+0.543482842 container died 5b186d7d40b4c5b3b210ab7cf3d3c595cd2e4fc9df728cea8745dbb2165656e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T06:18:32.760 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 19 06:18:32 smithi174 podman[71008]: 2024-09-19 06:18:32.745998701 +0000 UTC m=+0.530611510 container remove 5b186d7d40b4c5b3b210ab7cf3d3c595cd2e4fc9df728cea8745dbb2165656e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T06:18:32.766 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T06:18:32.806 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:32.806 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T06:18:32.806 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T06:18:32.806 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.3 2024-09-19T06:18:33.118 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:32 smithi103 systemd[1]: Stopping Ceph osd.3 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:33.494 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:33 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3[52039]: 2024-09-19T06:18:33.116+0000 7ffae5af6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:33.494 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:33 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3[52039]: 2024-09-19T06:18:33.116+0000 7ffae5af6640 -1 osd.3 89 *** Got signal Terminated *** 2024-09-19T06:18:33.494 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:33 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3[52039]: 2024-09-19T06:18:33.116+0000 7ffae5af6640 -1 osd.3 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:18:35.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:35.665+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:36.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:36 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:36.397+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:36.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:36 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:36.246+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:36.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:36 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:36.634+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:37.357 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:37 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:37.224+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:37.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:37 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:37.624+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:38.243 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:37 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:37.355+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:38.244 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:38 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:38.238+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:38.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:38 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:38.609+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:38.704 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:38 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:38.385+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:38.743 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:38 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:38.386+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:38.744 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:38 smithi103 podman[112701]: 2024-09-19 06:18:38.507614556 +0000 UTC m=+5.505921705 container died 1d0e44c00aae8385c29c230d3eedcb200d990dfc69b2f182fe8897aa6143bc7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:18:39.152 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:38 smithi103 podman[112701]: 2024-09-19 06:18:38.900025066 +0000 UTC m=+5.898332250 container cleanup 1d0e44c00aae8385c29c230d3eedcb200d990dfc69b2f182fe8897aa6143bc7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T06:18:39.152 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:38 smithi103 bash[112701]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3 2024-09-19T06:18:39.409 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:39 smithi103 podman[112728]: 2024-09-19 06:18:39.1517081 +0000 UTC m=+0.647457834 container remove 1d0e44c00aae8385c29c230d3eedcb200d990dfc69b2f182fe8897aa6143bc7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T06:18:39.409 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:39 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:39.256+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:39.704 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:39 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:39.421+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:39.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:39 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:39.575+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:39.743 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:39 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:39.407+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:39.744 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:39 smithi103 podman[112817]: 2024-09-19 06:18:39.41071351 +0000 UTC m=+0.016257370 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:18:39.744 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:39 smithi103 podman[112817]: 2024-09-19 06:18:39.510780736 +0000 UTC m=+0.116324584 container create 8c47df42ec5d1ebcd27bad65ee6989afd25fd2297ca0afbef3d1edb6565beaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:18:39.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:39 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:39.315+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:40.244 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:39 smithi103 podman[112817]: 2024-09-19 06:18:39.780137132 +0000 UTC m=+0.385680988 container init 8c47df42ec5d1ebcd27bad65ee6989afd25fd2297ca0afbef3d1edb6565beaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T06:18:40.244 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:39 smithi103 podman[112817]: 2024-09-19 06:18:39.783891729 +0000 UTC m=+0.389435577 container start 8c47df42ec5d1ebcd27bad65ee6989afd25fd2297ca0afbef3d1edb6565beaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T06:18:40.244 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:39 smithi103 podman[112817]: 2024-09-19 06:18:39.8631794 +0000 UTC m=+0.468723264 container attach 8c47df42ec5d1ebcd27bad65ee6989afd25fd2297ca0afbef3d1edb6565beaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T06:18:40.244 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 19 06:18:39 smithi103 podman[112817]: 2024-09-19 06:18:39.981907918 +0000 UTC m=+0.587451775 container died 8c47df42ec5d1ebcd27bad65ee6989afd25fd2297ca0afbef3d1edb6565beaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T06:18:40.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:40 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:40.270+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:40.642 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:40 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:40.400+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:40.643 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:40 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:40.280+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:40.667 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T06:18:40.703 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:40 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:40.622+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:40.704 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:40 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:40.410+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:40.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:40 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:40.397+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:40.709 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:40.710 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T06:18:40.710 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T06:18:40.710 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.4 2024-09-19T06:18:41.022 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:40 smithi169 systemd[1]: Stopping Ceph osd.4 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:41.277 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:41 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4[45351]: 2024-09-19T06:18:41.021+0000 7f7960f08640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:41.277 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:41 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4[45351]: 2024-09-19T06:18:41.021+0000 7f7960f08640 -1 osd.4 89 *** Got signal Terminated *** 2024-09-19T06:18:41.277 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:41 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4[45351]: 2024-09-19T06:18:41.021+0000 7f7960f08640 -1 osd.4 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:18:41.647 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:41 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:41.381+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:41.647 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:41 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:41.401+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:41.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:41 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:41.424+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:41.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:41 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:41.291+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:41.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:41 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:41.282+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:41.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:41 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:41.646+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:42.693 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:42 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:42.354+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:42.693 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:42 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:42.396+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:42.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:42 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:42.418+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:42.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:42 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:42.317+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:42.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:42 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:42.276+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:42.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:42 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:42.692+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:43.704 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:43.415+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:43.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:43.306+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:43.743 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:43 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:43.429+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:43.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:43 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:43.429+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:43.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:43 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:43.293+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:43.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:43 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:43.279+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:44.204 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:43 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:43.714+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:44.704 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:44 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:44.391+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:44.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:44 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:44.301+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:44.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:44 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:44.301+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:44.743 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:44.457+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:44.743 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:44.457+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:44.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:44 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:44.327+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:44.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:44 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:44.319+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:44.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:44 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:44.319+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:45.204 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:44 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:44.762+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:45.204 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:44 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:44.762+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:45.704 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:45 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:45.439+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:45.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:45 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:45.340+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:45.705 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:45 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:45.340+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:45.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:45 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:45.448+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:45.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:45 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:45.448+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:45.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:45 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:45.365+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:45.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:45 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:45.365+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:45.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:45.351+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:45.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:45 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:45.351+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:46.204 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:45 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:45.733+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:46.204 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:45 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:45.733+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:46.704 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:46 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:46.473+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:46.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:46 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:46.295+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:46.705 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:46 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:46.295+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:46.722 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:46 smithi169 podman[70392]: 2024-09-19 06:18:46.50128927 +0000 UTC m=+5.591458137 container died 9660653f36c4737a5a3b5ce884ed339a65052ef4447bd3a8ca55fdb484a98bd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:18:46.723 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:46 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:46.380+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:46.723 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:46 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:46.380+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:46.743 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:46 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:46.406+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:46.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:46 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:46.406+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:46.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:46 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:46.329+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:46.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:46 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:46.329+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:47.014 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:46 smithi169 podman[70392]: 2024-09-19 06:18:46.803852274 +0000 UTC m=+5.894021138 container cleanup 9660653f36c4737a5a3b5ce884ed339a65052ef4447bd3a8ca55fdb484a98bd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:18:47.014 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:46 smithi169 bash[70392]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4 2024-09-19T06:18:47.204 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:46 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:46.704+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:47.204 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:46 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:46.704+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:47.277 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:47 smithi169 podman[70407]: 2024-09-19 06:18:47.013795968 +0000 UTC m=+0.514981283 container remove 9660653f36c4737a5a3b5ce884ed339a65052ef4447bd3a8ca55fdb484a98bd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T06:18:47.593 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:47 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:47.346+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:47.593 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:47 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:47.346+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:47.593 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:47 smithi169 podman[70496]: 2024-09-19 06:18:47.228619585 +0000 UTC m=+0.015465458 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:18:47.593 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:47 smithi169 podman[70496]: 2024-09-19 06:18:47.33125634 +0000 UTC m=+0.118102243 container create 2f3ed2b5fad80e58e10dfbe64c904715d03d34fc24439327225af3d6b109c746 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:18:47.676 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:47 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:47.443+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:47.676 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:47 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:47.298+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:47.676 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:47 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:47.298+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:47.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:47.386+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:47.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:47.386+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:47.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:47.315+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:47.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:47 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:47.315+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:47.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:47 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:47.674+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:47.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:47 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:47.674+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:48.028 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:47 smithi169 podman[70496]: 2024-09-19 06:18:47.592286521 +0000 UTC m=+0.379132389 container init 2f3ed2b5fad80e58e10dfbe64c904715d03d34fc24439327225af3d6b109c746 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T06:18:48.028 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:47 smithi169 podman[70496]: 2024-09-19 06:18:47.595674803 +0000 UTC m=+0.382520670 container start 2f3ed2b5fad80e58e10dfbe64c904715d03d34fc24439327225af3d6b109c746 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:18:48.028 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:47 smithi169 podman[70496]: 2024-09-19 06:18:47.658620794 +0000 UTC m=+0.445466682 container attach 2f3ed2b5fad80e58e10dfbe64c904715d03d34fc24439327225af3d6b109c746 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T06:18:48.028 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 19 06:18:47 smithi169 podman[70496]: 2024-09-19 06:18:47.794161772 +0000 UTC m=+0.581007641 container died 2f3ed2b5fad80e58e10dfbe64c904715d03d34fc24439327225af3d6b109c746 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-19T06:18:48.351 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T06:18:48.386 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:48 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:48.286+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:48.386 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:48 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:48.286+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:48.391 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:48.391 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T06:18:48.391 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T06:18:48.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.5 2024-09-19T06:18:48.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:48 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:48.299+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:48.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:48 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:48.299+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:48.675 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:48 smithi174 systemd[1]: Stopping Ceph osd.5 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:48.675 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:48 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:48.462+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:48.675 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:48 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:48.462+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.808113+0000 front 2024-09-19T06:18:21.808243+0000 (oldest deadline 2024-09-19T06:18:47.708050+0000) 2024-09-19T06:18:48.675 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:48 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:48.671+0000 7f0697cd3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:48.743 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:48 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:48.385+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:48.743 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:48 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:48.385+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:48.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:48 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:48.468+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:48.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:48 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:48.330+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:48.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:48 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:48.330+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:48.954 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:48 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:48.671+0000 7f0697cd3640 -1 osd.5 89 *** Got signal Terminated *** 2024-09-19T06:18:48.954 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:48 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:48.671+0000 7f0697cd3640 -1 osd.5 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:18:48.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:48 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:48.702+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:48.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:48 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:48.702+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:49.674 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:49 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:49.484+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:49.674 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:49 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:49.484+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.808113+0000 front 2024-09-19T06:18:21.808243+0000 (oldest deadline 2024-09-19T06:18:47.708050+0000) 2024-09-19T06:18:49.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:49 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:49.310+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:49.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:49 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:49.310+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:49.743 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:49 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:49.414+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:49.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:49 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:49.414+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:49.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:49 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:49.291+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:49.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:49 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:49.291+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:49.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:49 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:49.505+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:49.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:49 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:49.314+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:49.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:49 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:49.314+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:49.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:49 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:49.671+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:49.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:49 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:49.671+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:50.684 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:50 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:50.490+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:50.684 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:50 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:50.490+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.808113+0000 front 2024-09-19T06:18:21.808243+0000 (oldest deadline 2024-09-19T06:18:47.708050+0000) 2024-09-19T06:18:50.685 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:50 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:50.345+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:50.685 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:50 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:50.345+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:50.743 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:50 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:50.400+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:50.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:50 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:50.400+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:50.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:50 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:50.256+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:50.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:50 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:50.256+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:50.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:50 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:50.519+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:50.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:50 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:50.343+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:50.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:50 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:50.343+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:50.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:50 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:50.681+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:50.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:50 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:50.681+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:51.651 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:51 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:51.502+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:51.651 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:51 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:51.502+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.808113+0000 front 2024-09-19T06:18:21.808243+0000 (oldest deadline 2024-09-19T06:18:47.708050+0000) 2024-09-19T06:18:51.651 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:51 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:51.354+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:51.651 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:51 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:51.354+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:51.651 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:51 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:51.354+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:18:51.743 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:51 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:51.255+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:51.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:51 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:51.255+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:51.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:51 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:51.448+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:51.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:51 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:51.448+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:51.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:51 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:51.492+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:51.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:51 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:51.339+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:51.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:51 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:51.339+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:51.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:51 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:51.649+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:51.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:51 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:51.649+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:52.612 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:52 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:52.507+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:52.612 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:52 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:52.507+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.808113+0000 front 2024-09-19T06:18:21.808243+0000 (oldest deadline 2024-09-19T06:18:47.708050+0000) 2024-09-19T06:18:52.612 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:52 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:52.344+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:52.612 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:52 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:52.344+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:52.612 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:52 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:52.344+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:18:52.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:52 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:52.459+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:52.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:52 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:52.459+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:52.744 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:52 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:52.459+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:29.887043+0000 front 2024-09-19T06:18:29.886980+0000 (oldest deadline 2024-09-19T06:18:52.186839+0000) 2024-09-19T06:18:52.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:52 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:52.259+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:52.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:52 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:52.259+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:52.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:52 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:52.443+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:52.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:52 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:52.344+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:52.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:52 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:52.344+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:52.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:52 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:52.344+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:18:52.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:52 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:52.610+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:52.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:52 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:52.610+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:53.493 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:53 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:53.455+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:53.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:53 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:53.455+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:53.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:53 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:53.455+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:29.887043+0000 front 2024-09-19T06:18:29.886980+0000 (oldest deadline 2024-09-19T06:18:52.186839+0000) 2024-09-19T06:18:53.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:53 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:53.225+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:53.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:53 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:53.225+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:53.622 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:53.298+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:53.623 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:53.298+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:53.623 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:53.298+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:18:53.623 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:53.496+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.606770+0000 front 2024-09-19T06:18:13.606914+0000 (oldest deadline 2024-09-19T06:18:37.706875+0000) 2024-09-19T06:18:53.623 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:53.496+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.808113+0000 front 2024-09-19T06:18:21.808243+0000 (oldest deadline 2024-09-19T06:18:47.708050+0000) 2024-09-19T06:18:53.623 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5[46357]: 2024-09-19T06:18:53.496+0000 7f06902d0640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:27.708373+0000 front 2024-09-19T06:18:27.708396+0000 (oldest deadline 2024-09-19T06:18:53.008670+0000) 2024-09-19T06:18:53.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:53 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:53.481+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:53.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:53 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:53.481+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:18:53.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:53 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:53.301+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:53.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:53 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:53.301+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:53.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:53 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:53.301+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:18:53.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:53.621+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:53.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:53 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:53.621+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:54.315 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:54 smithi174 podman[71087]: 2024-09-19 06:18:54.017605681 +0000 UTC m=+5.429459366 container died cc80dc64e2b2b7ef7a7536ff45e3d9ebe0ad14ddea9838e21f04bd6317e14c7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T06:18:54.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:54 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:54.235+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:54.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:54 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:54.235+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:54.648 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:54 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:54.316+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:54.648 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:54 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:54.316+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:54.648 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:54 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:54.316+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:18:54.649 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:54 smithi174 podman[71087]: 2024-09-19 06:18:54.314285395 +0000 UTC m=+5.726139069 container cleanup cc80dc64e2b2b7ef7a7536ff45e3d9ebe0ad14ddea9838e21f04bd6317e14c7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T06:18:54.649 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:54 smithi174 bash[71087]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5 2024-09-19T06:18:54.649 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:54 smithi174 podman[71103]: 2024-09-19 06:18:54.540340018 +0000 UTC m=+0.522017456 container remove cc80dc64e2b2b7ef7a7536ff45e3d9ebe0ad14ddea9838e21f04bd6317e14c7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-19T06:18:54.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:54 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:54.490+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:54.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:54 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:54.490+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:18:54.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:54 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:54.305+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:54.779 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:54 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:54.305+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:54.779 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:54 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:54.305+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:18:54.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:54 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:54.645+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:54.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:54 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:54.645+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:54.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:54 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:54.645+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:18:54.954 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:54 smithi174 podman[71193]: 2024-09-19 06:18:54.866299005 +0000 UTC m=+0.100877071 container create d30f34bf5b31e8fc0972955be9dc83f59a6bd038775c8358ccbd6f59460609da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T06:18:54.954 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:54 smithi174 podman[71193]: 2024-09-19 06:18:54.781332666 +0000 UTC m=+0.015910749 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:18:54.993 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:54 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:54.500+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:54.994 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:54 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:54.500+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:54.994 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:54 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:54.500+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:29.887043+0000 front 2024-09-19T06:18:29.886980+0000 (oldest deadline 2024-09-19T06:18:52.186839+0000) 2024-09-19T06:18:55.317 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:55 smithi174 podman[71193]: 2024-09-19 06:18:55.127053578 +0000 UTC m=+0.361631650 container init d30f34bf5b31e8fc0972955be9dc83f59a6bd038775c8358ccbd6f59460609da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T06:18:55.317 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:55 smithi174 podman[71193]: 2024-09-19 06:18:55.130331642 +0000 UTC m=+0.364909701 container start d30f34bf5b31e8fc0972955be9dc83f59a6bd038775c8358ccbd6f59460609da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:18:55.318 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:55 smithi174 podman[71193]: 2024-09-19 06:18:55.185209323 +0000 UTC m=+0.419787396 container attach d30f34bf5b31e8fc0972955be9dc83f59a6bd038775c8358ccbd6f59460609da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T06:18:55.493 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:55 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:55.453+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:55.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:55 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:55.453+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:55.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:55 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:55.453+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:29.887043+0000 front 2024-09-19T06:18:29.886980+0000 (oldest deadline 2024-09-19T06:18:52.186839+0000) 2024-09-19T06:18:55.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:55 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:55.228+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:55.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:55 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:55.228+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:55.589 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 19 06:18:55 smithi174 podman[71193]: 2024-09-19 06:18:55.317979151 +0000 UTC m=+0.552557227 container died d30f34bf5b31e8fc0972955be9dc83f59a6bd038775c8358ccbd6f59460609da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T06:18:55.589 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:55 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:55.315+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:55.589 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:55 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:55.315+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:55.589 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:55 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:55.315+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:18:55.679 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:55 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:55.457+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:55.679 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:55 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:55.457+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:18:55.679 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:55 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:55.329+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:55.679 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:55 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:55.329+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:55.679 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:55 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:55.329+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:18:55.873 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:55 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:55.598+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:55.873 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:55 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:55.598+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:55.873 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:55 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:55.598+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:18:55.901 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T06:18:55.939 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:18:55.939 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T06:18:55.939 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T06:18:55.939 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.6 2024-09-19T06:18:56.238 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:55 smithi103 systemd[1]: Stopping Ceph osd.6 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:18:56.493 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:56 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:56.235+0000 7f51c1af7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:18:56.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:56 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:56.235+0000 7f51c1af7640 -1 osd.6 89 *** Got signal Terminated *** 2024-09-19T06:18:56.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:56 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:56.235+0000 7f51c1af7640 -1 osd.6 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:18:56.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:56 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:56.424+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:56.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:56 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:56.424+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:56.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:56 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:56.424+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:29.887043+0000 front 2024-09-19T06:18:29.886980+0000 (oldest deadline 2024-09-19T06:18:52.186839+0000) 2024-09-19T06:18:56.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:56 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:56.278+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:56.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:56 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:56.278+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:56.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:56 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:56.278+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:18:56.607 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:56 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:56.278+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:56.607 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:56 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:56.278+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:56.607 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:56 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:56.278+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:18:56.698 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:56 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:56.488+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:56.699 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:56 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:56.488+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:18:56.699 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:56 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:56.369+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:56.699 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:56 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:56.369+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:56.699 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:56 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:56.369+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:18:56.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:56 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:56.605+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:56.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:56 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:56.605+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:56.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:56 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:56.605+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:18:57.250 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:57 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:57.232+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:57.250 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:57 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:57.232+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:57.250 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:57 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:57.232+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:18:57.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:57 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:57.430+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:57.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:57 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:57.430+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:57.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:57 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:57.430+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:29.887043+0000 front 2024-09-19T06:18:29.886980+0000 (oldest deadline 2024-09-19T06:18:52.186839+0000) 2024-09-19T06:18:57.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:57 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:57.234+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:57.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:57 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:57.234+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:57.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:57 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:57.234+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:18:57.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:57 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:57.450+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:57.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:57 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:57.450+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:18:57.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:57 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:57.339+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:57.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:57 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:57.339+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:57.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:57 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:57.339+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:18:57.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:57 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:57.579+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:57.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:57 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:57.579+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:57.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:57 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:57.579+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:18:58.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:58 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:58.403+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:58.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:58 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:58.403+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:58.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:58 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:58.403+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:29.887043+0000 front 2024-09-19T06:18:29.886980+0000 (oldest deadline 2024-09-19T06:18:52.186839+0000) 2024-09-19T06:18:58.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:58 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:58.201+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:58.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:58 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:58.201+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:58.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:58 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:58.201+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:18:58.623 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:58 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:58.236+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:58.623 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:58 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:58.236+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:58.623 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:58 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:58.236+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:18:58.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:58 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:58.457+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:58.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:58 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:58.457+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:18:58.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:58 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:58.323+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:58.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:58 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:58.323+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:58.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:58 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:58.323+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:18:58.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:58 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:58.621+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:58.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:58 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:58.621+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:58.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:58 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:58.621+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:18:59.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:59 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:59.386+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:18:59.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:59 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:59.386+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:18:59.494 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:18:59 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:18:59.386+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:29.887043+0000 front 2024-09-19T06:18:29.886980+0000 (oldest deadline 2024-09-19T06:18:52.186839+0000) 2024-09-19T06:18:59.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:59 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:59.217+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:18:59.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:59 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:59.217+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:18:59.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:59 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:59.217+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:18:59.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:18:59 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:18:59.217+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:18:59.617 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:59 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:59.224+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:18:59.617 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:59 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:59.224+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:18:59.617 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:18:59 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:18:59.224+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:18:59.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:59 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:59.422+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:18:59.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:18:59 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:18:59.422+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:18:59.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:59 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:59.292+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:18:59.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:59 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:59.292+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:18:59.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:18:59 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:18:59.292+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:18:59.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:59 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:59.615+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:18:59.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:59 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:59.615+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:18:59.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:18:59 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:18:59.615+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:00.454 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:00 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:00.200+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:00.454 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:00 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:00.200+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:00.454 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:00 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:00.200+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:00.496 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:19:00.375+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.883969+0000 front 2024-09-19T06:18:11.883944+0000 (oldest deadline 2024-09-19T06:18:35.984026+0000) 2024-09-19T06:19:00.496 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:19:00.375+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:21.285039+0000 front 2024-09-19T06:18:21.285093+0000 (oldest deadline 2024-09-19T06:18:42.984838+0000) 2024-09-19T06:19:00.496 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6[58679]: 2024-09-19T06:19:00.375+0000 7f51ba0f4640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:29.887043+0000 front 2024-09-19T06:18:29.886980+0000 (oldest deadline 2024-09-19T06:18:52.186839+0000) 2024-09-19T06:19:00.496 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:00.192+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:00.496 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:00.192+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:00.496 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:00.192+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:00.497 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:00 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:00.192+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:00.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:00 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:00.387+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:19:00.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:00 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:00.387+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:19:00.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:00 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:00.318+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:00.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:00 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:00.318+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:00.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:00 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:00.318+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:00.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:00 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:00.615+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:00.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:00 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:00.615+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:00.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:00 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:00.615+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:00.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:00 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:00.615+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:01.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:01 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:01.184+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:01.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:01 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:01.184+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:01.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:01 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:01.184+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:01.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:01 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:01.184+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:01.664 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:01 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:01.217+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:01.664 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:01 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:01.217+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:01.665 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:01 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:01.218+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:01.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:01 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:01.393+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:19:01.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:01 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:01.393+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:19:01.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:01 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:01.355+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:01.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:01 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:01.355+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:01.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:01 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:01.355+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:01.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:01 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:01.663+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:01.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:01 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:01.663+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:01.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:01 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:01.663+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:01.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:01 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:01.663+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:01.993 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:01 smithi103 podman[112920]: 2024-09-19 06:19:01.708183538 +0000 UTC m=+5.565989504 container died 07d7d70ceada4bde66642b11cbeb2a1af192a745b31f4479e9d4fce77d51b8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:19:02.338 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:02 smithi103 podman[112920]: 2024-09-19 06:19:02.094573453 +0000 UTC m=+5.952379418 container cleanup 07d7d70ceada4bde66642b11cbeb2a1af192a745b31f4479e9d4fce77d51b8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T06:19:02.338 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:02 smithi103 bash[112920]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6 2024-09-19T06:19:02.339 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:02 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:02.204+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:02.339 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:02 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:02.204+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:02.339 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:02 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:02.204+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:02.339 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:02 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:02.204+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:02.664 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:02 smithi103 podman[112936]: 2024-09-19 06:19:02.337595191 +0000 UTC m=+0.622209345 container remove 07d7d70ceada4bde66642b11cbeb2a1af192a745b31f4479e9d4fce77d51b8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T06:19:02.670 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:02 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:02.243+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:02.670 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:02 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:02.243+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:02.670 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:02 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:02.243+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:02.670 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:02 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:02.243+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:02.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:02 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:02.413+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:19:02.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:02 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:02.413+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:19:02.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:02 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:02.413+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.018238+0000 front 2024-09-19T06:18:37.018309+0000 (oldest deadline 2024-09-19T06:19:01.718326+0000) 2024-09-19T06:19:02.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:02 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:02.345+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:02.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:02 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:02.345+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:02.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:02 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:02.345+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:02.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:02 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:02.668+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:02.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:02 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:02.668+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:02.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:02 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:02.668+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:02.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:02 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:02.668+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:02.983 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:02 smithi103 podman[113026]: 2024-09-19 06:19:02.663359812 +0000 UTC m=+0.112008055 container create 875497f788d04b7adf59ef3ffc200ae331d9446343f0ba0791928e99f0767db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T06:19:02.983 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:02 smithi103 podman[113026]: 2024-09-19 06:19:02.567549675 +0000 UTC m=+0.016197888 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:19:02.983 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:02 smithi103 podman[113026]: 2024-09-19 06:19:02.882587486 +0000 UTC m=+0.331235691 container init 875497f788d04b7adf59ef3ffc200ae331d9446343f0ba0791928e99f0767db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T06:19:02.983 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:02 smithi103 podman[113026]: 2024-09-19 06:19:02.885908646 +0000 UTC m=+0.334556844 container start 875497f788d04b7adf59ef3ffc200ae331d9446343f0ba0791928e99f0767db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T06:19:02.983 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:02 smithi103 podman[113026]: 2024-09-19 06:19:02.982534229 +0000 UTC m=+0.431182427 container attach 875497f788d04b7adf59ef3ffc200ae331d9446343f0ba0791928e99f0767db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:19:03.244 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 19 06:19:03 smithi103 podman[113026]: 2024-09-19 06:19:03.071382487 +0000 UTC m=+0.520030686 container died 875497f788d04b7adf59ef3ffc200ae331d9446343f0ba0791928e99f0767db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T06:19:03.244 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:03 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:03.199+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:03.244 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:03 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:03.199+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:03.244 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:03 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:03.199+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:03.244 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:03 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:03.199+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:03.620 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:03 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:03.244+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:03.621 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:03 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:03.244+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:03.621 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:03 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:03.244+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:03.621 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:03 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:03.244+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:03.745 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T06:19:03.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:03 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:03.374+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:19:03.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:03 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:03.374+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:19:03.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:03 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:03.374+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.018238+0000 front 2024-09-19T06:18:37.018309+0000 (oldest deadline 2024-09-19T06:19:01.718326+0000) 2024-09-19T06:19:03.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:03 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:03.359+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:03.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:03 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:03.359+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:03.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:03 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:03.359+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:03.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:03 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:03.359+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:03.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:19:03.786 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T06:19:03.786 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T06:19:03.786 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.7 2024-09-19T06:19:03.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:03 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:03.619+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:03.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:03 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:03.619+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:03.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:03 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:03.619+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:03.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:03 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:03.619+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:04.082 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:03 smithi169 systemd[1]: Stopping Ceph osd.7 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:19:04.346 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:04 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:04.081+0000 7f978bbf9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:19:04.347 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:04 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:04.081+0000 7f978bbf9640 -1 osd.7 89 *** Got signal Terminated *** 2024-09-19T06:19:04.347 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:04 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:04.081+0000 7f978bbf9640 -1 osd.7 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:19:04.347 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:04 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:04.345+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:19:04.347 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:04 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:04.345+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:19:04.347 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:04 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:04.345+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.018238+0000 front 2024-09-19T06:18:37.018309+0000 (oldest deadline 2024-09-19T06:19:01.718326+0000) 2024-09-19T06:19:04.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:04 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:04.158+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:04.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:04 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:04.158+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:04.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:04 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:04.158+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:04.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:04 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:04.158+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:04.575 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:04 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:04.253+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:04.575 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:04 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:04.253+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:04.576 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:04 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:04.253+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:04.576 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:04 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:04.253+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:04.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:04 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:04.360+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:04.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:04 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:04.360+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:04.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:04 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:04.360+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:04.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:04 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:04.360+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:04.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:04 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:04.574+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:04.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:04 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:04.574+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:04.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:04 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:04.574+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:04.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:04 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:04.574+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:05.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:05 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:05.140+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:05.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:05 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:05.140+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:05.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:05 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:05.140+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:05.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:05 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:05.140+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:05.589 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:05 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:05.244+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:05.590 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:05 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:05.244+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:05.590 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:05 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:05.244+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:05.590 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:05 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:05.244+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:05.777 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:05 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:05.357+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:19:05.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:05 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:05.357+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:19:05.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:05 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:05.357+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.018238+0000 front 2024-09-19T06:18:37.018309+0000 (oldest deadline 2024-09-19T06:19:01.718326+0000) 2024-09-19T06:19:05.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:05 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:05.350+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:05.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:05 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:05.350+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:05.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:05 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:05.350+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:05.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:05 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:05.350+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:05.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:05 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:05.588+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:05.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:05 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:05.588+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:05.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:05 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:05.588+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:05.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:05 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:05.588+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:06.395 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:06 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:06.114+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:06.395 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:06 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:06.114+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:06.395 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:06 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:06.114+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:06.395 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:06 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:06.114+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:06.604 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:06 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:06.282+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:06.604 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:06 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:06.282+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:06.604 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:06 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:06.282+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:06.604 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:06 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:06.282+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:06.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:06 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:06.318+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:19:06.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:06 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:06.318+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:19:06.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:06 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:06.318+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.018238+0000 front 2024-09-19T06:18:37.018309+0000 (oldest deadline 2024-09-19T06:19:01.718326+0000) 2024-09-19T06:19:06.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:06 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:06.330+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:06.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:06 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:06.330+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:06.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:06 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:06.330+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:06.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:06 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:06.330+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:06.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:06 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:06.602+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:06.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:06 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:06.602+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:06.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:06 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:06.602+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:06.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:06 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:06.602+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:07.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:07.074+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:07.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:07.074+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:07.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:07.074+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:07.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:07 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:07.074+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:07.605 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:07 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:07.325+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:07.606 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:07 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:07.325+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:07.606 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:07 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:07.325+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:07.606 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:07 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:07.325+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:07.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:07 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:07.327+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:19:07.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:07 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:07.327+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:19:07.778 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:07 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:07.327+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.018238+0000 front 2024-09-19T06:18:37.018309+0000 (oldest deadline 2024-09-19T06:19:01.718326+0000) 2024-09-19T06:19:07.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:07 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:07.286+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:07.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:07 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:07.286+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:07.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:07 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:07.286+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:07.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:07 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:07.286+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:07.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:07 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:07.604+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:07.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:07 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:07.604+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:07.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:07 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:07.604+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:07.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:07 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:07.604+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:08.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:08 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:08.101+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:08.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:08 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:08.101+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:08.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:08 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:08.101+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:08.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:08 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:08.101+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:08.527 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:08 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:08.339+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.416117+0000 front 2024-09-19T06:18:22.416089+0000 (oldest deadline 2024-09-19T06:18:48.316244+0000) 2024-09-19T06:19:08.527 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:08 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:08.339+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.017297+0000 front 2024-09-19T06:18:30.017510+0000 (oldest deadline 2024-09-19T06:18:52.917387+0000) 2024-09-19T06:19:08.527 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:08 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7[52320]: 2024-09-19T06:19:08.339+0000 7f97841f6640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.018238+0000 front 2024-09-19T06:18:37.018309+0000 (oldest deadline 2024-09-19T06:19:01.718326+0000) 2024-09-19T06:19:08.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:08 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:08.261+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:08.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:08 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:08.261+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:08.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:08 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:08.261+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:08.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:08 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:08.261+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:08.571 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:08 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:08.343+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:08.571 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:08 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:08.343+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:08.571 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:08 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:08.343+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:08.571 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:08 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:08.343+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:08.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:08 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:08.569+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:08.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:08 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:08.569+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:08.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:08 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:08.569+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:08.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:08 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:08.569+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:09.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:09 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:09.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:09.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:09 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:09.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:09.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:09 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:09.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:09.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:09 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:09.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:09.527 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:09 smithi169 podman[70610]: 2024-09-19 06:19:09.46816217 +0000 UTC m=+5.486378820 container died a91a98a993b3c4ccdf21f89bcdfb809586f7a805bbfd679e891f25a74e4ef9fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T06:19:09.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:09 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:09.254+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:09.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:09 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:09.254+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:09.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:09 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:09.254+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:09.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:09 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:09.254+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:09.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:09.360+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:09.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:09.360+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:09.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:09.360+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:09.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:09.360+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:09.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:09.360+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:41.603634+0000 front 2024-09-19T06:18:41.603656+0000 (oldest deadline 2024-09-19T06:19:08.604023+0000) 2024-09-19T06:19:09.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:09.600+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:09.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:09.600+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:09.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:09.600+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:09.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:09.600+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:09.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:09 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:09.600+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:09.974 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:09 smithi169 podman[70610]: 2024-09-19 06:19:09.788843376 +0000 UTC m=+5.807060022 container cleanup a91a98a993b3c4ccdf21f89bcdfb809586f7a805bbfd679e891f25a74e4ef9fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:19:09.974 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:09 smithi169 bash[70610]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7 2024-09-19T06:19:10.270 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:09 smithi169 podman[70628]: 2024-09-19 06:19:09.973456934 +0000 UTC m=+0.504893807 container remove a91a98a993b3c4ccdf21f89bcdfb809586f7a805bbfd679e891f25a74e4ef9fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:19:10.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:10.069+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:10.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:10.069+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:10.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:10.069+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:10.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:10.069+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:10.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:10 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:10.069+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:10.527 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:10 smithi169 podman[70713]: 2024-09-19 06:19:10.302040778 +0000 UTC m=+0.016124522 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:19:10.527 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:10 smithi169 podman[70713]: 2024-09-19 06:19:10.432649385 +0000 UTC m=+0.146733164 container create 612eee59d2fc77c407d437dfafb6699ff63a51e1ee75e0c526ffaafea65ffc36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T06:19:10.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:10 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:10.267+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:10.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:10 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:10.267+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:10.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:10 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:10.267+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:10.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:10 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:10.267+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:10.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:10 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:10.267+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:10.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:10 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:10.346+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:10.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:10 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:10.346+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:10.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:10 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:10.346+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:10.646 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:10 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:10.346+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:10.646 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:10 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:10.346+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:41.603634+0000 front 2024-09-19T06:18:41.603656+0000 (oldest deadline 2024-09-19T06:19:08.604023+0000) 2024-09-19T06:19:10.829 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:10 smithi169 podman[70713]: 2024-09-19 06:19:10.643497473 +0000 UTC m=+0.357581212 container init 612eee59d2fc77c407d437dfafb6699ff63a51e1ee75e0c526ffaafea65ffc36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T06:19:10.829 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:10 smithi169 podman[70713]: 2024-09-19 06:19:10.646923709 +0000 UTC m=+0.361007456 container start 612eee59d2fc77c407d437dfafb6699ff63a51e1ee75e0c526ffaafea65ffc36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T06:19:10.830 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:10 smithi169 podman[70713]: 2024-09-19 06:19:10.73531718 +0000 UTC m=+0.449400915 container attach 612eee59d2fc77c407d437dfafb6699ff63a51e1ee75e0c526ffaafea65ffc36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T06:19:10.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:10 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:10.643+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:10.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:10 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:10.643+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:10.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:10 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:10.643+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:10.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:10 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:10.643+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:10.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:10 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:10.643+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:11.122 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 19 06:19:10 smithi169 podman[70713]: 2024-09-19 06:19:10.829052424 +0000 UTC m=+0.543136178 container died 612eee59d2fc77c407d437dfafb6699ff63a51e1ee75e0c526ffaafea65ffc36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T06:19:11.406 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:11 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:11.310+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:11.406 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:11 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:11.310+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:11.406 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:11 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:11.310+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:11.406 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:11 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:11.310+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:11.406 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:11 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:11.310+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:11.433 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T06:19:11.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:19:11.472 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T06:19:11.473 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T06:19:11.473 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.8 2024-09-19T06:19:11.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:11 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:11.091+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:11.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:11 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:11.091+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:11.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:11 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:11.091+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:11.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:11 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:11.091+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:11.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:11 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:11.091+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:11.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:11.606+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:11.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:11.606+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:11.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:11.606+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:11.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:11.606+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:11.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:11.606+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:11.705 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:11.386+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:11.705 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:11.386+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:11.705 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:11.386+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:11.705 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:11.386+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:11.705 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:11.386+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:41.603634+0000 front 2024-09-19T06:18:41.603656+0000 (oldest deadline 2024-09-19T06:19:08.604023+0000) 2024-09-19T06:19:11.705 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:11 smithi174 systemd[1]: Stopping Ceph osd.8 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:19:12.204 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:11.791+0000 7fcc94aba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:19:12.204 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:11.791+0000 7fcc94aba640 -1 osd.8 89 *** Got signal Terminated *** 2024-09-19T06:19:12.204 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:11 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:11.791+0000 7fcc94aba640 -1 osd.8 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:19:12.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:12 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:12.126+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:12.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:12 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:12.126+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:12.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:12 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:12.126+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:12.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:12 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:12.126+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:12.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:12 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:12.126+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:12.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:12 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:12.270+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:12.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:12 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:12.270+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:12.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:12 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:12.270+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:12.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:12 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:12.270+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:12.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:12 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:12.270+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:12.653 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:12 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:12.398+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:12.653 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:12 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:12.398+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:12.653 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:12 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:12.398+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:12.654 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:12 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:12.398+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:12.654 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:12 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:12.398+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:41.603634+0000 front 2024-09-19T06:18:41.603656+0000 (oldest deadline 2024-09-19T06:19:08.604023+0000) 2024-09-19T06:19:12.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:12 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:12.651+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:12.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:12 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:12.651+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:12.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:12 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:12.651+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:12.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:12 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:12.651+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:12.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:12 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:12.651+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:13.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:13 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:13.113+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:13.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:13 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:13.113+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:13.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:13 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:13.113+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:13.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:13 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:13.113+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:13.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:13 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:13.113+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:13.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:13 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:13.237+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:13.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:13 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:13.237+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:13.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:13 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:13.237+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:13.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:13 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:13.237+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:13.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:13 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:13.237+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:13.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:13 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:13.434+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:13.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:13 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:13.434+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:13.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:13 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:13.434+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:13.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:13 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:13.434+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:13.704 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:13 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:13.434+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:41.603634+0000 front 2024-09-19T06:18:41.603656+0000 (oldest deadline 2024-09-19T06:19:08.604023+0000) 2024-09-19T06:19:13.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:13 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:13.625+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:13.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:13 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:13.625+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:13.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:13 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:13.625+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:13.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:13 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:13.625+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:13.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:13 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:13.625+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:14.391 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:14 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:14.078+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:14.392 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:14 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:14.078+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:14.392 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:14 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:14.078+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:14.392 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:14 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:14.078+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:14.392 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:14 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:14.078+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:14.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:14 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:14.277+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:14.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:14 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:14.277+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:14.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:14 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:14.277+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:14.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:14 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:14.277+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:14.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:14 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:14.277+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:14.954 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:14.480+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:14.954 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:14.480+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:14.954 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:14.480+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:14.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:14.480+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:14.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:14.480+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:41.603634+0000 front 2024-09-19T06:18:41.603656+0000 (oldest deadline 2024-09-19T06:19:08.604023+0000) 2024-09-19T06:19:14.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:14.583+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:14.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:14.583+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:14.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:14.583+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:14.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:14.583+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:14.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:14 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:14.583+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:15.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:15.094+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:15.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:15.094+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:15.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:15.094+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:15.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:15.094+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:15.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:15 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:15.094+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:15.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:15.306+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:15.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:15.306+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:15.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:15.306+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:15.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:15.306+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:15.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:15 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:15.306+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:15.954 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:15.519+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:15.954 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:15.519+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:15.954 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:15.519+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:15.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:15.519+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:15.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:15.519+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:41.603634+0000 front 2024-09-19T06:18:41.603656+0000 (oldest deadline 2024-09-19T06:19:08.604023+0000) 2024-09-19T06:19:15.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:15.519+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.305047+0000 front 2024-09-19T06:18:53.304999+0000 (oldest deadline 2024-09-19T06:19:15.005070+0000) 2024-09-19T06:19:15.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:15.588+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:15.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:15.588+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:15.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:15.588+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:15.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:15.588+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:15.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:15.588+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:15.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:15 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:15.588+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:16.493 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:16 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:16.061+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:16.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:16 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:16.061+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:16.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:16 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:16.061+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:16.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:16 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:16.061+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:16.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:16 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:16.061+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:16.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:16 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:16.313+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:16.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:16 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:16.313+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:16.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:16 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:16.313+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:16.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:16 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:16.313+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:16.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:16 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:16.313+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:16.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:16.535+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.998010+0000 front 2024-09-19T06:18:11.998150+0000 (oldest deadline 2024-09-19T06:18:39.598637+0000) 2024-09-19T06:19:16.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:16.535+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.599152+0000 front 2024-09-19T06:18:19.599300+0000 (oldest deadline 2024-09-19T06:18:44.299106+0000) 2024-09-19T06:19:16.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:16.535+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.801265+0000 front 2024-09-19T06:18:28.801287+0000 (oldest deadline 2024-09-19T06:18:51.101443+0000) 2024-09-19T06:19:16.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:16.535+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:35.702985+0000 front 2024-09-19T06:18:35.702933+0000 (oldest deadline 2024-09-19T06:19:01.603051+0000) 2024-09-19T06:19:16.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:16.535+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:41.603634+0000 front 2024-09-19T06:18:41.603656+0000 (oldest deadline 2024-09-19T06:19:08.604023+0000) 2024-09-19T06:19:16.955 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8[52882]: 2024-09-19T06:19:16.535+0000 7fcc8d0b7640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.305047+0000 front 2024-09-19T06:18:53.304999+0000 (oldest deadline 2024-09-19T06:19:15.005070+0000) 2024-09-19T06:19:16.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:16.543+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:16.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:16.543+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:16.956 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:16.543+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:16.956 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:16.543+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:16.956 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:16.543+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:16.956 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:16 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:16.543+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:17.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:17.041+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:17.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:17.041+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:17.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:17.041+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:17.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:17.041+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:17.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:17 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:17.041+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:17.567 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:17 smithi174 podman[71308]: 2024-09-19 06:19:17.306813374 +0000 UTC m=+5.638140464 container died 726a287505343c326da6dbabcc50665c0b97419358e82210ddb544b6a102b5de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:19:17.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:17.281+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:17.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:17.281+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:17.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:17.281+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:17.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:17.281+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:17.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:17.281+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:17.884 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:17 smithi174 podman[71308]: 2024-09-19 06:19:17.657627047 +0000 UTC m=+5.988954136 container cleanup 726a287505343c326da6dbabcc50665c0b97419358e82210ddb544b6a102b5de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T06:19:17.884 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:17 smithi174 bash[71308]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8 2024-09-19T06:19:17.884 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:17.575+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:17.885 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:17.575+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:17.885 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:17.575+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:17.885 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:17.575+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:17.885 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:17.575+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:17.885 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:17 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:17.575+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:18.202 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:17 smithi174 podman[71326]: 2024-09-19 06:19:17.883476774 +0000 UTC m=+0.573290017 container remove 726a287505343c326da6dbabcc50665c0b97419358e82210ddb544b6a102b5de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T06:19:18.454 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:18 smithi174 podman[71414]: 2024-09-19 06:19:18.201036623 +0000 UTC m=+0.093563942 container create 2f6bae250135a010bd6627d67363f7807c1c7d5039b106f86a6b5e0038735db5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True) 2024-09-19T06:19:18.454 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:18 smithi174 podman[71414]: 2024-09-19 06:19:18.123193662 +0000 UTC m=+0.015720954 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:19:18.454 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:18 smithi174 podman[71414]: 2024-09-19 06:19:18.437011004 +0000 UTC m=+0.329538289 container init 2f6bae250135a010bd6627d67363f7807c1c7d5039b106f86a6b5e0038735db5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:19:18.454 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:18 smithi174 podman[71414]: 2024-09-19 06:19:18.440568053 +0000 UTC m=+0.333095328 container start 2f6bae250135a010bd6627d67363f7807c1c7d5039b106f86a6b5e0038735db5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:19:18.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:18.000+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:18.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:18.000+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:18.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:18.000+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:18.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:18.000+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:18.495 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:18 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:18.000+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:18.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:18.307+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:18.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:18.307+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:18.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:18.307+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:18.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:18.307+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:18.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:18 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:18.307+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:18.907 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:18 smithi174 podman[71414]: 2024-09-19 06:19:18.553571987 +0000 UTC m=+0.446099269 container attach 2f6bae250135a010bd6627d67363f7807c1c7d5039b106f86a6b5e0038735db5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:19:18.907 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 19 06:19:18 smithi174 podman[71414]: 2024-09-19 06:19:18.632265687 +0000 UTC m=+0.524792964 container died 2f6bae250135a010bd6627d67363f7807c1c7d5039b106f86a6b5e0038735db5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T06:19:18.907 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:18.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:18.907 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:18.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:18.907 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:18.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:18.907 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:18.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:18.907 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:18.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:18.908 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:18 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:18.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:19.220 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T06:19:19.262 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:19:19.262 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T06:19:19.262 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T06:19:19.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.9 2024-09-19T06:19:19.290 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.026+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:19.290 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.026+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:19.290 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.026+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:19.290 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.026+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:19.290 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.026+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:19.290 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.026+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:52.355287+0000 front 2024-09-19T06:18:52.355397+0000 (oldest deadline 2024-09-19T06:19:18.254992+0000) 2024-09-19T06:19:19.565 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 systemd[1]: Stopping Ceph osd.9 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:19:19.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:19 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:19.312+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:19.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:19 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:19.312+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:19.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:19 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:19.312+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:19.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:19 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:19.312+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:19.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:19 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:19.312+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:19.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:19 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:19.312+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:19.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:19 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:19.586+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:19.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:19 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:19.586+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:19.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:19 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:19.586+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:19.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:19 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:19.586+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:19.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:19 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:19.586+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:19.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:19 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:19.586+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:19.980 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.564+0000 7fa4807ad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:19:19.980 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.564+0000 7fa4807ad640 -1 osd.9 89 *** Got signal Terminated *** 2024-09-19T06:19:19.980 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.564+0000 7fa4807ad640 -1 osd.9 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:19:19.980 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.979+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:19.981 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.979+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:19.981 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.979+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:19.981 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.979+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:19.981 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.979+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:19.981 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:19 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:19.979+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:52.355287+0000 front 2024-09-19T06:18:52.355397+0000 (oldest deadline 2024-09-19T06:19:18.254992+0000) 2024-09-19T06:19:20.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:20 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:20.610+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:20.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:20 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:20.610+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:20.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:20 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:20.610+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:20.704 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:20 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:20.610+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:20.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:20 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:20.610+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:20.705 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:20 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:20.610+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:20.780 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:20 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:20.360+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:20.780 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:20 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:20.360+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:20.780 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:20 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:20.360+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:20.781 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:20 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:20.360+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:20.781 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:20 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:20.360+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:20.781 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:20 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:20.360+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:21.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:21.012+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:21.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:21.012+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:21.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:21.012+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:21.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:21.012+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:21.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:21.012+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:21.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:21 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:21.012+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:52.355287+0000 front 2024-09-19T06:18:52.355397+0000 (oldest deadline 2024-09-19T06:19:18.254992+0000) 2024-09-19T06:19:21.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:21 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:21.323+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:21.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:21 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:21.323+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:21.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:21 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:21.323+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:21.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:21 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:21.323+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:21.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:21 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:21.323+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:21.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:21 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:21.323+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:21.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:21 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:21.590+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:21.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:21 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:21.590+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:21.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:21 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:21.590+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:21.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:21 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:21.590+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:21.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:21 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:21.590+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:21.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:21 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:21.590+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:22.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:22 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:22.048+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:22.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:22 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:22.048+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:22.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:22 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:22.048+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:22.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:22 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:22.048+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:22.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:22 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:22.048+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:22.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:22 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:22.048+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:52.355287+0000 front 2024-09-19T06:18:52.355397+0000 (oldest deadline 2024-09-19T06:19:18.254992+0000) 2024-09-19T06:19:22.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:22 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:22.367+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:22.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:22 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:22.367+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:22.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:22 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:22.367+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:22.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:22 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:22.367+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:22.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:22 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:22.367+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:22.528 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:22 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:22.367+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:22.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:22 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:22.599+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:22.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:22 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:22.599+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:22.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:22 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:22.599+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:22.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:22 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:22.599+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:22.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:22 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:22.599+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:22.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:22 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:22.599+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:23.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:23.071+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:23.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:23.071+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:23.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:23.071+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:23.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:23.071+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:23.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:23.071+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:23.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:23 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:23.071+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:52.355287+0000 front 2024-09-19T06:18:52.355397+0000 (oldest deadline 2024-09-19T06:19:18.254992+0000) 2024-09-19T06:19:23.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:23 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:23.378+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:23.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:23 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:23.378+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:23.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:23 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:23.378+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:23.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:23 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:23.378+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:23.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:23 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:23.378+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:23.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:23 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:23.378+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:23.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:23 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:23.568+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:23.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:23 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:23.568+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:23.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:23 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:23.568+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:23.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:23 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:23.568+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:23.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:23 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:23.568+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:23.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:23 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:23.568+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:24.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:24 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:24.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:11.449420+0000 front 2024-09-19T06:18:11.449443+0000 (oldest deadline 2024-09-19T06:18:36.149655+0000) 2024-09-19T06:19:24.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:24 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:24.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:22.050740+0000 front 2024-09-19T06:18:22.050900+0000 (oldest deadline 2024-09-19T06:18:44.950689+0000) 2024-09-19T06:19:24.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:24 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:24.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.451875+0000 front 2024-09-19T06:18:28.451919+0000 (oldest deadline 2024-09-19T06:18:56.052304+0000) 2024-09-19T06:19:24.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:24 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:24.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:36.052670+0000 front 2024-09-19T06:18:36.052771+0000 (oldest deadline 2024-09-19T06:18:58.952786+0000) 2024-09-19T06:19:24.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:24 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:24.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.954627+0000 front 2024-09-19T06:18:45.954612+0000 (oldest deadline 2024-09-19T06:19:09.454282+0000) 2024-09-19T06:19:24.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:24 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:24.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:52.355287+0000 front 2024-09-19T06:18:52.355397+0000 (oldest deadline 2024-09-19T06:19:18.254992+0000) 2024-09-19T06:19:24.494 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:24 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9[65700]: 2024-09-19T06:19:24.080+0000 7fa47cdb2640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-09-19T06:18:58.255430+0000 front 2024-09-19T06:18:58.255459+0000 (oldest deadline 2024-09-19T06:19:23.555404+0000) 2024-09-19T06:19:24.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:24 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:24.363+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:24.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:24 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:24.363+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:24.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:24 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:24.363+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:24.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:24 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:24.363+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:24.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:24 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:24.363+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:24.779 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:24 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:24.363+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:24.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:24 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:24.544+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:24.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:24 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:24.544+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:24.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:24 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:24.544+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:24.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:24 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:24.544+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:24.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:24 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:24.544+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:24.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:24 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:24.544+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:25.291 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:25 smithi103 podman[113143]: 2024-09-19 06:19:25.012494515 +0000 UTC m=+5.553803336 container died 223579b3af032430514d310d50c9e5f60a9b0c4c9d1ffa02a750ffcc83b78e54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T06:19:25.674 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:25 smithi103 podman[113143]: 2024-09-19 06:19:25.397430763 +0000 UTC m=+5.938739581 container cleanup 223579b3af032430514d310d50c9e5f60a9b0c4c9d1ffa02a750ffcc83b78e54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T06:19:25.674 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:25 smithi103 bash[113143]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9 2024-09-19T06:19:25.679 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:25 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:25.336+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:25.679 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:25 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:25.336+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:25.679 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:25 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:25.336+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:25.679 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:25 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:25.336+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:25.679 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:25 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:25.336+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:25.679 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:25 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:25.336+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:25.855 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:25 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:25.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:25.856 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:25 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:25.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:25.856 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:25 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:25.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:25.856 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:25 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:25.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:25.856 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:25 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:25.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:25.856 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:25 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:25.563+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:25.982 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:25 smithi103 podman[113158]: 2024-09-19 06:19:25.673503372 +0000 UTC m=+0.657493046 container remove 223579b3af032430514d310d50c9e5f60a9b0c4c9d1ffa02a750ffcc83b78e54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T06:19:26.244 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:25 smithi103 podman[113244]: 2024-09-19 06:19:25.884731097 +0000 UTC m=+0.016025754 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:19:26.244 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:25 smithi103 podman[113244]: 2024-09-19 06:19:25.982472271 +0000 UTC m=+0.113766927 container create 511dbaacfe6e0a536b43738bbb2295100a6f93381282bd5c0c884409901814f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T06:19:26.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:26 smithi103 podman[113244]: 2024-09-19 06:19:26.25166323 +0000 UTC m=+0.382957889 container init 511dbaacfe6e0a536b43738bbb2295100a6f93381282bd5c0c884409901814f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:19:26.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:26 smithi103 podman[113244]: 2024-09-19 06:19:26.255126517 +0000 UTC m=+0.386421174 container start 511dbaacfe6e0a536b43738bbb2295100a6f93381282bd5c0c884409901814f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:19:26.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:26 smithi103 podman[113244]: 2024-09-19 06:19:26.334956048 +0000 UTC m=+0.466250707 container attach 511dbaacfe6e0a536b43738bbb2295100a6f93381282bd5c0c884409901814f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:19:26.744 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 19 06:19:26 smithi103 podman[113244]: 2024-09-19 06:19:26.437915839 +0000 UTC m=+0.569210503 container died 511dbaacfe6e0a536b43738bbb2295100a6f93381282bd5c0c884409901814f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:19:26.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:26 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:26.334+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:26.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:26 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:26.334+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:26.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:26 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:26.334+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:26.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:26 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:26.334+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:26.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:26 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:26.334+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:26.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:26 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:26.334+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:26.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:26 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:26.334+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-09-19T06:19:01.021178+0000 front 2024-09-19T06:19:01.021224+0000 (oldest deadline 2024-09-19T06:19:25.721064+0000) 2024-09-19T06:19:26.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:26 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:26.517+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:26.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:26 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:26.517+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:26.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:26 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:26.517+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:26.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:26 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:26.517+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:26.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:26 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:26.517+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:26.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:26 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:26.517+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:27.089 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T06:19:27.168 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:19:27.169 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T06:19:27.169 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T06:19:27.169 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.10 2024-09-19T06:19:27.467 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 systemd[1]: Stopping Ceph osd.10 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:19:27.467 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:27.320+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:27.467 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:27.320+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:27.467 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:27.320+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:27.468 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:27.320+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:27.468 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:27.320+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:27.468 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:27.320+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:27.468 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:27.320+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-09-19T06:19:01.021178+0000 front 2024-09-19T06:19:01.021224+0000 (oldest deadline 2024-09-19T06:19:25.721064+0000) 2024-09-19T06:19:27.468 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:27.465+0000 7fb7bc43f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:19:27.468 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:27.465+0000 7fb7bc43f640 -1 osd.10 89 *** Got signal Terminated *** 2024-09-19T06:19:27.468 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:27 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:27.465+0000 7fb7bc43f640 -1 osd.10 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:19:27.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:27 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:27.556+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:27.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:27 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:27.556+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:27.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:27 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:27.556+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:27.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:27 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:27.556+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:27.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:27 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:27.556+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:27.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:27 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:27.556+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:28.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:28 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:28.318+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:28.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:28 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:28.318+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:28.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:28 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:28.318+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:28.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:28 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:28.318+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:28.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:28 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:28.318+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:28.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:28 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:28.318+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:28.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:28 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:28.318+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-09-19T06:19:01.021178+0000 front 2024-09-19T06:19:01.021224+0000 (oldest deadline 2024-09-19T06:19:25.721064+0000) 2024-09-19T06:19:28.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:28 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:28.569+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:28.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:28 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:28.569+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:28.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:28 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:28.569+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:28.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:28 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:28.569+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:28.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:28 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:28.569+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:28.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:28 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:28.569+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:29.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:29 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:29.340+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:29.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:29 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:29.340+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:29.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:29 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:29.340+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:29.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:29 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:29.340+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:29.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:29 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:29.340+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:29.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:29 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:29.340+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:29.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:29 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:29.340+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-09-19T06:19:01.021178+0000 front 2024-09-19T06:19:01.021224+0000 (oldest deadline 2024-09-19T06:19:25.721064+0000) 2024-09-19T06:19:29.948 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:29 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:29.562+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:29.948 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:29 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:29.562+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:29.948 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:29 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:29.562+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:29.948 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:29 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:29.562+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:29.948 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:29 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:29.562+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:29.948 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:29 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:29.562+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:30.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:30 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:30.390+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:30.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:30 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:30.390+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:30.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:30 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:30.390+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:30.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:30 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:30.390+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:30.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:30 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:30.390+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:30.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:30 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:30.390+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:30.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:30 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:30.390+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-09-19T06:19:01.021178+0000 front 2024-09-19T06:19:01.021224+0000 (oldest deadline 2024-09-19T06:19:25.721064+0000) 2024-09-19T06:19:30.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:30 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:30.601+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:30.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:30 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:30.601+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:30.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:30 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:30.601+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:30.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:30 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:30.601+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:30.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:30 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:30.601+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:30.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:30 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:30.601+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:30.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:30 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:30.601+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-19T06:19:07.294442+0000 front 2024-09-19T06:19:07.294425+0000 (oldest deadline 2024-09-19T06:19:30.194359+0000) 2024-09-19T06:19:31.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:31 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:31.426+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:31.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:31 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:31.426+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:31.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:31 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:31.426+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:31.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:31 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:31.426+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:31.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:31 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:31.426+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:31.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:31 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:31.426+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:31.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:31 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:31.426+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-09-19T06:19:01.021178+0000 front 2024-09-19T06:19:01.021224+0000 (oldest deadline 2024-09-19T06:19:25.721064+0000) 2024-09-19T06:19:31.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:31 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:31.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:31.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:31 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:31.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:31.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:31 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:31.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:31.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:31 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:31.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:31.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:31 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:31.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:31.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:31 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:31.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:31.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:31 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:31.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-19T06:19:07.294442+0000 front 2024-09-19T06:19:07.294425+0000 (oldest deadline 2024-09-19T06:19:30.194359+0000) 2024-09-19T06:19:32.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:32 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:32.420+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:13.413337+0000 front 2024-09-19T06:18:13.413370+0000 (oldest deadline 2024-09-19T06:18:38.713295+0000) 2024-09-19T06:19:32.777 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:32 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:32.420+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:18.713790+0000 front 2024-09-19T06:18:18.713803+0000 (oldest deadline 2024-09-19T06:18:44.013733+0000) 2024-09-19T06:19:32.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:32 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:32.420+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:30.216187+0000 front 2024-09-19T06:18:30.216084+0000 (oldest deadline 2024-09-19T06:18:51.916081+0000) 2024-09-19T06:19:32.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:32 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:32.420+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:33.017251+0000 front 2024-09-19T06:18:33.017141+0000 (oldest deadline 2024-09-19T06:19:03.017561+0000) 2024-09-19T06:19:32.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:32 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:32.420+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.819075+0000 front 2024-09-19T06:18:45.819056+0000 (oldest deadline 2024-09-19T06:19:09.319074+0000) 2024-09-19T06:19:32.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:32 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:32.420+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:53.420218+0000 front 2024-09-19T06:18:53.420279+0000 (oldest deadline 2024-09-19T06:19:18.720189+0000) 2024-09-19T06:19:32.778 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:32 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10[58899]: 2024-09-19T06:19:32.420+0000 7fb7b8a44640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-09-19T06:19:01.021178+0000 front 2024-09-19T06:19:01.021224+0000 (oldest deadline 2024-09-19T06:19:25.721064+0000) 2024-09-19T06:19:32.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:32 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:32.640+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:32.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:32 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:32.640+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:32.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:32 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:32.640+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:32.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:32 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:32.640+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:32.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:32 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:32.640+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:32.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:32 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:32.640+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:32.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:32 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:32.640+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-19T06:19:07.294442+0000 front 2024-09-19T06:19:07.294425+0000 (oldest deadline 2024-09-19T06:19:30.194359+0000) 2024-09-19T06:19:33.133 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:32 smithi169 podman[70840]: 2024-09-19 06:19:32.82350857 +0000 UTC m=+5.464111246 container died af3bcb201f3c4b15d3df0dafef9d4121792c2f147a9c72ddfd56216c1fda1446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:19:33.133 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:33 smithi169 podman[70840]: 2024-09-19 06:19:33.132220584 +0000 UTC m=+5.772823257 container cleanup af3bcb201f3c4b15d3df0dafef9d4121792c2f147a9c72ddfd56216c1fda1446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T06:19:33.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:33 smithi169 bash[70840]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10 2024-09-19T06:19:33.527 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:33 smithi169 podman[70856]: 2024-09-19 06:19:33.350389907 +0000 UTC m=+0.526875621 container remove af3bcb201f3c4b15d3df0dafef9d4121792c2f147a9c72ddfd56216c1fda1446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T06:19:33.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:33 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:33.598+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:33.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:33 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:33.598+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:33.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:33 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:33.598+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:33.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:33 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:33.598+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:33.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:33 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:33.598+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:33.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:33 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:33.598+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:33.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:33 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:33.598+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-19T06:19:07.294442+0000 front 2024-09-19T06:19:07.294425+0000 (oldest deadline 2024-09-19T06:19:30.194359+0000) 2024-09-19T06:19:34.027 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:33 smithi169 podman[70947]: 2024-09-19 06:19:33.751084173 +0000 UTC m=+0.107056387 container create 15776d655d784b128987cbe0089e91a2acae255bb3303e7a632fe18c963db638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-19T06:19:34.027 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:33 smithi169 podman[70947]: 2024-09-19 06:19:33.660148927 +0000 UTC m=+0.016121150 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:19:34.027 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:33 smithi169 podman[70947]: 2024-09-19 06:19:33.995427732 +0000 UTC m=+0.351399946 container init 15776d655d784b128987cbe0089e91a2acae255bb3303e7a632fe18c963db638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:19:34.028 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:33 smithi169 podman[70947]: 2024-09-19 06:19:33.998759422 +0000 UTC m=+0.354731646 container start 15776d655d784b128987cbe0089e91a2acae255bb3303e7a632fe18c963db638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10-deactivate, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T06:19:34.423 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:34 smithi169 podman[70947]: 2024-09-19 06:19:34.053530421 +0000 UTC m=+0.409502647 container attach 15776d655d784b128987cbe0089e91a2acae255bb3303e7a632fe18c963db638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:19:34.423 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 19 06:19:34 smithi169 podman[70947]: 2024-09-19 06:19:34.190930697 +0000 UTC m=+0.546902921 container died 15776d655d784b128987cbe0089e91a2acae255bb3303e7a632fe18c963db638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T06:19:34.819 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T06:19:34.860 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:19:34.861 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T06:19:34.861 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T06:19:34.861 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.11 2024-09-19T06:19:34.889 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:34 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:34.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:34.889 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:34 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:34.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:34.889 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:34 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:34.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:34.889 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:34 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:34.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:34.889 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:34 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:34.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:34.889 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:34 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:34.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:34.890 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:34 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:34.627+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-19T06:19:07.294442+0000 front 2024-09-19T06:19:07.294425+0000 (oldest deadline 2024-09-19T06:19:30.194359+0000) 2024-09-19T06:19:35.160 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:34 smithi174 systemd[1]: Stopping Ceph osd.11 for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:19:35.160 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:35.158+0000 7f0b85c67640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:19:35.454 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:35.158+0000 7f0b85c67640 -1 osd.11 89 *** Got signal Terminated *** 2024-09-19T06:19:35.454 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:35.158+0000 7f0b85c67640 -1 osd.11 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:19:35.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:35.658+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:35.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:35.658+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:35.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:35.658+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:35.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:35.658+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:35.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:35.658+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:35.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:35.658+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:35.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:35.658+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-19T06:19:07.294442+0000 front 2024-09-19T06:19:07.294425+0000 (oldest deadline 2024-09-19T06:19:30.194359+0000) 2024-09-19T06:19:36.957 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:36 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:36.641+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:36.957 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:36 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:36.641+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:36.957 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:36 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:36.641+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:36.957 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:36 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:36.641+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:36.957 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:36 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:36.641+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:36.957 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:36 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:36.641+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:36.957 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:36 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:36.641+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-19T06:19:07.294442+0000 front 2024-09-19T06:19:07.294425+0000 (oldest deadline 2024-09-19T06:19:30.194359+0000) 2024-09-19T06:19:37.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:37 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:37.661+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:37.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:37 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:37.661+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:37.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:37 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:37.661+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:37.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:37 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:37.661+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:37.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:37 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:37.661+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:37.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:37 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:37.661+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:37.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:37 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:37.661+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-19T06:19:07.294442+0000 front 2024-09-19T06:19:07.294425+0000 (oldest deadline 2024-09-19T06:19:30.194359+0000) 2024-09-19T06:19:38.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:38 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:38.655+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:38.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:38 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:38.655+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:38.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:38 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:38.655+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:38.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:38 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:38.655+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:38.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:38 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:38.655+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:38.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:38 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:38.655+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:38.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:38 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:38.655+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-19T06:19:07.294442+0000 front 2024-09-19T06:19:07.294425+0000 (oldest deadline 2024-09-19T06:19:30.194359+0000) 2024-09-19T06:19:39.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:39 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:39.680+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-19T06:18:12.983942+0000 front 2024-09-19T06:18:12.983816+0000 (oldest deadline 2024-09-19T06:18:35.283791+0000) 2024-09-19T06:19:39.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:39 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:39.680+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-19T06:18:19.885423+0000 front 2024-09-19T06:18:19.885599+0000 (oldest deadline 2024-09-19T06:18:43.985386+0000) 2024-09-19T06:19:39.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:39 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:39.680+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-19T06:18:28.487821+0000 front 2024-09-19T06:18:28.487881+0000 (oldest deadline 2024-09-19T06:18:53.787961+0000) 2024-09-19T06:19:39.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:39 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:39.680+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-09-19T06:18:37.288826+0000 front 2024-09-19T06:18:37.289049+0000 (oldest deadline 2024-09-19T06:19:00.188893+0000) 2024-09-19T06:19:39.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:39 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:39.680+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-19T06:18:45.890907+0000 front 2024-09-19T06:18:45.890833+0000 (oldest deadline 2024-09-19T06:19:09.390721+0000) 2024-09-19T06:19:39.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:39 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:39.680+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-19T06:18:49.391182+0000 front 2024-09-19T06:18:49.391120+0000 (oldest deadline 2024-09-19T06:19:15.291177+0000) 2024-09-19T06:19:39.955 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:39 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11[59768]: 2024-09-19T06:19:39.680+0000 7f0b8226c640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-19T06:19:07.294442+0000 front 2024-09-19T06:19:07.294425+0000 (oldest deadline 2024-09-19T06:19:30.194359+0000) 2024-09-19T06:19:40.954 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:40 smithi174 podman[71528]: 2024-09-19 06:19:40.701971081 +0000 UTC m=+5.641105732 container died d84323b0964f95ff936cf1a757164ee4a23cebf475006920bd6bd8fcdd292846 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T06:19:41.454 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:41 smithi174 podman[71528]: 2024-09-19 06:19:41.025224249 +0000 UTC m=+5.964358890 container cleanup d84323b0964f95ff936cf1a757164ee4a23cebf475006920bd6bd8fcdd292846 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:19:41.454 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:41 smithi174 bash[71528]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11 2024-09-19T06:19:41.454 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:41 smithi174 podman[71545]: 2024-09-19 06:19:41.201195406 +0000 UTC m=+0.499196994 container remove d84323b0964f95ff936cf1a757164ee4a23cebf475006920bd6bd8fcdd292846 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T06:19:41.904 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:41 smithi174 podman[71633]: 2024-09-19 06:19:41.627056956 +0000 UTC m=+0.100102146 container create ded374eba0a118cffa31efae62be2a281c8983720a2a03f3b8feab2f7676ff9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T06:19:41.905 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:41 smithi174 podman[71633]: 2024-09-19 06:19:41.542671235 +0000 UTC m=+0.015716380 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:19:41.905 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:41 smithi174 podman[71633]: 2024-09-19 06:19:41.829082079 +0000 UTC m=+0.302127233 container init ded374eba0a118cffa31efae62be2a281c8983720a2a03f3b8feab2f7676ff9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T06:19:41.905 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:41 smithi174 podman[71633]: 2024-09-19 06:19:41.832503195 +0000 UTC m=+0.305548341 container start ded374eba0a118cffa31efae62be2a281c8983720a2a03f3b8feab2f7676ff9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T06:19:41.905 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:41 smithi174 podman[71633]: 2024-09-19 06:19:41.903940121 +0000 UTC m=+0.376985266 container attach ded374eba0a118cffa31efae62be2a281c8983720a2a03f3b8feab2f7676ff9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T06:19:42.204 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:42 smithi174 podman[71633]: 2024-09-19 06:19:42.018338222 +0000 UTC m=+0.491383370 container died ded374eba0a118cffa31efae62be2a281c8983720a2a03f3b8feab2f7676ff9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T06:19:42.601 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 19 06:19:42 smithi174 podman[71657]: 2024-09-19 06:19:42.598859534 +0000 UTC m=+0.574337999 container remove ded374eba0a118cffa31efae62be2a281c8983720a2a03f3b8feab2f7676ff9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-19T06:19:42.622 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T06:19:42.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:19:42.702 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T06:19:42.703 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T06:19:42.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.a 2024-09-19T06:19:45.109 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 19 06:19:44 smithi103 podman[113346]: 2024-09-19 06:19:44.831085687 +0000 UTC m=+1.931980246 container died 173f113680d95c13b4b5d799ec75592e21277b2862d9ec6721a17862b3045ed4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T06:19:45.467 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 19 06:19:45 smithi103 podman[113346]: 2024-09-19 06:19:45.206830983 +0000 UTC m=+2.307725541 container cleanup 173f113680d95c13b4b5d799ec75592e21277b2862d9ec6721a17862b3045ed4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:19:45.467 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 19 06:19:45 smithi103 bash[113346]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-a 2024-09-19T06:19:45.637 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T06:19:45.674 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:19:45.674 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T06:19:45.674 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T06:19:45.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.d 2024-09-19T06:19:45.993 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:19:45 smithi103 systemd[1]: Stopping Ceph mds.d for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:19:46.494 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:19:46 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-d[71436]: 2024-09-19T06:19:46.010+0000 7f07c2146640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:19:46.494 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:19:46 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-d[71436]: 2024-09-19T06:19:46.010+0000 7f07c2146640 -1 mds.d *** got signal Terminated *** 2024-09-19T06:19:50.363 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:19:50 smithi103 podman[113476]: 2024-09-19 06:19:50.006185116 +0000 UTC m=+4.101365787 container died 948f79608e22df33cbe69b967450edd39c12e1f530f167d2daec8069fd7bdd2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T06:19:50.646 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:19:50 smithi103 podman[113476]: 2024-09-19 06:19:50.444641681 +0000 UTC m=+4.539822351 container cleanup 948f79608e22df33cbe69b967450edd39c12e1f530f167d2daec8069fd7bdd2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T06:19:50.646 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 19 06:19:50 smithi103 bash[113476]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-d 2024-09-19T06:19:50.869 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T06:19:50.905 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:19:50.906 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T06:19:50.906 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T06:19:50.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.g 2024-09-19T06:19:51.232 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:19:50 smithi103 systemd[1]: Stopping Ceph mds.g for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:19:51.493 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:19:51 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-g[72200]: 2024-09-19T06:19:51.230+0000 7f7142446640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:19:51.493 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:19:51 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-g[72200]: 2024-09-19T06:19:51.230+0000 7f7142446640 -1 mds.g *** got signal Terminated *** 2024-09-19T06:19:53.616 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:19:53 smithi103 podman[113598]: 2024-09-19 06:19:53.346613804 +0000 UTC m=+2.219786749 container died 2b7dba4064d9be9d1093e23f925827e699682f5b17787e31f1c2197e6874ca98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T06:19:53.975 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:19:53 smithi103 podman[113598]: 2024-09-19 06:19:53.723453102 +0000 UTC m=+2.596626037 container cleanup 2b7dba4064d9be9d1093e23f925827e699682f5b17787e31f1c2197e6874ca98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:19:53.976 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 19 06:19:53 smithi103 bash[113598]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-g 2024-09-19T06:19:54.163 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T06:19:54.196 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:19:54.196 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T06:19:54.196 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T06:19:54.196 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.j 2024-09-19T06:19:54.528 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:19:54 smithi103 systemd[1]: Stopping Ceph mds.j for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:19:54.993 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:19:54 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-j[71042]: 2024-09-19T06:19:54.526+0000 7f76ea989640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:19:54.994 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:19:54 smithi103 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-j[71042]: 2024-09-19T06:19:54.526+0000 7f76ea989640 -1 mds.j *** got signal Terminated *** 2024-09-19T06:19:58.743 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:19:58 smithi103 podman[113719]: 2024-09-19 06:19:58.438954247 +0000 UTC m=+4.026886021 container died 24e6db657bdb655fc40b1d0ae1d48b67156f426548cc657bff6dae852017d465 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T06:19:59.063 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:19:58 smithi103 podman[113719]: 2024-09-19 06:19:58.877657873 +0000 UTC m=+4.465589641 container cleanup 24e6db657bdb655fc40b1d0ae1d48b67156f426548cc657bff6dae852017d465 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T06:19:59.063 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 19 06:19:58 smithi103 bash[113719]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-j 2024-09-19T06:19:59.271 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T06:19:59.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:19:59.303 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T06:19:59.303 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T06:19:59.303 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.b 2024-09-19T06:19:59.600 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:19:59 smithi169 systemd[1]: Stopping Ceph mds.b for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:19:59.856 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:19:59 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b[64365]: 2024-09-19T06:19:59.597+0000 7f040bc76640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:19:59.856 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:19:59 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b[64365]: 2024-09-19T06:19:59.597+0000 7f040bc76640 -1 mds.b *** got signal Terminated *** 2024-09-19T06:20:07.115 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:20:06 smithi169 podman[71049]: 2024-09-19 06:20:06.80994232 +0000 UTC m=+7.315503404 container died 80292f349ebffe22384eb50b16be26043114df98ac612ac5780df3c86ed30909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:20:07.115 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:20:07 smithi169 podman[71049]: 2024-09-19 06:20:07.114639127 +0000 UTC m=+7.620200205 container cleanup 80292f349ebffe22384eb50b16be26043114df98ac612ac5780df3c86ed30909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T06:20:07.456 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:20:07 smithi169 bash[71049]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b 2024-09-19T06:20:07.456 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 19 06:20:07 smithi169 podman[71073]: 2024-09-19 06:20:07.349170592 +0000 UTC m=+0.531064032 container remove 80292f349ebffe22384eb50b16be26043114df98ac612ac5780df3c86ed30909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T06:20:07.471 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T06:20:07.508 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:20:07.508 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T06:20:07.508 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T06:20:07.509 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.e 2024-09-19T06:20:07.777 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:20:07 smithi169 systemd[1]: Stopping Ceph mds.e for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:20:08.277 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:20:07 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-e[63762]: 2024-09-19T06:20:07.835+0000 7f07c8d3e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:20:08.277 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:20:07 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-e[63762]: 2024-09-19T06:20:07.835+0000 7f07c8d3e640 -1 mds.e *** got signal Terminated *** 2024-09-19T06:20:12.137 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:20:11 smithi169 podman[71181]: 2024-09-19 06:20:11.846923217 +0000 UTC m=+4.118123540 container died 1bc7a114a0685aebf8da7972925212c6def82b47af8675ebab17c57161f76cc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T06:20:12.487 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:20:12 smithi169 podman[71181]: 2024-09-19 06:20:12.243277735 +0000 UTC m=+4.514478056 container cleanup 1bc7a114a0685aebf8da7972925212c6def82b47af8675ebab17c57161f76cc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T06:20:12.487 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 19 06:20:12 smithi169 bash[71181]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-e 2024-09-19T06:20:12.620 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T06:20:12.654 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:20:12.654 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T06:20:12.654 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T06:20:12.654 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.h 2024-09-19T06:20:13.027 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:20:12 smithi169 systemd[1]: Stopping Ceph mds.h for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:20:13.027 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:20:12 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-h[64063]: 2024-09-19T06:20:12.972+0000 7f16925cf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:20:13.028 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:20:12 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-h[64063]: 2024-09-19T06:20:12.972+0000 7f16925cf640 -1 mds.h *** got signal Terminated *** 2024-09-19T06:20:16.277 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:20:15 smithi169 podman[71301]: 2024-09-19 06:20:15.944011433 +0000 UTC m=+3.063559140 container died baeceb04780c478054def496fb79fb0b6f4e2ce0ddf5ce3cc5c64963c9f65a3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:20:16.715 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:20:16 smithi169 podman[71301]: 2024-09-19 06:20:16.421858028 +0000 UTC m=+3.541405732 container cleanup baeceb04780c478054def496fb79fb0b6f4e2ce0ddf5ce3cc5c64963c9f65a3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T06:20:16.715 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 19 06:20:16 smithi169 bash[71301]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-h 2024-09-19T06:20:16.853 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T06:20:16.886 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:20:16.886 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T06:20:16.886 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T06:20:16.886 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.k 2024-09-19T06:20:17.235 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:20:16 smithi169 systemd[1]: Stopping Ceph mds.k for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:20:17.527 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:20:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-k[63451]: 2024-09-19T06:20:17.233+0000 7f9de730d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:20:17.527 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:20:17 smithi169 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-k[63451]: 2024-09-19T06:20:17.233+0000 7f9de730d640 -1 mds.k *** got signal Terminated *** 2024-09-19T06:20:19.569 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:20:19 smithi169 podman[71425]: 2024-09-19 06:20:19.293106351 +0000 UTC m=+2.188292998 container died 91505c6b4b346d76f21c89c457636f4c2bef0dd9488626a19d45d42498b4b0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:20:19.911 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:20:19 smithi169 podman[71425]: 2024-09-19 06:20:19.658916657 +0000 UTC m=+2.554103306 container cleanup 91505c6b4b346d76f21c89c457636f4c2bef0dd9488626a19d45d42498b4b0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T06:20:19.911 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 19 06:20:19 smithi169 bash[71425]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-k 2024-09-19T06:20:20.077 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T06:20:20.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:20:20.109 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T06:20:20.109 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T06:20:20.109 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.c 2024-09-19T06:20:20.433 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:20:20 smithi174 systemd[1]: Stopping Ceph mds.c for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:20:20.687 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:20:20 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:20:20.431+0000 7fb9ab55e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:20:20.687 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:20:20 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c[65031]: 2024-09-19T06:20:20.431+0000 7fb9ab55e640 -1 mds.c *** got signal Terminated *** 2024-09-19T06:20:23.391 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:20:23 smithi174 podman[71736]: 2024-09-19 06:20:23.010011008 +0000 UTC m=+2.705146916 container died ddcd11b28c2d897ce160ac493f65908081329e1b1bc32bacd02cfff8917b9294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T06:20:23.704 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:20:23 smithi174 podman[71736]: 2024-09-19 06:20:23.481186952 +0000 UTC m=+3.176322871 container cleanup ddcd11b28c2d897ce160ac493f65908081329e1b1bc32bacd02cfff8917b9294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:20:23.704 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 19 06:20:23 smithi174 bash[71736]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-c 2024-09-19T06:20:23.856 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T06:20:23.893 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:20:23.893 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T06:20:23.893 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T06:20:23.893 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.f 2024-09-19T06:20:24.294 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:20:23 smithi174 systemd[1]: Stopping Ceph mds.f for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:20:24.704 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:20:24 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-f[64729]: 2024-09-19T06:20:24.292+0000 7fe34ab2a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:20:24.704 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:20:24 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-f[64729]: 2024-09-19T06:20:24.292+0000 7fe34ab2a640 -1 mds.f *** got signal Terminated *** 2024-09-19T06:20:27.293 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:20:27 smithi174 podman[71871]: 2024-09-19 06:20:27.006210563 +0000 UTC m=+2.880686341 container died c2f352d10ca0b3eea5db9175525c60cb06dbfdfd9229c68264e6b5aaaca0f33c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T06:20:27.293 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:20:27 smithi174 podman[71871]: 2024-09-19 06:20:27.292531527 +0000 UTC m=+3.167007304 container cleanup c2f352d10ca0b3eea5db9175525c60cb06dbfdfd9229c68264e6b5aaaca0f33c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T06:20:27.625 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:20:27 smithi174 bash[71871]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-f 2024-09-19T06:20:27.625 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 19 06:20:27 smithi174 podman[71883]: 2024-09-19 06:20:27.502135341 +0000 UTC m=+0.497142604 container remove c2f352d10ca0b3eea5db9175525c60cb06dbfdfd9229c68264e6b5aaaca0f33c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T06:20:27.642 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T06:20:27.674 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:20:27.674 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T06:20:27.674 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T06:20:27.675 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.i 2024-09-19T06:20:27.956 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:20:27 smithi174 systemd[1]: Stopping Ceph mds.i for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:20:28.454 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:20:28 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i[65331]: 2024-09-19T06:20:28.013+0000 7fd1aa335640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:20:28.454 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:20:28 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i[65331]: 2024-09-19T06:20:28.013+0000 7fd1aa335640 -1 mds.i *** got signal Terminated *** 2024-09-19T06:20:34.247 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:20:33 smithi174 podman[71991]: 2024-09-19 06:20:33.983367075 +0000 UTC m=+6.090062293 container died 89fcc9ea8a7477c3b0722970433317c064da4aae7296385db472db370a51e9e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T06:20:34.589 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:20:34 smithi174 podman[71991]: 2024-09-19 06:20:34.337519381 +0000 UTC m=+6.444214585 container cleanup 89fcc9ea8a7477c3b0722970433317c064da4aae7296385db472db370a51e9e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T06:20:34.589 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 19 06:20:34 smithi174 bash[71991]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-i 2024-09-19T06:20:34.765 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T06:20:34.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:20:34.797 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T06:20:34.797 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T06:20:34.797 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.l 2024-09-19T06:20:35.109 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:20:34 smithi174 systemd[1]: Stopping Ceph mds.l for f3f6d2a8-764b-11ef-bceb-c7b262605968... 2024-09-19T06:20:35.454 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:20:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-l[64419]: 2024-09-19T06:20:35.107+0000 7f426fa06640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:20:35.454 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:20:35 smithi174 ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-l[64419]: 2024-09-19T06:20:35.107+0000 7f426fa06640 -1 mds.l *** got signal Terminated *** 2024-09-19T06:20:36.900 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:20:36 smithi174 podman[72113]: 2024-09-19 06:20:36.613232887 +0000 UTC m=+1.598743648 container died 34d7941af29b5d80d350095c238c3180d2b8f2e7c29c95dc149e014b6e66c68d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:20:36.900 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:20:36 smithi174 podman[72113]: 2024-09-19 06:20:36.89920047 +0000 UTC m=+1.884711231 container cleanup 34d7941af29b5d80d350095c238c3180d2b8f2e7c29c95dc149e014b6e66c68d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T06:20:37.204 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:20:36 smithi174 bash[72113]: ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-l 2024-09-19T06:20:37.204 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 19 06:20:37 smithi174 podman[72125]: 2024-09-19 06:20:37.124955955 +0000 UTC m=+0.512314288 container remove 34d7941af29b5d80d350095c238c3180d2b8f2e7c29c95dc149e014b6e66c68d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:20:37.269 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3f6d2a8-764b-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T06:20:37.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:20:37.301 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T06:20:37.301 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:20:37.504 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T06:20:40.223 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:20:40.424 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T06:20:42.916 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:20:43.117 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T06:20:45.457 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:20:45.490 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:20:45.524 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:20:45.551 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T06:20:45.553 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705/remote/smithi103/crash 2024-09-19T06:20:45.554 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:20:45.590 INFO:teuthology.orchestra.run.smithi103.stderr:tar: /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:20:45.590 INFO:teuthology.orchestra.run.smithi103.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:20:45.592 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705/remote/smithi169/crash 2024-09-19T06:20:45.593 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:20:45.639 INFO:teuthology.orchestra.run.smithi169.stderr:tar: /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:20:45.639 INFO:teuthology.orchestra.run.smithi169.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:20:45.642 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705/remote/smithi174/crash 2024-09-19T06:20:45.642 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:20:45.678 INFO:teuthology.orchestra.run.smithi174.stderr:tar: /var/lib/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:20:45.678 INFO:teuthology.orchestra.run.smithi174.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:20:45.679 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T06:20:45.679 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T06:20:45.716 INFO:teuthology.orchestra.run.smithi103.stdout:2024-09-19T06:08:53.686440+0000 mds.c (mds.2) 2 : cluster [WRN] Scrub error on inode 0x1000000023f (/volumes/qa/sv_0/dc07b841-4793-4328-a037-1a9cabc3f071/client.0/tmp/xfstests-dev/.git/index.lock) see mds.c log and `damage ls` output for details 2024-09-19T06:20:45.717 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-19T06:20:45.717 INFO:tasks.cephadm:Compressing logs... 2024-09-19T06:20:45.717 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:20:45.759 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:20:45.765 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:20:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T06:20:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:: No such file or directory 2024-09-19T06:20:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T06:20:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.0.log: -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:20:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:20:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T06:20:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:20:45.787 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T06:20:45.787 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T06:20:45.787 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mon.a.log: 84.5% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:20:45.787 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T06:20:45.787 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:20:45.788 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.6.log: /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.4% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:20:45.789 INFO:teuthology.orchestra.run.smithi169.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T06:20:45.789 INFO:teuthology.orchestra.run.smithi169.stderr:: No such file or directory 2024-09-19T06:20:45.789 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T06:20:45.789 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T06:20:45.789 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:20:45.790 INFO:teuthology.orchestra.run.smithi103.stderr: 94.6% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T06:20:45.792 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T06:20:45.792 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T06:20:45.792 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T06:20:45.792 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:20:45.793 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:20:45.796 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.audit.log: 90.6% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:20:45.796 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T06:20:45.796 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.1% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:20:45.796 INFO:teuthology.orchestra.run.smithi169.stderr: 94.5% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T06:20:45.799 INFO:teuthology.orchestra.run.smithi174.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:20:45.799 INFO:teuthology.orchestra.run.smithi174.stderr:: No such file or directory 2024-09-19T06:20:45.799 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.11.log: 82.1% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr: 90.6% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.l.log: 87.8% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T06:20:45.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.7% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T06:20:45.801 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T06:20:45.803 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:20:45.803 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:20:45.803 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T06:20:45.803 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.log: 87.8% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:20:45.803 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T06:20:45.803 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:20:45.804 INFO:teuthology.orchestra.run.smithi103.stderr: 94.6% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T06:20:45.804 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T06:20:45.804 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T06:20:45.804 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T06:20:45.804 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mgr.x.log: 87.7% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:20:45.804 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T06:20:45.805 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T06:20:45.805 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-19T06:20:45.805 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:20:45.805 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:20:45.805 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.log: 94.6% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T06:20:45.805 INFO:teuthology.orchestra.run.smithi169.stderr: 91.8% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T06:20:45.807 INFO:teuthology.orchestra.run.smithi174.stderr: 91.8% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T06:20:45.808 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T06:20:45.808 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:20:45.812 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T06:20:45.813 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:20:45.821 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:20:45.824 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:20:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/cephadm.log: 93.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:20:46.142 INFO:teuthology.orchestra.run.smithi103.stderr: 90.2% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T06:20:46.199 INFO:teuthology.orchestra.run.smithi174.stderr: 91.9% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T06:20:46.251 INFO:teuthology.orchestra.run.smithi169.stderr: 91.9% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T06:20:46.658 INFO:teuthology.orchestra.run.smithi103.stderr: 90.5% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T06:20:47.400 INFO:teuthology.orchestra.run.smithi169.stderr: 95.2% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T06:20:47.541 INFO:teuthology.orchestra.run.smithi174.stderr: 95.1% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T06:20:47.985 INFO:teuthology.orchestra.run.smithi103.stderr: 94.0% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T06:20:49.085 INFO:teuthology.orchestra.run.smithi169.stderr: 95.9% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T06:20:50.204 INFO:teuthology.orchestra.run.smithi174.stderr: 93.9% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T06:20:50.522 INFO:teuthology.orchestra.run.smithi174.stderr: 94.0% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T06:20:50.526 INFO:teuthology.orchestra.run.smithi103.stderr: 93.8% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T06:20:50.620 INFO:teuthology.orchestra.run.smithi103.stderr: 93.9% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T06:20:50.854 INFO:teuthology.orchestra.run.smithi103.stderr: 93.6% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T06:20:51.294 INFO:teuthology.orchestra.run.smithi169.stderr: 94.0% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T06:20:53.053 INFO:teuthology.orchestra.run.smithi174.stderr: 94.3% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T06:20:53.132 INFO:teuthology.orchestra.run.smithi174.stderr: 94.0% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T06:20:53.573 INFO:teuthology.orchestra.run.smithi169.stderr: 94.5% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T06:20:53.916 INFO:teuthology.orchestra.run.smithi169.stderr: 94.2% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T06:20:54.201 INFO:teuthology.orchestra.run.smithi169.stderr: 94.1% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T06:20:55.927 INFO:teuthology.orchestra.run.smithi174.stderr: 93.7% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T06:20:58.967 INFO:teuthology.orchestra.run.smithi174.stderr: 93.9% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T06:20:58.969 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-09-19T06:20:58.970 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m13.190s 2024-09-19T06:20:58.970 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m47.550s 2024-09-19T06:20:58.970 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m1.551s 2024-09-19T06:21:05.923 INFO:teuthology.orchestra.run.smithi103.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-19T06:21:05.925 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-19T06:21:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m20.153s 2024-09-19T06:21:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m36.827s 2024-09-19T06:21:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m1.356s 2024-09-19T06:21:18.367 INFO:teuthology.orchestra.run.smithi169.stderr: 93.4% -- replaced with /var/log/ceph/f3f6d2a8-764b-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T06:21:18.369 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-19T06:21:18.369 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m32.593s 2024-09-19T06:21:18.369 INFO:teuthology.orchestra.run.smithi169.stderr:user 1m5.496s 2024-09-19T06:21:18.369 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m2.160s 2024-09-19T06:21:18.369 INFO:tasks.cephadm:Archiving logs... 2024-09-19T06:21:18.369 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705/remote/smithi103/log 2024-09-19T06:21:18.371 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:21:23.607 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705/remote/smithi169/log 2024-09-19T06:21:23.608 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:21:32.412 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705/remote/smithi174/log 2024-09-19T06:21:32.413 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:21:38.163 INFO:tasks.cephadm:Removing cluster... 2024-09-19T06:21:38.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 --force 2024-09-19T06:21:38.368 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T06:21:38.650 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 --force 2024-09-19T06:21:38.853 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T06:21:39.253 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3f6d2a8-764b-11ef-bceb-c7b262605968 --force 2024-09-19T06:21:39.450 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: f3f6d2a8-764b-11ef-bceb-c7b262605968 2024-09-19T06:21:39.756 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T06:21:39.756 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:21:39.775 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:21:39.792 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:21:39.808 INFO:tasks.cephadm:Teardown complete 2024-09-19T06:21:39.808 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T06:21:39.819 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T06:21:39.820 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T06:21:39.820 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:21:39.823 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:21:39.835 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:21:39.943 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T06:21:39.954 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T06:21:39.954 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:21:39.957 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:21:39.959 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:21:39.971 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:21:39.971 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:21:39.973 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:21:39.976 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:21:39.976 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-19T06:21:39.976 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 +11us[ +28us] +/- 40ms 2024-09-19T06:21:39.976 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 +336us[ +353us] +/- 70ms 2024-09-19T06:21:39.976 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -193us[ -176us] +/- 63ms 2024-09-19T06:21:39.976 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:21:39.978 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:21:39.978 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-19T06:21:39.978 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 -12us[+8237ns] +/- 40ms 2024-09-19T06:21:39.978 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 +323us[ +323us] +/- 70ms 2024-09-19T06:21:39.978 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -218us[ -218us] +/- 63ms 2024-09-19T06:21:39.978 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:21:39.979 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:21:39.979 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-09-19T06:21:39.979 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -25us[-4056ns] +/- 40ms 2024-09-19T06:21:39.979 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 +323us[ +344us] +/- 70ms 2024-09-19T06:21:39.979 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -233us[ -212us] +/- 63ms 2024-09-19T06:21:39.979 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:21:39.980 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T06:21:39.990 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T06:21:39.990 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T06:21:40.000 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:21:40.099 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:21:40.167 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:21:40.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:21:40.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:21:40.264 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:21:40.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:21:40.292 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:21:40.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:21:40.319 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T06:21:40.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T06:21:40.343 INFO:teuthology.task.internal:Duration was 1826.133595 seconds 2024-09-19T06:21:40.343 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T06:21:40.354 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T06:21:40.354 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:21:40.357 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:21:40.359 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:21:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:21:40.395 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:21:40.398 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:21:40.819 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T06:21:40.819 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T06:21:40.819 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:21:40.849 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T06:21:40.850 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:21:40.887 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T06:21:40.888 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:21:40.917 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T06:21:40.917 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:21:40.919 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:21:40.930 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:21:40.985 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T06:21:40.985 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:21:40.987 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:21:40.996 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:21:41.589 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T06:21:41.600 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T06:21:41.600 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:21:41.625 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:21:41.650 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:21:41.676 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T06:21:41.689 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:21:41.692 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:21:41.694 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:21:41.713 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-19T06:21:41.716 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-09-19T06:21:41.739 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-09-19T06:21:41.768 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:21:41.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:21:41.782 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:21:41.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:21:41.816 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:21:41.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:21:41.831 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T06:21:41.843 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T06:21:41.844 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705/remote/smithi103 2024-09-19T06:21:41.844 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:21:41.894 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705/remote/smithi169 2024-09-19T06:21:41.894 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:21:41.931 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911705/remote/smithi174 2024-09-19T06:21:41.931 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:21:41.969 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T06:21:41.969 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:21:41.972 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:21:41.975 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:21:42.017 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T06:21:42.029 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T06:21:42.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T06:21:42.040 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T06:21:42.040 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:21:42.043 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:21:42.045 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:21:42.055 INFO:teuthology.orchestra.run.smithi103.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:21 /home/ubuntu/cephtest 2024-09-19T06:21:42.057 INFO:teuthology.orchestra.run.smithi169.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:21 /home/ubuntu/cephtest 2024-09-19T06:21:42.071 INFO:teuthology.orchestra.run.smithi174.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:21 /home/ubuntu/cephtest 2024-09-19T06:21:42.073 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T06:21:42.088 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T06:21:42.107 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T06:21:42.110 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/fsx}} duration: 1826.1335952281952 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-19T06:21:42.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:21:42.200 INFO:teuthology.run:FAIL